2024-04-26T17:51:04.345 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T17:51:04.345 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902 --name leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi --verbose --owner scheduled_leonidus@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} -- /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/orig.config.yaml 2024-04-26T17:51:04.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T17:51:04.490 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902 branch: wip-lusov-quiescer-fixes description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} email: null first_in_suite: false job_id: '7674902' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer-fixes ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer-fixes sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 9496 sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer-fixes suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEQIpNjdmw3OpD6urd9c73iOU/gvK8pVA7gfAwGaZV98H13QrqB25Dp9rK4lsH5j+mXwdMM7LVekWSQKFmxgdjg= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbY6cHb+lyowSuGrXDH5beUKiAA8gcpQt5g9hJxe6q8KsDPigm0OceYPTSxwM/X8ogHP4aGS4xf3nYiLcxB+nM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_17:24:23 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T17:51:04.490 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa; will attempt to use it 2024-04-26T17:51:04.491 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks 2024-04-26T17:51:04.491 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T17:51:04.493 INFO:teuthology.task.internal:Checking packages... 2024-04-26T17:51:04.516 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1' 2024-04-26T17:51:04.516 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T17:51:04.516 INFO:teuthology.packaging:ref: None 2024-04-26T17:51:04.516 INFO:teuthology.packaging:tag: None 2024-04-26T17:51:04.516 INFO:teuthology.packaging:branch: wip-lusov-quiescer-fixes 2024-04-26T17:51:04.516 INFO:teuthology.packaging:sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:51:04.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer-fixes 2024-04-26T17:51:04.790 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3267.gbc94a2a9 2024-04-26T17:51:04.792 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T17:51:04.801 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T17:51:04.801 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T17:51:04.815 INFO:teuthology.task.internal:Saving configuration 2024-04-26T17:51:04.834 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T17:51:04.842 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T17:51:04.868 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:57.999179', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEQIpNjdmw3OpD6urd9c73iOU/gvK8pVA7gfAwGaZV98H13QrqB25Dp9rK4lsH5j+mXwdMM7LVekWSQKFmxgdjg='} 2024-04-26T17:51:04.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:57.997779', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbY6cHb+lyowSuGrXDH5beUKiAA8gcpQt5g9hJxe6q8KsDPigm0OceYPTSxwM/X8ogHP4aGS4xf3nYiLcxB+nM='} 2024-04-26T17:51:04.890 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T17:51:04.901 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T17:51:04.901 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-26T17:51:04.901 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T17:51:04.983 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb98500c0d0>, signals=[15]) 2024-04-26T17:51:04.984 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T17:51:04.995 INFO:teuthology.task.internal:Opening connections... 2024-04-26T17:51:04.996 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T17:51:04.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:51:05.117 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T17:51:05.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:51:05.239 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T17:51:05.247 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-04-26T17:51:05.265 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-04-26T17:51:05.266 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-04-26T17:51:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T17:51:05.324 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-04-26T17:51:05.324 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T17:51:05.324 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T17:51:05.324 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T17:51:05.324 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-04-26T17:51:05.343 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-04-26T17:51:05.360 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-04-26T17:51:05.361 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-04-26T17:51:05.418 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-04-26T17:51:05.418 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T17:51:05.419 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T17:51:05.420 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-04-26T17:51:05.443 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T17:51:05.454 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T17:51:05.465 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T17:51:05.465 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-04-26T17:51:05.468 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-04-26T17:51:05.485 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T17:51:05.495 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T17:51:05.496 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-04-26T17:51:05.525 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-04-26T17:51:05.642 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T17:51:05.698 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T17:51:05.718 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-26T17:51:05.718 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-26T17:51:05.718 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-26T17:51:05.719 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T17:51:05.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:51:05.735 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-04-26T17:51:05.792 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-437.el9.x86_64 2024-04-26T17:51:05.792 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.14.0-437.el9.x86_64 2024-04-26T17:51:05.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2024-04-26T17:51:09.175 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.0 MB 00:01 2024-04-26T17:51:13.775 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 19 MB 00:03 2024-04-26T17:51:17.953 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T17:51:19.726 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-26T17:51:20.786 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-26T17:51:25.760 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-26T17:51:27.625 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T17:51:27.625 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T17:51:27.727 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-26T17:51:27.728 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-26T17:51:27.728 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-26T17:51:27.860 DEBUG:teuthology.orchestra.run.smithi139:> echo no | sudo yum reinstall kernel || true 2024-04-26T17:51:28.361 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 05:51:25 PM UTC. 2024-04-26T17:51:28.484 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-26T17:51:28.500 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-26T17:51:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-04-26T17:51:28.500 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout:Reinstalling: 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 255 k 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 0 2024-04-26T17:51:28.501 INFO:teuthology.orchestra.run.smithi139.stderr:Operation aborted. 2024-04-26T17:51:28.571 INFO:teuthology.orchestra.run.smithi139.stdout:Is this ok [y/N]: 2024-04-26T17:51:28.571 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum reinstall -y kernel || true 2024-04-26T17:51:29.064 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 05:51:25 PM UTC. 2024-04-26T17:51:29.182 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:Reinstalling: 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 255 k 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 0 2024-04-26T17:51:29.183 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-26T17:51:29.454 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.2 MB/s | 255 kB 00:00 2024-04-26T17:51:29.454 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:51:29.454 INFO:teuthology.orchestra.run.smithi139.stdout:Total 941 kB/s | 255 kB 00:00 2024-04-26T17:51:29.476 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-26T17:51:29.680 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-26T17:51:29.680 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-26T17:51:29.685 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-26T17:51:29.686 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-26T17:51:29.805 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-26T17:51:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T17:51:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:51:30.523 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:51:30.523 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T17:51:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:51:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:51:31.239 INFO:teuthology.orchestra.run.smithi139.stdout:Reinstalled: 2024-04-26T17:51:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T17:51:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:51:31.239 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-26T17:51:31.424 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T17:51:31.470 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T17:51:31.471 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T17:51:31.471 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T17:51:31.472 DEBUG:teuthology.parallel:result is None 2024-04-26T17:51:31.472 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T17:51:31.482 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T17:51:31.482 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T17:51:31.485 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T17:51:31.503 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T17:51:31.514 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T17:51:31.528 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T17:51:31.528 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T17:51:31.539 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T17:51:31.662 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T17:51:31.671 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T17:51:31.671 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T17:51:31.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:51:31.691 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T17:51:31.693 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T17:51:31.726 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:31.749 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:31.779 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:31.808 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:31.810 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T17:51:31.817 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T17:51:31.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T17:51:31.820 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T17:51:31.845 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T17:51:31.858 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T17:51:31.858 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T17:51:31.883 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T17:51:31.901 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:31.976 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:32.020 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:32.102 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:32.140 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:51:32.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T17:51:32.203 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:32.245 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:32.299 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:32.382 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:32.423 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:51:32.423 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T17:51:32.488 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-04-26T17:51:32.490 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-04-26T17:51:32.522 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T17:51:32.561 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T17:51:33.007 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T17:51:33.017 INFO:teuthology.task.internal:Starting timer... 2024-04-26T17:51:33.017 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T17:51:33.034 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T17:51:33.046 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T17:51:33.047 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-04-26T17:51:33.093 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-04-26T17:51:33.094 DEBUG:teuthology.orchestra.run.smithi143:> sudo service auditd rotate 2024-04-26T17:51:33.139 INFO:teuthology.orchestra.run.smithi143.stdout:Rotating logs: 2024-04-26T17:51:33.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T17:51:33.140 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-04-26T17:51:33.163 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-04-26T17:51:33.164 DEBUG:teuthology.orchestra.run.smithi143:> /usr/sbin/getenforce 2024-04-26T17:51:33.203 INFO:teuthology.orchestra.run.smithi143.stdout:Permissive 2024-04-26T17:51:33.203 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi139.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi143.front.sepia.ceph.com': 'permissive'} 2024-04-26T17:51:33.203 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T17:51:33.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:51:33.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T17:51:33.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:51:33.268 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T17:51:33.268 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-04-26T17:51:33.292 DEBUG:teuthology.orchestra.run.smithi143:> sudo /usr/sbin/setenforce permissive 2024-04-26T17:51:33.337 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T17:51:33.347 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T17:51:33.363 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T17:51:33.365 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi139.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T17:55:19.511 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2024-04-26T17:55:19.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-26T17:55:19.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:55:19.591 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-26T17:55:19.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-26T17:55:19.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T17:55:19.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:55:19.762 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-04-26T17:55:19.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-26T17:55:19.803 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T17:55:19.814 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T17:55:19.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T17:55:19.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T17:55:19.818 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T17:55:19.818 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T17:55:19.844 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T17:55:19.858 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T17:55:19.870 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T17:55:19.882 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-04-26T17:55:19.883 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T17:55:19.892 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-04-26T17:55:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T17:55:19.905 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: ntpd: command not found 2024-04-26T17:55:19.915 INFO:teuthology.orchestra.run.smithi143.stdout:506 Cannot talk to daemon 2024-04-26T17:55:19.918 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T17:55:19.928 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T17:55:19.941 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T17:55:19.976 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-26T17:55:19.980 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T17:55:19.980 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-26T17:55:19.980 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:19.980 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:19.980 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:19.980 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:19.997 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-04-26T17:55:20.001 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T17:55:20.001 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-04-26T17:55:20.001 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:20.002 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:20.002 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:20.002 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:20.002 INFO:teuthology.run_tasks:Running task install... 2024-04-26T17:55:20.011 DEBUG:teuthology.task.install:project ceph 2024-04-26T17:55:20.011 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}} 2024-04-26T17:55:20.011 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'} 2024-04-26T17:55:20.011 INFO:teuthology.task.install:Using flavor: default 2024-04-26T17:55:20.018 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T17:55:20.018 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T17:55:20.019 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T17:55:20.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:55:20.022 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T17:55:20.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:55:20.173 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T17:55:20.173 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T17:55:20.238 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T17:55:20.238 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T17:55:20.282 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T17:55:20.282 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:55:20.283 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T17:55:20.307 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T17:55:20.307 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T17:55:20.345 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T17:55:20.346 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:55:20.346 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T17:55:20.370 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T17:55:20.370 DEBUG:teuthology.orchestra.run.smithi143:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T17:55:20.372 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T17:55:20.435 DEBUG:teuthology.orchestra.run.smithi143:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T17:55:20.445 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T17:55:20.507 DEBUG:teuthology.orchestra.run.smithi143:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T17:55:20.508 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-04-26T17:55:20.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-04-26T17:55:20.570 INFO:teuthology.orchestra.run.smithi143.stdout:check_obsoletes = 1 2024-04-26T17:55:20.572 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum clean all 2024-04-26T17:55:20.733 INFO:teuthology.orchestra.run.smithi139.stdout:48 files removed 2024-04-26T17:55:20.759 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T17:55:20.797 INFO:teuthology.orchestra.run.smithi143.stdout:48 files removed 2024-04-26T17:55:20.825 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T17:55:21.499 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 175 kB/s | 84 kB 00:00 2024-04-26T17:55:21.542 INFO:teuthology.orchestra.run.smithi143.stdout:ceph packages for x86_64 183 kB/s | 84 kB 00:00 2024-04-26T17:55:21.941 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-04-26T17:55:21.960 INFO:teuthology.orchestra.run.smithi143.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-26T17:55:22.367 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-26T17:55:22.393 INFO:teuthology.orchestra.run.smithi143.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-26T17:55:22.867 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-04-26T17:55:24.085 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.0 MB 00:01 2024-04-26T17:55:27.026 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-04-26T17:55:28.028 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 19 MB 00:02 2024-04-26T17:55:31.876 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.2 MB 00:01 2024-04-26T17:55:33.029 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-04-26T17:55:33.527 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-26T17:55:34.648 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-26T17:55:34.820 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-26T17:55:36.451 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-26T17:55:39.862 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-26T17:55:41.439 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-26T17:55:42.012 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:42.013 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:42.024 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T17:55:42.025 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T17:55:42.026 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T17:55:42.027 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T17:55:42.028 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T17:55:42.031 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T17:55:42.031 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T17:55:42.094 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T17:55:42.103 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T17:55:42.104 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T17:55:42.105 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-26T17:55:42.106 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T17:55:42.107 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T17:55:42.108 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T17:55:42.109 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T17:55:42.110 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T17:55:42.111 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T17:55:42.112 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T17:55:42.113 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T17:55:42.114 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T17:55:42.115 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-04-26T17:55:42.115 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T17:55:42.115 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:55:42.115 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-26T17:55:42.119 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-26T17:55:42.119 INFO:teuthology.orchestra.run.smithi139.stdout:Install 148 Packages 2024-04-26T17:55:42.119 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 4 Packages 2024-04-26T17:55:42.119 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:55:42.119 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 222 M 2024-04-26T17:55:42.120 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-26T17:55:43.071 INFO:teuthology.orchestra.run.smithi139.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 34 kB/s | 6.6 kB 00:00 2024-04-26T17:55:43.296 INFO:teuthology.orchestra.run.smithi139.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 3.9 MB/s | 890 kB 00:00 2024-04-26T17:55:43.354 INFO:teuthology.orchestra.run.smithi139.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 2.4 MB/s | 145 kB 00:00 2024-04-26T17:55:43.496 INFO:teuthology.orchestra.run.smithi139.stdout:(4/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 8.7 MB/s | 5.4 MB 00:00 2024-04-26T17:55:43.574 INFO:teuthology.orchestra.run.smithi143.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:43.574 INFO:teuthology.orchestra.run.smithi143.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:43.585 INFO:teuthology.orchestra.run.smithi143.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T17:55:43.586 INFO:teuthology.orchestra.run.smithi143.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T17:55:43.587 INFO:teuthology.orchestra.run.smithi143.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T17:55:43.587 INFO:teuthology.orchestra.run.smithi143.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T17:55:43.589 INFO:teuthology.orchestra.run.smithi143.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T17:55:43.591 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T17:55:43.592 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T17:55:43.639 INFO:teuthology.orchestra.run.smithi139.stdout:(5/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 8.3 MB/s | 2.4 MB 00:00 2024-04-26T17:55:43.653 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T17:55:43.678 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T17:55:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T17:55:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T17:55:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T17:55:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T17:55:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T17:55:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T17:55:43.679 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T17:55:43.680 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T17:55:43.681 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrading: 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T17:55:43.682 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T17:55:43.683 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T17:55:43.684 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T17:55:43.685 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T17:55:43.686 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T17:55:43.687 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T17:55:43.688 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T17:55:43.689 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout:Installing weak dependencies: 2024-04-26T17:55:43.690 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T17:55:43.691 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:55:43.691 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-04-26T17:55:43.691 INFO:teuthology.orchestra.run.smithi143.stdout:======================================================================================= 2024-04-26T17:55:43.691 INFO:teuthology.orchestra.run.smithi143.stdout:Install 148 Packages 2024-04-26T17:55:43.691 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrade 4 Packages 2024-04-26T17:55:43.691 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:55:43.692 INFO:teuthology.orchestra.run.smithi139.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-04-26T17:55:43.692 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 222 M 2024-04-26T17:55:43.692 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-04-26T17:55:44.205 INFO:teuthology.orchestra.run.smithi139.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 8.3 MB/s | 4.7 MB 00:00 2024-04-26T17:55:44.357 INFO:teuthology.orchestra.run.smithi143.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-26T17:55:45.122 INFO:teuthology.orchestra.run.smithi139.stdout:(8/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x86 12 MB/s | 17 MB 00:01 2024-04-26T17:55:45.124 INFO:teuthology.orchestra.run.smithi143.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-26T17:55:45.206 INFO:teuthology.orchestra.run.smithi139.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 303 kB/s | 25 kB 00:00 2024-04-26T17:55:45.266 INFO:teuthology.orchestra.run.smithi143.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 1.0 MB/s | 145 kB 00:00 2024-04-26T17:55:45.533 INFO:teuthology.orchestra.run.smithi143.stdout:(4/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 3.8 MB/s | 5.4 MB 00:01 2024-04-26T17:55:45.917 INFO:teuthology.orchestra.run.smithi143.stdout:(5/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-04-26T17:55:46.392 INFO:teuthology.orchestra.run.smithi143.stdout:(6/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-04-26T17:55:46.490 INFO:teuthology.orchestra.run.smithi139.stdout:(10/152): ceph-common-19.0.0-3267.gbc94a2a9.el9 5.9 MB/s | 21 MB 00:03 2024-04-26T17:55:46.615 INFO:teuthology.orchestra.run.smithi139.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 1.8 MB/s | 224 kB 00:00 2024-04-26T17:55:46.715 INFO:teuthology.orchestra.run.smithi139.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 271 kB/s | 27 kB 00:00 2024-04-26T17:55:46.815 INFO:teuthology.orchestra.run.smithi139.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 317 kB/s | 32 kB 00:00 2024-04-26T17:55:46.859 INFO:teuthology.orchestra.run.smithi143.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 5.0 MB/s | 4.7 MB 00:00 2024-04-26T17:55:46.999 INFO:teuthology.orchestra.run.smithi139.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 4.0 MB/s | 746 kB 00:00 2024-04-26T17:55:47.132 INFO:teuthology.orchestra.run.smithi139.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.4 MB/s | 163 kB 00:00 2024-04-26T17:55:47.224 INFO:teuthology.orchestra.run.smithi139.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 1.1 MB/s | 127 kB 00:00 2024-04-26T17:55:47.699 INFO:teuthology.orchestra.run.smithi139.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 1.0 MB/s | 501 kB 00:00 2024-04-26T17:55:47.808 INFO:teuthology.orchestra.run.smithi139.stdout:(18/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 2.9 MB/s | 11 MB 00:03 2024-04-26T17:55:47.900 INFO:teuthology.orchestra.run.smithi139.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 493 kB/s | 45 kB 00:00 2024-04-26T17:55:48.042 INFO:teuthology.orchestra.run.smithi139.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 954 kB/s | 135 kB 00:00 2024-04-26T17:55:48.209 INFO:teuthology.orchestra.run.smithi139.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 971 kB/s | 162 kB 00:00 2024-04-26T17:55:48.459 INFO:teuthology.orchestra.run.smithi139.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 1.2 MB/s | 320 kB 00:00 2024-04-26T17:55:48.709 INFO:teuthology.orchestra.run.smithi139.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 1.2 MB/s | 298 kB 00:00 2024-04-26T17:55:48.801 INFO:teuthology.orchestra.run.smithi139.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.1 MB/s | 99 kB 00:00 2024-04-26T17:55:48.893 INFO:teuthology.orchestra.run.smithi139.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 932 kB/s | 85 kB 00:00 2024-04-26T17:55:49.460 INFO:teuthology.orchestra.run.smithi139.stdout:(26/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 3.0 MB/s | 5.4 MB 00:01 2024-04-26T17:55:49.568 INFO:teuthology.orchestra.run.smithi139.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 1.5 MB/s | 170 kB 00:00 2024-04-26T17:55:49.669 INFO:teuthology.orchestra.run.smithi139.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 342 kB/s | 34 kB 00:00 2024-04-26T17:55:49.777 INFO:teuthology.orchestra.run.smithi139.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.3 MB/s | 142 kB 00:00 2024-04-26T17:55:49.917 INFO:teuthology.orchestra.run.smithi143.stdout:(8/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x86 4.8 MB/s | 17 MB 00:03 2024-04-26T17:55:50.026 INFO:teuthology.orchestra.run.smithi143.stdout:(9/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el9 3.3 MB/s | 11 MB 00:03 2024-04-26T17:55:50.051 INFO:teuthology.orchestra.run.smithi143.stdout:(10/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el 189 kB/s | 25 kB 00:00 2024-04-26T17:55:50.118 INFO:teuthology.orchestra.run.smithi143.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 3.3 MB/s | 224 kB 00:00 2024-04-26T17:55:50.194 INFO:teuthology.orchestra.run.smithi143.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 361 kB/s | 27 kB 00:00 2024-04-26T17:55:50.294 INFO:teuthology.orchestra.run.smithi143.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 317 kB/s | 32 kB 00:00 2024-04-26T17:55:50.527 INFO:teuthology.orchestra.run.smithi143.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 3.1 MB/s | 746 kB 00:00 2024-04-26T17:55:50.561 INFO:teuthology.orchestra.run.smithi139.stdout:(30/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 1.9 MB/s | 3.1 MB 00:01 2024-04-26T17:55:50.619 INFO:teuthology.orchestra.run.smithi143.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.7 MB/s | 163 kB 00:00 2024-04-26T17:55:50.711 INFO:teuthology.orchestra.run.smithi143.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 1.4 MB/s | 127 kB 00:00 2024-04-26T17:55:50.795 INFO:teuthology.orchestra.run.smithi139.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 3.5 MB/s | 3.5 MB 00:01 2024-04-26T17:55:50.870 INFO:teuthology.orchestra.run.smithi143.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 3.1 MB/s | 501 kB 00:00 2024-04-26T17:55:50.912 INFO:teuthology.orchestra.run.smithi139.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 2.1 MB/s | 249 kB 00:00 2024-04-26T17:55:51.020 INFO:teuthology.orchestra.run.smithi139.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 456 kB/s | 49 kB 00:00 2024-04-26T17:55:51.137 INFO:teuthology.orchestra.run.smithi139.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 141 kB/s | 16 kB 00:00 2024-04-26T17:55:51.312 INFO:teuthology.orchestra.run.smithi139.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 1.5 MB/s | 273 kB 00:00 2024-04-26T17:55:51.621 INFO:teuthology.orchestra.run.smithi139.stdout:(36/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 2.4 MB/s | 762 kB 00:00 2024-04-26T17:55:51.722 INFO:teuthology.orchestra.run.smithi139.stdout:(37/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 183 kB/s | 18 kB 00:00 2024-04-26T17:55:51.797 INFO:teuthology.orchestra.run.smithi139.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-04-26T17:55:51.897 INFO:teuthology.orchestra.run.smithi139.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2024-04-26T17:55:51.972 INFO:teuthology.orchestra.run.smithi139.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-04-26T17:55:52.047 INFO:teuthology.orchestra.run.smithi139.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-26T17:55:52.156 INFO:teuthology.orchestra.run.smithi139.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-04-26T17:55:52.223 INFO:teuthology.orchestra.run.smithi139.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T17:55:52.290 INFO:teuthology.orchestra.run.smithi139.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-26T17:55:52.357 INFO:teuthology.orchestra.run.smithi139.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-26T17:55:52.432 INFO:teuthology.orchestra.run.smithi139.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-04-26T17:55:52.524 INFO:teuthology.orchestra.run.smithi139.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 7.4 MB/s | 689 kB 00:00 2024-04-26T17:55:52.537 INFO:teuthology.orchestra.run.smithi143.stdout:(18/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-04-26T17:55:52.621 INFO:teuthology.orchestra.run.smithi143.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 543 kB/s | 45 kB 00:00 2024-04-26T17:55:52.712 INFO:teuthology.orchestra.run.smithi143.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.4 MB/s | 135 kB 00:00 2024-04-26T17:55:52.733 INFO:teuthology.orchestra.run.smithi139.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-04-26T17:55:52.796 INFO:teuthology.orchestra.run.smithi143.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.9 MB/s | 162 kB 00:00 2024-04-26T17:55:52.800 INFO:teuthology.orchestra.run.smithi139.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-26T17:55:52.842 INFO:teuthology.orchestra.run.smithi139.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 519 kB/s | 21 kB 00:00 2024-04-26T17:55:52.934 INFO:teuthology.orchestra.run.smithi139.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-04-26T17:55:52.979 INFO:teuthology.orchestra.run.smithi143.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 1.7 MB/s | 320 kB 00:00 2024-04-26T17:55:52.984 INFO:teuthology.orchestra.run.smithi139.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-04-26T17:55:53.138 INFO:teuthology.orchestra.run.smithi143.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 1.8 MB/s | 298 kB 00:00 2024-04-26T17:55:53.205 INFO:teuthology.orchestra.run.smithi143.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.5 MB/s | 99 kB 00:00 2024-04-26T17:55:53.264 INFO:teuthology.orchestra.run.smithi143.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-26T17:55:53.276 INFO:teuthology.orchestra.run.smithi139.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-04-26T17:55:53.326 INFO:teuthology.orchestra.run.smithi139.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 366 kB/s | 18 kB 00:00 2024-04-26T17:55:53.368 INFO:teuthology.orchestra.run.smithi139.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-04-26T17:55:53.435 INFO:teuthology.orchestra.run.smithi139.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-04-26T17:55:53.494 INFO:teuthology.orchestra.run.smithi139.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-04-26T17:55:53.603 INFO:teuthology.orchestra.run.smithi139.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-04-26T17:55:53.711 INFO:teuthology.orchestra.run.smithi139.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-04-26T17:55:53.762 INFO:teuthology.orchestra.run.smithi139.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-26T17:55:53.821 INFO:teuthology.orchestra.run.smithi139.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 815 kB/s | 47 kB 00:00 2024-04-26T17:55:53.929 INFO:teuthology.orchestra.run.smithi139.stdout:(62/152): ceph-mgr-diskprediction-local-19.0.0- 2.2 MB/s | 7.4 MB 00:03 2024-04-26T17:55:53.979 INFO:teuthology.orchestra.run.smithi139.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-04-26T17:55:54.021 INFO:teuthology.orchestra.run.smithi139.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-26T17:55:54.046 INFO:teuthology.orchestra.run.smithi139.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-04-26T17:55:54.172 INFO:teuthology.orchestra.run.smithi143.stdout:(26/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 3.4 MB/s | 3.1 MB 00:00 2024-04-26T17:55:54.256 INFO:teuthology.orchestra.run.smithi143.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-26T17:55:54.340 INFO:teuthology.orchestra.run.smithi143.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 411 kB/s | 34 kB 00:00 2024-04-26T17:55:54.346 INFO:teuthology.orchestra.run.smithi139.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-04-26T17:55:54.406 INFO:teuthology.orchestra.run.smithi139.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-26T17:55:54.416 INFO:teuthology.orchestra.run.smithi143.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.9 MB/s | 142 kB 00:00 2024-04-26T17:55:54.522 INFO:teuthology.orchestra.run.smithi139.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 7.6 MB/s | 911 kB 00:00 2024-04-26T17:55:54.572 INFO:teuthology.orchestra.run.smithi139.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-04-26T17:55:54.606 INFO:teuthology.orchestra.run.smithi139.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-26T17:55:54.723 INFO:teuthology.orchestra.run.smithi139.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-04-26T17:55:54.781 INFO:teuthology.orchestra.run.smithi139.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T17:55:54.923 INFO:teuthology.orchestra.run.smithi139.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-04-26T17:55:54.999 INFO:teuthology.orchestra.run.smithi139.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-26T17:55:55.074 INFO:teuthology.orchestra.run.smithi139.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-04-26T17:55:55.116 INFO:teuthology.orchestra.run.smithi139.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-04-26T17:55:55.191 INFO:teuthology.orchestra.run.smithi139.stdout:(77/152): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-04-26T17:55:55.224 INFO:teuthology.orchestra.run.smithi139.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-04-26T17:55:55.275 INFO:teuthology.orchestra.run.smithi139.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-26T17:55:55.300 INFO:teuthology.orchestra.run.smithi139.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-04-26T17:55:55.375 INFO:teuthology.orchestra.run.smithi139.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-26T17:55:55.451 INFO:teuthology.orchestra.run.smithi139.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-26T17:55:55.517 INFO:teuthology.orchestra.run.smithi139.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-04-26T17:55:55.549 INFO:teuthology.orchestra.run.smithi143.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 3.1 MB/s | 3.5 MB 00:01 2024-04-26T17:55:55.601 INFO:teuthology.orchestra.run.smithi139.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-04-26T17:55:55.626 INFO:teuthology.orchestra.run.smithi139.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-04-26T17:55:55.693 INFO:teuthology.orchestra.run.smithi139.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-04-26T17:55:55.718 INFO:teuthology.orchestra.run.smithi139.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-26T17:55:55.779 INFO:teuthology.orchestra.run.smithi139.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 844 kB/s | 51 kB 00:00 2024-04-26T17:55:55.804 INFO:teuthology.orchestra.run.smithi139.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-26T17:55:55.855 INFO:teuthology.orchestra.run.smithi139.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-04-26T17:55:55.914 INFO:teuthology.orchestra.run.smithi139.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-04-26T17:55:55.980 INFO:teuthology.orchestra.run.smithi139.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 665 kB/s | 44 kB 00:00 2024-04-26T17:55:56.055 INFO:teuthology.orchestra.run.smithi139.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-26T17:55:56.114 INFO:teuthology.orchestra.run.smithi139.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-04-26T17:55:56.181 INFO:teuthology.orchestra.run.smithi139.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-04-26T17:55:56.290 INFO:teuthology.orchestra.run.smithi139.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-04-26T17:55:56.465 INFO:teuthology.orchestra.run.smithi139.stdout:(97/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-26T17:55:56.490 INFO:teuthology.orchestra.run.smithi139.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 289 kB/s | 58 kB 00:00 2024-04-26T17:55:56.549 INFO:teuthology.orchestra.run.smithi139.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-26T17:55:56.574 INFO:teuthology.orchestra.run.smithi139.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-04-26T17:55:56.624 INFO:teuthology.orchestra.run.smithi139.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-04-26T17:55:56.675 INFO:teuthology.orchestra.run.smithi139.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-04-26T17:55:56.933 INFO:teuthology.orchestra.run.smithi139.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-04-26T17:55:56.967 INFO:teuthology.orchestra.run.smithi139.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-04-26T17:55:57.000 INFO:teuthology.orchestra.run.smithi139.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-04-26T17:55:57.084 INFO:teuthology.orchestra.run.smithi139.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 166 kB/s | 19 kB 00:00 2024-04-26T17:55:57.184 INFO:teuthology.orchestra.run.smithi139.stdout:(107/152): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-04-26T17:55:57.209 INFO:teuthology.orchestra.run.smithi139.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-04-26T17:55:57.234 INFO:teuthology.orchestra.run.smithi139.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 972 kB/s | 49 kB 00:00 2024-04-26T17:55:57.294 INFO:teuthology.orchestra.run.smithi139.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-26T17:55:57.327 INFO:teuthology.orchestra.run.smithi139.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 575 kB/s | 67 kB 00:00 2024-04-26T17:55:57.360 INFO:teuthology.orchestra.run.smithi139.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-04-26T17:55:57.411 INFO:teuthology.orchestra.run.smithi139.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-04-26T17:55:57.452 INFO:teuthology.orchestra.run.smithi139.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 776 kB/s | 32 kB 00:00 2024-04-26T17:55:57.478 INFO:teuthology.orchestra.run.smithi139.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-04-26T17:55:57.494 INFO:teuthology.orchestra.run.smithi139.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 358 kB/s | 15 kB 00:00 2024-04-26T17:55:57.553 INFO:teuthology.orchestra.run.smithi139.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-26T17:55:57.587 INFO:teuthology.orchestra.run.smithi139.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-26T17:55:57.621 INFO:teuthology.orchestra.run.smithi139.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-04-26T17:55:57.646 INFO:teuthology.orchestra.run.smithi139.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2024-04-26T17:55:57.679 INFO:teuthology.orchestra.run.smithi139.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-04-26T17:55:57.788 INFO:teuthology.orchestra.run.smithi139.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-26T17:55:57.822 INFO:teuthology.orchestra.run.smithi139.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-04-26T17:55:57.847 INFO:teuthology.orchestra.run.smithi139.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-04-26T17:55:57.872 INFO:teuthology.orchestra.run.smithi139.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-26T17:55:57.897 INFO:teuthology.orchestra.run.smithi139.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-04-26T17:55:57.923 INFO:teuthology.orchestra.run.smithi139.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-26T17:55:57.948 INFO:teuthology.orchestra.run.smithi139.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-04-26T17:55:57.974 INFO:teuthology.orchestra.run.smithi143.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 3.1 MB/s | 7.4 MB 00:02 2024-04-26T17:55:57.990 INFO:teuthology.orchestra.run.smithi139.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-04-26T17:55:58.015 INFO:teuthology.orchestra.run.smithi139.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-04-26T17:55:58.040 INFO:teuthology.orchestra.run.smithi139.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-26T17:55:58.074 INFO:teuthology.orchestra.run.smithi139.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-04-26T17:55:58.099 INFO:teuthology.orchestra.run.smithi139.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-04-26T17:55:58.107 INFO:teuthology.orchestra.run.smithi143.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 1.8 MB/s | 249 kB 00:00 2024-04-26T17:55:58.124 INFO:teuthology.orchestra.run.smithi139.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-04-26T17:55:58.150 INFO:teuthology.orchestra.run.smithi139.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-04-26T17:55:58.175 INFO:teuthology.orchestra.run.smithi139.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-04-26T17:55:58.200 INFO:teuthology.orchestra.run.smithi139.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-04-26T17:55:58.216 INFO:teuthology.orchestra.run.smithi143.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 455 kB/s | 49 kB 00:00 2024-04-26T17:55:58.234 INFO:teuthology.orchestra.run.smithi139.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-04-26T17:55:58.259 INFO:teuthology.orchestra.run.smithi139.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-26T17:55:58.284 INFO:teuthology.orchestra.run.smithi139.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-04-26T17:55:58.292 INFO:teuthology.orchestra.run.smithi143.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 218 kB/s | 16 kB 00:00 2024-04-26T17:55:58.309 INFO:teuthology.orchestra.run.smithi139.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-26T17:55:58.343 INFO:teuthology.orchestra.run.smithi139.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-26T17:55:58.368 INFO:teuthology.orchestra.run.smithi139.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-26T17:55:58.427 INFO:teuthology.orchestra.run.smithi139.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-26T17:55:58.452 INFO:teuthology.orchestra.run.smithi139.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-04-26T17:55:58.461 INFO:teuthology.orchestra.run.smithi143.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 1.6 MB/s | 273 kB 00:00 2024-04-26T17:55:58.494 INFO:teuthology.orchestra.run.smithi139.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-26T17:55:58.553 INFO:teuthology.orchestra.run.smithi139.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-26T17:55:58.761 INFO:teuthology.orchestra.run.smithi143.stdout:(36/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 2.5 MB/s | 762 kB 00:00 2024-04-26T17:55:58.861 INFO:teuthology.orchestra.run.smithi143.stdout:(37/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 182 kB/s | 18 kB 00:00 2024-04-26T17:55:59.245 INFO:teuthology.orchestra.run.smithi143.stdout:(38/152): ceph-common-19.0.0-3267.gbc94a2a9.el9 1.4 MB/s | 21 MB 00:15 2024-04-26T17:55:59.304 INFO:teuthology.orchestra.run.smithi143.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 182 kB/s | 80 kB 00:00 2024-04-26T17:55:59.379 INFO:teuthology.orchestra.run.smithi143.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-04-26T17:55:59.405 INFO:teuthology.orchestra.run.smithi143.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-04-26T17:55:59.471 INFO:teuthology.orchestra.run.smithi143.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-26T17:55:59.546 INFO:teuthology.orchestra.run.smithi143.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-04-26T17:55:59.572 INFO:teuthology.orchestra.run.smithi143.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-04-26T17:55:59.639 INFO:teuthology.orchestra.run.smithi143.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-26T17:55:59.664 INFO:teuthology.orchestra.run.smithi143.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-04-26T17:55:59.669 INFO:teuthology.orchestra.run.smithi139.stdout:(148/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 2.8 MB/s | 3.1 MB 00:01 2024-04-26T17:55:59.731 INFO:teuthology.orchestra.run.smithi143.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-26T17:55:59.781 INFO:teuthology.orchestra.run.smithi143.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 5.8 MB/s | 689 kB 00:00 2024-04-26T17:55:59.813 INFO:teuthology.orchestra.run.smithi139.stdout:(149/152): librados2-19.0.0-3267.gbc94a2a9.el9. 2.6 MB/s | 3.4 MB 00:01 2024-04-26T17:55:59.848 INFO:teuthology.orchestra.run.smithi143.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-26T17:55:59.853 INFO:teuthology.orchestra.run.smithi139.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 7.4 MB/s | 1.3 MB 00:00 2024-04-26T17:55:59.874 INFO:teuthology.orchestra.run.smithi143.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-04-26T17:55:59.924 INFO:teuthology.orchestra.run.smithi143.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 286 kB/s | 21 kB 00:00 2024-04-26T17:55:59.974 INFO:teuthology.orchestra.run.smithi143.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-04-26T17:56:00.000 INFO:teuthology.orchestra.run.smithi143.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-04-26T17:56:00.050 INFO:teuthology.orchestra.run.smithi143.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-26T17:56:00.100 INFO:teuthology.orchestra.run.smithi143.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-26T17:56:00.184 INFO:teuthology.orchestra.run.smithi143.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-26T17:56:00.234 INFO:teuthology.orchestra.run.smithi143.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-04-26T17:56:00.276 INFO:teuthology.orchestra.run.smithi143.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-04-26T17:56:00.304 INFO:teuthology.orchestra.run.smithi139.stdout:(151/152): ceph-test-19.0.0-3267.gbc94a2a9.el9. 3.3 MB/s | 49 MB 00:15 2024-04-26T17:56:00.351 INFO:teuthology.orchestra.run.smithi143.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-04-26T17:56:00.402 INFO:teuthology.orchestra.run.smithi143.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 4.5 MB/s | 582 kB 00:00 2024-04-26T17:56:00.427 INFO:teuthology.orchestra.run.smithi143.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-26T17:56:00.469 INFO:teuthology.orchestra.run.smithi143.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-04-26T17:56:00.520 INFO:teuthology.orchestra.run.smithi143.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-26T17:56:00.529 INFO:teuthology.orchestra.run.smithi139.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-04-26T17:56:00.533 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:56:00.533 INFO:teuthology.orchestra.run.smithi139.stdout:Total 12 MB/s | 222 MB 00:18 2024-04-26T17:56:00.562 INFO:teuthology.orchestra.run.smithi143.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-26T17:56:00.578 INFO:teuthology.orchestra.run.smithi143.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-04-26T17:56:00.804 INFO:teuthology.orchestra.run.smithi143.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-04-26T17:56:00.871 INFO:teuthology.orchestra.run.smithi143.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-26T17:56:00.979 INFO:teuthology.orchestra.run.smithi143.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 8.2 MB/s | 911 kB 00:00 2024-04-26T17:56:01.021 INFO:teuthology.orchestra.run.smithi143.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-04-26T17:56:01.080 INFO:teuthology.orchestra.run.smithi143.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-04-26T17:56:01.189 INFO:teuthology.orchestra.run.smithi143.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-26T17:56:01.247 INFO:teuthology.orchestra.run.smithi143.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T17:56:01.356 INFO:teuthology.orchestra.run.smithi143.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-04-26T17:56:01.645 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-26T17:56:01.791 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-26T17:56:01.791 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-26T17:56:01.956 INFO:teuthology.orchestra.run.smithi143.stdout:(74/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 4.1 MB/s | 49 MB 00:11 2024-04-26T17:56:02.023 INFO:teuthology.orchestra.run.smithi143.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 366 kB/s | 244 kB 00:00 2024-04-26T17:56:02.048 INFO:teuthology.orchestra.run.smithi143.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-04-26T17:56:02.090 INFO:teuthology.orchestra.run.smithi143.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-04-26T17:56:02.116 INFO:teuthology.orchestra.run.smithi143.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-26T17:56:02.166 INFO:teuthology.orchestra.run.smithi143.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-04-26T17:56:02.191 INFO:teuthology.orchestra.run.smithi143.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-04-26T17:56:02.292 INFO:teuthology.orchestra.run.smithi143.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-04-26T17:56:02.342 INFO:teuthology.orchestra.run.smithi143.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-04-26T17:56:02.392 INFO:teuthology.orchestra.run.smithi143.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-04-26T17:56:02.418 INFO:teuthology.orchestra.run.smithi143.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-04-26T17:56:02.476 INFO:teuthology.orchestra.run.smithi143.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 506 kB/s | 42 kB 00:00 2024-04-26T17:56:02.551 INFO:teuthology.orchestra.run.smithi143.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-04-26T17:56:02.702 INFO:teuthology.orchestra.run.smithi143.stdout:(87/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.5 MB/s | 5.1 MB 00:00 2024-04-26T17:56:02.727 INFO:teuthology.orchestra.run.smithi143.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 633 kB/s | 159 kB 00:00 2024-04-26T17:56:02.794 INFO:teuthology.orchestra.run.smithi143.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.1 MB/s | 279 kB 00:00 2024-04-26T17:56:02.811 INFO:teuthology.orchestra.run.smithi143.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-04-26T17:56:02.829 INFO:teuthology.orchestra.run.smithi143.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 533 kB/s | 54 kB 00:00 2024-04-26T17:56:02.871 INFO:teuthology.orchestra.run.smithi143.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-04-26T17:56:02.896 INFO:teuthology.orchestra.run.smithi143.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-04-26T17:56:02.954 INFO:teuthology.orchestra.run.smithi143.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-04-26T17:56:02.988 INFO:teuthology.orchestra.run.smithi143.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-04-26T17:56:03.038 INFO:teuthology.orchestra.run.smithi143.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-04-26T17:56:03.088 INFO:teuthology.orchestra.run.smithi143.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-26T17:56:03.114 INFO:teuthology.orchestra.run.smithi143.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-04-26T17:56:03.172 INFO:teuthology.orchestra.run.smithi143.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-26T17:56:03.198 INFO:teuthology.orchestra.run.smithi143.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-04-26T17:56:03.256 INFO:teuthology.orchestra.run.smithi143.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-04-26T17:56:03.357 INFO:teuthology.orchestra.run.smithi143.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-04-26T17:56:03.524 INFO:teuthology.orchestra.run.smithi143.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-04-26T17:56:03.557 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-26T17:56:03.558 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-26T17:56:03.716 INFO:teuthology.orchestra.run.smithi143.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.6 MB/s | 309 kB 00:00 2024-04-26T17:56:03.741 INFO:teuthology.orchestra.run.smithi143.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-04-26T17:56:03.766 INFO:teuthology.orchestra.run.smithi143.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 386 kB/s | 19 kB 00:00 2024-04-26T17:56:03.800 INFO:teuthology.orchestra.run.smithi143.stdout:(107/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-04-26T17:56:03.825 INFO:teuthology.orchestra.run.smithi143.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-04-26T17:56:03.875 INFO:teuthology.orchestra.run.smithi143.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-26T17:56:03.918 INFO:teuthology.orchestra.run.smithi143.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-04-26T17:56:03.984 INFO:teuthology.orchestra.run.smithi143.stdout:(111/152): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-26T17:56:04.010 INFO:teuthology.orchestra.run.smithi143.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-04-26T17:56:04.035 INFO:teuthology.orchestra.run.smithi143.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-04-26T17:56:04.052 INFO:teuthology.orchestra.run.smithi143.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-04-26T17:56:04.077 INFO:teuthology.orchestra.run.smithi143.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 770 kB/s | 32 kB 00:00 2024-04-26T17:56:04.094 INFO:teuthology.orchestra.run.smithi143.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 357 kB/s | 15 kB 00:00 2024-04-26T17:56:04.128 INFO:teuthology.orchestra.run.smithi143.stdout:(117/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-04-26T17:56:04.153 INFO:teuthology.orchestra.run.smithi143.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-26T17:56:04.179 INFO:teuthology.orchestra.run.smithi143.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-04-26T17:56:04.204 INFO:teuthology.orchestra.run.smithi143.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 702 kB/s | 35 kB 00:00 2024-04-26T17:56:04.229 INFO:teuthology.orchestra.run.smithi143.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-04-26T17:56:04.255 INFO:teuthology.orchestra.run.smithi143.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-26T17:56:04.271 INFO:teuthology.orchestra.run.smithi143.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-04-26T17:56:04.322 INFO:teuthology.orchestra.run.smithi143.stdout:(124/152): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-26T17:56:04.347 INFO:teuthology.orchestra.run.smithi143.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-04-26T17:56:04.372 INFO:teuthology.orchestra.run.smithi143.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2024-04-26T17:56:04.398 INFO:teuthology.orchestra.run.smithi143.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-26T17:56:04.423 INFO:teuthology.orchestra.run.smithi143.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-04-26T17:56:04.448 INFO:teuthology.orchestra.run.smithi143.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T17:56:04.473 INFO:teuthology.orchestra.run.smithi143.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 924 kB/s | 46 kB 00:00 2024-04-26T17:56:04.499 INFO:teuthology.orchestra.run.smithi143.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-26T17:56:04.524 INFO:teuthology.orchestra.run.smithi143.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-26T17:56:04.566 INFO:teuthology.orchestra.run.smithi143.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-04-26T17:56:04.592 INFO:teuthology.orchestra.run.smithi143.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-04-26T17:56:04.617 INFO:teuthology.orchestra.run.smithi143.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-26T17:56:04.642 INFO:teuthology.orchestra.run.smithi143.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T17:56:04.667 INFO:teuthology.orchestra.run.smithi143.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-26T17:56:04.692 INFO:teuthology.orchestra.run.smithi143.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-04-26T17:56:04.726 INFO:teuthology.orchestra.run.smithi143.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-26T17:56:04.751 INFO:teuthology.orchestra.run.smithi143.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-04-26T17:56:04.777 INFO:teuthology.orchestra.run.smithi143.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-04-26T17:56:04.802 INFO:teuthology.orchestra.run.smithi143.stdout:(142/152): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-04-26T17:56:04.828 INFO:teuthology.orchestra.run.smithi143.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-04-26T17:56:04.853 INFO:teuthology.orchestra.run.smithi143.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-26T17:56:04.879 INFO:teuthology.orchestra.run.smithi143.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-04-26T17:56:04.896 INFO:teuthology.orchestra.run.smithi143.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-04-26T17:56:04.921 INFO:teuthology.orchestra.run.smithi143.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-04-26T17:56:04.971 INFO:teuthology.orchestra.run.smithi143.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-26T17:56:05.088 INFO:teuthology.orchestra.run.smithi143.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-26T17:56:05.255 INFO:teuthology.orchestra.run.smithi143.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-04-26T17:56:05.322 INFO:teuthology.orchestra.run.smithi143.stdout:(151/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 7.8 MB/s | 3.1 MB 00:00 2024-04-26T17:56:05.430 INFO:teuthology.orchestra.run.smithi143.stdout:(152/152): librados2-19.0.0-3267.gbc94a2a9.el9. 6.4 MB/s | 3.4 MB 00:00 2024-04-26T17:56:05.432 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:56:05.433 INFO:teuthology.orchestra.run.smithi143.stdout:Total 10 MB/s | 222 MB 00:21 2024-04-26T17:56:06.525 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-04-26T17:56:06.664 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-04-26T17:56:06.665 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-04-26T17:56:08.417 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-04-26T17:56:08.417 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-04-26T17:56:09.571 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-26T17:56:09.657 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T17:56:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T17:56:09.749 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T17:56:09.783 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T17:56:09.808 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T17:56:09.851 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T17:56:10.234 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T17:56:10.284 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:10.406 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:10.435 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:10.535 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:10.573 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:56:10.725 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T17:56:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T17:56:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:10.908 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:10.932 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:10.994 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:11.016 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:11.036 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:11.242 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:11.274 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T17:56:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T17:56:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T17:56:11.551 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T17:56:11.637 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T17:56:11.683 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T17:56:11.727 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T17:56:11.759 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T17:56:11.786 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T17:56:11.856 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T17:56:11.917 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T17:56:11.947 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T17:56:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T17:56:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T17:56:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T17:56:12.137 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T17:56:12.165 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T17:56:12.236 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T17:56:12.282 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T17:56:12.364 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T17:56:12.499 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T17:56:12.549 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T17:56:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T17:56:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T17:56:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T17:56:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T17:56:13.279 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T17:56:13.321 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T17:56:13.486 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T17:56:13.540 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T17:56:13.595 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T17:56:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T17:56:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T17:56:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T17:56:13.782 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T17:56:13.818 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T17:56:13.861 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T17:56:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T17:56:14.049 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T17:56:14.101 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T17:56:14.130 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T17:56:14.172 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T17:56:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T17:56:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T17:56:14.316 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-04-26T17:56:14.345 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T17:56:14.371 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T17:56:14.395 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T17:56:14.408 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T17:56:14.447 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T17:56:14.471 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T17:56:14.584 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T17:56:14.597 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T17:56:14.636 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T17:56:14.664 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T17:56:14.698 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T17:56:14.727 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T17:56:14.737 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T17:56:14.752 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T17:56:14.768 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T17:56:14.796 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T17:56:14.798 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T17:56:14.833 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T17:56:14.866 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T17:56:14.908 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T17:56:14.942 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T17:56:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T17:56:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T17:56:15.112 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T17:56:15.122 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T17:56:15.237 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:15.243 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T17:56:15.352 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T17:56:15.360 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:15.405 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:15.405 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T17:56:15.495 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:15.526 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:56:15.677 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T17:56:15.731 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T17:56:15.768 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:15.870 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:15.910 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:15.965 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:15.987 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:16.009 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:16.142 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T17:56:16.185 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T17:56:16.195 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T17:56:16.228 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T17:56:16.340 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T17:56:16.377 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T17:56:16.437 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T17:56:16.466 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T17:56:16.470 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T17:56:16.496 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T17:56:16.506 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T17:56:16.582 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T17:56:16.622 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T17:56:16.665 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T17:56:16.673 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T17:56:16.693 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T17:56:16.706 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T17:56:16.733 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T17:56:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T17:56:16.806 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T17:56:16.858 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T17:56:16.895 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T17:56:16.947 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T17:56:17.026 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T17:56:17.058 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T17:56:17.102 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T17:56:17.130 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T17:56:17.202 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T17:56:17.245 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T17:56:17.322 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T17:56:17.451 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T17:56:17.470 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T17:56:17.523 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T17:56:17.567 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T17:56:18.065 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T17:56:18.153 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T17:56:18.181 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T17:56:18.224 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T17:56:18.262 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T17:56:18.303 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T17:56:18.459 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T17:56:18.507 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T17:56:18.562 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T17:56:18.635 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T17:56:18.666 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T17:56:18.702 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T17:56:18.750 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T17:56:18.785 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T17:56:18.808 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T17:56:18.829 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T17:56:18.872 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T17:56:18.888 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T17:56:18.916 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T17:56:18.949 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T17:56:19.010 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T17:56:19.068 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T17:56:19.098 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T17:56:19.140 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T17:56:19.237 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T17:56:19.262 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T17:56:19.299 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T17:56:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:19.339 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T17:56:19.364 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T17:56:19.389 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T17:56:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:19.425 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T17:56:19.461 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T17:56:19.465 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T17:56:19.594 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T17:56:19.631 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T17:56:19.659 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T17:56:19.693 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T17:56:19.733 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T17:56:19.772 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T17:56:19.802 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T17:56:19.837 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T17:56:19.870 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T17:56:19.912 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T17:56:19.946 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T17:56:19.950 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T17:56:19.973 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:20.056 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T17:56:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T17:56:20.102 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T17:56:20.133 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T17:56:20.181 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T17:56:20.290 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T17:56:20.352 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T17:56:21.097 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T17:56:21.141 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T17:56:21.174 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T17:56:21.275 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T17:56:21.333 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T17:56:21.424 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T17:56:21.493 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T17:56:21.670 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T17:56:21.691 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T17:56:21.769 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T17:56:22.309 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:22.346 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:22.433 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T17:56:22.551 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T17:56:22.897 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:22.932 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:23.236 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T17:56:23.236 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T17:56:23.236 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:23.237 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:23.804 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T17:56:23.881 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T17:56:23.909 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T17:56:23.942 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T17:56:24.253 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T17:56:24.305 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:24.396 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:24.418 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T17:56:24.454 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T17:56:24.941 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T17:56:24.975 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:25.054 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:25.076 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T17:56:27.361 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:27.398 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:27.949 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:27.986 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:28.078 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:28.079 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T17:56:28.079 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T17:56:28.079 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:28.104 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:34.441 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-04-26T17:56:34.441 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-04-26T17:56:34.441 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-04-26T17:56:34.441 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-04-26T17:56:34.441 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-04-26T17:56:34.442 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-04-26T17:56:34.442 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-04-26T17:56:34.442 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:34.636 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:34.636 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T17:56:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:36.113 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:36.139 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:36.139 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:36.140 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T17:56:36.140 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:36.140 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:36.140 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:36.363 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:36.386 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:36.386 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:36.386 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T17:56:36.386 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:36.387 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:36.387 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:36.854 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:36.854 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:36.854 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T17:56:36.854 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:36.854 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:36.854 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:36.961 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T17:56:37.018 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T17:56:37.073 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T17:56:37.262 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T17:56:37.307 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T17:56:37.386 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T17:56:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:56:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:56:37.648 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T17:56:37.680 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T17:56:37.707 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T17:56:38.084 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:38.114 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:38.155 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T17:56:38.216 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T17:56:38.246 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:39.285 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:39.322 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:39.678 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:39.678 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /sys 2024-04-26T17:56:39.678 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /proc 2024-04-26T17:56:39.679 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /mnt 2024-04-26T17:56:39.679 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /var/tmp 2024-04-26T17:56:39.679 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /home 2024-04-26T17:56:39.679 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /root 2024-04-26T17:56:39.679 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /tmp 2024-04-26T17:56:39.679 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:39.853 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:39.869 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:39.869 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T17:56:39.869 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:40.293 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:40.331 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:40.435 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:40.605 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T17:56:40.633 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:40.657 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:40.657 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:40.657 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T17:56:40.657 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:40.658 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:40.658 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:40.700 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:40.711 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:40.809 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T17:56:40.857 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T17:56:41.366 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:41.391 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:41.391 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:41.391 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T17:56:41.392 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:41.392 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:41.392 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:41.617 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:41.639 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:41.640 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:41.640 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T17:56:41.640 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:41.640 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:41.640 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T17:56:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:41.850 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:41.850 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T17:56:41.850 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:41.850 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:41.850 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:41.895 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:41.917 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:41.918 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:41.918 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T17:56:41.918 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:41.962 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:41.985 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:41.985 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:41.985 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T17:56:41.985 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:41.986 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:41.986 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:42.092 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:42.115 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:42.115 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T17:56:42.115 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:42.115 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:42.115 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:42.223 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T17:56:42.281 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T17:56:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:42.311 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:42.311 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T17:56:42.311 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:42.311 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:42.336 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T17:56:42.524 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T17:56:42.577 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T17:56:42.656 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T17:56:42.745 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:56:42.887 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:56:42.928 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T17:56:42.960 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T17:56:42.987 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T17:56:43.460 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:43.487 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:43.519 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T17:56:43.600 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T17:56:43.627 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:44.677 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:44.729 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:45.696 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:45.720 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:45.824 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:45.991 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T17:56:46.014 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:46.037 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:46.037 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:46.037 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T17:56:46.038 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:46.038 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:46.038 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:46.082 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:46.093 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:46.182 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T17:56:46.239 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T17:56:46.883 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T17:56:46.924 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T17:56:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T17:56:46.997 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T17:56:47.024 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T17:56:47.163 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T17:56:47.193 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:47.213 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T17:56:47.216 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:47.216 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:47.216 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T17:56:47.216 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:47.216 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:47.216 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:47.253 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T17:56:47.260 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:47.282 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:47.283 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:47.283 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T17:56:47.283 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:47.283 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T17:56:47.328 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:47.350 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:47.350 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:47.351 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T17:56:47.351 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:47.351 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:47.351 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:47.654 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:47.676 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:47.676 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T17:56:47.676 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:47.676 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:47.676 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:56:47.849 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:47.888 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:47.909 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:48.756 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T17:56:48.843 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T17:56:48.884 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T17:56:48.967 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T17:56:48.997 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T17:56:48.997 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:56:49.081 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:56:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:56:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:56:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:56:49.270 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:56:52.282 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T17:56:52.324 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T17:56:52.365 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T17:56:52.414 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T17:56:52.441 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T17:56:52.621 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T17:56:52.662 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T17:56:52.692 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T17:56:53.277 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:53.316 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:53.336 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:54.181 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T17:56:54.272 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T17:56:54.313 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T17:56:54.396 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T17:56:54.427 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T17:56:54.427 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:56:54.519 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:56:54.544 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:56:54.544 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:56:54.638 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:56:54.702 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:56:54.836 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:56:54.836 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T17:56:54.836 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T17:56:54.837 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T17:56:54.838 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T17:56:54.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T17:56:54.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T17:56:54.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T17:56:54.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T17:56:54.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T17:56:54.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T17:56:54.853 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T17:56:54.854 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T17:56:54.856 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T17:56:54.857 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T17:56:54.858 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T17:56:54.859 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T17:56:54.860 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T17:56:54.861 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T17:56:54.862 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T17:56:54.863 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T17:56:54.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T17:56:54.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T17:56:54.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T17:56:54.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T17:56:54.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T17:56:54.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:56:54.864 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T17:56:57.027 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:56:57.027 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:57.027 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-04-26T17:56:57.027 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.027 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.028 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.029 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T17:56:57.030 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T17:56:57.031 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T17:56:57.032 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T17:56:57.033 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T17:56:57.034 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T17:56:57.035 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T17:56:57.036 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T17:56:57.037 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T17:56:57.038 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T17:56:57.039 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T17:56:57.039 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T17:56:57.039 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:56:57.039 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-26T17:56:57.458 DEBUG:teuthology.parallel:result is None 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:57:00.712 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T17:57:00.713 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T17:57:00.714 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T17:57:00.714 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T17:57:00.714 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T17:57:00.714 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T17:57:00.725 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T17:57:00.725 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T17:57:00.725 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T17:57:00.726 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T17:57:00.727 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T17:57:00.728 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T17:57:00.729 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T17:57:00.730 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T17:57:00.731 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T17:57:00.732 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T17:57:00.733 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:57:00.734 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout:Upgraded: 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T17:57:02.811 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T17:57:02.813 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T17:57:02.814 INFO:teuthology.orchestra.run.smithi143.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T17:57:02.815 INFO:teuthology.orchestra.run.smithi143.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T17:57:02.816 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T17:57:02.817 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T17:57:02.818 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T17:57:02.819 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T17:57:02.820 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.821 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T17:57:02.822 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T17:57:02.823 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:02.823 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-04-26T17:57:03.196 DEBUG:teuthology.parallel:result is None 2024-04-26T17:57:03.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:57:03.347 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T17:57:03.373 INFO:teuthology.orchestra.run.smithi139.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:03.373 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:03.373 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T17:57:03.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:57:03.519 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T17:57:03.540 INFO:teuthology.orchestra.run.smithi143.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:03.540 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:03.540 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T17:57:03.542 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T17:57:03.542 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:03.542 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T17:57:03.573 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:03.573 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T17:57:03.608 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T17:57:03.608 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:03.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T17:57:03.641 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T17:57:03.708 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:03.708 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T17:57:03.732 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T17:57:03.795 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T17:57:03.796 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:03.796 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T17:57:03.822 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T17:57:03.888 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:03.888 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T17:57:03.912 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T17:57:03.978 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T17:57:03.978 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:03.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T17:57:04.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T17:57:04.066 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:04.066 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T17:57:04.091 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T17:57:04.154 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T17:57:04.243 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T17:57:04.243 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-04-26T17:57:04.247 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /var/log/ceph 2024-04-26T17:57:04.270 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T17:57:04.270 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T17:57:04.311 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T17:57:04.335 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T17:57:04.335 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T17:57:04.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T17:57:04.407 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T17:57:04.407 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T17:57:04.407 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T17:57:04.407 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:04.407 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T17:57:04.451 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:04.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:04.598 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:04.598 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T17:57:04.613 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:04.718 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:04.764 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T17:57:04.764 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T17:57:04.764 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902', 'branch': 'wip-lusov-quiescer-fixes', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}}', 'email': None, 'first_in_suite': False, 'job_id': '7674902', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer-fixes'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer-fixes', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 9496, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer-fixes', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEQIpNjdmw3OpD6urd9c73iOU/gvK8pVA7gfAwGaZV98H13QrqB25Dp9rK4lsH5j+mXwdMM7LVekWSQKFmxgdjg=', 'smithi143.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbY6cHb+lyowSuGrXDH5beUKiAA8gcpQt5g9hJxe6q8KsDPigm0OceYPTSxwM/X8ogHP4aGS4xf3nYiLcxB+nM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_17:24:23', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T17:57:04.765 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T17:57:04.767 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T17:57:04.812 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T17:57:04.823 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T17:57:04.877 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:04.877 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T17:57:04.898 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T17:57:04.899 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-04-26T17:57:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T17:57:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:04.954 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T17:57:04.954 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:04.954 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:04.954 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 17:56:49.624107821 +0000 2024-04-26T17:57:04.954 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 17:54:42.351427352 +0000 2024-04-26T17:57:04.954 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 17:54:42.351427352 +0000 2024-04-26T17:57:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 17:54:42.351427352 +0000 2024-04-26T17:57:04.955 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T17:57:05.015 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T17:57:05.015 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T17:57:05.015 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000259676 s, 2.0 MB/s 2024-04-26T17:57:05.016 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T17:57:05.072 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 17:56:49.624107821 +0000 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 17:54:42.686419184 +0000 2024-04-26T17:57:05.128 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 17:54:42.686419184 +0000 2024-04-26T17:57:05.129 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 17:54:42.686419184 +0000 2024-04-26T17:57:05.129 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T17:57:05.189 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T17:57:05.190 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T17:57:05.190 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000185063 s, 2.8 MB/s 2024-04-26T17:57:05.191 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T17:57:05.247 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-04-26T17:57:05.302 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T17:57:05.302 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:05.302 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T17:57:05.302 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:05.302 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:05.302 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 17:56:49.624107821 +0000 2024-04-26T17:57:05.303 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 17:54:43.017411109 +0000 2024-04-26T17:57:05.303 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 17:54:43.017411109 +0000 2024-04-26T17:57:05.303 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 17:54:43.017411109 +0000 2024-04-26T17:57:05.303 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T17:57:05.364 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T17:57:05.365 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T17:57:05.365 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000237101 s, 2.2 MB/s 2024-04-26T17:57:05.366 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T17:57:05.421 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-26 17:56:49.625107799 +0000 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 17:54:43.352402937 +0000 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 17:54:43.352402937 +0000 2024-04-26T17:57:05.475 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 17:54:43.352402937 +0000 2024-04-26T17:57:05.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T17:57:05.536 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-26T17:57:05.536 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-26T17:57:05.537 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000190089 s, 2.7 MB/s 2024-04-26T17:57:05.537 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T17:57:05.593 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:05.593 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:05.593 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T17:57:05.609 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T17:57:05.609 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-04-26T17:57:05.664 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 17:56:55.065511701 +0000 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 17:55:01.442941937 +0000 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 17:55:01.442941937 +0000 2024-04-26T17:57:05.665 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 17:55:01.442941937 +0000 2024-04-26T17:57:05.666 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T17:57:05.727 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T17:57:05.728 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T17:57:05.728 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000245314 s, 2.1 MB/s 2024-04-26T17:57:05.729 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T17:57:05.785 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 17:56:55.065511701 +0000 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 17:55:01.776932468 +0000 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 17:55:01.776932468 +0000 2024-04-26T17:57:05.840 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 17:55:01.776932468 +0000 2024-04-26T17:57:05.841 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T17:57:05.902 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T17:57:05.902 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T17:57:05.902 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000196626 s, 2.6 MB/s 2024-04-26T17:57:05.903 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T17:57:05.958 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 17:56:55.065511701 +0000 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 17:55:02.138922205 +0000 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 17:55:02.138922205 +0000 2024-04-26T17:57:06.014 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 17:55:02.138922205 +0000 2024-04-26T17:57:06.015 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T17:57:06.076 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T17:57:06.076 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T17:57:06.076 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00019828 s, 2.6 MB/s 2024-04-26T17:57:06.077 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T17:57:06.133 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-04-26 17:56:55.066511673 +0000 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-04-26 17:55:02.497912027 +0000 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-04-26 17:55:02.497912027 +0000 2024-04-26T17:57:06.189 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-04-26 17:55:02.497912027 +0000 2024-04-26T17:57:06.189 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T17:57:06.251 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-04-26T17:57:06.252 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-04-26T17:57:06.252 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000170036 s, 3.0 MB/s 2024-04-26T17:57:06.253 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T17:57:06.308 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:06.308 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T17:57:06.308 INFO:tasks.ceph:Generating config... 2024-04-26T17:57:06.310 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T17:57:06.310 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-26T17:57:06.310 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T17:57:06.310 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T17:57:06.310 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T17:57:06.310 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T17:57:06.310 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T17:57:06.310 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T17:57:06.310 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T17:57:06.310 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T17:57:06.310 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-26T17:57:06.310 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-26T17:57:06.310 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-26T17:57:06.311 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T17:57:06.312 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T17:57:06.312 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T17:57:06.312 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T17:57:06.312 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T17:57:06.313 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T17:57:06.314 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T17:57:06.314 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T17:57:06.314 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T17:57:06.314 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T17:57:06.314 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:06.363 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T17:57:06.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T17:57:06.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T17:57:06.470 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.139'), ('mon.b', '172.21.15.143'), ('mon.c', '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]')] 2024-04-26T17:57:06.471 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.139,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T17:57:06.472 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:06.472 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T17:57:06.527 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.139 --add b 172.21.15.143 --addv c '[v2:172.21.15.143:3301,v1:172.21.15.143:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: generated fsid ef741c66-6f9a-4560-84cd-b0800c4824c8 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:setting min_mon_release = quincy 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:epoch 0 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:fsid ef741c66-6f9a-4560-84cd-b0800c4824c8 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:last_changed 2024-04-26T17:57:06.615306+0000 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:created 2024-04-26T17:57:06.615306+0000 2024-04-26T17:57:06.614 INFO:teuthology.orchestra.run.smithi139.stdout:min_mon_release 17 (quincy) 2024-04-26T17:57:06.615 INFO:teuthology.orchestra.run.smithi139.stdout:election_strategy: 1 2024-04-26T17:57:06.615 INFO:teuthology.orchestra.run.smithi139.stdout:0: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.a 2024-04-26T17:57:06.615 INFO:teuthology.orchestra.run.smithi139.stdout:1: [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] mon.b 2024-04-26T17:57:06.615 INFO:teuthology.orchestra.run.smithi139.stdout:2: [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] mon.c 2024-04-26T17:57:06.615 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T17:57:06.616 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T17:57:06.630 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ef741c66-6f9a-4560-84cd-b0800c4824c8... 2024-04-26T17:57:06.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T17:57:06.673 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T17:57:06.710 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-04-26T17:57:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-04-26T17:57:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T17:57:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-04-26T17:57:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T17:57:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.139,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T17:57:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on skipped message = False 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = ef741c66-6f9a-4560-84cd-b0800c4824c8 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-04-26T17:57:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-04-26T17:57:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon client directed command retry = 5 2024-04-26T17:57:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject delay max = 1 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject delay type = client mds 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject socket failures = 2500 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd blocked scrub grace period = 3600 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd max markdown count = 1000 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-04-26T17:57:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-26T17:57:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon down mkfs grace = 300 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon op complaint time = 120 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: client mount timeout = 600 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: client_shutdown_timeout = 120 2024-04-26T17:57:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 900 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 900 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.e] 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-04-26T17:57:06.721 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.f] 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout:[mds] 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds = 20 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds balancer = 20 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal fragment size max = 10000 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal merge size = 5 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split bits = 3 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split size = 100 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug frag = True 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug scatterstat = True 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds oft prefetch dirfrags = True 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds op complaint time = 180 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds verify scatter = True 2024-04-26T17:57:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: mds_dir_prefetch = True 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: mon client directed command retry = 5 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject delay max = 1 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject delay type = client mds osd 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject socket failures = 2500 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 900 2024-04-26T17:57:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 900 2024-04-26T17:57:06.724 INFO:teuthology.orchestra.run.smithi143.stdout:[global] 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: chdir = "" 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: auth supported = cephx 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: filestore xattr use omap = true 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: mon clock drift allowed = 1.000 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: osd crush chooseleaf type = 0 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: auth debug = true 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on old message = true 2024-04-26T17:57:06.725 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on bug = true 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: mon pg warn max object skew = 0 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default size = 2 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow primary affinity = true 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd allow pg remap = true 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on legacy crush tunables = false 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on crush straw calc version zero = false 2024-04-26T17:57:06.726 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on no sortbitwise = false 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on osd down out interval zero = false 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon warn on too few osds = false 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon_allow_pool_size_one = true 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: osd default data pool replay window = 5 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon allow pool delete = true 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon cluster log file level = debug 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: debug asserts on shutdown = true 2024-04-26T17:57:06.727 INFO:teuthology.orchestra.run.smithi143.stdout: mon health detail to clog = false 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: mon host = "172.21.15.139,172.21.15.143,[v2:172.21.15.143:3301,v1:172.21.15.143:6790]" 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: ms die on skipped message = False 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: fsid = ef741c66-6f9a-4560-84cd-b0800c4824c8 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout:[osd] 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: osd journal size = 100 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub load threshold = 5.0 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: osd scrub max interval = 600 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: osd mclock profile = high_recovery_ops 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: osd recover clone overlap = true 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: osd recovery max chunk = 1048576 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.728 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug shutdown = true 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug op order = true 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug verify stray on activate = true 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug trim objects = true 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: osd open classes on start = true 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug pg log writeout = true 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: osd deep scrub update digest min age = 30 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: osd map max advance = 10 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: journal zero on create = true 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: filestore ondisk finisher threads = 3 2024-04-26T17:57:06.729 INFO:teuthology.orchestra.run.smithi143.stdout: filestore apply finisher threads = 3 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: bdev debug aio = true 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: osd debug misdirected ops = true 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore block size = 96636764160 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: bluestore fsck on mount = True 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluefs = 20 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: debug bluestore = 20 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: debug osd = 20 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: debug rocksdb = 10 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: mon client directed command retry = 5 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd full ratio = 0.9 2024-04-26T17:57:06.730 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd nearfull ratio = 0.8 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject delay max = 1 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject delay type = client mds 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject socket failures = 2500 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: osd blocked scrub grace period = 3600 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: osd failsafe full ratio = 0.95 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: osd max markdown count = 1000 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: osd objectstore = bluestore 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr] 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: debug mgr = 20 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T17:57:06.731 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: mgr/telemetry/nag = false 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout:[mon] 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: debug mon = 20 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: debug paxos = 20 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: debug auth = 20 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: mon data avail warn = 5 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: mon mgr mkfs grace = 240 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:06.732 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd reporter subtree level = osd 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: mon osd prime pg temp = true 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: # 1m isn't quite enough 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: mon_down_mkfs_grace = 2m 2024-04-26T17:57:06.733 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: mon_warn_on_filestore_osds = false 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: mon down mkfs grace = 300 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: mon op complaint time = 120 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout:[client] 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: rgw cache enabled = true 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable ops log = true 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: rgw enable usage log = true 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T17:57:06.734 INFO:teuthology.orchestra.run.smithi143.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout: client mount timeout = 600 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout: client_shutdown_timeout = 120 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout: debug client = 20 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.a] 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.b] 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout:[mon.c] 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-04-26T17:57:06.735 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.e] 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.f] 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout:[mds] 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds = 20 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: debug mds balancer = 20 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: debug ms = 1 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds bal fragment size max = 10000 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds bal merge size = 5 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds bal split bits = 3 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds bal split size = 100 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug frag = True 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds debug scatterstat = True 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds oft prefetch dirfrags = True 2024-04-26T17:57:06.736 INFO:teuthology.orchestra.run.smithi143.stdout: mds op complaint time = 180 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: mds verify scatter = True 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: mds_dir_prefetch = True 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: mon client directed command retry = 5 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject delay max = 1 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject delay type = client mds osd 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: ms inject socket failures = 2500 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: osd op complaint time = 180 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: rados mon op timeout = 900 2024-04-26T17:57:06.737 INFO:teuthology.orchestra.run.smithi143.stdout: rados osd op timeout = 900 2024-04-26T17:57:06.737 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T17:57:06.738 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T17:57:06.817 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T17:57:06.817 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:06.817 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T17:57:06.831 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:06.832 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T17:57:06.886 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T17:57:06.886 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:06.886 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T17:57:06.886 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T17:57:06.959 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:06.959 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:07.014 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T17:57:07.014 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:07.014 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T17:57:07.014 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T17:57:07.254 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:07.254 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:07.309 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T17:57:07.309 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T17:57:07.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T17:57:07.357 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T17:57:07.360 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T17:57:07.436 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T17:57:07.438 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T17:57:07.439 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T17:57:07.487 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T17:57:07.490 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T17:57:07.514 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T17:57:07.602 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T17:57:07.604 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T17:57:07.627 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T17:57:07.715 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T17:57:07.718 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-26T17:57:07.741 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T17:57:07.789 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T17:57:07.792 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T17:57:07.815 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T17:57:07.903 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T17:57:07.906 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T17:57:07.929 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T17:57:08.017 INFO:teuthology.orchestra.run.smithi143.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T17:57:08.019 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-26T17:57:08.041 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T17:57:08.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T17:57:08.082 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T17:57:08.094 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T17:57:08.094 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi143.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T17:57:08.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:08.157 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:08.157 INFO:tasks.ceph:role: osd.0 2024-04-26T17:57:08.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T17:57:08.157 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T17:57:08.228 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:08.229 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:08.229 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:08.229 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:08.229 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:08.750 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-26T17:57:08.751 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-26T17:57:08.752 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:08.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:08.911 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:08.975 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:08.976 INFO:tasks.ceph:role: osd.1 2024-04-26T17:57:08.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T17:57:08.976 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T17:57:09.047 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:09.048 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:09.497 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-26T17:57:09.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-26T17:57:09.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:09.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:09.636 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:09.700 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:09.700 INFO:tasks.ceph:role: osd.2 2024-04-26T17:57:09.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T17:57:09.700 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T17:57:09.771 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:09.771 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:09.771 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:09.772 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:09.772 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:09.772 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:09.772 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:09.772 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:09.772 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:09.772 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:10.258 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-26T17:57:10.260 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-26T17:57:10.260 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:10.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:10.430 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:10.494 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:10.494 INFO:tasks.ceph:role: osd.3 2024-04-26T17:57:10.494 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T17:57:10.494 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T17:57:10.564 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:10.565 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:11.085 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-26T17:57:11.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-26T17:57:11.087 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:11.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:11.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:11.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:11.357+0000 7f6d5f7fc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T17:57:11.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:11.357+0000 7f6d5f7fc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T17:57:11.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:11.357+0000 7f6d5f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T17:57:11.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:11.357+0000 7f6d5f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T17:57:11.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:11.357+0000 7f6d5f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T17:57:11.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:11.358+0000 7f6d5f7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T17:57:14.204 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:14.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:14.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:14.318+0000 7f4a92533640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T17:57:14.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:14.319+0000 7f4a92533640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T17:57:14.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:14.319+0000 7f4a92533640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T17:57:14.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:14.319+0000 7f4a92533640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T17:57:14.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:14.319+0000 7f4a92533640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T17:57:14.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:14.319+0000 7f4a92533640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T17:57:17.168 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:17.197 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:17.285+0000 7f699c830640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T17:57:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:17.285+0000 7f699c830640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T17:57:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:17.285+0000 7f699c830640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T17:57:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:17.285+0000 7f699c830640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T17:57:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:17.285+0000 7f699c830640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T17:57:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:17.285+0000 7f699c830640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T17:57:20.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:20.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:20.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:20.253+0000 7f9493a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T17:57:20.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:20.253+0000 7f9493a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T17:57:20.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:20.253+0000 7f9493a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T17:57:20.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:20.253+0000 7f9493a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T17:57:20.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:20.253+0000 7f9493a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T17:57:20.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:20.254+0000 7f9493a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T17:57:23.098 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:23.122 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:23.151 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:23.151 INFO:tasks.ceph:role: osd.4 2024-04-26T17:57:23.151 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T17:57:23.151 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:23.226 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:23.724 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T17:57:23.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T17:57:23.727 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:23.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:23.892 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:23.957 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:23.957 INFO:tasks.ceph:role: osd.5 2024-04-26T17:57:23.957 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T17:57:23.957 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:24.029 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:24.030 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:24.030 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:24.489 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T17:57:24.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T17:57:24.492 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:24.580 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:24.607 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:24.670 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:24.670 INFO:tasks.ceph:role: osd.6 2024-04-26T17:57:24.670 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T17:57:24.671 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T17:57:24.740 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:24.740 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:24.740 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:24.740 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:24.740 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:24.740 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:24.740 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:24.741 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:24.741 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:24.741 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:25.225 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T17:57:25.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T17:57:25.227 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:25.364 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:25.394 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:25.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:25.459 INFO:tasks.ceph:role: osd.7 2024-04-26T17:57:25.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T17:57:25.459 DEBUG:teuthology.orchestra.run.smithi143:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:25.531 INFO:teuthology.orchestra.run.smithi143.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:26.046 INFO:teuthology.orchestra.run.smithi143.stdout:Discarding blocks...Done. 2024-04-26T17:57:26.049 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi143.front.sepia.ceph.com -o noatime 2024-04-26T17:57:26.049 DEBUG:teuthology.orchestra.run.smithi143:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:26.194 DEBUG:teuthology.orchestra.run.smithi143:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:26.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:26.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:26.326+0000 7f728eb1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T17:57:26.327 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:26.327+0000 7f728eb1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T17:57:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:26.327+0000 7f728eb1f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T17:57:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:26.327+0000 7f728eb1f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T17:57:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:26.327+0000 7f728eb1f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T17:57:26.328 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:26.327+0000 7f728eb1f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T17:57:29.178 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:29.205 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:29.294 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:29.292+0000 7f73dfb53640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T17:57:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:29.293+0000 7f73dfb53640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T17:57:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:29.293+0000 7f73dfb53640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T17:57:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:29.293+0000 7f73dfb53640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T17:57:29.295 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:29.293+0000 7f73dfb53640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T17:57:29.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:29.293+0000 7f73dfb53640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T17:57:32.142 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:32.170 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:32.258+0000 7f4e956af640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T17:57:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:32.258+0000 7f4e956af640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T17:57:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:32.258+0000 7f4e956af640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T17:57:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:32.258+0000 7f4e956af640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T17:57:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:32.258+0000 7f4e956af640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T17:57:32.258 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:32.259+0000 7f4e956af640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T17:57:34.766 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:34.769 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:35.100 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:35.124 DEBUG:teuthology.orchestra.run.smithi143:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:35.208+0000 7f3fb9550640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T17:57:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:35.208+0000 7f3fb9550640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T17:57:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:35.208+0000 7f3fb9550640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T17:57:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:35.208+0000 7f3fb9550640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T17:57:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:35.208+0000 7f3fb9550640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T17:57:35.208 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:35.209+0000 7f3fb9550640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T17:57:38.052 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:38.119 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T17:57:38.119 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T17:57:38.147 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.147 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T17:57:38.215 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T17:57:38.283 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.284 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-26T17:57:38.350 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.351 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T17:57:38.417 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.417 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T17:57:38.481 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T17:57:38.546 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:38.546 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T17:57:38.611 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:38.611 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T17:57:38.639 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:38.639 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T17:57:38.708 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:38.708 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T17:57:38.774 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:38.774 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-26T17:57:38.840 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:38.840 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T17:57:38.905 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:38.906 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T17:57:38.970 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:38.970 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T17:57:39.035 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:39.035 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T17:57:39.100 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:39.100 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T17:57:39.116 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T17:57:39.116 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T17:57:39.159 DEBUG:teuthology.orchestra.run.smithi143:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.y] 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz6itmnFVlFRAAAbKf1ULQWvmx7Sx0mEZPWQ== 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz6itmCKUjHRAAdEW0qcM3BQggG+dUs4MWPQ== 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz6itmIV/zIxAAhFaZ1z706CZsito3GtygUg== 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.e] 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz6itmiXi9KhAAustIJWMJbtVgu4PKhCcJVA== 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-04-26T17:57:39.181 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD36itm6xVbFRAAOhZk+Yp5scWwv7wXBw1M5g== 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD66itmIgYSExAAUakNWmOQ3O6xcQTeANkeCg== 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD96itmL40OERAARSRvfubzwavnpXiuoRf5GA== 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAA6ytmnOQrDxAAkIpDtVOmCQdTkDjLXoFqdA== 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz6itmKqcVGhAA1h8Yf7nN70K0HYKvCx/nLA== 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz6itmsyUnLxAAYIY7TENAcVWmPrimaQnn5A== 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz6itm7lPyNRAAFHiCSDWihruj+wC51L2pmg== 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.f] 2024-04-26T17:57:39.182 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD06itmWLAaARAAeyf28TMo7tRHkmMMgyR/IA== 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAG6ytmpyaRExAATFAnQp8vHGcv29ZzRcZ7Kw== 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAJ6ytmJZyJERAAIn0NZEH4usQBrl9GnlZODg== 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.6] 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAM6ytmKittDxAAz/EYtC9bufYJriOmiFWiWw== 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.7] 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAP6ytmSWhxDBAA77ExKvGc284Aojmimtrmfg== 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD06itmfFH+BBAAjm10HhHKHjhqglAsi8dMKQ== 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.y] 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDz6itmnFVlFRAAAbKf1ULQWvmx7Sx0mEZPWQ== 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.a] 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDz6itmCKUjHRAAdEW0qcM3BQggG+dUs4MWPQ== 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.c] 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDz6itmIV/zIxAAhFaZ1z706CZsito3GtygUg== 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.e] 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDz6itmiXi9KhAAustIJWMJbtVgu4PKhCcJVA== 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.0] 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQD36itm6xVbFRAAOhZk+Yp5scWwv7wXBw1M5g== 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.1] 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQD66itmIgYSExAAUakNWmOQ3O6xcQTeANkeCg== 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.2] 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQD96itmL40OERAARSRvfubzwavnpXiuoRf5GA== 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.3] 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAA6ytmnOQrDxAAkIpDtVOmCQdTkDjLXoFqdA== 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout:[mgr.x] 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDz6itmKqcVGhAA1h8Yf7nN70K0HYKvCx/nLA== 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.b] 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDz6itmsyUnLxAAYIY7TENAcVWmPrimaQnn5A== 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.d] 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQDz6itm7lPyNRAAFHiCSDWihruj+wC51L2pmg== 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout:[mds.f] 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQD06itmWLAaARAAeyf28TMo7tRHkmMMgyR/IA== 2024-04-26T17:57:39.186 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.4] 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAG6ytmpyaRExAATFAnQp8vHGcv29ZzRcZ7Kw== 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.5] 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAJ6ytmJZyJERAAIn0NZEH4usQBrl9GnlZODg== 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.6] 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAM6ytmKittDxAAz/EYtC9bufYJriOmiFWiWw== 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout:[osd.7] 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQAP6ytmSWhxDBAA77ExKvGc284Aojmimtrmfg== 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout:[client.0] 2024-04-26T17:57:39.187 INFO:teuthology.orchestra.run.smithi143.stdout: key = AQD06itmfFH+BBAAjm10HhHKHjhqglAsi8dMKQ== 2024-04-26T17:57:39.187 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:39.228 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:39.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.281 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.332 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.335 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.388 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.439 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.441 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.490 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.492 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.543 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.593 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.642 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:39.644 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:39.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.694 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.747 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.815 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:39.874 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.881 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.930 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.934 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:39.989 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:40.039 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:40.042 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:40.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T17:57:40.093 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T17:57:40.145 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T17:57:40.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T17:57:40.169 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:40.266 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T17:57:40.290 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T17:57:40.314 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:40.412 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T17:57:40.435 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T17:57:40.498 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:40.591 DEBUG:teuthology.orchestra.run.smithi143:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T17:57:40.615 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:40.618 DEBUG:teuthology.orchestra.run.smithi143:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:40.670 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T17:57:40.670 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T17:57:40.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T17:57:40.673 INFO:tasks.ceph.mon.a:Started 2024-04-26T17:57:40.673 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T17:57:40.673 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T17:57:40.712 INFO:tasks.ceph.mon.b:Started 2024-04-26T17:57:40.713 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T17:57:40.713 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T17:57:40.715 INFO:tasks.ceph.mon.c:Started 2024-04-26T17:57:40.715 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T17:57:40.717 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T17:57:40.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T17:57:40.719 INFO:tasks.ceph.mgr.y:Started 2024-04-26T17:57:40.720 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T17:57:40.720 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T17:57:40.722 INFO:tasks.ceph.mgr.x:Started 2024-04-26T17:57:40.722 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T17:57:40.722 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T17:57:40.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.819+0000 7f14fb74d640 1 Processor -- start 2024-04-26T17:57:40.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.819+0000 7f14fb74d640 1 -- start start 2024-04-26T17:57:40.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14fb74d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14f40c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14fb74d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 0x7f14f40cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14fb74d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f415c1d0 con 0x7f14f40cd520 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14fb74d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f14f415c450 con 0x7f14f40c63a0 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14fb74d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f14f415c730 con 0x7f14f4155f60 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f8ce8640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f14f40cd520 0x7f14f415bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:59594/0 (socket says 172.21.15.139:59594) 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f8ce8640 1 -- 172.21.15.139:0/4007877222 learned_addr learned my addr 172.21.15.139:0/4007877222 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f9cea640 1 --2- 172.21.15.139:0/4007877222 >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 0x7f14f40cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f94e9640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14f40c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f9cea640 1 -- 172.21.15.139:0/4007877222 >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 msgr2=0x7f14f40cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f9cea640 1 -- 172.21.15.139:0/4007877222 >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 msgr2=0x7f14f40cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f9cea640 1 --2- 172.21.15.139:0/4007877222 >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 0x7f14f40cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f94e9640 1 -- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 msgr2=0x7f14f40c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f94e9640 1 -- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 msgr2=0x7f14f40c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:57:40.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f9cea640 1 --2- 172.21.15.139:0/4007877222 >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 0x7f14f40cc140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:57:40.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f94e9640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14f40c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:57:40.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.820+0000 7f14f94e9640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14f40c79b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:57:40.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943934278 0 0) 0x7f14f0001110 con 0x7f14f40cd520 2024-04-26T17:57:40.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e0003520 con 0x7f14f40cd520 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4050437472 0 0) 0x7f14e0003520 con 0x7f14f40cd520 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 msgr2=0x7f14f40c79b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14f40c79b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 msgr2=0x7f14f40cc140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 --2- 172.21.15.139:0/4007877222 >> v2:172.21.15.143:3300/0 conn(0x7f14f40c63a0 0x7f14f40cc140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f415ca10 con 0x7f14f40cd520 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f14f0001840 con 0x7f14f40cd520 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 >> v1:172.21.15.139:6789/0 conn(0x7f14f40cd520 legacy=0x7f14f415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14e00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14e0003fe0 0x7f14e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14e0004d40 0x7f14e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f14f415c450 con 0x7f14e0004d40 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f14f415c730 con 0x7f14e0003fe0 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.983+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f14e000bb50 con 0x7f14f4155f60 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f9cea640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14e0004d40 0x7f14e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f94e9640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14e00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f8ce8640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14e0003fe0 0x7f14e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f9cea640 1 -- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 msgr2=0x7f14e00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f9cea640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14f4155f60 0x7f14e00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f9cea640 1 -- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14e0003fe0 msgr2=0x7f14e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f9cea640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14e0003fe0 0x7f14e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.984+0000 7f14f9cea640 1 -- 172.21.15.139:0/4007877222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e0003520 con 0x7f14e0004d40 2024-04-26T17:57:40.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.985+0000 7f14f9cea640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14e0004d40 0x7f14e00051c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009fd0 tx=0x7f14e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1457b792c803c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:40.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.986+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec033070 con 0x7f14e0004d40 2024-04-26T17:57:40.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.986+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec02f670 con 0x7f14e0004d40 2024-04-26T17:57:40.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.986+0000 7f14ebfff640 1 -- 172.21.15.139:0/4007877222 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec009bd0 con 0x7f14e0004d40 2024-04-26T17:57:40.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.987+0000 7f14fb74d640 1 -- 172.21.15.139:0/4007877222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14e0004d40 msgr2=0x7f14e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:40.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.987+0000 7f14fb74d640 1 --2- 172.21.15.139:0/4007877222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14e0004d40 0x7f14e00051c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009fd0 tx=0x7f14e0005830 comp rx=0 tx=0).stop 2024-04-26T17:57:40.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.987+0000 7f14f9cea640 1 -- 172.21.15.139:0/4007877222 reap_dead start 2024-04-26T17:57:40.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.987+0000 7f14fb74d640 1 -- 172.21.15.139:0/4007877222 shutdown_connections 2024-04-26T17:57:40.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.987+0000 7f14fb74d640 1 -- 172.21.15.139:0/4007877222 >> 172.21.15.139:0/4007877222 conn(0x7f14f4072930 msgr2=0x7f14f4072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:40.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.987+0000 7f14fb74d640 1 -- 172.21.15.139:0/4007877222 shutdown_connections 2024-04-26T17:57:40.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.987+0000 7f14fb74d640 1 -- 172.21.15.139:0/4007877222 wait complete. 2024-04-26T17:57:40.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.988+0000 7f14fb74d640 1 Processor -- start 2024-04-26T17:57:40.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.988+0000 7f14fb74d640 1 -- start start 2024-04-26T17:57:40.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14fb74d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14e0004d40 0x7f14f4146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14fb74d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f414db70 0x7f14f414ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14fb74d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14f40cab20 0x7f14f40cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:40.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14fb74d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f14f40c7490 con 0x7f14f40cab20 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14fb74d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f14f40c71b0 con 0x7f14f414db70 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14fb74d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f14f40c6ab0 con 0x7f14e0004d40 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14f40cab20 0x7f14f40cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f94e9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14e0004d40 0x7f14f4146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14f40cab20 0x7f14f40cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43708/0 (socket says 172.21.15.139:43708) 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f94e9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14e0004d40 0x7f14f4146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:37078/0 (socket says 172.21.15.139:37078) 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 -- 172.21.15.139:0/3980999889 learned_addr learned my addr 172.21.15.139:0/3980999889 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f8ce8640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f414db70 0x7f14f414ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 -- 172.21.15.139:0/3980999889 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14e0004d40 msgr2=0x7f14f4146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14e0004d40 0x7f14f4146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 -- 172.21.15.139:0/3980999889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f414db70 msgr2=0x7f14f414ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f414db70 0x7f14f414ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.989+0000 7f14f9cea640 1 -- 172.21.15.139:0/3980999889 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f4148eb0 con 0x7f14f40cab20 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14f9cea640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14f40cab20 0x7f14f40cafa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f14ec02b050 tx=0x7f14ec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14e9ffb640 1 -- 172.21.15.139:0/3980999889 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec033040 con 0x7f14f40cab20 2024-04-26T17:57:40.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14e9ffb640 1 -- 172.21.15.139:0/3980999889 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14ec02fe40 con 0x7f14f40cab20 2024-04-26T17:57:40.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f40d0160 con 0x7f14f40cab20 2024-04-26T17:57:40.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14e9ffb640 1 -- 172.21.15.139:0/3980999889 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec038890 con 0x7f14f40cab20 2024-04-26T17:57:40.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f414d380 con 0x7f14f40cab20 2024-04-26T17:57:40.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14e9ffb640 1 -- 172.21.15.139:0/3980999889 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f14ec036070 con 0x7f14f40cab20 2024-04-26T17:57:40.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.990+0000 7f14e9ffb640 1 -- 172.21.15.139:0/3980999889 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f14ec042ce0 con 0x7f14f40cab20 2024-04-26T17:57:40.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.991+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f4076d20 con 0x7f14f40cab20 2024-04-26T17:57:40.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:40.993+0000 7f14e9ffb640 1 -- 172.21.15.139:0/3980999889 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f14f4148eb0 con 0x7f14f40cab20 2024-04-26T17:57:41.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.057+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f14f41557a0 con 0x7f14f40cab20 2024-04-26T17:57:41.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.058+0000 7f14e9ffb640 1 -- 172.21.15.139:0/3980999889 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f14ec042420 con 0x7f14f40cab20 2024-04-26T17:57:41.058 INFO:teuthology.orchestra.run.smithi139.stderr:adjusted tunables profile to default 2024-04-26T17:57:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14f40cab20 msgr2=0x7f14f40cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14f40cab20 0x7f14f40cafa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f14ec02b050 tx=0x7f14ec004ab0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 shutdown_connections 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14f40cab20 0x7f14f40cafa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f14f414db70 0x7f14f414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 --2- 172.21.15.139:0/3980999889 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f14e0004d40 0x7f14f4146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 >> 172.21.15.139:0/3980999889 conn(0x7f14f4072930 msgr2=0x7f14f415b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 shutdown_connections 2024-04-26T17:57:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:41.059+0000 7f14fb74d640 1 -- 172.21.15.139:0/3980999889 wait complete. 2024-04-26T17:57:41.071 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T17:57:41.071 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T17:57:41.071 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:41.071 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T17:57:41.088 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:41.088+0000 7f3e3fd17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:57:41.088 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:41.089+0000 7f82c082d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:57:41.094 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:41.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T17:57:41.157 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:41.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T17:57:41.220 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:57:41.220 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T17:57:41.235 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:41.235+0000 7f3e3fd17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:41.258 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:41.258 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T17:57:41.266 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:41.267+0000 7f82c082d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:41.282 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:41.282 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T17:57:41.291 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:41.291+0000 7f3e3fd17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:57:41.322 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:41.322+0000 7f82c082d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:57:41.344 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:41.345 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T17:57:41.408 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-04-26T17:57:41.409 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T17:57:41.472 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new e6951230-a06c-4cb8-9d72-2d09d8613dd4 0 2024-04-26T17:57:41.533 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:41.533+0000 7f3e3fd17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:57:41.572 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:41.573+0000 7f82c082d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:57:41.577 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:41.577+0000 7f3e3fd17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:57:41.610 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.611+0000 7ffadb54e640 1 Processor -- start 2024-04-26T17:57:41.611 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.611+0000 7ffadb54e640 1 -- start start 2024-04-26T17:57:41.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffadb54e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad40caba0 0x7ffad40caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffadb54e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffad406cb20 0x7ffad41665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffadb54e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad41563b0 con 0x7ffad406c4a0 2024-04-26T17:57:41.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffadb54e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ffad415c670 con 0x7ffad406cb20 2024-04-26T17:57:41.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffadb54e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffad415f930 con 0x7ffad40caba0 2024-04-26T17:57:41.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad9aeb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffad406cb20 0x7ffad41665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad92ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad40caba0 0x7ffad40caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad92ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad40caba0 0x7ffad40caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:57410/0 (socket says 172.21.15.143:57410) 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad9aeb640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ffad406cb20 0x7ffad41665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51408/0 (socket says 172.21.15.143:51408) 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad92ea640 1 -- 172.21.15.143:0/1731783882 learned_addr learned my addr 172.21.15.143:0/1731783882 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad92ea640 1 -- 172.21.15.143:0/1731783882 >> v2:172.21.15.143:3300/0 conn(0x7ffad406cb20 msgr2=0x7ffad41665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad92ea640 1 --2- 172.21.15.143:0/1731783882 >> v2:172.21.15.143:3300/0 conn(0x7ffad406cb20 0x7ffad41665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad92ea640 1 -- 172.21.15.143:0/1731783882 >> v1:172.21.15.143:6789/0 conn(0x7ffad406c4a0 legacy=0x7ffad415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad92ea640 1 -- 172.21.15.143:0/1731783882 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad40b0f60 con 0x7ffad40caba0 2024-04-26T17:57:41.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.612+0000 7ffad9aeb640 1 --2- 172.21.15.143:0/1731783882 >> v2:172.21.15.143:3300/0 conn(0x7ffad406cb20 0x7ffad41665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.613+0000 7ffad92ea640 1 --2- 172.21.15.143:0/1731783882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad40caba0 0x7ffad40caf80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009870 tx=0x7ffad002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=765541afd546a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.613+0000 7ffacbfff640 1 -- 172.21.15.143:0/1731783882 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0037070 con 0x7ffad40caba0 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffacbfff640 1 -- 172.21.15.143:0/1731783882 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffad002ae50 con 0x7ffad40caba0 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffacbfff640 1 -- 172.21.15.143:0/1731783882 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0032860 con 0x7ffad40caba0 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 -- 172.21.15.143:0/1731783882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad40caba0 msgr2=0x7ffad40caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 --2- 172.21.15.143:0/1731783882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad40caba0 0x7ffad40caf80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009870 tx=0x7ffad002a300 comp rx=0 tx=0).stop 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 -- 172.21.15.143:0/1731783882 shutdown_connections 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 --2- 172.21.15.143:0/1731783882 >> v2:172.21.15.143:3300/0 conn(0x7ffad406cb20 0x7ffad41665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 --2- 172.21.15.143:0/1731783882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad40caba0 0x7ffad40caf80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 -- 172.21.15.143:0/1731783882 >> 172.21.15.143:0/1731783882 conn(0x7ffad4070a50 msgr2=0x7ffad4070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 -- 172.21.15.143:0/1731783882 shutdown_connections 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.614+0000 7ffadb54e640 1 -- 172.21.15.143:0/1731783882 wait complete. 2024-04-26T17:57:41.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.615+0000 7ffadb54e640 1 Processor -- start 2024-04-26T17:57:41.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.615+0000 7ffadb54e640 1 -- start start 2024-04-26T17:57:41.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffadb54e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffad406c4a0 0x7ffad415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffadb54e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad406cb20 0x7ffad40cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffadb54e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffad40caba0 0x7ffad414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffadb54e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffad415c020 con 0x7ffad406c4a0 2024-04-26T17:57:41.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffadb54e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffad415bd40 con 0x7ffad40caba0 2024-04-26T17:57:41.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffadb54e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffad415c300 con 0x7ffad406cb20 2024-04-26T17:57:41.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffad9aeb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffad40caba0 0x7ffad414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffad8ae9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad406cb20 0x7ffad40cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffad9aeb640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffad40caba0 0x7ffad414fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51412/0 (socket says 172.21.15.143:51412) 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffad9aeb640 1 -- 172.21.15.143:0/883600664 learned_addr learned my addr 172.21.15.143:0/883600664 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffad92ea640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffad406c4a0 0x7ffad415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.616+0000 7ffad9aeb640 1 -- 172.21.15.143:0/883600664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad406cb20 msgr2=0x7ffad40cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffad9aeb640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad406cb20 0x7ffad40cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffad9aeb640 1 -- 172.21.15.143:0/883600664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffad406c4a0 msgr2=0x7ffad415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffad9aeb640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffad406c4a0 0x7ffad415dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffad9aeb640 1 -- 172.21.15.143:0/883600664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad415e2b0 con 0x7ffad40caba0 2024-04-26T17:57:41.619 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffad92ea640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffad406c4a0 0x7ffad415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffad9aeb640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffad40caba0 0x7ffad414fb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009eb0 tx=0x7ffacc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffac9ffb640 1 -- 172.21.15.143:0/883600664 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc018020 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffac9ffb640 1 -- 172.21.15.143:0/883600664 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc014480 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad4151f40 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffac9ffb640 1 -- 172.21.15.143:0/883600664 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc014850 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad41f6280 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffac9ffb640 1 -- 172.21.15.143:0/883600664 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffacc01b020 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.617+0000 7ffac9ffb640 1 -- 172.21.15.143:0/883600664 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ffacc0133e0 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.618+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad4076d20 con 0x7ffad40caba0 2024-04-26T17:57:41.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.620+0000 7ffac9ffb640 1 -- 172.21.15.143:0/883600664 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffacc022020 con 0x7ffad40caba0 2024-04-26T17:57:41.621 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:41.622+0000 7f82c082d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:57:41.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.693+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e6951230-a06c-4cb8-9d72-2d09d8613dd4", "id": 0} v 0) -- 0x7ffad41e7420 con 0x7ffad40caba0 2024-04-26T17:57:41.696 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.697+0000 7ffac9ffb640 1 -- 172.21.15.143:0/883600664 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6951230-a06c-4cb8-9d72-2d09d8613dd4", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ffacc010040 con 0x7ffad40caba0 2024-04-26T17:57:41.696 INFO:teuthology.orchestra.run.smithi143.stdout:0 2024-04-26T17:57:41.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffad40caba0 msgr2=0x7ffad414fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffad40caba0 0x7ffad414fb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009eb0 tx=0x7ffacc00c490 comp rx=0 tx=0).stop 2024-04-26T17:57:41.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 shutdown_connections 2024-04-26T17:57:41.697 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffad40caba0 0x7ffad414fb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffad406cb20 0x7ffad40cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 --2- 172.21.15.143:0/883600664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffad406c4a0 0x7ffad415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 >> 172.21.15.143:0/883600664 conn(0x7ffad4070a50 msgr2=0x7ffad41e7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:41.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 shutdown_connections 2024-04-26T17:57:41.698 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.698+0000 7ffadb54e640 1 -- 172.21.15.143:0/883600664 wait complete. 2024-04-26T17:57:41.711 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 67d74841-bcd8-49bb-a1ea-d377f02f9809 1 2024-04-26T17:57:41.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.808+0000 7f606fe9b640 1 Processor -- start 2024-04-26T17:57:41.808 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.808+0000 7f606fe9b640 1 -- start start 2024-04-26T17:57:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606fe9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6068071ad0 0x7f6068071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606fe9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60680c6210 0x7f60680c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606fe9b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60680cb8e0 con 0x7f60680ca8c0 2024-04-26T17:57:41.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606fe9b640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f60680cbfa0 con 0x7f6068071ad0 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606fe9b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f60680cbba0 con 0x7f60680c6210 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606d436640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60680c6210 0x7f60680c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606d436640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f60680c6210 0x7f60680c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51428/0 (socket says 172.21.15.143:51428) 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606d436640 1 -- 172.21.15.143:0/3300113861 learned_addr learned my addr 172.21.15.143:0/3300113861 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606dc37640 1 --2- 172.21.15.143:0/3300113861 >> v2:172.21.15.139:3300/0 conn(0x7f6068071ad0 0x7f6068071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606d436640 1 -- 172.21.15.143:0/3300113861 >> v2:172.21.15.139:3300/0 conn(0x7f6068071ad0 msgr2=0x7f6068071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606d436640 1 --2- 172.21.15.143:0/3300113861 >> v2:172.21.15.139:3300/0 conn(0x7f6068071ad0 0x7f6068071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606d436640 1 -- 172.21.15.143:0/3300113861 >> v1:172.21.15.143:6789/0 conn(0x7f60680ca8c0 legacy=0x7f60680cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.809+0000 7f606d436640 1 -- 172.21.15.143:0/3300113861 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60680cc1f0 con 0x7f60680c6210 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.810+0000 7f606d436640 1 --2- 172.21.15.143:0/3300113861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680c6210 0x7f60680c9d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f60680c58e0 tx=0x7f606402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c71c4db50a08ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.810+0000 7f606cc35640 1 -- 172.21.15.143:0/3300113861 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064037070 con 0x7f60680c6210 2024-04-26T17:57:41.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.810+0000 7f606cc35640 1 -- 172.21.15.143:0/3300113861 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6064032440 con 0x7f60680c6210 2024-04-26T17:57:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.810+0000 7f606cc35640 1 -- 172.21.15.143:0/3300113861 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064032810 con 0x7f60680c6210 2024-04-26T17:57:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 -- 172.21.15.143:0/3300113861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680c6210 msgr2=0x7f60680c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.811 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 --2- 172.21.15.143:0/3300113861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680c6210 0x7f60680c9d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f60680c58e0 tx=0x7f606402a270 comp rx=0 tx=0).stop 2024-04-26T17:57:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 -- 172.21.15.143:0/3300113861 shutdown_connections 2024-04-26T17:57:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 --2- 172.21.15.143:0/3300113861 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680c6210 0x7f60680c9d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 --2- 172.21.15.143:0/3300113861 >> v2:172.21.15.139:3300/0 conn(0x7f6068071ad0 0x7f6068071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 -- 172.21.15.143:0/3300113861 >> 172.21.15.143:0/3300113861 conn(0x7f60680746d0 msgr2=0x7f6068076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 -- 172.21.15.143:0/3300113861 shutdown_connections 2024-04-26T17:57:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.811+0000 7f606fe9b640 1 -- 172.21.15.143:0/3300113861 wait complete. 2024-04-26T17:57:41.812 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.813+0000 7f606fe9b640 1 Processor -- start 2024-04-26T17:57:41.813 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.813+0000 7f606fe9b640 1 -- start start 2024-04-26T17:57:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606fe9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6068071ad0 0x7f60681477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606fe9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60680c6210 0x7f60681f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606fe9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680ca8c0 0x7f60681f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606fe9b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f60680cb5a0 con 0x7f60680c6210 2024-04-26T17:57:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606fe9b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f60680cc7b0 con 0x7f60680ca8c0 2024-04-26T17:57:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606fe9b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6068157600 con 0x7f6068071ad0 2024-04-26T17:57:41.815 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6068071ad0 0x7f60681477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6068071ad0 0x7f60681477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:57424/0 (socket says 172.21.15.143:57424) 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 -- 172.21.15.143:0/3527726346 learned_addr learned my addr 172.21.15.143:0/3527726346 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606e438640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680ca8c0 0x7f60681f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606d436640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60680c6210 0x7f60681f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 -- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680ca8c0 msgr2=0x7f60681f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680ca8c0 0x7f60681f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 -- 172.21.15.143:0/3527726346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60680c6210 msgr2=0x7f60681f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60680c6210 0x7f60681f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 -- 172.21.15.143:0/3527726346 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60681f58a0 con 0x7f6068071ad0 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606e438640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680ca8c0 0x7f60681f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.814+0000 7f606dc37640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6068071ad0 0x7f60681477d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f605800e9e0 tx=0x7f605800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.815+0000 7f605e7fc640 1 -- 172.21.15.143:0/3527726346 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058017070 con 0x7f6068071ad0 2024-04-26T17:57:41.816 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.815+0000 7f605e7fc640 1 -- 172.21.15.143:0/3527726346 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605800c9d0 con 0x7f6068071ad0 2024-04-26T17:57:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.815+0000 7f605e7fc640 1 -- 172.21.15.143:0/3527726346 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605800cdc0 con 0x7f6068071ad0 2024-04-26T17:57:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.815+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60681f5b80 con 0x7f6068071ad0 2024-04-26T17:57:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.815+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60681f6140 con 0x7f6068071ad0 2024-04-26T17:57:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.815+0000 7f605e7fc640 1 -- 172.21.15.143:0/3527726346 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f605801a070 con 0x7f6068071ad0 2024-04-26T17:57:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.815+0000 7f605e7fc640 1 -- 172.21.15.143:0/3527726346 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f605801c990 con 0x7f6068071ad0 2024-04-26T17:57:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.816+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6068069ae0 con 0x7f6068071ad0 2024-04-26T17:57:41.817 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.818+0000 7f605e7fc640 1 -- 172.21.15.143:0/3527726346 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f605801cc40 con 0x7f6068071ad0 2024-04-26T17:57:41.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.890+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67d74841-bcd8-49bb-a1ea-d377f02f9809", "id": 1} v 0) -- 0x7f6068076d20 con 0x7f6068071ad0 2024-04-26T17:57:41.893 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f605e7fc640 1 -- 172.21.15.143:0/3527726346 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67d74841-bcd8-49bb-a1ea-d377f02f9809", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6058005990 con 0x7f6068071ad0 2024-04-26T17:57:41.893 INFO:teuthology.orchestra.run.smithi143.stdout:1 2024-04-26T17:57:41.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6068071ad0 msgr2=0x7f60681477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:41.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f606fe9b640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6068071ad0 0x7f60681477d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f605800e9e0 tx=0x7f605800eea0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 shutdown_connections 2024-04-26T17:57:41.894 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f606fe9b640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f60680ca8c0 0x7f60681f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f606fe9b640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60680c6210 0x7f60681f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f606fe9b640 1 --2- 172.21.15.143:0/3527726346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6068071ad0 0x7f60681477d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:41.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.894+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 >> 172.21.15.143:0/3527726346 conn(0x7f60680746d0 msgr2=0x7f6068154840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:41.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.895+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 shutdown_connections 2024-04-26T17:57:41.895 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:41.895+0000 7f606fe9b640 1 -- 172.21.15.143:0/3527726346 wait complete. 2024-04-26T17:57:41.904 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 217ac863-ae16-45ca-beb8-ea1c98608bbb 2 2024-04-26T17:57:42.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.004+0000 7f7f787e7640 1 Processor -- start 2024-04-26T17:57:42.003 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.004+0000 7f7f787e7640 1 -- start start 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.004+0000 7f7f787e7640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7f700caba0 0x7f7f700caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.004+0000 7f7f787e7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006cb20 0x7f7f701665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.004+0000 7f7f787e7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f701563b0 con 0x7f7f7006c4a0 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f787e7640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7f7015c670 con 0x7f7f700caba0 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f787e7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7015f930 con 0x7f7f7006cb20 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76583640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7f700caba0 0x7f7f700caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76d84640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006cb20 0x7f7f701665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76583640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7f700caba0 0x7f7f700caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51444/0 (socket says 172.21.15.143:51444) 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76d84640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006cb20 0x7f7f701665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:57426/0 (socket says 172.21.15.143:57426) 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f75d82640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7f7006c4a0 0x7f7f7015f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33624/0 (socket says 172.21.15.143:33624) 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76583640 1 -- 172.21.15.143:0/1006904245 learned_addr learned my addr 172.21.15.143:0/1006904245 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76583640 1 -- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006cb20 msgr2=0x7f7f701665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:42.005 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76583640 1 --2- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006cb20 0x7f7f701665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76583640 1 -- 172.21.15.143:0/1006904245 >> v1:172.21.15.143:6789/0 conn(0x7f7f7006c4a0 legacy=0x7f7f7015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76583640 1 -- 172.21.15.143:0/1006904245 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f700b0f60 con 0x7f7f700caba0 2024-04-26T17:57:42.006 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.005+0000 7f7f76d84640 1 --2- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006cb20 0x7f7f701665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:42.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.006+0000 7f7f76583640 1 --2- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f700caba0 0x7f7f700caf80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009870 tx=0x7f7f6c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d76231bb8576c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.006+0000 7f7f75581640 1 -- 172.21.15.143:0/1006904245 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c037070 con 0x7f7f700caba0 2024-04-26T17:57:42.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.006+0000 7f7f75581640 1 -- 172.21.15.143:0/1006904245 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6c02ae50 con 0x7f7f700caba0 2024-04-26T17:57:42.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.006+0000 7f7f75581640 1 -- 172.21.15.143:0/1006904245 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c032860 con 0x7f7f700caba0 2024-04-26T17:57:42.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 -- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f700caba0 msgr2=0x7f7f700caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 --2- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f700caba0 0x7f7f700caf80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009870 tx=0x7f7f6c02a300 comp rx=0 tx=0).stop 2024-04-26T17:57:42.007 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 -- 172.21.15.143:0/1006904245 shutdown_connections 2024-04-26T17:57:42.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 --2- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006cb20 0x7f7f701665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 --2- 172.21.15.143:0/1006904245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f700caba0 0x7f7f700caf80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 -- 172.21.15.143:0/1006904245 >> 172.21.15.143:0/1006904245 conn(0x7f7f70070a50 msgr2=0x7f7f70070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 -- 172.21.15.143:0/1006904245 shutdown_connections 2024-04-26T17:57:42.008 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.007+0000 7f7f787e7640 1 -- 172.21.15.143:0/1006904245 wait complete. 2024-04-26T17:57:42.010 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.008+0000 7f7f787e7640 1 Processor -- start 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.008+0000 7f7f787e7640 1 -- start start 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f787e7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006c4a0 0x7f7f7014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f787e7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7006cb20 0x7f7f7015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f787e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f700caba0 0x7f7f700c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f787e7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7015c020 con 0x7f7f700caba0 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f787e7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7015bd40 con 0x7f7f7006cb20 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f787e7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7015c300 con 0x7f7f7006c4a0 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f76583640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006c4a0 0x7f7f7014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7006cb20 0x7f7f7015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7006cb20 0x7f7f7015a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51458/0 (socket says 172.21.15.143:51458) 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 -- 172.21.15.143:0/372662336 learned_addr learned my addr 172.21.15.143:0/372662336 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f76d84640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f700caba0 0x7f7f700c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 -- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006c4a0 msgr2=0x7f7f7014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.011 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006c4a0 0x7f7f7014d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 -- 172.21.15.143:0/372662336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f700caba0 msgr2=0x7f7f700c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f700caba0 0x7f7f700c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f75d82640 1 -- 172.21.15.143:0/372662336 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f701f35f0 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.009+0000 7f7f76583640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006c4a0 0x7f7f7014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f75d82640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7006cb20 0x7f7f7015a4b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000c470 tx=0x7f7f60001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f66ffd640 1 -- 172.21.15.143:0/372662336 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f600074e0 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f66ffd640 1 -- 172.21.15.143:0/372662336 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f60007680 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f66ffd640 1 -- 172.21.15.143:0/372662336 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60004a20 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7015a9f0 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f701f2830 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f66ffd640 1 -- 172.21.15.143:0/372662336 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f6001a020 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.010+0000 7f7f66ffd640 1 -- 172.21.15.143:0/372662336 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f7f60013820 con 0x7f7f7006cb20 2024-04-26T17:57:42.012 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.011+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7015cae0 con 0x7f7f7006cb20 2024-04-26T17:57:42.013 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.013+0000 7f7f66ffd640 1 -- 172.21.15.143:0/372662336 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7f60021070 con 0x7f7f7006cb20 2024-04-26T17:57:42.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.101+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "217ac863-ae16-45ca-beb8-ea1c98608bbb", "id": 2} v 0) -- 0x7f7f70076d20 con 0x7f7f7006cb20 2024-04-26T17:57:42.105 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.106+0000 7f7f66ffd640 1 -- 172.21.15.143:0/372662336 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "217ac863-ae16-45ca-beb8-ea1c98608bbb", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f7f600134d0 con 0x7f7f7006cb20 2024-04-26T17:57:42.106 INFO:teuthology.orchestra.run.smithi143.stdout:2 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7006cb20 msgr2=0x7f7f7015a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7006cb20 0x7f7f7015a4b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000c470 tx=0x7f7f60001e70 comp rx=0 tx=0).stop 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 shutdown_connections 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f700caba0 0x7f7f700c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f7006cb20 0x7f7f7015a4b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 --2- 172.21.15.143:0/372662336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7f7006c4a0 0x7f7f7014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 >> 172.21.15.143:0/372662336 conn(0x7f7f70070a50 msgr2=0x7f7f7014ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 shutdown_connections 2024-04-26T17:57:42.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.107+0000 7f7f787e7640 1 -- 172.21.15.143:0/372662336 wait complete. 2024-04-26T17:57:42.117 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new c63be4e7-36b9-4a28-bd92-f19624621308 3 2024-04-26T17:57:42.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.215+0000 7f6e8ac86640 1 Processor -- start 2024-04-26T17:57:42.215 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.215+0000 7f6e8ac86640 1 -- start start 2024-04-26T17:57:42.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.216+0000 7f6e8ac86640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e8406d0b0 0x7f6e8415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.216+0000 7f6e8ac86640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e840c8c90 con 0x7f6e84072f40 2024-04-26T17:57:42.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.216+0000 7f6e8ac86640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e840c8f30 con 0x7f6e84153e40 2024-04-26T17:57:42.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.216+0000 7f6e8ac86640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6e840c9210 con 0x7f6e8406d0b0 2024-04-26T17:57:42.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.216+0000 7f6e83fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e8406d0b0 0x7f6e8415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.216+0000 7f6e83fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6e8406d0b0 0x7f6e8415dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51464/0 (socket says 172.21.15.143:51464) 2024-04-26T17:57:42.216 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.216+0000 7f6e83fff640 1 -- 172.21.15.143:0/2930499928 learned_addr learned my addr 172.21.15.143:0/2930499928 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.217+0000 7f6e83fff640 1 -- 172.21.15.143:0/2930499928 >> v1:172.21.15.143:6789/0 conn(0x7f6e84153e40 legacy=0x7f6e8406c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.217+0000 7f6e83fff640 1 -- 172.21.15.143:0/2930499928 >> v1:172.21.15.139:6789/0 conn(0x7f6e84072f40 legacy=0x7f6e84164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.217 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.217+0000 7f6e83fff640 1 -- 172.21.15.143:0/2930499928 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e840c94f0 con 0x7f6e8406d0b0 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.217+0000 7f6e83fff640 1 --2- 172.21.15.143:0/2930499928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8406d0b0 0x7f6e8415dc40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009870 tx=0x7f6e7002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e943e04b2968f816 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.217+0000 7f6e837fe640 1 -- 172.21.15.143:0/2930499928 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70037070 con 0x7f6e8406d0b0 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.217+0000 7f6e837fe640 1 -- 172.21.15.143:0/2930499928 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7002ae50 con 0x7f6e8406d0b0 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.217+0000 7f6e837fe640 1 -- 172.21.15.143:0/2930499928 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70032860 con 0x7f6e8406d0b0 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.218+0000 7f6e8ac86640 1 -- 172.21.15.143:0/2930499928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8406d0b0 msgr2=0x7f6e8415dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.218+0000 7f6e8ac86640 1 --2- 172.21.15.143:0/2930499928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8406d0b0 0x7f6e8415dc40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009870 tx=0x7f6e7002a300 comp rx=0 tx=0).stop 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.218+0000 7f6e8ac86640 1 -- 172.21.15.143:0/2930499928 shutdown_connections 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.218+0000 7f6e8ac86640 1 --2- 172.21.15.143:0/2930499928 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e8406d0b0 0x7f6e8415dc40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.218 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.218+0000 7f6e8ac86640 1 -- 172.21.15.143:0/2930499928 >> 172.21.15.143:0/2930499928 conn(0x7f6e84070a50 msgr2=0x7f6e84070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.218+0000 7f6e8ac86640 1 -- 172.21.15.143:0/2930499928 shutdown_connections 2024-04-26T17:57:42.219 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.218+0000 7f6e8ac86640 1 -- 172.21.15.143:0/2930499928 wait complete. 2024-04-26T17:57:42.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.219+0000 7f6e8ac86640 1 Processor -- start 2024-04-26T17:57:42.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.219+0000 7f6e8ac86640 1 -- start start 2024-04-26T17:57:42.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e8ac86640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8406d0b0 0x7f6e840afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.221 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e8ac86640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e84072f40 0x7f6e841567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e8ac86640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e84153e40 0x7f6e84156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e8ac86640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8415d720 con 0x7f6e84072f40 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e8ac86640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8415d440 con 0x7f6e84153e40 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e8ac86640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6e840b3b50 con 0x7f6e8406d0b0 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8406d0b0 0x7f6e840afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8406d0b0 0x7f6e840afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:57450/0 (socket says 172.21.15.143:57450) 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e89223640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e84153e40 0x7f6e84156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 -- 172.21.15.143:0/3045946754 learned_addr learned my addr 172.21.15.143:0/3045946754 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e83fff640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e84072f40 0x7f6e841567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 -- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e84153e40 msgr2=0x7f6e84156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e84153e40 0x7f6e84156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 -- 172.21.15.143:0/3045946754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e84072f40 msgr2=0x7f6e841567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e84072f40 0x7f6e841567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.222 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e88a22640 1 -- 172.21.15.143:0/3045946754 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8415c070 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.220+0000 7f6e89223640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e84153e40 0x7f6e84156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e88a22640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8406d0b0 0x7f6e840afb50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800c430 tx=0x7f6e7800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e817fa640 1 -- 172.21.15.143:0/3045946754 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78017070 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e817fa640 1 -- 172.21.15.143:0/3045946754 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e780052d0 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e817fa640 1 -- 172.21.15.143:0/3045946754 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78003830 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8415c310 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e841f2aa0 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e817fa640 1 -- 172.21.15.143:0/3045946754 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e7801a070 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.221+0000 7f6e817fa640 1 -- 172.21.15.143:0/3045946754 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6e78011590 con 0x7f6e8406d0b0 2024-04-26T17:57:42.223 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.222+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e84076d20 con 0x7f6e8406d0b0 2024-04-26T17:57:42.224 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.224+0000 7f6e817fa640 1 -- 172.21.15.143:0/3045946754 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6e78021070 con 0x7f6e8406d0b0 2024-04-26T17:57:42.280 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:42.280+0000 7f3e3fd17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:57:42.296 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.297+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c63be4e7-36b9-4a28-bd92-f19624621308", "id": 3} v 0) -- 0x7f6e840b0ca0 con 0x7f6e8406d0b0 2024-04-26T17:57:42.302 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.302+0000 7f6e817fa640 1 -- 172.21.15.143:0/3045946754 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c63be4e7-36b9-4a28-bd92-f19624621308", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6e78011ae0 con 0x7f6e8406d0b0 2024-04-26T17:57:42.302 INFO:teuthology.orchestra.run.smithi143.stdout:3 2024-04-26T17:57:42.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8406d0b0 msgr2=0x7f6e840afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8406d0b0 0x7f6e840afb50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800c430 tx=0x7f6e7800c8f0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 shutdown_connections 2024-04-26T17:57:42.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e84153e40 0x7f6e84156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e84072f40 0x7f6e841567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.303 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 --2- 172.21.15.143:0/3045946754 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6e8406d0b0 0x7f6e840afb50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 >> 172.21.15.143:0/3045946754 conn(0x7f6e84070a50 msgr2=0x7f6e841525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 shutdown_connections 2024-04-26T17:57:42.304 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.303+0000 7f6e8ac86640 1 -- 172.21.15.143:0/3045946754 wait complete. 2024-04-26T17:57:42.313 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 9f00d029-aa1d-4c57-bc47-5754aa16cc46 4 2024-04-26T17:57:42.366 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:42.366+0000 7f3e3fd17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:42.387 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:42.388+0000 7f82c082d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:57:42.408 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:42.408+0000 7f3e3fd17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:57:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.411+0000 7f5b15472640 1 Processor -- start 2024-04-26T17:57:42.410 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.411+0000 7f5b15472640 1 -- start start 2024-04-26T17:57:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b15472640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f5b10155f10 0x7f5b100cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b15472640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b100cbb90 0x7f5b100ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b15472640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b100caa10 con 0x7f5b100ca5e0 2024-04-26T17:57:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b15472640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f5b100cbfd0 con 0x7f5b10155f10 2024-04-26T17:57:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b15472640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f5b1015f340 con 0x7f5b100cbb90 2024-04-26T17:57:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0e7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b100cbb90 0x7f5b100ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.412 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0e7fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5b100cbb90 0x7f5b100ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51474/0 (socket says 172.21.15.143:51474) 2024-04-26T17:57:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3133023280 learned_addr learned my addr 172.21.15.143:0/3133023280 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0effd640 1 --2- 172.21.15.143:0/3133023280 >> v2:172.21.15.139:3300/0 conn(0x7f5b10155f10 0x7f5b100cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3133023280 >> v2:172.21.15.139:3300/0 conn(0x7f5b10155f10 msgr2=0x7f5b100cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0e7fc640 1 --2- 172.21.15.143:0/3133023280 >> v2:172.21.15.139:3300/0 conn(0x7f5b10155f10 0x7f5b100cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3133023280 >> v1:172.21.15.143:6789/0 conn(0x7f5b100ca5e0 legacy=0x7f5b1015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.413 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.412+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3133023280 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1015c030 con 0x7f5b100cbb90 2024-04-26T17:57:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.413+0000 7f5b0e7fc640 1 --2- 172.21.15.143:0/3133023280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b100ca0a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b1006d260 tx=0x7f5b0002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a04ac04f9606f717 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.413+0000 7f5b0dffb640 1 -- 172.21.15.143:0/3133023280 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00004030 con 0x7f5b100cbb90 2024-04-26T17:57:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.413+0000 7f5b0dffb640 1 -- 172.21.15.143:0/3133023280 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b000041d0 con 0x7f5b100cbb90 2024-04-26T17:57:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.413+0000 7f5b0dffb640 1 -- 172.21.15.143:0/3133023280 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00003610 con 0x7f5b100cbb90 2024-04-26T17:57:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 -- 172.21.15.143:0/3133023280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 msgr2=0x7f5b100ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 --2- 172.21.15.143:0/3133023280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b100ca0a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b1006d260 tx=0x7f5b0002a270 comp rx=0 tx=0).stop 2024-04-26T17:57:42.414 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 -- 172.21.15.143:0/3133023280 shutdown_connections 2024-04-26T17:57:42.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 --2- 172.21.15.143:0/3133023280 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b100ca0a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 --2- 172.21.15.143:0/3133023280 >> v2:172.21.15.139:3300/0 conn(0x7f5b10155f10 0x7f5b100cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 -- 172.21.15.143:0/3133023280 >> 172.21.15.143:0/3133023280 conn(0x7f5b1006c310 msgr2=0x7f5b1006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 -- 172.21.15.143:0/3133023280 shutdown_connections 2024-04-26T17:57:42.415 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.414+0000 7f5b15472640 1 -- 172.21.15.143:0/3133023280 wait complete. 2024-04-26T17:57:42.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.415+0000 7f5b15472640 1 Processor -- start 2024-04-26T17:57:42.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.415+0000 7f5b15472640 1 -- start start 2024-04-26T17:57:42.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b15472640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b100ca5e0 0x7f5b101e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b15472640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b101f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b15472640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b10155f10 0x7f5b101f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.417 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b15472640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1015c5d0 con 0x7f5b10155f10 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b15472640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1015c2f0 con 0x7f5b100cbb90 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b15472640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5b1015c8b0 con 0x7f5b100ca5e0 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b101f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b100ca5e0 0x7f5b101e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b101f1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51482/0 (socket says 172.21.15.143:51482) 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3997918633 learned_addr learned my addr 172.21.15.143:0/3997918633 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0f7fe640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b10155f10 0x7f5b101f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b100ca5e0 msgr2=0x7f5b101e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b100ca5e0 0x7f5b101e5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3997918633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b10155f10 msgr2=0x7f5b101f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b10155f10 0x7f5b101f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0e7fc640 1 -- 172.21.15.143:0/3997918633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1015b3f0 con 0x7f5b100cbb90 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0effd640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b100ca5e0 0x7f5b101e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:42.418 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.416+0000 7f5b0f7fe640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b10155f10 0x7f5b101f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b0e7fc640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b101f1360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000c00 tx=0x7f5b000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b077fe640 1 -- 172.21.15.143:0/3997918633 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00041020 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b077fe640 1 -- 172.21.15.143:0/3997918633 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00003c50 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1015b6b0 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b077fe640 1 -- 172.21.15.143:0/3997918633 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00004030 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b101f4bb0 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b077fe640 1 -- 172.21.15.143:0/3997918633 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5b00044020 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.417+0000 7f5b077fe640 1 -- 172.21.15.143:0/3997918633 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5b0003c960 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.418+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b10069ae0 con 0x7f5b100cbb90 2024-04-26T17:57:42.419 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.420+0000 7f5b077fe640 1 -- 172.21.15.143:0/3997918633 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5b0004b030 con 0x7f5b100cbb90 2024-04-26T17:57:42.515 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:42.516+0000 7f82c082d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:42.569 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.570+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f00d029-aa1d-4c57-bc47-5754aa16cc46", "id": 4} v 0) -- 0x7f5b10069600 con 0x7f5b100cbb90 2024-04-26T17:57:42.570 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:42.570+0000 7f3e3fd17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:57:42.577 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.575+0000 7f5b077fe640 1 -- 172.21.15.143:0/3997918633 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f00d029-aa1d-4c57-bc47-5754aa16cc46", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f5b10069600 con 0x7f5b100cbb90 2024-04-26T17:57:42.577 INFO:teuthology.orchestra.run.smithi143.stdout:4 2024-04-26T17:57:42.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 msgr2=0x7f5b101f1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b101f1360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5b00000c00 tx=0x7f5b000046c0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.578 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 shutdown_connections 2024-04-26T17:57:42.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b10155f10 0x7f5b101f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b100cbb90 0x7f5b101f1360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 --2- 172.21.15.143:0/3997918633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5b100ca5e0 0x7f5b101e5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 >> 172.21.15.143:0/3997918633 conn(0x7f5b1006c310 msgr2=0x7f5b100739c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 shutdown_connections 2024-04-26T17:57:42.579 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.577+0000 7f5b15472640 1 -- 172.21.15.143:0/3997918633 wait complete. 2024-04-26T17:57:42.580 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:42.581+0000 7f82c082d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:57:42.587 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 8c61e259-582c-460f-8e57-9e5d5cc4d3eb 5 2024-04-26T17:57:42.623 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:42.623+0000 7f3e3fd17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:57:42.675 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:42.675+0000 7f3e3fd17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:57:42.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 Processor -- start 2024-04-26T17:57:42.684 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 -- start start 2024-04-26T17:57:42.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f58200ca4a0 0x7f58200c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5820072ff0 0x7f5820158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820159020 0x7f58200ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f582015ca20 con 0x7f58200ca4a0 2024-04-26T17:57:42.686 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f58200745e0 con 0x7f5820072ff0 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.685+0000 7f5825de2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f582015c0f0 con 0x7f5820159020 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5820072ff0 0x7f5820158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581ffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820159020 0x7f58200ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f5820072ff0 0x7f5820158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51484/0 (socket says 172.21.15.143:51484) 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 -- 172.21.15.143:0/4030061308 learned_addr learned my addr 172.21.15.143:0/4030061308 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581f7fe640 1 --2- 172.21.15.143:0/4030061308 >> v2:172.21.15.139:3300/0 conn(0x7f58200ca4a0 0x7f58200c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 -- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820159020 msgr2=0x7f58200ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 --2- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820159020 0x7f58200ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 -- 172.21.15.143:0/4030061308 >> v2:172.21.15.139:3300/0 conn(0x7f58200ca4a0 msgr2=0x7f58200c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 --2- 172.21.15.143:0/4030061308 >> v2:172.21.15.139:3300/0 conn(0x7f58200ca4a0 0x7f58200c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 -- 172.21.15.143:0/4030061308 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582015c3d0 con 0x7f5820072ff0 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581ffff640 1 --2- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820159020 0x7f58200ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.686+0000 7f581effd640 1 --2- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820072ff0 0x7f5820158ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f58200cbfe0 tx=0x7f581002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ef504a394350de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f581e7fc640 1 -- 172.21.15.143:0/4030061308 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810037070 con 0x7f5820072ff0 2024-04-26T17:57:42.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f581e7fc640 1 -- 172.21.15.143:0/4030061308 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5810032440 con 0x7f5820072ff0 2024-04-26T17:57:42.688 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f581e7fc640 1 -- 172.21.15.143:0/4030061308 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810032810 con 0x7f5820072ff0 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 -- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820072ff0 msgr2=0x7f5820158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 --2- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820072ff0 0x7f5820158ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f58200cbfe0 tx=0x7f581002a1e0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 -- 172.21.15.143:0/4030061308 shutdown_connections 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 --2- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820159020 0x7f58200ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 --2- 172.21.15.143:0/4030061308 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820072ff0 0x7f5820158ae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 --2- 172.21.15.143:0/4030061308 >> v2:172.21.15.139:3300/0 conn(0x7f58200ca4a0 0x7f58200c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 -- 172.21.15.143:0/4030061308 >> 172.21.15.143:0/4030061308 conn(0x7f5820070a50 msgr2=0x7f5820070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 -- 172.21.15.143:0/4030061308 shutdown_connections 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.687+0000 7f5825de2640 1 -- 172.21.15.143:0/4030061308 wait complete. 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.689+0000 7f5825de2640 1 Processor -- start 2024-04-26T17:57:42.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.689+0000 7f5825de2640 1 -- start start 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820072ff0 0x7f58200ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58200ca4a0 0x7f5820151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820159020 0x7f5820151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f58200748c0 con 0x7f58200ca4a0 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f582015ceb0 con 0x7f5820159020 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f5820074230 con 0x7f5820072ff0 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820072ff0 0x7f58200ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820159020 0x7f5820151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820159020 0x7f5820151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51486/0 (socket says 172.21.15.143:51486) 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820072ff0 0x7f58200ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:57492/0 (socket says 172.21.15.143:57492) 2024-04-26T17:57:42.692 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581ffff640 1 -- 172.21.15.143:0/142875348 learned_addr learned my addr 172.21.15.143:0/142875348 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581effd640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58200ca4a0 0x7f5820151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 -- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820159020 msgr2=0x7f5820151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820159020 0x7f5820151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 -- 172.21.15.143:0/142875348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58200ca4a0 msgr2=0x7f5820151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58200ca4a0 0x7f5820151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 -- 172.21.15.143:0/142875348 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58201533b0 con 0x7f5820072ff0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581ffff640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820159020 0x7f5820151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f581f7fe640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820072ff0 0x7f58200ce790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f581400e8a0 tx=0x7f581400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5807fff640 1 -- 172.21.15.143:0/142875348 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814017070 con 0x7f5820072ff0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5807fff640 1 -- 172.21.15.143:0/142875348 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581400c940 con 0x7f5820072ff0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5807fff640 1 -- 172.21.15.143:0/142875348 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581400ccf0 con 0x7f5820072ff0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5820153650 con 0x7f5820072ff0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.691+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5820153c10 con 0x7f5820072ff0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.692+0000 7f5807fff640 1 -- 172.21.15.143:0/142875348 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f581401a070 con 0x7f5820072ff0 2024-04-26T17:57:42.693 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.692+0000 7f5807fff640 1 -- 172.21.15.143:0/142875348 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f5814013470 con 0x7f5820072ff0 2024-04-26T17:57:42.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.692+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5820076d20 con 0x7f5820072ff0 2024-04-26T17:57:42.694 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.694+0000 7f5807fff640 1 -- 172.21.15.143:0/142875348 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5814006520 con 0x7f5820072ff0 2024-04-26T17:57:42.757 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:42.758+0000 7f82c082d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:57:42.766 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.767+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8c61e259-582c-460f-8e57-9e5d5cc4d3eb", "id": 5} v 0) -- 0x7f58200c4b30 con 0x7f5820072ff0 2024-04-26T17:57:42.772 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.773+0000 7f5807fff640 1 -- 172.21.15.143:0/142875348 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c61e259-582c-460f-8e57-9e5d5cc4d3eb", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f5814006700 con 0x7f5820072ff0 2024-04-26T17:57:42.772 INFO:teuthology.orchestra.run.smithi143.stdout:5 2024-04-26T17:57:42.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820072ff0 msgr2=0x7f58200ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.773 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820072ff0 0x7f58200ce790 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f581400e8a0 tx=0x7f581400ed60 comp rx=0 tx=0).stop 2024-04-26T17:57:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 shutdown_connections 2024-04-26T17:57:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5820159020 0x7f5820151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58200ca4a0 0x7f5820151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 --2- 172.21.15.143:0/142875348 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f5820072ff0 0x7f58200ce790 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 >> 172.21.15.143:0/142875348 conn(0x7f5820070a50 msgr2=0x7f582015b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 shutdown_connections 2024-04-26T17:57:42.774 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.774+0000 7f5825de2640 1 -- 172.21.15.143:0/142875348 wait complete. 2024-04-26T17:57:42.784 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 70338401-87be-4309-8795-449c1c990609 6 2024-04-26T17:57:42.786 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:42.787+0000 7f3e3fd17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:42.816 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:42.816+0000 7f82c082d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:57:42.871 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:42.872+0000 7f82c082d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:57:42.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.881+0000 7f8ab7499640 1 Processor -- start 2024-04-26T17:57:42.881 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.881+0000 7f8ab7499640 1 -- start start 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab7499640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab0071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab7499640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab00ca490 con 0x7f8ab0071ad0 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab7499640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab00cb8e0 con 0x7f8ab00ca8c0 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab7499640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00cbfa0 con 0x7f8ab00c6210 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab4a34640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab0071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab5a36640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8ab00ca8c0 0x7f8ab00cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33646/0 (socket says 172.21.15.143:33646) 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab5a36640 1 -- 172.21.15.143:0/1529593991 learned_addr learned my addr 172.21.15.143:0/1529593991 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab4a34640 1 -- 172.21.15.143:0/1529593991 >> v1:172.21.15.143:6789/0 conn(0x7f8ab00ca8c0 legacy=0x7f8ab00cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.882 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab4a34640 1 -- 172.21.15.143:0/1529593991 >> v1:172.21.15.139:6789/0 conn(0x7f8ab0071ad0 legacy=0x7f8ab00c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8aa7fff640 1 -- 172.21.15.143:0/1529593991 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459203548 0 0) 0x7f8ab00cb8e0 con 0x7f8ab00ca8c0 2024-04-26T17:57:42.883 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.882+0000 7f8ab4a34640 1 -- 172.21.15.143:0/1529593991 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00cbba0 con 0x7f8ab00c6210 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.883+0000 7f8ab4a34640 1 --2- 172.21.15.143:0/1529593991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab0071eb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0097d0 tx=0x7f8aac02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8e846082f068dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.883+0000 7f8aa7fff640 1 -- 172.21.15.143:0/1529593991 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac037070 con 0x7f8ab00c6210 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.883+0000 7f8aa7fff640 1 -- 172.21.15.143:0/1529593991 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac032440 con 0x7f8ab00c6210 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.883+0000 7f8aa7fff640 1 -- 172.21.15.143:0/1529593991 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac032810 con 0x7f8ab00c6210 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.884+0000 7f8ab7499640 1 -- 172.21.15.143:0/1529593991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 msgr2=0x7f8ab0071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.884+0000 7f8ab7499640 1 --2- 172.21.15.143:0/1529593991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab0071eb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0097d0 tx=0x7f8aac02a210 comp rx=0 tx=0).stop 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.884+0000 7f8ab7499640 1 -- 172.21.15.143:0/1529593991 shutdown_connections 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.884+0000 7f8ab7499640 1 --2- 172.21.15.143:0/1529593991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab0071eb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.884+0000 7f8ab7499640 1 -- 172.21.15.143:0/1529593991 >> 172.21.15.143:0/1529593991 conn(0x7f8ab00746d0 msgr2=0x7f8ab0076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.884 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.884+0000 7f8ab7499640 1 -- 172.21.15.143:0/1529593991 shutdown_connections 2024-04-26T17:57:42.885 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.884+0000 7f8ab7499640 1 -- 172.21.15.143:0/1529593991 wait complete. 2024-04-26T17:57:42.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.885+0000 7f8ab7499640 1 Processor -- start 2024-04-26T17:57:42.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.885+0000 7f8ab7499640 1 -- start start 2024-04-26T17:57:42.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab7499640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab0071ad0 0x7f8ab01e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab7499640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab01e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab7499640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00ca8c0 0x7f8ab006c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:42.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab7499640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00cc7b0 con 0x7f8ab0071ad0 2024-04-26T17:57:42.887 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab7499640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00cc4d0 con 0x7f8ab00ca8c0 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab7499640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00cb5a0 con 0x7f8ab00c6210 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab5a36640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00ca8c0 0x7f8ab006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab01e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab01e5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:57510/0 (socket says 172.21.15.143:57510) 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 -- 172.21.15.143:0/4001856871 learned_addr learned my addr 172.21.15.143:0/4001856871 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab5a36640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00ca8c0 0x7f8ab006c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51500/0 (socket says 172.21.15.143:51500) 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab5235640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab0071ad0 0x7f8ab01e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 -- 172.21.15.143:0/4001856871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00ca8c0 msgr2=0x7f8ab006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00ca8c0 0x7f8ab006c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 -- 172.21.15.143:0/4001856871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab0071ad0 msgr2=0x7f8ab01e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab0071ad0 0x7f8ab01e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 -- 172.21.15.143:0/4001856871 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab01f5d70 con 0x7f8ab00c6210 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8ab4a34640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab01e5400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0098f0 tx=0x7f8aac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8aa5ffb640 1 -- 172.21.15.143:0/4001856871 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac037040 con 0x7f8ab00c6210 2024-04-26T17:57:42.888 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.886+0000 7f8aa5ffb640 1 -- 172.21.15.143:0/4001856871 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac042070 con 0x7f8ab00c6210 2024-04-26T17:57:42.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.887+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab01f2000 con 0x7f8ab00c6210 2024-04-26T17:57:42.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.887+0000 7f8aa5ffb640 1 -- 172.21.15.143:0/4001856871 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac030a70 con 0x7f8ab00c6210 2024-04-26T17:57:42.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.887+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab01f22a0 con 0x7f8ab00c6210 2024-04-26T17:57:42.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.887+0000 7f8aa5ffb640 1 -- 172.21.15.143:0/4001856871 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8aac030c10 con 0x7f8ab00c6210 2024-04-26T17:57:42.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.887+0000 7f8aa5ffb640 1 -- 172.21.15.143:0/4001856871 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8aac047c80 con 0x7f8ab00c6210 2024-04-26T17:57:42.889 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.888+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab0069ae0 con 0x7f8ab00c6210 2024-04-26T17:57:42.890 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.891+0000 7f8aa5ffb640 1 -- 172.21.15.143:0/4001856871 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8ab01f5d70 con 0x7f8ab00c6210 2024-04-26T17:57:42.962 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.962+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70338401-87be-4309-8795-449c1c990609", "id": 6} v 0) -- 0x7f8ab0076d20 con 0x7f8ab00c6210 2024-04-26T17:57:42.967 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.968+0000 7f8aa5ffb640 1 -- 172.21.15.143:0/4001856871 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70338401-87be-4309-8795-449c1c990609", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8aac047460 con 0x7f8ab00c6210 2024-04-26T17:57:42.967 INFO:teuthology.orchestra.run.smithi143.stdout:6 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 msgr2=0x7f8ab01e5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab01e5400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0098f0 tx=0x7f8aac0046c0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 shutdown_connections 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ab00ca8c0 0x7f8ab006c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ab00c6210 0x7f8ab01e5400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 --2- 172.21.15.143:0/4001856871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ab0071ad0 0x7f8ab01e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 >> 172.21.15.143:0/4001856871 conn(0x7f8ab00746d0 msgr2=0x7f8ab0152340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 shutdown_connections 2024-04-26T17:57:42.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:42.969+0000 7f8ab7499640 1 -- 172.21.15.143:0/4001856871 wait complete. 2024-04-26T17:57:42.979 DEBUG:teuthology.orchestra.run.smithi143:> sudo ceph --cluster ceph osd new 29a5a215-4bec-4320-a3ac-3a8a48619903 7 2024-04-26T17:57:42.991 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:42.991+0000 7f82c082d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:43.086 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.087+0000 7f8a557e4640 1 Processor -- start 2024-04-26T17:57:43.087 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.087+0000 7f8a557e4640 1 -- start start 2024-04-26T17:57:43.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a557e4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a50158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a557e4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a500745e0 con 0x7f8a500ca4a0 2024-04-26T17:57:43.088 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a557e4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5015c0f0 con 0x7f8a50159020 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a557e4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8a500c5370 con 0x7f8a500c4f50 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8a50159020 0x7f8a500ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.143:33650/0 (socket says 172.21.15.143:33650) 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a50158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4f7fe640 1 -- 172.21.15.143:0/361575400 learned_addr learned my addr 172.21.15.143:0/361575400 (peer_addr_for_me v1:172.21.15.143:0/0) 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4dffb640 1 -- 172.21.15.143:0/361575400 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129594263 0 0) 0x7f8a5015c0f0 con 0x7f8a50159020 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4dffb640 1 -- 172.21.15.143:0/361575400 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a38003520 con 0x7f8a50159020 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4e7fc640 1 -- 172.21.15.143:0/361575400 >> v1:172.21.15.143:6789/0 conn(0x7f8a50159020 legacy=0x7f8a500ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4e7fc640 1 -- 172.21.15.143:0/361575400 >> v1:172.21.15.139:6789/0 conn(0x7f8a500ca4a0 legacy=0x7f8a50072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.088+0000 7f8a4e7fc640 1 -- 172.21.15.143:0/361575400 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5015c3d0 con 0x7f8a500c4f50 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.089+0000 7f8a4e7fc640 1 --2- 172.21.15.143:0/361575400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a50158ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a400097d0 tx=0x7f8a4002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da23e5a56d01ec6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.089+0000 7f8a4dffb640 1 -- 172.21.15.143:0/361575400 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40037070 con 0x7f8a500c4f50 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.089+0000 7f8a4dffb640 1 -- 172.21.15.143:0/361575400 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a40032440 con 0x7f8a500c4f50 2024-04-26T17:57:43.089 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.089+0000 7f8a4dffb640 1 -- 172.21.15.143:0/361575400 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400327f0 con 0x7f8a500c4f50 2024-04-26T17:57:43.090 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.090+0000 7f8a557e4640 1 -- 172.21.15.143:0/361575400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 msgr2=0x7f8a50158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.090+0000 7f8a557e4640 1 --2- 172.21.15.143:0/361575400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a50158ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a400097d0 tx=0x7f8a4002a200 comp rx=0 tx=0).stop 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.090+0000 7f8a557e4640 1 -- 172.21.15.143:0/361575400 shutdown_connections 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.090+0000 7f8a557e4640 1 --2- 172.21.15.143:0/361575400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a50158ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.090+0000 7f8a557e4640 1 -- 172.21.15.143:0/361575400 >> 172.21.15.143:0/361575400 conn(0x7f8a50070a50 msgr2=0x7f8a50070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.090+0000 7f8a557e4640 1 -- 172.21.15.143:0/361575400 shutdown_connections 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.090+0000 7f8a557e4640 1 -- 172.21.15.143:0/361575400 wait complete. 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.091+0000 7f8a557e4640 1 Processor -- start 2024-04-26T17:57:43.091 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.091+0000 7f8a557e4640 1 -- start start 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a557e4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a500c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a557e4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a500ca4a0 0x7f8a501f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a557e4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a50159020 0x7f8a50068300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a557e4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5015ceb0 con 0x7f8a50159020 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a557e4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5015ca20 con 0x7f8a500ca4a0 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a557e4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8a500748c0 con 0x7f8a500c4f50 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a500c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a500ca4a0 0x7f8a501f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a500ca4a0 0x7f8a501f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51502/0 (socket says 172.21.15.143:51502) 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4effd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a500c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.143:57524/0 (socket says 172.21.15.143:57524) 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 -- 172.21.15.143:0/385032897 learned_addr learned my addr 172.21.15.143:0/385032897 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4f7fe640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a50159020 0x7f8a50068300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.094 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 -- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 msgr2=0x7f8a500c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a500c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 -- 172.21.15.143:0/385032897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a50159020 msgr2=0x7f8a50068300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a50159020 0x7f8a50068300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 -- 172.21.15.143:0/385032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a500c9850 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4effd640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a500c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.092+0000 7f8a4e7fc640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a500ca4a0 0x7f8a501f29f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a400097d0 tx=0x7f8a400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.093+0000 7f8a377fe640 1 -- 172.21.15.143:0/385032897 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40037050 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.093+0000 7f8a377fe640 1 -- 172.21.15.143:0/385032897 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a40043070 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.093+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a50152770 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.093+0000 7f8a377fe640 1 -- 172.21.15.143:0/385032897 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40032810 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.093+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a500c54f0 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.093+0000 7f8a377fe640 1 -- 172.21.15.143:0/385032897 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a400329b0 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.093+0000 7f8a377fe640 1 -- 172.21.15.143:0/385032897 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8a40048de0 con 0x7f8a500ca4a0 2024-04-26T17:57:43.095 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.094+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a50076d20 con 0x7f8a500ca4a0 2024-04-26T17:57:43.096 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.096+0000 7f8a377fe640 1 -- 172.21.15.143:0/385032897 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8a40048780 con 0x7f8a500ca4a0 2024-04-26T17:57:43.163 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:43.163+0000 7f3e3fd17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:57:43.166 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.167+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29a5a215-4bec-4320-a3ac-3a8a48619903", "id": 7} v 0) -- 0x7f8a50073b30 con 0x7f8a500ca4a0 2024-04-26T17:57:43.172 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a377fe640 1 -- 172.21.15.143:0/385032897 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29a5a215-4bec-4320-a3ac-3a8a48619903", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8a40048960 con 0x7f8a500ca4a0 2024-04-26T17:57:43.172 INFO:teuthology.orchestra.run.smithi143.stdout:7 2024-04-26T17:57:43.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a500ca4a0 msgr2=0x7f8a501f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a557e4640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a500ca4a0 0x7f8a501f29f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a400097d0 tx=0x7f8a400046c0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 shutdown_connections 2024-04-26T17:57:43.173 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a557e4640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a50159020 0x7f8a50068300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a557e4640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a500ca4a0 0x7f8a501f29f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a557e4640 1 --2- 172.21.15.143:0/385032897 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a500c4f50 0x7f8a500c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.173+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 >> 172.21.15.143:0/385032897 conn(0x7f8a50070a50 msgr2=0x7f8a500b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:43.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.174+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 shutdown_connections 2024-04-26T17:57:43.174 INFO:teuthology.orchestra.run.smithi143.stderr:2024-04-26T17:57:43.174+0000 7f8a557e4640 1 -- 172.21.15.143:0/385032897 wait complete. 2024-04-26T17:57:43.183 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T17:57:43.184 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T17:57:43.187 INFO:tasks.ceph.osd.0:Started 2024-04-26T17:57:43.189 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T17:57:43.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T17:57:43.191 INFO:tasks.ceph.osd.1:Started 2024-04-26T17:57:43.191 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T17:57:43.191 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T17:57:43.193 INFO:tasks.ceph.osd.2:Started 2024-04-26T17:57:43.193 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T17:57:43.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T17:57:43.196 INFO:tasks.ceph.osd.3:Started 2024-04-26T17:57:43.196 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T17:57:43.196 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T17:57:43.199 INFO:tasks.ceph.osd.4:Started 2024-04-26T17:57:43.199 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T17:57:43.199 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T17:57:43.202 INFO:tasks.ceph.osd.5:Started 2024-04-26T17:57:43.202 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T17:57:43.202 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T17:57:43.204 INFO:tasks.ceph.osd.6:Started 2024-04-26T17:57:43.204 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T17:57:43.205 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T17:57:43.206 INFO:tasks.ceph.osd.7:Started 2024-04-26T17:57:43.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:57:43.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.327+0000 7f0a39e59640 1 Processor -- start 2024-04-26T17:57:43.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.327+0000 7f0a39e59640 1 -- start start 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a39e59640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0a34155fa0 0x7f0a3415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a39e59640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a340ccd60 con 0x7f0a340cc8f0 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a39e59640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3415c0c0 con 0x7f0a340cc4f0 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a39e59640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0a3415c3a0 con 0x7f0a34155fa0 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a337fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0a34155fa0 0x7f0a3415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a337fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0a34155fa0 0x7f0a3415feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43742/0 (socket says 172.21.15.139:43742) 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a337fe640 1 -- 172.21.15.139:0/3309258037 learned_addr learned my addr 172.21.15.139:0/3309258037 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.328+0000 7f0a33fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0a340cc8f0 0x7f0a340b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:59628/0 (socket says 172.21.15.139:59628) 2024-04-26T17:57:43.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.329+0000 7f0a327fc640 1 -- 172.21.15.139:0/3309258037 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908263934 0 0) 0x7f0a3415c0c0 con 0x7f0a340cc4f0 2024-04-26T17:57:43.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.329+0000 7f0a337fe640 1 -- 172.21.15.139:0/3309258037 >> v1:172.21.15.143:6789/0 conn(0x7f0a340cc4f0 legacy=0x7f0a340cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.329+0000 7f0a337fe640 1 -- 172.21.15.139:0/3309258037 >> v1:172.21.15.139:6789/0 conn(0x7f0a340cc8f0 legacy=0x7f0a340b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.329+0000 7f0a337fe640 1 -- 172.21.15.139:0/3309258037 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3415c680 con 0x7f0a34155fa0 2024-04-26T17:57:43.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.329+0000 7f0a337fe640 1 --2- 172.21.15.139:0/3309258037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a3415feb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009870 tx=0x7f0a2802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8946ceda6a53f304 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:43.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a327fc640 1 -- 172.21.15.139:0/3309258037 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28037070 con 0x7f0a34155fa0 2024-04-26T17:57:43.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a327fc640 1 -- 172.21.15.139:0/3309258037 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a28032440 con 0x7f0a34155fa0 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a327fc640 1 -- 172.21.15.139:0/3309258037 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28032810 con 0x7f0a34155fa0 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a39e59640 1 -- 172.21.15.139:0/3309258037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 msgr2=0x7f0a3415feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a39e59640 1 --2- 172.21.15.139:0/3309258037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a3415feb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009870 tx=0x7f0a2802a290 comp rx=0 tx=0).stop 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a39e59640 1 -- 172.21.15.139:0/3309258037 shutdown_connections 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a39e59640 1 --2- 172.21.15.139:0/3309258037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a3415feb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a39e59640 1 -- 172.21.15.139:0/3309258037 >> 172.21.15.139:0/3309258037 conn(0x7f0a34068090 msgr2=0x7f0a340684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a39e59640 1 -- 172.21.15.139:0/3309258037 shutdown_connections 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.330+0000 7f0a39e59640 1 -- 172.21.15.139:0/3309258037 wait complete. 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.332+0000 7f0a39e59640 1 Processor -- start 2024-04-26T17:57:43.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.332+0000 7f0a39e59640 1 -- start start 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.332+0000 7f0a39e59640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a340cc4f0 0x7f0a341f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.332+0000 7f0a39e59640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a340cc8f0 0x7f0a3414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.332+0000 7f0a39e59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a34154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a39e59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3415bd90 con 0x7f0a34155fa0 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a39e59640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3415cc40 con 0x7f0a340cc4f0 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a39e59640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0a34156380 con 0x7f0a340cc8f0 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a34154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a340cc4f0 0x7f0a341f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a34154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43750/0 (socket says 172.21.15.139:43750) 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 -- 172.21.15.139:0/3737171857 learned_addr learned my addr 172.21.15.139:0/3737171857 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a32ffd640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a340cc8f0 0x7f0a3414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 -- 172.21.15.139:0/3737171857 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a340cc8f0 msgr2=0x7f0a3414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a340cc8f0 0x7f0a3414bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 -- 172.21.15.139:0/3737171857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a340cc4f0 msgr2=0x7f0a341f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a340cc4f0 0x7f0a341f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 -- 172.21.15.139:0/3737171857 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a341f5d50 con 0x7f0a34155fa0 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a33fff640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a34154940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00caf0 tx=0x7f0a2c002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a1bfff640 1 -- 172.21.15.139:0/3737171857 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c018070 con 0x7f0a34155fa0 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a1bfff640 1 -- 172.21.15.139:0/3737171857 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c00a6a0 con 0x7f0a34155fa0 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a1bfff640 1 -- 172.21.15.139:0/3737171857 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c00aa90 con 0x7f0a34155fa0 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a341523c0 con 0x7f0a34155fa0 2024-04-26T17:57:43.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a1bfff640 1 -- 172.21.15.139:0/3737171857 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a2c01b070 con 0x7f0a34155fa0 2024-04-26T17:57:43.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.333+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a34152980 con 0x7f0a34155fa0 2024-04-26T17:57:43.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.334+0000 7f0a1bfff640 1 -- 172.21.15.139:0/3737171857 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0a2c00ac30 con 0x7f0a34155fa0 2024-04-26T17:57:43.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.334+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a34069ae0 con 0x7f0a34155fa0 2024-04-26T17:57:43.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.336+0000 7f0a1bfff640 1 -- 172.21.15.139:0/3737171857 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0a2c0070d0 con 0x7f0a34155fa0 2024-04-26T17:57:43.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.395+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a34076d20 con 0x7f0a34155fa0 2024-04-26T17:57:43.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.396+0000 7f0a1bfff640 1 -- 172.21.15.139:0/3737171857 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0a2c0072b0 con 0x7f0a34155fa0 2024-04-26T17:57:43.396 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:43.397 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":10,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:57:43.168764+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:43.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 msgr2=0x7f0a34154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a34154940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00caf0 tx=0x7f0a2c002090 comp rx=0 tx=0).stop 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 shutdown_connections 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a34155fa0 0x7f0a34154940 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a340cc8f0 0x7f0a3414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 --2- 172.21.15.139:0/3737171857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a340cc4f0 0x7f0a341f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 >> 172.21.15.139:0/3737171857 conn(0x7f0a34068090 msgr2=0x7f0a3415db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 shutdown_connections 2024-04-26T17:57:43.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:43.397+0000 7f0a39e59640 1 -- 172.21.15.139:0/3737171857 wait complete. 2024-04-26T17:57:43.398 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:43.398+0000 7f82c082d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:57:43.407 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T17:57:43.408 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T17:57:43.462 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:43.462+0000 7f3e3fd17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:57:43.514 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:43.514+0000 7f3e3fd17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:57:43.632 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:43.632+0000 7f3e3fd17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:57:43.655 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:43.656+0000 7f82c082d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:57:43.707 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:43.707+0000 7f82c082d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:57:43.789 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-04-26T17:57:43.789+0000 7ff31e32a640 -1 Falling back to public interface 2024-04-26T17:57:43.794 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T17:57:43.795+0000 7fb0d9e13640 -1 Falling back to public interface 2024-04-26T17:57:43.796 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T17:57:43.796+0000 7f5ffdc0d640 -1 Falling back to public interface 2024-04-26T17:57:43.813 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-04-26T17:57:43.813+0000 7f8bfda22640 -1 Falling back to public interface 2024-04-26T17:57:43.818 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-04-26T17:57:43.818+0000 7f4cc381a640 -1 Falling back to public interface 2024-04-26T17:57:43.824 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-04-26T17:57:43.824+0000 7f1404cfd640 -1 Falling back to public interface 2024-04-26T17:57:43.825 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:43.826+0000 7f82c082d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:57:43.827 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T17:57:43.828+0000 7f9dd5af0640 -1 Falling back to public interface 2024-04-26T17:57:43.831 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T17:57:43.832+0000 7fcc8a20d640 -1 Falling back to public interface 2024-04-26T17:57:43.910 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:43.910+0000 7f3e3fd17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:57:43.957 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:43.957+0000 7f3e3fd17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:57:44.107 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:44.108+0000 7f82c082d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:57:44.114 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:44.114+0000 7f3e3fd17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:57:44.156 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:44.156+0000 7f82c082d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:57:44.213 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T17:57:44.251 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:44.251+0000 7f3e3fd17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:57:44.302 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:44.302+0000 7f3e3fd17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:57:44.303 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.302+0000 7efcca083640 1 Processor -- start 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.302+0000 7efcca083640 1 -- start start 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcca083640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efcc40c96b0 0x7efcc40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcca083640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc4072b50 con 0x7efcc4155ea0 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcca083640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc4072e30 con 0x7efcc415bbc0 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcca083640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7efcc4072920 con 0x7efcc40c96b0 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcc2ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efcc40c96b0 0x7efcc40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcc37fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7efcc4155ea0 0x7efcc40cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:59640/0 (socket says 172.21.15.139:59640) 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcc37fe640 1 -- 172.21.15.139:0/2071580333 learned_addr learned my addr 172.21.15.139:0/2071580333 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcc2ffd640 1 -- 172.21.15.139:0/2071580333 >> v1:172.21.15.143:6789/0 conn(0x7efcc415bbc0 legacy=0x7efcc41664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcc2ffd640 1 -- 172.21.15.139:0/2071580333 >> v1:172.21.15.139:6789/0 conn(0x7efcc4155ea0 legacy=0x7efcc40cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:44.304 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.303+0000 7efcc27fc640 1 -- 172.21.15.139:0/2071580333 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320646209 0 0) 0x7efcc4072b50 con 0x7efcc4155ea0 2024-04-26T17:57:44.305 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.304+0000 7efcc2ffd640 1 -- 172.21.15.139:0/2071580333 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40c9cb0 con 0x7efcc40c96b0 2024-04-26T17:57:44.306 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.304+0000 7efcc2ffd640 1 --2- 172.21.15.139:0/2071580333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc40c9040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcb40097a0 tx=0x7efcb402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b5f702a40275cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:44.306 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.304+0000 7efcc27fc640 1 -- 172.21.15.139:0/2071580333 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4037070 con 0x7efcc40c96b0 2024-04-26T17:57:44.306 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.304+0000 7efcc27fc640 1 -- 172.21.15.139:0/2071580333 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb4032440 con 0x7efcc40c96b0 2024-04-26T17:57:44.306 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.304+0000 7efcc27fc640 1 -- 172.21.15.139:0/2071580333 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb402ae60 con 0x7efcc40c96b0 2024-04-26T17:57:44.306 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.305+0000 7efcca083640 1 -- 172.21.15.139:0/2071580333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 msgr2=0x7efcc40c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:44.306 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.305+0000 7efcca083640 1 --2- 172.21.15.139:0/2071580333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc40c9040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcb40097a0 tx=0x7efcb402a110 comp rx=0 tx=0).stop 2024-04-26T17:57:44.307 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.305+0000 7efcca083640 1 -- 172.21.15.139:0/2071580333 shutdown_connections 2024-04-26T17:57:44.307 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.305+0000 7efcca083640 1 --2- 172.21.15.139:0/2071580333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc40c9040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:44.307 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.305+0000 7efcca083640 1 -- 172.21.15.139:0/2071580333 >> 172.21.15.139:0/2071580333 conn(0x7efcc406c320 msgr2=0x7efcc406c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:44.307 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.305+0000 7efcca083640 1 -- 172.21.15.139:0/2071580333 shutdown_connections 2024-04-26T17:57:44.307 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.305+0000 7efcca083640 1 -- 172.21.15.139:0/2071580333 wait complete. 2024-04-26T17:57:44.307 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.306+0000 7efcca083640 1 Processor -- start 2024-04-26T17:57:44.307 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.306+0000 7efcca083640 1 -- start start 2024-04-26T17:57:44.309 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcca083640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc41465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:44.309 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcca083640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcc4155ea0 0x7efcc40cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:44.309 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcca083640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcc415bbc0 0x7efcc4157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcca083640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4156280 con 0x7efcc40c96b0 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcca083640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4073110 con 0x7efcc4155ea0 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcca083640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efcc40ce080 con 0x7efcc415bbc0 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc41465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc41465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43766/0 (socket says 172.21.15.139:43766) 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 -- 172.21.15.139:0/1055466450 learned_addr learned my addr 172.21.15.139:0/1055466450 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc2ffd640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcc4155ea0 0x7efcc40cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc3fff640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcc415bbc0 0x7efcc4157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 -- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcc415bbc0 msgr2=0x7efcc4157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcc415bbc0 0x7efcc4157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 -- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcc4155ea0 msgr2=0x7efcc40cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcc4155ea0 0x7efcc40cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 -- 172.21.15.139:0/1055466450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40cd110 con 0x7efcc40c96b0 2024-04-26T17:57:44.310 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.307+0000 7efcc37fe640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc41465b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c4a0 tx=0x7efcb800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.308+0000 7efcabfff640 1 -- 172.21.15.139:0/1055466450 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8018070 con 0x7efcc40c96b0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.308+0000 7efcabfff640 1 -- 172.21.15.139:0/1055466450 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb80074e0 con 0x7efcc40c96b0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.308+0000 7efcabfff640 1 -- 172.21.15.139:0/1055466450 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8004a20 con 0x7efcc40c96b0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.308+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc41f19a0 con 0x7efcc40c96b0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.309+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc41f1f60 con 0x7efcc40c96b0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.309+0000 7efcabfff640 1 -- 172.21.15.139:0/1055466450 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efcb8004bc0 con 0x7efcc40c96b0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.309+0000 7efcabfff640 1 -- 172.21.15.139:0/1055466450 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7efcb801ba30 con 0x7efcc40c96b0 2024-04-26T17:57:44.311 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.309+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc40506c0 con 0x7efcc40c96b0 2024-04-26T17:57:44.312 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:44.312+0000 7f82c082d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:57:44.312 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.311+0000 7efcabfff640 1 -- 172.21.15.139:0/1055466450 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7efcb8021070 con 0x7efcc40c96b0 2024-04-26T17:57:44.373 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.373+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcc40c4870 con 0x7efcc40c96b0 2024-04-26T17:57:44.374 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.374+0000 7efcabfff640 1 -- 172.21.15.139:0/1055466450 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7efcb801bc30 con 0x7efcc40c96b0 2024-04-26T17:57:44.374 INFO:teuthology.misc.health.smithi139.stdout: 2024-04-26T17:57:44.374 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":10,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:57:43.168764+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 msgr2=0x7efcc41465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc41465b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efcb800c4a0 tx=0x7efcb800c960 comp rx=0 tx=0).stop 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 shutdown_connections 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcc415bbc0 0x7efcc4157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcc4155ea0 0x7efcc40cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 --2- 172.21.15.139:0/1055466450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcc40c96b0 0x7efcc41465b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 >> 172.21.15.139:0/1055466450 conn(0x7efcc406c320 msgr2=0x7efcc40681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:44.375 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 shutdown_connections 2024-04-26T17:57:44.376 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:44.375+0000 7efcca083640 1 -- 172.21.15.139:0/1055466450 wait complete. 2024-04-26T17:57:44.376 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:44.376+0000 7f3e3fd17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:44.384 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T17:57:44.423 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:44.424+0000 7f3e3fd17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:57:44.450 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:44.451+0000 7f82c082d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:57:44.499 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:44.499+0000 7f82c082d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:57:44.568 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:44.568+0000 7f82c082d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:44.614 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:44.614+0000 7f82c082d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:57:44.897 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:44.897+0000 7f3e3fd17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:57:45.015 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:45.015+0000 7f3e3fd17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:57:45.097 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:45.098+0000 7f82c082d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:57:45.214 INFO:tasks.ceph.mgr.x.smithi143.stderr:2024-04-26T17:57:45.214+0000 7f82c082d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:57:46.029 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:46.029+0000 7f3de08fb640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T17:57:46.029 INFO:tasks.ceph.mgr.y.smithi139.stderr:2024-04-26T17:57:46.029+0000 7f3de08fb640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T17:57:47.280 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-04-26T17:57:47.280+0000 7ff31e32a640 -1 osd.0 0 log_to_monitors true 2024-04-26T17:57:47.300 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T17:57:47.300+0000 7fb0d9e13640 -1 osd.4 0 log_to_monitors true 2024-04-26T17:57:47.303 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T17:57:47.304+0000 7f5ffdc0d640 -1 osd.5 0 log_to_monitors true 2024-04-26T17:57:47.336 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-04-26T17:57:47.336+0000 7f8bfda22640 -1 osd.2 0 log_to_monitors true 2024-04-26T17:57:47.355 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T17:57:47.356+0000 7f9dd5af0640 -1 osd.6 0 log_to_monitors true 2024-04-26T17:57:47.357 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T17:57:47.358+0000 7fcc8a20d640 -1 osd.7 0 log_to_monitors true 2024-04-26T17:57:47.363 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-04-26T17:57:47.363+0000 7f4cc381a640 -1 osd.3 0 log_to_monitors true 2024-04-26T17:57:47.368 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-04-26T17:57:47.369+0000 7f1404cfd640 -1 osd.1 0 log_to_monitors true 2024-04-26T17:57:51.091 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-04-26T17:57:51.091+0000 7f8bf931a640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T17:57:51.103 INFO:tasks.ceph.osd.2.smithi139.stderr:2024-04-26T17:57:51.104+0000 7f8bf113a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.118 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T17:57:51.118+0000 7f5ff949d640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T17:57:51.128 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T17:57:51.127+0000 7f9dd1a86640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T17:57:51.131 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-04-26T17:57:51.131+0000 7f14014a7640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T17:57:51.136 INFO:tasks.ceph.osd.5.smithi143.stderr:2024-04-26T17:57:51.136+0000 7f5ff12bd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.142 INFO:tasks.ceph.osd.1.smithi139.stderr:2024-04-26T17:57:51.143+0000 7f13f8ab3640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.151 INFO:tasks.ceph.osd.6.smithi143.stderr:2024-04-26T17:57:51.151+0000 7f9dc98a6640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.151 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T17:57:51.151+0000 7fcc86349640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T17:57:51.153 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-04-26T17:57:51.154+0000 7f4cbf1e7640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T17:57:51.163 INFO:tasks.ceph.osd.7.smithi143.stderr:2024-04-26T17:57:51.163+0000 7fcc7d955640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.165 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-04-26T17:57:51.165+0000 7ff31a2c0640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T17:57:51.169 INFO:tasks.ceph.osd.3.smithi139.stderr:2024-04-26T17:57:51.170+0000 7f4cb7007640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.174 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T17:57:51.174+0000 7fb0d56f3640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T17:57:51.179 INFO:tasks.ceph.osd.0.smithi139.stderr:2024-04-26T17:57:51.180+0000 7ff3120e0640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.185 INFO:tasks.ceph.osd.4.smithi143.stderr:2024-04-26T17:57:51.185+0000 7fb0cd513640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:57:51.191 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T17:57:51.280 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.280+0000 7ff8c51a4640 1 Processor -- start 2024-04-26T17:57:51.280 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.280+0000 7ff8c51a4640 1 -- start start 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.281+0000 7ff8c51a4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c006ef30 0x7ff8c006f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.281+0000 7ff8c51a4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff8c00ca7f0 0x7ff8c01529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.281+0000 7ff8c51a4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c006d6e0 con 0x7ff8c00ca410 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.281+0000 7ff8c51a4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c00c8c30 con 0x7ff8c00ca7f0 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.281+0000 7ff8c51a4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c00c9160 con 0x7ff8c006ef30 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.281+0000 7ff8bf59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff8c00ca7f0 0x7ff8c01529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8be59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c006ef30 0x7ff8c006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.282 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bf59e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff8c00ca7f0 0x7ff8c01529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:43062/0 (socket says 172.21.15.139:43062) 2024-04-26T17:57:51.283 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bf59e640 1 -- 172.21.15.139:0/3912534976 learned_addr learned my addr 172.21.15.139:0/3912534976 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:51.283 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bf59e640 1 -- 172.21.15.139:0/3912534976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c006ef30 msgr2=0x7ff8c006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:51.283 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bf59e640 1 --2- 172.21.15.139:0/3912534976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c006ef30 0x7ff8c006f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.283 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bf59e640 1 -- 172.21.15.139:0/3912534976 >> v1:172.21.15.143:6789/0 conn(0x7ff8c00ca410 legacy=0x7ff8c006e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.283 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bf59e640 1 -- 172.21.15.139:0/3912534976 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c006d9a0 con 0x7ff8c00ca7f0 2024-04-26T17:57:51.283 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bdd9b640 1 -- 172.21.15.139:0/3912534976 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002127263 0 0) 0x7ff8c006d6e0 con 0x7ff8c00ca410 2024-04-26T17:57:51.284 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.282+0000 7ff8bf59e640 1 --2- 172.21.15.139:0/3912534976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01529d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009870 tx=0x7ff8b002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2ca6d62247f7880 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.284 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8bdd9b640 1 -- 172.21.15.139:0/3912534976 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0037070 con 0x7ff8c00ca7f0 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8bdd9b640 1 -- 172.21.15.139:0/3912534976 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b0032440 con 0x7ff8c00ca7f0 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8bdd9b640 1 -- 172.21.15.139:0/3912534976 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0032810 con 0x7ff8c00ca7f0 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 -- 172.21.15.139:0/3912534976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c00ca7f0 msgr2=0x7ff8c01529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/3912534976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01529d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009870 tx=0x7ff8b002a1c0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 -- 172.21.15.139:0/3912534976 shutdown_connections 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/3912534976 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01529d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/3912534976 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c006ef30 0x7ff8c006f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 -- 172.21.15.139:0/3912534976 >> 172.21.15.139:0/3912534976 conn(0x7ff8c0070b60 msgr2=0x7ff8c0070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 -- 172.21.15.139:0/3912534976 shutdown_connections 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.283+0000 7ff8c51a4640 1 -- 172.21.15.139:0/3912534976 wait complete. 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 Processor -- start 2024-04-26T17:57:51.285 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 -- start start 2024-04-26T17:57:51.288 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c006ef30 0x7ff8c0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.288 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c00ca410 0x7ff8c0075ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.288 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.288 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c00c5860 con 0x7ff8c00ca7f0 2024-04-26T17:57:51.288 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c00c5bd0 con 0x7ff8c006ef30 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8c51a4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c00c98c0 con 0x7ff8c00ca410 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8bf59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8bf59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51340/0 (socket says 172.21.15.139:51340) 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8bf59e640 1 -- 172.21.15.139:0/2303289448 learned_addr learned my addr 172.21.15.139:0/2303289448 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8bed9d640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c006ef30 0x7ff8c0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.285+0000 7ff8be59c640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c00ca410 0x7ff8c0075ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8bed9d640 1 -- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c00ca410 msgr2=0x7ff8c0075ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8bed9d640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c00ca410 0x7ff8c0075ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8bed9d640 1 -- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8c00ca7f0 msgr2=0x7ff8c01f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8bed9d640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8bed9d640 1 -- 172.21.15.139:0/2303289448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c01ef5a0 con 0x7ff8c006ef30 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8bf59e640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8bed9d640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c006ef30 0x7ff8c0154830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c450 tx=0x7ff8b800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.289 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8a77fe640 1 -- 172.21.15.139:0/2303289448 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8017070 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8a77fe640 1 -- 172.21.15.139:0/2303289448 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b80035f0 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8a77fe640 1 -- 172.21.15.139:0/2303289448 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80039e0 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c0155770 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.286+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c01efb00 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.287+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c00506c0 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.288+0000 7ff8a77fe640 1 -- 172.21.15.139:0/2303289448 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff8b801a070 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.288+0000 7ff8a77fe640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8ac06c860 0x7ff8ac06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.288+0000 7ff8a77fe640 1 -- 172.21.15.139:0/2303289448 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7ff8b808a020 con 0x7ff8c006ef30 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.288+0000 7ff8be59c640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8ac06c860 0x7ff8ac06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.290 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.288+0000 7ff8be59c640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8ac06c860 0x7ff8ac06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8c01f3bd0 tx=0x7ff8b400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.292 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.293+0000 7ff8a77fe640 1 -- 172.21.15.139:0/2303289448 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8c01ef5a0 con 0x7ff8c006ef30 2024-04-26T17:57:51.468 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.469+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8c01f0200 con 0x7ff8c006ef30 2024-04-26T17:57:51.469 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.470+0000 7ff8a77fe640 1 -- 172.21.15.139:0/2303289448 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7ff8b8058c70 con 0x7ff8c006ef30 2024-04-26T17:57:51.470 INFO:teuthology.misc.health.smithi139.stdout: 2024-04-26T17:57:51.470 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":12,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:57:49.035246+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8ac06c860 msgr2=0x7ff8ac06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8ac06c860 0x7ff8ac06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8c01f3bd0 tx=0x7ff8b400b040 comp rx=0 tx=0).stop 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c006ef30 msgr2=0x7ff8c0154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c006ef30 0x7ff8c0154830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c450 tx=0x7ff8b800c910 comp rx=0 tx=0).stop 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 shutdown_connections 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8ac06c860 0x7ff8ac06ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8c00ca7f0 0x7ff8c01f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff8c00ca410 0x7ff8c0075ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.472 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 --2- 172.21.15.139:0/2303289448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8c006ef30 0x7ff8c0154830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.473 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 >> 172.21.15.139:0/2303289448 conn(0x7ff8c0070b60 msgr2=0x7ff8c0070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.473 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 shutdown_connections 2024-04-26T17:57:51.473 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:51.472+0000 7ff8c51a4640 1 -- 172.21.15.139:0/2303289448 wait complete. 2024-04-26T17:57:51.482 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T17:57:58.289 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T17:57:58.389 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.389+0000 7f2eb67f0640 1 Processor -- start 2024-04-26T17:57:58.390 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.389+0000 7f2eb67f0640 1 -- start start 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eb67f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2eb0155fa0 0x7f2eb00cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eb67f0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2eb015f1e0 0x7f2eb00cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eb67f0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb00c67d0 con 0x7f2eb00cda00 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eb67f0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb0156380 con 0x7f2eb015f1e0 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eb67f0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb015bfd0 con 0x7f2eb0155fa0 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eb4d8d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2eb015f1e0 0x7f2eb00cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eaf7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2eb00cda00 0x7f2eb015c460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50360/0 (socket says 172.21.15.139:50360) 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eaf7fe640 1 -- 172.21.15.139:0/3550732403 learned_addr learned my addr 172.21.15.139:0/3550732403 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.390+0000 7f2eaffff640 1 --2- 172.21.15.139:0/3550732403 >> v2:172.21.15.143:3300/0 conn(0x7f2eb0155fa0 0x7f2eb00cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eaeffd640 1 -- 172.21.15.139:0/3550732403 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042476294 0 0) 0x7f2eb00c67d0 con 0x7f2eb00cda00 2024-04-26T17:57:58.391 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eaeffd640 1 -- 172.21.15.139:0/3550732403 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e98003520 con 0x7f2eb00cda00 2024-04-26T17:57:58.392 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eb4d8d640 1 -- 172.21.15.139:0/3550732403 >> v2:172.21.15.143:3300/0 conn(0x7f2eb0155fa0 msgr2=0x7f2eb00cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:58.392 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eb4d8d640 1 --2- 172.21.15.139:0/3550732403 >> v2:172.21.15.143:3300/0 conn(0x7f2eb0155fa0 0x7f2eb00cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.392 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eb4d8d640 1 -- 172.21.15.139:0/3550732403 >> v1:172.21.15.139:6789/0 conn(0x7f2eb00cda00 legacy=0x7f2eb015c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.392 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eb4d8d640 1 -- 172.21.15.139:0/3550732403 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb015f7b0 con 0x7f2eb015f1e0 2024-04-26T17:57:58.393 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eb4d8d640 1 --2- 172.21.15.139:0/3550732403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00cc1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00ceb10 tx=0x7f2ea802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72552d46a306e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:58.393 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.391+0000 7f2eaeffd640 1 -- 172.21.15.139:0/3550732403 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8007740 con 0x7f2eb015f1e0 2024-04-26T17:57:58.393 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eaeffd640 1 -- 172.21.15.139:0/3550732403 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea80078e0 con 0x7f2eb015f1e0 2024-04-26T17:57:58.393 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eaeffd640 1 -- 172.21.15.139:0/3550732403 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8007c90 con 0x7f2eb015f1e0 2024-04-26T17:57:58.393 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 -- 172.21.15.139:0/3550732403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb015f1e0 msgr2=0x7f2eb00cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.393 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/3550732403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00cc1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00ceb10 tx=0x7f2ea802a710 comp rx=0 tx=0).stop 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 -- 172.21.15.139:0/3550732403 shutdown_connections 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/3550732403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00cc1f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/3550732403 >> v2:172.21.15.143:3300/0 conn(0x7f2eb0155fa0 0x7f2eb00cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 -- 172.21.15.139:0/3550732403 >> 172.21.15.139:0/3550732403 conn(0x7f2eb0075f80 msgr2=0x7f2eb006c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 -- 172.21.15.139:0/3550732403 shutdown_connections 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.392+0000 7f2eb67f0640 1 -- 172.21.15.139:0/3550732403 wait complete. 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.393+0000 7f2eb67f0640 1 Processor -- start 2024-04-26T17:57:58.394 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.393+0000 7f2eb67f0640 1 -- start start 2024-04-26T17:57:58.396 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eb67f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb00cda00 0x7f2eb014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eb67f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb0155fa0 0x7f2eb01e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eb67f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00d1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eb67f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb0160050 con 0x7f2eb0155fa0 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eb67f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb015fd70 con 0x7f2eb015f1e0 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eb67f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb015cb70 con 0x7f2eb00cda00 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb0155fa0 0x7f2eb01e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb0155fa0 0x7f2eb01e8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51392/0 (socket says 172.21.15.139:51392) 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eaf7fe640 1 -- 172.21.15.139:0/2855929281 learned_addr learned my addr 172.21.15.139:0/2855929281 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eaffff640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb00cda00 0x7f2eb014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.394+0000 7f2eb4d8d640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eaf7fe640 1 -- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb00cda00 msgr2=0x7f2eb014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eaf7fe640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb00cda00 0x7f2eb014c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eaf7fe640 1 -- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb015f1e0 msgr2=0x7f2eb00d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.397 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eaf7fe640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eaf7fe640 1 -- 172.21.15.139:0/2855929281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb01f56a0 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eaffff640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb00cda00 0x7f2eb014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eb4d8d640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eaf7fe640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb0155fa0 0x7f2eb01e8a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c460 tx=0x7f2ea400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eacff9640 1 -- 172.21.15.139:0/2855929281 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4017070 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eacff9640 1 -- 172.21.15.139:0/2855929281 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea4005ce0 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb01f5980 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eacff9640 1 -- 172.21.15.139:0/2855929281 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4007290 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.395+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb01f5f40 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.396+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb01f1ee0 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.396+0000 7f2eacff9640 1 -- 172.21.15.139:0/2855929281 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ea401a070 con 0x7f2eb0155fa0 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.397+0000 7f2eacff9640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.398 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.397+0000 7f2eaffff640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.399 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.397+0000 7f2eacff9640 1 -- 172.21.15.139:0/2855929281 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2ea408ac00 con 0x7f2eb0155fa0 2024-04-26T17:57:58.399 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.397+0000 7f2eaffff640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009b90 tx=0x7f2ea0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:58.401 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.401+0000 7f2eacff9640 1 -- 172.21.15.139:0/2855929281 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2eb01f1ee0 con 0x7f2eb0155fa0 2024-04-26T17:57:58.579 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.579+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2eb00506c0 con 0x7f2eb0155fa0 2024-04-26T17:57:58.580 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.580+0000 7f2eacff9640 1 -- 172.21.15.139:0/2855929281 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f2ea4091080 con 0x7f2eb0155fa0 2024-04-26T17:57:58.580 INFO:teuthology.misc.health.smithi139.stdout: 2024-04-26T17:57:58.580 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":16,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:57:55.201163+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:58.582 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2e9c06c8f0 msgr2=0x7f2e9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.582 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009b90 tx=0x7f2ea0008040 comp rx=0 tx=0).stop 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb0155fa0 msgr2=0x7f2eb01e8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb0155fa0 0x7f2eb01e8a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c460 tx=0x7f2ea400c920 comp rx=0 tx=0).stop 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 shutdown_connections 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2e9c06c8f0 0x7f2e9c06edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2eb015f1e0 0x7f2eb00d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb0155fa0 0x7f2eb01e8a10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 --2- 172.21.15.139:0/2855929281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2eb00cda00 0x7f2eb014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 >> 172.21.15.139:0/2855929281 conn(0x7f2eb0075f80 msgr2=0x7f2eb00c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 shutdown_connections 2024-04-26T17:57:58.583 INFO:teuthology.misc.health.smithi139.stderr:2024-04-26T17:57:58.582+0000 7f2eb67f0640 1 -- 172.21.15.139:0/2855929281 wait complete. 2024-04-26T17:57:58.592 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T17:57:58.592 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T17:57:58.592 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T17:57:58.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T17:57:58.595 INFO:tasks.ceph.mds.a:Started 2024-04-26T17:57:58.595 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T17:57:58.595 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T17:57:58.597 INFO:tasks.ceph.mds.c:Started 2024-04-26T17:57:58.597 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-26T17:57:58.597 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-26T17:57:58.599 INFO:tasks.ceph.mds.e:Started 2024-04-26T17:57:58.599 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T17:57:58.599 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T17:57:58.602 INFO:tasks.ceph.mds.b:Started 2024-04-26T17:57:58.602 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T17:57:58.602 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T17:57:58.604 INFO:tasks.ceph.mds.d:Started 2024-04-26T17:57:58.604 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-26T17:57:58.605 DEBUG:teuthology.orchestra.run.smithi143:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-26T17:57:58.607 INFO:tasks.ceph.mds.f:Started 2024-04-26T17:57:58.607 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T17:57:58.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:57:58.669 INFO:tasks.ceph.mds.a.smithi139.stdout:starting mds.a at 2024-04-26T17:57:58.670 INFO:tasks.ceph.mds.c.smithi139.stdout:starting mds.c at 2024-04-26T17:57:58.674 INFO:tasks.ceph.mds.e.smithi139.stdout:starting mds.e at 2024-04-26T17:57:58.687 INFO:tasks.ceph.mds.f.smithi143.stdout:starting mds.f at 2024-04-26T17:57:58.688 INFO:tasks.ceph.mds.b.smithi143.stdout:starting mds.b at 2024-04-26T17:57:58.688 INFO:tasks.ceph.mds.d.smithi143.stdout:starting mds.d at 2024-04-26T17:57:58.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.714+0000 7f125a0ea640 1 Processor -- start 2024-04-26T17:57:58.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.714+0000 7f125a0ea640 1 -- start start 2024-04-26T17:57:58.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f125a0ea640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1254156180 0x7f125415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f125a0ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12540cd840 0x7f12540c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f125a0ea640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125415f2a0 con 0x7f1254155da0 2024-04-26T17:57:58.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f125a0ea640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f125415cbc0 con 0x7f1254156180 2024-04-26T17:57:58.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f125a0ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f12540cc730 con 0x7f12540cd840 2024-04-26T17:57:58.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f1252ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1254156180 0x7f125415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f1252ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1254156180 0x7f125415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51438/0 (socket says 172.21.15.139:51438) 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f1252ffd640 1 -- 172.21.15.139:0/1065791394 learned_addr learned my addr 172.21.15.139:0/1065791394 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f1253fff640 1 --2- 172.21.15.139:0/1065791394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12540cd840 0x7f12540c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.715+0000 7f12527fc640 1 -- 172.21.15.139:0/1065791394 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523246506 0 0) 0x7f125415f2a0 con 0x7f1254155da0 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f12527fc640 1 -- 172.21.15.139:0/1065791394 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f123c003520 con 0x7f1254155da0 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f1253fff640 1 -- 172.21.15.139:0/1065791394 >> v2:172.21.15.139:3300/0 conn(0x7f1254156180 msgr2=0x7f125415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f1253fff640 1 --2- 172.21.15.139:0/1065791394 >> v2:172.21.15.139:3300/0 conn(0x7f1254156180 0x7f125415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f1253fff640 1 -- 172.21.15.139:0/1065791394 >> v1:172.21.15.143:6789/0 conn(0x7f1254155da0 legacy=0x7f12540d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f1253fff640 1 -- 172.21.15.139:0/1065791394 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125415f580 con 0x7f12540cd840 2024-04-26T17:57:58.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f1253fff640 1 --2- 172.21.15.139:0/1065791394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12540cd840 0x7f12540c62a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f124c009d90 tx=0x7f124c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7ec931fb9d2d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f12527fc640 1 -- 172.21.15.139:0/1065791394 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c031600 con 0x7f12540cd840 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f12527fc640 1 -- 172.21.15.139:0/1065791394 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124c0317a0 con 0x7f12540cd840 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.716+0000 7f12527fc640 1 -- 172.21.15.139:0/1065791394 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c031b50 con 0x7f12540cd840 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 -- 172.21.15.139:0/1065791394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12540cd840 msgr2=0x7f12540c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 --2- 172.21.15.139:0/1065791394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12540cd840 0x7f12540c62a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f124c009d90 tx=0x7f124c02a5d0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 -- 172.21.15.139:0/1065791394 shutdown_connections 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 --2- 172.21.15.139:0/1065791394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12540cd840 0x7f12540c62a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 --2- 172.21.15.139:0/1065791394 >> v2:172.21.15.139:3300/0 conn(0x7f1254156180 0x7f125415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 -- 172.21.15.139:0/1065791394 >> 172.21.15.139:0/1065791394 conn(0x7f1254068090 msgr2=0x7f12540684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 -- 172.21.15.139:0/1065791394 shutdown_connections 2024-04-26T17:57:58.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.717+0000 7f125a0ea640 1 -- 172.21.15.139:0/1065791394 wait complete. 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.718+0000 7f125a0ea640 1 Processor -- start 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.718+0000 7f125a0ea640 1 -- start start 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f125a0ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12540cd840 0x7f1254158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f125a0ea640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254155da0 0x7f1254150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f125a0ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1254157ad0 0x7f1254152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f125a0ea640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12540d19d0 con 0x7f1254155da0 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f125a0ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f125415fb40 con 0x7f12540cd840 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f125a0ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f12540d1b50 con 0x7f1254157ad0 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254155da0 0x7f1254150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254155da0 0x7f1254150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51450/0 (socket says 172.21.15.139:51450) 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 -- 172.21.15.139:0/2816150817 learned_addr learned my addr 172.21.15.139:0/2816150817 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1253fff640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1254157ad0 0x7f1254152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f12537fe640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12540cd840 0x7f1254158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 -- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1254157ad0 msgr2=0x7f1254152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1254157ad0 0x7f1254152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 -- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12540cd840 msgr2=0x7f1254158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12540cd840 0x7f1254158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 -- 172.21.15.139:0/2816150817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1254158860 con 0x7f1254155da0 2024-04-26T17:57:58.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.719+0000 7f1252ffd640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254155da0 0x7f1254150020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f124800e870 tx=0x7f124800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.720+0000 7f123bfff640 1 -- 172.21.15.139:0/2816150817 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248017070 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.720+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1254157fc0 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.720+0000 7f123bfff640 1 -- 172.21.15.139:0/2816150817 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124800c940 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.720+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1254158580 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.720+0000 7f123bfff640 1 -- 172.21.15.139:0/2816150817 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124800cd10 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.721+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1234005290 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.721+0000 7f123bfff640 1 -- 172.21.15.139:0/2816150817 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f124801a070 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.721+0000 7f123bfff640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f124006c8f0 0x7f124006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.722+0000 7f123bfff640 1 -- 172.21.15.139:0/2816150817 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f124808b640 con 0x7f1254155da0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.722+0000 7f12537fe640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f124006c8f0 0x7f124006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:58.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.722+0000 7f12537fe640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f124006c8f0 0x7f124006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1244007fd0 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:58.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.726+0000 7f123bfff640 1 -- 172.21.15.139:0/2816150817 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12480596f0 con 0x7f1254155da0 2024-04-26T17:57:58.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.939+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1234005850 con 0x7f1254155da0 2024-04-26T17:57:58.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.939+0000 7f123bfff640 1 -- 172.21.15.139:0/2816150817 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f124805d9f0 con 0x7f1254155da0 2024-04-26T17:57:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:57:58.939 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T17:57:58.940 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 2 2024-04-26T17:57:58.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f124006c8f0 msgr2=0x7f124006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f124006c8f0 0x7f124006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1244007fd0 tx=0x7f1244009040 comp rx=0 tx=0).stop 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254155da0 msgr2=0x7f1254150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254155da0 0x7f1254150020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f124800e870 tx=0x7f124800ed30 comp rx=0 tx=0).stop 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 shutdown_connections 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f124006c8f0 0x7f124006edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1254157ad0 0x7f1254152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254155da0 0x7f1254150020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 --2- 172.21.15.139:0/2816150817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12540cd840 0x7f1254158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 >> 172.21.15.139:0/2816150817 conn(0x7f1254068090 msgr2=0x7f12540cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 shutdown_connections 2024-04-26T17:57:58.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:57:58.941+0000 7f125a0ea640 1 -- 172.21.15.139:0/2816150817 wait complete. 2024-04-26T17:58:00.953 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:01.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.061+0000 7fca40025640 1 Processor -- start 2024-04-26T17:58:01.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.062+0000 7fca40025640 1 -- start start 2024-04-26T17:58:01.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.062+0000 7fca40025640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fca38155fa0 0x7fca3815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.062+0000 7fca40025640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca380cc4f0 0x7fca380cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.062+0000 7fca40025640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3815c0c0 con 0x7fca380cdaf0 2024-04-26T17:58:01.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.062+0000 7fca40025640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fca3815c3a0 con 0x7fca38155fa0 2024-04-26T17:58:01.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.062+0000 7fca40025640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fca3815c680 con 0x7fca380cc4f0 2024-04-26T17:58:01.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3d5c0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca380cc4f0 0x7fca380cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3ddc1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fca38155fa0 0x7fca3815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3d5c0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca380cc4f0 0x7fca380cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54380/0 (socket says 172.21.15.139:54380) 2024-04-26T17:58:01.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3d5c0640 1 -- 172.21.15.139:0/3450810450 learned_addr learned my addr 172.21.15.139:0/3450810450 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:01.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3e5c2640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fca380cdaf0 0x7fca380b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:40214/0 (socket says 172.21.15.139:40214) 2024-04-26T17:58:01.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3d5c0640 1 -- 172.21.15.139:0/3450810450 >> v2:172.21.15.143:3300/0 conn(0x7fca38155fa0 msgr2=0x7fca3815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3d5c0640 1 --2- 172.21.15.139:0/3450810450 >> v2:172.21.15.143:3300/0 conn(0x7fca38155fa0 0x7fca3815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3d5c0640 1 -- 172.21.15.139:0/3450810450 >> v1:172.21.15.143:6789/0 conn(0x7fca380cdaf0 legacy=0x7fca380b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3d5c0640 1 -- 172.21.15.139:0/3450810450 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3815c960 con 0x7fca380cc4f0 2024-04-26T17:58:01.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.063+0000 7fca3ddc1640 1 --2- 172.21.15.139:0/3450810450 >> v2:172.21.15.143:3300/0 conn(0x7fca38155fa0 0x7fca3815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:01.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.064+0000 7fca3d5c0640 1 --2- 172.21.15.139:0/3450810450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca380cc4f0 0x7fca380cc8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca28009870 tx=0x7fca2802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebdb98e40cbaa1f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.064+0000 7fca3cdbf640 1 -- 172.21.15.139:0/3450810450 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28037070 con 0x7fca380cc4f0 2024-04-26T17:58:01.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.064+0000 7fca3cdbf640 1 -- 172.21.15.139:0/3450810450 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2802ae50 con 0x7fca380cc4f0 2024-04-26T17:58:01.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.064+0000 7fca3cdbf640 1 -- 172.21.15.139:0/3450810450 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28032860 con 0x7fca380cc4f0 2024-04-26T17:58:01.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 -- 172.21.15.139:0/3450810450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca380cc4f0 msgr2=0x7fca380cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 --2- 172.21.15.139:0/3450810450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca380cc4f0 0x7fca380cc8f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca28009870 tx=0x7fca2802a300 comp rx=0 tx=0).stop 2024-04-26T17:58:01.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 -- 172.21.15.139:0/3450810450 shutdown_connections 2024-04-26T17:58:01.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 --2- 172.21.15.139:0/3450810450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca380cc4f0 0x7fca380cc8f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 --2- 172.21.15.139:0/3450810450 >> v2:172.21.15.143:3300/0 conn(0x7fca38155fa0 0x7fca3815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 -- 172.21.15.139:0/3450810450 >> 172.21.15.139:0/3450810450 conn(0x7fca38068090 msgr2=0x7fca380684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:01.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 -- 172.21.15.139:0/3450810450 shutdown_connections 2024-04-26T17:58:01.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.065+0000 7fca40025640 1 -- 172.21.15.139:0/3450810450 wait complete. 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.066+0000 7fca40025640 1 Processor -- start 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.066+0000 7fca40025640 1 -- start start 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca40025640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca380cc4f0 0x7fca38156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca40025640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca380cdaf0 0x7fca380ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca40025640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca38155fa0 0x7fca381f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca40025640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca38156380 con 0x7fca380cc4f0 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca40025640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fca3815bd90 con 0x7fca380cdaf0 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca40025640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fca38156500 con 0x7fca38155fa0 2024-04-26T17:58:01.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca380cc4f0 0x7fca38156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca380cc4f0 0x7fca38156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54686/0 (socket says 172.21.15.139:54686) 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 -- 172.21.15.139:0/1897981079 learned_addr learned my addr 172.21.15.139:0/1897981079 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3e5c2640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca38155fa0 0x7fca381f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3d5c0640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca380cdaf0 0x7fca380ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 -- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca38155fa0 msgr2=0x7fca381f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca38155fa0 0x7fca381f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 -- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca380cdaf0 msgr2=0x7fca380ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca380cdaf0 0x7fca380ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 -- 172.21.15.139:0/1897981079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca38157390 con 0x7fca380cc4f0 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3e5c2640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca38155fa0 0x7fca381f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3d5c0640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca380cdaf0 0x7fca380ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca3ddc1640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca380cc4f0 0x7fca38156680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ebe0 tx=0x7fca3000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.067+0000 7fca2e7fc640 1 -- 172.21.15.139:0/1897981079 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30017070 con 0x7fca380cc4f0 2024-04-26T17:58:01.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.068+0000 7fca2e7fc640 1 -- 172.21.15.139:0/1897981079 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3000cbd0 con 0x7fca380cc4f0 2024-04-26T17:58:01.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.068+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca381570b0 con 0x7fca380cc4f0 2024-04-26T17:58:01.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.068+0000 7fca2e7fc640 1 -- 172.21.15.139:0/1897981079 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30013470 con 0x7fca380cc4f0 2024-04-26T17:58:01.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.068+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca380c8bc0 con 0x7fca380cc4f0 2024-04-26T17:58:01.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.068+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca38069ae0 con 0x7fca380cc4f0 2024-04-26T17:58:01.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.069+0000 7fca2e7fc640 1 -- 172.21.15.139:0/1897981079 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca3001a070 con 0x7fca380cc4f0 2024-04-26T17:58:01.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.069+0000 7fca2e7fc640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca1c06c8f0 0x7fca1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.069+0000 7fca2e7fc640 1 -- 172.21.15.139:0/1897981079 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fca3008bad0 con 0x7fca380cc4f0 2024-04-26T17:58:01.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.069+0000 7fca3d5c0640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca1c06c8f0 0x7fca1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.070+0000 7fca3d5c0640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca1c06c8f0 0x7fca1c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca2802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.074+0000 7fca2e7fc640 1 -- 172.21.15.139:0/1897981079 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca3005a250 con 0x7fca380cc4f0 2024-04-26T17:58:01.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.287+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca380c85e0 con 0x7fca380cc4f0 2024-04-26T17:58:01.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.288+0000 7fca2e7fc640 1 -- 172.21.15.139:0/1897981079 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5509 (secure 0 0 0) 0x7fca380c85e0 con 0x7fca380cc4f0 2024-04-26T17:58:01.288 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:01.288 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4309,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T17:58:01.288 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 3 2024-04-26T17:58:01.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca1c06c8f0 msgr2=0x7fca1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca1c06c8f0 0x7fca1c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca2802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:01.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca380cc4f0 msgr2=0x7fca38156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca380cc4f0 0x7fca38156680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ebe0 tx=0x7fca3000c520 comp rx=0 tx=0).stop 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 shutdown_connections 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca1c06c8f0 0x7fca1c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fca38155fa0 0x7fca381f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca380cdaf0 0x7fca380ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 --2- 172.21.15.139:0/1897981079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca380cc4f0 0x7fca38156680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 >> 172.21.15.139:0/1897981079 conn(0x7fca38068090 msgr2=0x7fca380cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 shutdown_connections 2024-04-26T17:58:01.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.290+0000 7fca40025640 1 -- 172.21.15.139:0/1897981079 wait complete. 2024-04-26T17:58:01.301 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T17:58:01.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.397+0000 7fc7246bd640 1 Processor -- start 2024-04-26T17:58:01.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.397+0000 7fc7246bd640 1 -- start start 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.398+0000 7fc7246bd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc71c152850 0x7fc71c0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.398+0000 7fc7246bd640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71c0c95e0 con 0x7fc71c15c460 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.398+0000 7fc7246bd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71c0c98c0 con 0x7fc71c0686f0 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.398+0000 7fc7246bd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc71c0c9ba0 con 0x7fc71c152850 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.398+0000 7fc722c5a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc71c15c460 0x7fc71c166560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55576/0 (socket says 172.21.15.139:55576) 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.398+0000 7fc722c5a640 1 -- 172.21.15.139:0/3768646302 learned_addr learned my addr 172.21.15.139:0/3768646302 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.398+0000 7fc722459640 1 --2- 172.21.15.139:0/3768646302 >> v2:172.21.15.143:3300/0 conn(0x7fc71c152850 0x7fc71c0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893196122 0 0) 0x7fc71c0c95e0 con 0x7fc71c15c460 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc708003520 con 0x7fc71c15c460 2024-04-26T17:58:01.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551379824 0 0) 0x7fc71c0c98c0 con 0x7fc71c0686f0 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc71c0c95e0 con 0x7fc71c0686f0 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1620063127 0 0) 0x7fc708003520 con 0x7fc71c15c460 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 >> v2:172.21.15.143:3300/0 conn(0x7fc71c152850 msgr2=0x7fc71c0c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 --2- 172.21.15.139:0/3768646302 >> v2:172.21.15.143:3300/0 conn(0x7fc71c152850 0x7fc71c0c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 >> v1:172.21.15.143:6789/0 conn(0x7fc71c0686f0 legacy=0x7fc71c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c0caab0 con 0x7fc71c15c460 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7fc714001670 con 0x7fc71c15c460 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 >> v1:172.21.15.139:6789/0 conn(0x7fc71c15c460 legacy=0x7fc71c166560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc708003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc708004800 0x7fc708004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7080051c0 0x7fc70800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0c9ba0 con 0x7fc708003b40 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc70800c040 con 0x7fc708004800 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc70800c240 con 0x7fc7080051c0 2024-04-26T17:58:01.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722459640 1 --2- 172.21.15.139:0/3768646302 >> v2:172.21.15.143:3300/0 conn(0x7fc71c152850 0x7fc71c0c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722459640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc708003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc721c58640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc708004800 0x7fc708004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722c5a640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7080051c0 0x7fc70800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722459640 1 -- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7080051c0 msgr2=0x7fc70800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722459640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7080051c0 0x7fc70800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722459640 1 -- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc708004800 msgr2=0x7fc708004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722459640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc708004800 0x7fc708004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722459640 1 -- 172.21.15.139:0/3768646302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc708003520 con 0x7fc708003b40 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722c5a640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7080051c0 0x7fc70800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.399+0000 7fc722c5a640 1 -- 172.21.15.139:0/3768646302 reap_dead start 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.400+0000 7fc722459640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc708003f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc71800e350 tx=0x7fc708005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b725ae60b922d418 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.400+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718033070 con 0x7fc708003b40 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.400+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc718003b90 con 0x7fc708003b40 2024-04-26T17:58:01.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.400+0000 7fc721457640 1 -- 172.21.15.139:0/3768646302 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718009dc0 con 0x7fc708003b40 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.401+0000 7fc7246bd640 1 -- 172.21.15.139:0/3768646302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 msgr2=0x7fc708003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.401+0000 7fc7246bd640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc708003f40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc71800e350 tx=0x7fc708005830 comp rx=0 tx=0).stop 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.401+0000 7fc7246bd640 1 -- 172.21.15.139:0/3768646302 shutdown_connections 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.401+0000 7fc7246bd640 1 --2- 172.21.15.139:0/3768646302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc708003f40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.401+0000 7fc7246bd640 1 -- 172.21.15.139:0/3768646302 >> 172.21.15.139:0/3768646302 conn(0x7fc71c0730d0 msgr2=0x7fc71c0734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.401+0000 7fc7246bd640 1 -- 172.21.15.139:0/3768646302 shutdown_connections 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.401+0000 7fc7246bd640 1 -- 172.21.15.139:0/3768646302 wait complete. 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.402+0000 7fc7246bd640 1 Processor -- start 2024-04-26T17:58:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.402+0000 7fc7246bd640 1 -- start start 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc71c14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c149eb0 0x7fc71c147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c155cd0 0x7fc71c1f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0c9190 con 0x7fc708003b40 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0cade0 con 0x7fc71c149eb0 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c0cb2b0 con 0x7fc71c155cd0 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc71c14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc71c14c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54698/0 (socket says 172.21.15.139:54698) 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 -- 172.21.15.139:0/2565312302 learned_addr learned my addr 172.21.15.139:0/2565312302 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:01.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 -- 172.21.15.139:0/2565312302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c155cd0 msgr2=0x7fc71c1f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c155cd0 0x7fc71c1f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 -- 172.21.15.139:0/2565312302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c149eb0 msgr2=0x7fc71c147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c149eb0 0x7fc71c147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 -- 172.21.15.139:0/2565312302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c1f5450 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc722459640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc71c14c9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc71802b040 tx=0x7fc718009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc712ffd640 1 -- 172.21.15.139:0/2565312302 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718033040 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c1490f0 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c1496b0 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc712ffd640 1 -- 172.21.15.139:0/2565312302 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc718003990 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.403+0000 7fc712ffd640 1 -- 172.21.15.139:0/2565312302 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718009dc0 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.404+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c076d20 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.404+0000 7fc712ffd640 1 -- 172.21.15.139:0/2565312302 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc718037810 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.405+0000 7fc712ffd640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc70006c8f0 0x7fc70006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.405+0000 7fc712ffd640 1 -- 172.21.15.139:0/2565312302 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc7180ac7c0 con 0x7fc708003b40 2024-04-26T17:58:01.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.405+0000 7fc721c58640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc70006c8f0 0x7fc70006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.405+0000 7fc721c58640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc70006c8f0 0x7fc70006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc71c06f880 tx=0x7fc70c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.409+0000 7fc712ffd640 1 -- 172.21.15.139:0/2565312302 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc71807aec0 con 0x7fc708003b40 2024-04-26T17:58:01.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.585+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc71c14cf00 con 0x7fc708003b40 2024-04-26T17:58:01.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.585+0000 7fc712ffd640 1 -- 172.21.15.139:0/2565312302 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fc71807a7c0 con 0x7fc708003b40 2024-04-26T17:58:01.586 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:01.586 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2024-04-26T17:58:01.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-04-26T17:58:01.586 INFO:teuthology.orchestra.run.smithi139.stdout: "poolnum": 1, 2024-04-26T17:58:01.586 INFO:teuthology.orchestra.run.smithi139.stdout: "poolname": ".mgr" 2024-04-26T17:58:01.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:58:01.586 INFO:teuthology.orchestra.run.smithi139.stdout:] 2024-04-26T17:58:01.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc70006c8f0 msgr2=0x7fc70006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc70006c8f0 0x7fc70006edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc71c06f880 tx=0x7fc70c009040 comp rx=0 tx=0).stop 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 msgr2=0x7fc71c14c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc71c14c9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc71802b040 tx=0x7fc718009750 comp rx=0 tx=0).stop 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 shutdown_connections 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc70006c8f0 0x7fc70006edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc71c155cd0 0x7fc71c1f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc71c149eb0 0x7fc71c147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 --2- 172.21.15.139:0/2565312302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc708003b40 0x7fc71c14c9c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 >> 172.21.15.139:0/2565312302 conn(0x7fc71c0730d0 msgr2=0x7fc71c14bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 shutdown_connections 2024-04-26T17:58:01.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.587+0000 7fc7246bd640 1 -- 172.21.15.139:0/2565312302 wait complete. 2024-04-26T17:58:01.598 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T17:58:01.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T17:58:01.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.699+0000 7f693e47e640 1 Processor -- start 2024-04-26T17:58:01.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693e47e640 1 -- start start 2024-04-26T17:58:01.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693e47e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 0x7f69380c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693e47e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f69380729f0 0x7f693806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693e47e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69381540f0 con 0x7f693806e580 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693e47e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6938072430 con 0x7f69380729f0 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693e47e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6938072710 con 0x7f6938153d10 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693ca1b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f693806e580 0x7f6938073320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55580/0 (socket says 172.21.15.139:55580) 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.700+0000 7f693ca1b640 1 -- 172.21.15.139:0/3339400791 learned_addr learned my addr 172.21.15.139:0/3339400791 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859502043 0 0) 0x7f69381540f0 con 0x7f693806e580 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6920003520 con 0x7f693806e580 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f69377fe640 1 --2- 172.21.15.139:0/3339400791 >> v2:172.21.15.143:3300/0 conn(0x7f69380729f0 0x7f693806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6937fff640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 0x7f69380c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 668513304 0 0) 0x7f6920003520 con 0x7f693806e580 2024-04-26T17:58:01.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 msgr2=0x7f69380c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 0x7f69380c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 >> v2:172.21.15.143:3300/0 conn(0x7f69380729f0 msgr2=0x7f693806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 --2- 172.21.15.139:0/3339400791 >> v2:172.21.15.143:3300/0 conn(0x7f69380729f0 0x7f693806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693806ee60 con 0x7f693806e580 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f69300019f0 con 0x7f693806e580 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 >> v1:172.21.15.139:6789/0 conn(0x7f693806e580 legacy=0x7f6938073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 0x7f69200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920003f30 0x7f6920004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6920004d40 0x7f69200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6938072430 con 0x7f6920003f30 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6938072710 con 0x7f6920004d40 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f692000b9f0 con 0x7f6938153d10 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f69377fe640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920003f30 0x7f6920004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6937fff640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 0x7f69200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f693ca1b640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6920004d40 0x7f69200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f69377fe640 1 -- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 msgr2=0x7f69200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f69377fe640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 0x7f69200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f69377fe640 1 -- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6920004d40 msgr2=0x7f69200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f69377fe640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6920004d40 0x7f69200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f69377fe640 1 -- 172.21.15.139:0/3339400791 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6920003520 con 0x7f6920003f30 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.701+0000 7f6937fff640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6938153d10 0x7f69200039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.702+0000 7f69377fe640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920003f30 0x7f6920004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f692c009ac0 tx=0x7f6920005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620fc8d36c55b2d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.702+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c036070 con 0x7f6920003f30 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.702+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c031400 con 0x7f6920003f30 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.702+0000 7f6936ffd640 1 -- 172.21.15.139:0/3339400791 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c009690 con 0x7f6920003f30 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.703+0000 7f693e47e640 1 -- 172.21.15.139:0/3339400791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920003f30 msgr2=0x7f6920004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.703+0000 7f693e47e640 1 --2- 172.21.15.139:0/3339400791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920003f30 0x7f6920004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f692c009ac0 tx=0x7f6920005830 comp rx=0 tx=0).stop 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.703+0000 7f693ca1b640 1 -- 172.21.15.139:0/3339400791 reap_dead start 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.703+0000 7f693e47e640 1 -- 172.21.15.139:0/3339400791 shutdown_connections 2024-04-26T17:58:01.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.703+0000 7f693e47e640 1 -- 172.21.15.139:0/3339400791 >> 172.21.15.139:0/3339400791 conn(0x7f693806fc00 msgr2=0x7f6938070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:01.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.703+0000 7f693e47e640 1 -- 172.21.15.139:0/3339400791 shutdown_connections 2024-04-26T17:58:01.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.703+0000 7f693e47e640 1 -- 172.21.15.139:0/3339400791 wait complete. 2024-04-26T17:58:01.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.704+0000 7f693e47e640 1 Processor -- start 2024-04-26T17:58:01.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.704+0000 7f693e47e640 1 -- start start 2024-04-26T17:58:01.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6920003f30 0x7f693814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f693815a660 0x7f69380cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f693814ccc0 0x7f6938149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6938072060 con 0x7f693814ccc0 2024-04-26T17:58:01.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f693806f420 con 0x7f693815a660 2024-04-26T17:58:01.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f69380721e0 con 0x7f6920003f30 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f693814ccc0 0x7f6938149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f693814ccc0 0x7f6938149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54714/0 (socket says 172.21.15.139:54714) 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 -- 172.21.15.139:0/3803074989 learned_addr learned my addr 172.21.15.139:0/3803074989 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f6937fff640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6920003f30 0x7f693814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f69377fe640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f693815a660 0x7f69380cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 -- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6920003f30 msgr2=0x7f693814bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6920003f30 0x7f693814bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 -- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f693815a660 msgr2=0x7f69380cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f693815a660 0x7f69380cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 -- 172.21.15.139:0/3803074989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693814ace0 con 0x7f693814ccc0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693ca1b640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f693814ccc0 0x7f6938149a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f69300013d0 tx=0x7f693000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f6934ff9640 1 -- 172.21.15.139:0/3803074989 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693000edd0 con 0x7f693814ccc0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f6934ff9640 1 -- 172.21.15.139:0/3803074989 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6930014430 con 0x7f693814ccc0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f6934ff9640 1 -- 172.21.15.139:0/3803074989 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930014820 con 0x7f693814ccc0 2024-04-26T17:58:01.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693814d7f0 con 0x7f693814ccc0 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.705+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6938159e60 con 0x7f693814ccc0 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.706+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6938076d20 con 0x7f693814ccc0 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.707+0000 7f6934ff9640 1 -- 172.21.15.139:0/3803074989 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69300149c0 con 0x7f693814ccc0 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.707+0000 7f6934ff9640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f692406c8f0 0x7f692406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.707+0000 7f6934ff9640 1 -- 172.21.15.139:0/3803074989 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f693008b610 con 0x7f693814ccc0 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.707+0000 7f6937fff640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f692406c8f0 0x7f692406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.708+0000 7f6937fff640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f692406c8f0 0x7f692406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6928009a60 tx=0x7f6928008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.712+0000 7f6934ff9640 1 -- 172.21.15.139:0/3803074989 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6930059740 con 0x7f693814ccc0 2024-04-26T17:58:01.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:01.886+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f693806eba0 con 0x7f693814ccc0 2024-04-26T17:58:02.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.688+0000 7f6934ff9640 1 -- 172.21.15.139:0/3803074989 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f693005da40 con 0x7f693814ccc0 2024-04-26T17:58:02.689 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' created 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f692406c8f0 msgr2=0x7f692406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f692406c8f0 0x7f692406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6928009a60 tx=0x7f6928008040 comp rx=0 tx=0).stop 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f693814ccc0 msgr2=0x7f6938149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f693814ccc0 0x7f6938149a20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f69300013d0 tx=0x7f693000e530 comp rx=0 tx=0).stop 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 shutdown_connections 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f692406c8f0 0x7f692406edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f693814ccc0 0x7f6938149a20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f693815a660 0x7f69380cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 --2- 172.21.15.139:0/3803074989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6920003f30 0x7f693814bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 >> 172.21.15.139:0/3803074989 conn(0x7f693806fc00 msgr2=0x7f69380c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:02.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.691+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 shutdown_connections 2024-04-26T17:58:02.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.692+0000 7f693e47e640 1 -- 172.21.15.139:0/3803074989 wait complete. 2024-04-26T17:58:02.707 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T17:58:02.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.813+0000 7f12fbc25640 1 Processor -- start 2024-04-26T17:58:02.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.813+0000 7f12fbc25640 1 -- start start 2024-04-26T17:58:02.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12fbc25640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12f4155e70 0x7f12f40c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:02.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12fbc25640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f4156250 con 0x7f12f40c9be0 2024-04-26T17:58:02.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12fbc25640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f415bac0 con 0x7f12f40c4740 2024-04-26T17:58:02.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12fbc25640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f12f415c670 con 0x7f12f4155e70 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12f99c1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12f4155e70 0x7f12f40c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12f99c1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12f4155e70 0x7f12f40c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54722/0 (socket says 172.21.15.139:54722) 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12f91c0640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f12f40c9be0 0x7f12f40cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55596/0 (socket says 172.21.15.139:55596) 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12f99c1640 1 -- 172.21.15.139:0/3479229896 learned_addr learned my addr 172.21.15.139:0/3479229896 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12f99c1640 1 -- 172.21.15.139:0/3479229896 >> v1:172.21.15.143:6789/0 conn(0x7f12f40c4740 legacy=0x7f12f4166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12f99c1640 1 -- 172.21.15.139:0/3479229896 >> v1:172.21.15.139:6789/0 conn(0x7f12f40c9be0 legacy=0x7f12f40cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.814+0000 7f12f99c1640 1 -- 172.21.15.139:0/3479229896 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f4070ac0 con 0x7f12f4155e70 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.815+0000 7f12f99c1640 1 --2- 172.21.15.139:0/3479229896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f4155e70 0x7f12f40c4200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f002a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af1d3d4494db8b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.815+0000 7f12f89bf640 1 -- 172.21.15.139:0/3479229896 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0036070 con 0x7f12f4155e70 2024-04-26T17:58:02.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.815+0000 7f12f89bf640 1 -- 172.21.15.139:0/3479229896 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f0031600 con 0x7f12f4155e70 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.815+0000 7f12f89bf640 1 -- 172.21.15.139:0/3479229896 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00319d0 con 0x7f12f4155e70 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.816+0000 7f12fbc25640 1 -- 172.21.15.139:0/3479229896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f4155e70 msgr2=0x7f12f40c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.816+0000 7f12fbc25640 1 --2- 172.21.15.139:0/3479229896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f4155e70 0x7f12f40c4200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f002a7f0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.816+0000 7f12fbc25640 1 -- 172.21.15.139:0/3479229896 shutdown_connections 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.816+0000 7f12fbc25640 1 --2- 172.21.15.139:0/3479229896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f4155e70 0x7f12f40c4200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.816+0000 7f12fbc25640 1 -- 172.21.15.139:0/3479229896 >> 172.21.15.139:0/3479229896 conn(0x7f12f4068090 msgr2=0x7f12f4068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.816+0000 7f12fbc25640 1 -- 172.21.15.139:0/3479229896 shutdown_connections 2024-04-26T17:58:02.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.816+0000 7f12fbc25640 1 -- 172.21.15.139:0/3479229896 wait complete. 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.817+0000 7f12fbc25640 1 Processor -- start 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.817+0000 7f12fbc25640 1 -- start start 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f40c4740 0x7f12f40c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12f40c9be0 0x7f12f40c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12f4155e70 0x7f12f41e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12f415c300 con 0x7f12f40c4740 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f12f415c020 con 0x7f12f40c9be0 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f12f4070e90 con 0x7f12f4155e70 2024-04-26T17:58:02.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f40c4740 0x7f12f40c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f40c4740 0x7f12f40c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54738/0 (socket says 172.21.15.139:54738) 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 -- 172.21.15.139:0/2723942764 learned_addr learned my addr 172.21.15.139:0/2723942764 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 -- 172.21.15.139:0/2723942764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12f4155e70 msgr2=0x7f12f41e8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12f4155e70 0x7f12f41e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 -- 172.21.15.139:0/2723942764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12f40c9be0 msgr2=0x7f12f40c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12f40c9be0 0x7f12f40c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 -- 172.21.15.139:0/2723942764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f40c74c0 con 0x7f12f40c4740 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12f99c1640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f40c4740 0x7f12f40c6350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12ea7fc640 1 -- 172.21.15.139:0/2723942764 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f003f070 con 0x7f12f40c4740 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12ea7fc640 1 -- 172.21.15.139:0/2723942764 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f003b690 con 0x7f12f40c4740 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f415fef0 con 0x7f12f40c4740 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12ea7fc640 1 -- 172.21.15.139:0/2723942764 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0036040 con 0x7f12f40c4740 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.818+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f415fc10 con 0x7f12f40c4740 2024-04-26T17:58:02.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.819+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f4076d20 con 0x7f12f40c4740 2024-04-26T17:58:02.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.820+0000 7f12ea7fc640 1 -- 172.21.15.139:0/2723942764 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12f0042070 con 0x7f12f40c4740 2024-04-26T17:58:02.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.820+0000 7f12ea7fc640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12d806c920 0x7f12d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:02.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.820+0000 7f12f91c0640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12d806c920 0x7f12d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:02.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.820+0000 7f12ea7fc640 1 -- 172.21.15.139:0/2723942764 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f12f00ac1d0 con 0x7f12f40c4740 2024-04-26T17:58:02.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.821+0000 7f12f91c0640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12d806c920 0x7f12d806ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12e4000f60 tx=0x7f12e4007a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:02.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:02.825+0000 7f12ea7fc640 1 -- 172.21.15.139:0/2723942764 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12f415fef0 con 0x7f12f40c4740 2024-04-26T17:58:03.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.003+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f12f40ca0c0 con 0x7f12f40c4740 2024-04-26T17:58:03.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.695+0000 7f12ea7fc640 1 -- 172.21.15.139:0/2723942764 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f12f415bac0 con 0x7f12f40c4740 2024-04-26T17:58:03.695 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' created 2024-04-26T17:58:03.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12d806c920 msgr2=0x7f12d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12d806c920 0x7f12d806ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12e4000f60 tx=0x7f12e4007a00 comp rx=0 tx=0).stop 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f40c4740 msgr2=0x7f12f40c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f40c4740 0x7f12f40c6350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009e50 tx=0x7f12f0004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 shutdown_connections 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12d806c920 0x7f12d806ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12f4155e70 0x7f12f41e8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12f40c9be0 0x7f12f40c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 --2- 172.21.15.139:0/2723942764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12f40c4740 0x7f12f40c6350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 >> 172.21.15.139:0/2723942764 conn(0x7f12f4068090 msgr2=0x7f12f4068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 shutdown_connections 2024-04-26T17:58:03.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.697+0000 7f12fbc25640 1 -- 172.21.15.139:0/2723942764 wait complete. 2024-04-26T17:58:03.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T17:58:03.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.820+0000 7fab387c1640 1 Processor -- start 2024-04-26T17:58:03.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.821+0000 7fab387c1640 1 -- start start 2024-04-26T17:58:03.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.821+0000 7fab387c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab300d18f0 0x7fab3015fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.821+0000 7fab387c1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fab300cd620 0x7fab300c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.821+0000 7fab387c1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab300ce5e0 con 0x7fab300d1510 2024-04-26T17:58:03.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.821+0000 7fab387c1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fab300ce8c0 con 0x7fab300cd620 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.821+0000 7fab387c1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fab300ceba0 con 0x7fab300d18f0 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fab300cd620 0x7fab300c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fab300cd620 0x7fab300c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54742/0 (socket says 172.21.15.139:54742) 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 -- 172.21.15.139:0/1409130005 learned_addr learned my addr 172.21.15.139:0/1409130005 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab3655d640 1 --1- 172.21.15.139:0/1409130005 >> v1:172.21.15.139:6789/0 conn(0x7fab300d1510 0x7fab300cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55598/0 (socket says 172.21.15.139:55598) 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab35d5c640 1 --2- 172.21.15.139:0/1409130005 >> v2:172.21.15.143:3300/0 conn(0x7fab300d18f0 0x7fab3015fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 -- 172.21.15.139:0/1409130005 >> v2:172.21.15.143:3300/0 conn(0x7fab300d18f0 msgr2=0x7fab3015fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 --2- 172.21.15.139:0/1409130005 >> v2:172.21.15.143:3300/0 conn(0x7fab300d18f0 0x7fab3015fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 -- 172.21.15.139:0/1409130005 >> v1:172.21.15.139:6789/0 conn(0x7fab300d1510 legacy=0x7fab300cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 -- 172.21.15.139:0/1409130005 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3015f100 con 0x7fab300cd620 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab3555b640 1 -- 172.21.15.139:0/1409130005 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148151504 0 0) 0x7fab300ce5e0 con 0x7fab300d1510 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab35d5c640 1 --2- 172.21.15.139:0/1409130005 >> v2:172.21.15.143:3300/0 conn(0x7fab300d18f0 0x7fab3015fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.822+0000 7fab36d5e640 1 --2- 172.21.15.139:0/1409130005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300cd620 0x7fab300c61f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab30073510 tx=0x7fab2802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2d5463a34aa1f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab3555b640 1 -- 172.21.15.139:0/1409130005 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28036070 con 0x7fab300cd620 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab3555b640 1 -- 172.21.15.139:0/1409130005 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab28031600 con 0x7fab300cd620 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab3555b640 1 -- 172.21.15.139:0/1409130005 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab280319f0 con 0x7fab300cd620 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 -- 172.21.15.139:0/1409130005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300cd620 msgr2=0x7fab300c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 --2- 172.21.15.139:0/1409130005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300cd620 0x7fab300c61f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fab30073510 tx=0x7fab2802a7c0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 -- 172.21.15.139:0/1409130005 shutdown_connections 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 --2- 172.21.15.139:0/1409130005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300cd620 0x7fab300c61f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 --2- 172.21.15.139:0/1409130005 >> v2:172.21.15.143:3300/0 conn(0x7fab300d18f0 0x7fab3015fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 -- 172.21.15.139:0/1409130005 >> 172.21.15.139:0/1409130005 conn(0x7fab30072930 msgr2=0x7fab30072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:03.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 -- 172.21.15.139:0/1409130005 shutdown_connections 2024-04-26T17:58:03.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.823+0000 7fab387c1640 1 -- 172.21.15.139:0/1409130005 wait complete. 2024-04-26T17:58:03.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.824+0000 7fab387c1640 1 Processor -- start 2024-04-26T17:58:03.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.824+0000 7fab387c1640 1 -- start start 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab387c1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab300cd620 0x7fab3015e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab387c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300d1510 0x7fab3015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab387c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab300d18f0 0x7fab3014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab387c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fab300ccc70 con 0x7fab300d1510 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab387c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fab3015f6c0 con 0x7fab300d18f0 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab387c1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fab30155860 con 0x7fab300cd620 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300d1510 0x7fab3015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300d1510 0x7fab3015cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54744/0 (socket says 172.21.15.139:54744) 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 -- 172.21.15.139:0/3478589784 learned_addr learned my addr 172.21.15.139:0/3478589784 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:03.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab3655d640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab300cd620 0x7fab3015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab36d5e640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab300d18f0 0x7fab3014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 -- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab300cd620 msgr2=0x7fab3015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab300cd620 0x7fab3015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 -- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab300d18f0 msgr2=0x7fab3014b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab300d18f0 0x7fab3014b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.825+0000 7fab35d5c640 1 -- 172.21.15.139:0/3478589784 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab301f11c0 con 0x7fab300d1510 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.826+0000 7fab35d5c640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300d1510 0x7fab3015cc30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c820 tx=0x7fab2c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.826+0000 7fab22ffd640 1 -- 172.21.15.139:0/3478589784 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c015070 con 0x7fab300d1510 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.826+0000 7fab22ffd640 1 -- 172.21.15.139:0/3478589784 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c007a30 con 0x7fab300d1510 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.826+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab301f51e0 con 0x7fab300d1510 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.826+0000 7fab22ffd640 1 -- 172.21.15.139:0/3478589784 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c007e00 con 0x7fab300d1510 2024-04-26T17:58:03.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.826+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab301f1480 con 0x7fab300d1510 2024-04-26T17:58:03.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.827+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab30076d20 con 0x7fab300d1510 2024-04-26T17:58:03.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.827+0000 7fab22ffd640 1 -- 172.21.15.139:0/3478589784 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab2c018070 con 0x7fab300d1510 2024-04-26T17:58:03.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.827+0000 7fab22ffd640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab1406c920 0x7fab1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.828+0000 7fab22ffd640 1 -- 172.21.15.139:0/3478589784 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fab2c08b890 con 0x7fab300d1510 2024-04-26T17:58:03.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.828+0000 7fab3655d640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab1406c920 0x7fab1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.828+0000 7fab3655d640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab1406c920 0x7fab1406ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab24000f60 tx=0x7fab24007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:03.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:03.832+0000 7fab22ffd640 1 -- 172.21.15.139:0/3478589784 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab2c059d20 con 0x7fab300d1510 2024-04-26T17:58:04.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.045+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fab301536b0 con 0x7fab300d1510 2024-04-26T17:58:04.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.697+0000 7fab22ffd640 1 -- 172.21.15.139:0/3478589784 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fab2c059620 con 0x7fab300d1510 2024-04-26T17:58:04.699 INFO:teuthology.orchestra.run.smithi139.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T17:58:04.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.701+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab1406c920 msgr2=0x7fab1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:04.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.701+0000 7fab387c1640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab1406c920 0x7fab1406ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab24000f60 tx=0x7fab24007b50 comp rx=0 tx=0).stop 2024-04-26T17:58:04.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.701+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300d1510 msgr2=0x7fab3015cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:04.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.701+0000 7fab387c1640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300d1510 0x7fab3015cc30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00c820 tx=0x7fab2c00cce0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.702+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 shutdown_connections 2024-04-26T17:58:04.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.702+0000 7fab387c1640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab1406c920 0x7fab1406ede0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab24000f60 tx=0x7fab24007b50 comp rx=0 tx=0).stop 2024-04-26T17:58:04.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.702+0000 7fab387c1640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab300d18f0 0x7fab3014b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.702+0000 7fab387c1640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab300d1510 0x7fab3015cc30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.702+0000 7fab387c1640 1 --2- 172.21.15.139:0/3478589784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab300cd620 0x7fab3015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.702+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 >> 172.21.15.139:0/3478589784 conn(0x7fab30072930 msgr2=0x7fab300c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:04.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.704+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 shutdown_connections 2024-04-26T17:58:04.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.704+0000 7fab387c1640 1 -- 172.21.15.139:0/3478589784 wait complete. 2024-04-26T17:58:04.730 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T17:58:04.730 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T17:58:04.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:04.831 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:04.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.835+0000 7ffb76a5b640 1 Processor -- start 2024-04-26T17:58:04.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.835+0000 7ffb76a5b640 1 -- start start 2024-04-26T17:58:04.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb76a5b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ffb70155f20 0x7ffb7015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:04.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb76a5b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb700cc220 0x7ffb700c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:04.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb76a5b640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7015bfe0 con 0x7ffb700cd890 2024-04-26T17:58:04.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb76a5b640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ffb7015cbf0 con 0x7ffb70155f20 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb76a5b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffb701601a0 con 0x7ffb700cc220 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb6ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ffb70155f20 0x7ffb7015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb6f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ffb700cd890 0x7ffb700d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55604/0 (socket says 172.21.15.139:55604) 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb6ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ffb70155f20 0x7ffb7015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54746/0 (socket says 172.21.15.139:54746) 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb6f7fe640 1 -- 172.21.15.139:0/1687242168 learned_addr learned my addr 172.21.15.139:0/1687242168 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.836+0000 7ffb74ff8640 1 --2- 172.21.15.139:0/1687242168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb700cc220 0x7ffb700c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6ffff640 1 -- 172.21.15.139:0/1687242168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb700cc220 msgr2=0x7ffb700c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6ffff640 1 --2- 172.21.15.139:0/1687242168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb700cc220 0x7ffb700c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6ffff640 1 -- 172.21.15.139:0/1687242168 >> v1:172.21.15.139:6789/0 conn(0x7ffb700cd890 legacy=0x7ffb700d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6ffff640 1 -- 172.21.15.139:0/1687242168 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7015c2c0 con 0x7ffb70155f20 2024-04-26T17:58:04.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6effd640 1 -- 172.21.15.139:0/1687242168 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943793157 0 0) 0x7ffb7015bfe0 con 0x7ffb700cd890 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6ffff640 1 --2- 172.21.15.139:0/1687242168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb70155f20 0x7ffb7015fc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb640097a0 tx=0x7ffb6402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78189178c98cbb69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6effd640 1 -- 172.21.15.139:0/1687242168 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64037070 con 0x7ffb70155f20 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6effd640 1 -- 172.21.15.139:0/1687242168 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb64032440 con 0x7ffb70155f20 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.837+0000 7ffb6effd640 1 -- 172.21.15.139:0/1687242168 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64032810 con 0x7ffb70155f20 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 -- 172.21.15.139:0/1687242168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb70155f20 msgr2=0x7ffb7015fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/1687242168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb70155f20 0x7ffb7015fc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb640097a0 tx=0x7ffb6402a210 comp rx=0 tx=0).stop 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 -- 172.21.15.139:0/1687242168 shutdown_connections 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/1687242168 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb700cc220 0x7ffb700c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/1687242168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb70155f20 0x7ffb7015fc60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 -- 172.21.15.139:0/1687242168 >> 172.21.15.139:0/1687242168 conn(0x7ffb70068090 msgr2=0x7ffb700684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 -- 172.21.15.139:0/1687242168 shutdown_connections 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.838+0000 7ffb76a5b640 1 -- 172.21.15.139:0/1687242168 wait complete. 2024-04-26T17:58:04.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.839+0000 7ffb76a5b640 1 Processor -- start 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.839+0000 7ffb76a5b640 1 -- start start 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb76a5b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb700cc220 0x7ffb7014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb76a5b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb700cd890 0x7ffb7014c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb76a5b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155f20 0x7ffb70158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb76a5b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7015bcb0 con 0x7ffb700cd890 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb76a5b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7015c880 con 0x7ffb700cc220 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb76a5b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffb70156300 con 0x7ffb70155f20 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb700cd890 0x7ffb7014c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb700cd890 0x7ffb7014c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54760/0 (socket says 172.21.15.139:54760) 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb6f7fe640 1 -- 172.21.15.139:0/3138495249 learned_addr learned my addr 172.21.15.139:0/3138495249 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb74ff8640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155f20 0x7ffb70158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.840+0000 7ffb6ffff640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb700cc220 0x7ffb7014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:04.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6f7fe640 1 -- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155f20 msgr2=0x7ffb70158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6f7fe640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155f20 0x7ffb70158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6f7fe640 1 -- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb700cc220 msgr2=0x7ffb7014bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6f7fe640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb700cc220 0x7ffb7014bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6f7fe640 1 -- 172.21.15.139:0/3138495249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb70153510 con 0x7ffb700cd890 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6f7fe640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb700cd890 0x7ffb7014c1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000c500 tx=0x7ffb6000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6cff9640 1 -- 172.21.15.139:0/3138495249 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60018070 con 0x7ffb700cd890 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6cff9640 1 -- 172.21.15.139:0/3138495249 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb60007580 con 0x7ffb700cd890 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb6cff9640 1 -- 172.21.15.139:0/3138495249 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60004a20 con 0x7ffb700cd890 2024-04-26T17:58:04.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb701f1a40 con 0x7ffb700cd890 2024-04-26T17:58:04.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.841+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb701f1fc0 con 0x7ffb700cd890 2024-04-26T17:58:04.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.842+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb70069ae0 con 0x7ffb700cd890 2024-04-26T17:58:04.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.842+0000 7ffb6cff9640 1 -- 172.21.15.139:0/3138495249 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb60004bc0 con 0x7ffb700cd890 2024-04-26T17:58:04.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.843+0000 7ffb6cff9640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffb5c06c8f0 0x7ffb5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:04.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.843+0000 7ffb6cff9640 1 -- 172.21.15.139:0/3138495249 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7ffb6008ad30 con 0x7ffb700cd890 2024-04-26T17:58:04.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.843+0000 7ffb6ffff640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffb5c06c8f0 0x7ffb5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:04.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.843+0000 7ffb6ffff640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffb5c06c8f0 0x7ffb5c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffb64034000 tx=0x7ffb6402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:04.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:04.847+0000 7ffb6cff9640 1 -- 172.21.15.139:0/3138495249 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb60058b10 con 0x7ffb700cd890 2024-04-26T17:58:05.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.035+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ffb700caf20 con 0x7ffb700cd890 2024-04-26T17:58:05.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.699+0000 7ffb6cff9640 1 -- 172.21.15.139:0/3138495249 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7ffb700caf20 con 0x7ffb700cd890 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.702+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffb5c06c8f0 msgr2=0x7ffb5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.702+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffb5c06c8f0 0x7ffb5c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffb64034000 tx=0x7ffb6402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb700cd890 msgr2=0x7ffb7014c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb700cd890 0x7ffb7014c1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000c500 tx=0x7ffb6000c9c0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 shutdown_connections 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffb5c06c8f0 0x7ffb5c06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb70155f20 0x7ffb70158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb700cd890 0x7ffb7014c1e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 --2- 172.21.15.139:0/3138495249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb700cc220 0x7ffb7014bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 >> 172.21.15.139:0/3138495249 conn(0x7ffb70068090 msgr2=0x7ffb700ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 shutdown_connections 2024-04-26T17:58:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.703+0000 7ffb76a5b640 1 -- 172.21.15.139:0/3138495249 wait complete. 2024-04-26T17:58:05.716 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T17:58:05.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.826+0000 7f11942c8640 1 Processor -- start 2024-04-26T17:58:05.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.826+0000 7f11942c8640 1 -- start start 2024-04-26T17:58:05.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f11942c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f118c0c64b0 0x7f118c0c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:05.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f11942c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c0c6900 0x7f118c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:05.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f11942c8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c156200 con 0x7f118c155e20 2024-04-26T17:58:05.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f11942c8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f118c0cd550 con 0x7f118c0c64b0 2024-04-26T17:58:05.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f11942c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f118c15c330 con 0x7f118c0c6900 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1191863640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f118c0c64b0 0x7f118c0c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1192865640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c0c6900 0x7f118c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1191863640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f118c0c64b0 0x7f118c0c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:43248/0 (socket says 172.21.15.139:43248) 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1192064640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f118c155e20 0x7f118c15bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:40252/0 (socket says 172.21.15.139:40252) 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1191863640 1 -- 172.21.15.139:0/799701805 learned_addr learned my addr 172.21.15.139:0/799701805 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1191863640 1 -- 172.21.15.139:0/799701805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c0c6900 msgr2=0x7f118c0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1191863640 1 --2- 172.21.15.139:0/799701805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c0c6900 0x7f118c0cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1191863640 1 -- 172.21.15.139:0/799701805 >> v1:172.21.15.143:6789/0 conn(0x7f118c155e20 legacy=0x7f118c15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.827+0000 7f1191863640 1 -- 172.21.15.139:0/799701805 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c15c610 con 0x7f118c0c64b0 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.828+0000 7f1191863640 1 --2- 172.21.15.139:0/799701805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c64b0 0x7f118c0c77f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f117c009870 tx=0x7f117c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5de9b667be22d77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.828+0000 7f1191062640 1 -- 172.21.15.139:0/799701805 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c037070 con 0x7f118c0c64b0 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.828+0000 7f1191062640 1 -- 172.21.15.139:0/799701805 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c032440 con 0x7f118c0c64b0 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.828+0000 7f1191062640 1 -- 172.21.15.139:0/799701805 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c032810 con 0x7f118c0c64b0 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 -- 172.21.15.139:0/799701805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c64b0 msgr2=0x7f118c0c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 --2- 172.21.15.139:0/799701805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c64b0 0x7f118c0c77f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f117c009870 tx=0x7f117c02a270 comp rx=0 tx=0).stop 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 -- 172.21.15.139:0/799701805 shutdown_connections 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 --2- 172.21.15.139:0/799701805 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c0c6900 0x7f118c0cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 --2- 172.21.15.139:0/799701805 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c64b0 0x7f118c0c77f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 -- 172.21.15.139:0/799701805 >> 172.21.15.139:0/799701805 conn(0x7f118c072930 msgr2=0x7f118c072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 -- 172.21.15.139:0/799701805 shutdown_connections 2024-04-26T17:58:05.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.829+0000 7f11942c8640 1 -- 172.21.15.139:0/799701805 wait complete. 2024-04-26T17:58:05.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.830+0000 7f11942c8640 1 Processor -- start 2024-04-26T17:58:05.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.830+0000 7f11942c8640 1 -- start start 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f11942c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f118c0c64b0 0x7f118c0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f11942c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c6900 0x7f118c152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f11942c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c155e20 0x7f118c147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f11942c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f118c0c72d0 con 0x7f118c0c64b0 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f11942c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f118c0c6ff0 con 0x7f118c0c6900 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f11942c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f118c0c7d30 con 0x7f118c155e20 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f118c0c64b0 0x7f118c0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f118c0c64b0 0x7f118c0d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54764/0 (socket says 172.21.15.139:54764) 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 -- 172.21.15.139:0/3635463912 learned_addr learned my addr 172.21.15.139:0/3635463912 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1191863640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c6900 0x7f118c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192865640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c155e20 0x7f118c147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:05.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 -- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c155e20 msgr2=0x7f118c147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c155e20 0x7f118c147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 -- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c6900 msgr2=0x7f118c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c6900 0x7f118c152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 -- 172.21.15.139:0/3635463912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c14edd0 con 0x7f118c0c64b0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1191863640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c6900 0x7f118c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.831+0000 7f1192064640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f118c0c64b0 0x7f118c0d0380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f118800c3c0 tx=0x7f118800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.832+0000 7f1182ffd640 1 -- 172.21.15.139:0/3635463912 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11880074e0 con 0x7f118c0c64b0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.832+0000 7f1182ffd640 1 -- 172.21.15.139:0/3635463912 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1188007680 con 0x7f118c0c64b0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.832+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c14f0b0 con 0x7f118c0c64b0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.832+0000 7f1182ffd640 1 -- 172.21.15.139:0/3635463912 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188004a00 con 0x7f118c0c64b0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.832+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c153450 con 0x7f118c0c64b0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.833+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118c076d20 con 0x7f118c0c64b0 2024-04-26T17:58:05.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.833+0000 7f1182ffd640 1 -- 172.21.15.139:0/3635463912 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f118801a020 con 0x7f118c0c64b0 2024-04-26T17:58:05.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.834+0000 7f1182ffd640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117006c8f0 0x7f117006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:05.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.834+0000 7f1191863640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117006c8f0 0x7f117006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:05.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.834+0000 7f1182ffd640 1 -- 172.21.15.139:0/3635463912 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f118808b460 con 0x7f118c0c64b0 2024-04-26T17:58:05.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.834+0000 7f1191863640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117006c8f0 0x7f117006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f117c034000 tx=0x7f117c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:05.838+0000 7f1182ffd640 1 -- 172.21.15.139:0/3635463912 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11880596d0 con 0x7f118c0c64b0 2024-04-26T17:58:06.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:06.016+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f118c15aea0 con 0x7f118c0c64b0 2024-04-26T17:58:07.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.715+0000 7f1182ffd640 1 -- 172.21.15.139:0/3635463912 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f1188058fd0 con 0x7f118c0c64b0 2024-04-26T17:58:07.715 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data_ec' created 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.718+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117006c8f0 msgr2=0x7f117006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.718+0000 7f11942c8640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117006c8f0 0x7f117006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f117c034000 tx=0x7f117c02e000 comp rx=0 tx=0).stop 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.718+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f118c0c64b0 msgr2=0x7f118c0d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.718+0000 7f11942c8640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f118c0c64b0 0x7f118c0d0380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f118800c3c0 tx=0x7f118800c880 comp rx=0 tx=0).stop 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 shutdown_connections 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117006c8f0 0x7f117006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f118c155e20 0x7f118c147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f118c0c6900 0x7f118c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 --2- 172.21.15.139:0/3635463912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f118c0c64b0 0x7f118c0d0380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 >> 172.21.15.139:0/3635463912 conn(0x7f118c072930 msgr2=0x7f118c0c8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 shutdown_connections 2024-04-26T17:58:07.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.719+0000 7f11942c8640 1 -- 172.21.15.139:0/3635463912 wait complete. 2024-04-26T17:58:07.738 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T17:58:07.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.843+0000 7f572219e640 1 Processor -- start 2024-04-26T17:58:07.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.843+0000 7f572219e640 1 -- start start 2024-04-26T17:58:07.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f572219e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 0x7f571c0c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f572219e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c0c5f60 con 0x7f571c06f110 2024-04-26T17:58:07.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f572219e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c152540 con 0x7f571c15b650 2024-04-26T17:58:07.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f572219e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f571c06ddb0 con 0x7f571c152160 2024-04-26T17:58:07.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571affd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f571c06f110 0x7f571c072a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55606/0 (socket says 172.21.15.139:55606) 2024-04-26T17:58:07.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571affd640 1 -- 172.21.15.139:0/3214167079 learned_addr learned my addr 172.21.15.139:0/3214167079 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:07.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571b7fe640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 0x7f571c0c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246982102 0 0) 0x7f571c0c5f60 con 0x7f571c06f110 2024-04-26T17:58:07.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5704003520 con 0x7f571c06f110 2024-04-26T17:58:07.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722415732 0 0) 0x7f5714001490 con 0x7f571c15b650 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f571c0c5f60 con 0x7f571c15b650 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.844+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3710229615 0 0) 0x7f5704003520 con 0x7f571c06f110 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 msgr2=0x7f571c0c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 0x7f571c0c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 >> v1:172.21.15.143:6789/0 conn(0x7f571c15b650 legacy=0x7f571c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c06e070 con 0x7f571c06f110 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f5710001670 con 0x7f571c06f110 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 >> v1:172.21.15.139:6789/0 conn(0x7f571c06f110 legacy=0x7f571c072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 0x7f5704003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57040040d0 0x7f5704004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5704004d40 0x7f57040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f571c06ddb0 con 0x7f57040040d0 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f570400cc60 con 0x7f5704004d40 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f570400ce30 con 0x7f571c152160 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571affd640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57040040d0 0x7f5704004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571b7fe640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 0x7f5704003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571bfff640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5704004d40 0x7f57040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571affd640 1 -- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 msgr2=0x7f5704003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571affd640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f571c152160 0x7f5704003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571affd640 1 -- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5704004d40 msgr2=0x7f57040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571affd640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5704004d40 0x7f57040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.845+0000 7f571affd640 1 -- 172.21.15.139:0/3214167079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5704003520 con 0x7f57040040d0 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f571affd640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57040040d0 0x7f5704004800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f571000c190 tx=0x7f5704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfd61ce744caa42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710007cc0 con 0x7f57040040d0 2024-04-26T17:58:07.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5710005af0 con 0x7f57040040d0 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f571a7fc640 1 -- 172.21.15.139:0/3214167079 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710007070 con 0x7f57040040d0 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f572219e640 1 -- 172.21.15.139:0/3214167079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57040040d0 msgr2=0x7f5704004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f572219e640 1 --2- 172.21.15.139:0/3214167079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57040040d0 0x7f5704004800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f571000c190 tx=0x7f5704005830 comp rx=0 tx=0).stop 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f571bfff640 1 -- 172.21.15.139:0/3214167079 reap_dead start 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f572219e640 1 -- 172.21.15.139:0/3214167079 shutdown_connections 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f572219e640 1 -- 172.21.15.139:0/3214167079 >> 172.21.15.139:0/3214167079 conn(0x7f571c06fc00 msgr2=0x7f571c070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f572219e640 1 -- 172.21.15.139:0/3214167079 shutdown_connections 2024-04-26T17:58:07.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.846+0000 7f572219e640 1 -- 172.21.15.139:0/3214167079 wait complete. 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.847+0000 7f572219e640 1 Processor -- start 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f572219e640 1 -- start start 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f572219e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57040040d0 0x7f571c1e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f572219e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0c3b60 0x7f571c1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f572219e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f571c1e21f0 0x7f571c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f572219e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f571c06e910 con 0x7f571c1e21f0 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f572219e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f571c06e630 con 0x7f571c0c3b60 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f572219e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f571c06ebf0 con 0x7f57040040d0 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f571bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f571c1e21f0 0x7f571c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f571bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f571c1e21f0 0x7f571c152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54782/0 (socket says 172.21.15.139:54782) 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.848+0000 7f571bfff640 1 -- 172.21.15.139:0/2205952251 learned_addr learned my addr 172.21.15.139:0/2205952251 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:07.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571affd640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0c3b60 0x7f571c1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571b7fe640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57040040d0 0x7f571c1e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571bfff640 1 -- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57040040d0 msgr2=0x7f571c1e1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571bfff640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57040040d0 0x7f571c1e1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571bfff640 1 -- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0c3b60 msgr2=0x7f571c1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571bfff640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0c3b60 0x7f571c1547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571bfff640 1 -- 172.21.15.139:0/2205952251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c15a9e0 con 0x7f571c1e21f0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571affd640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0c3b60 0x7f571c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f571bfff640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f571c1e21f0 0x7f571c152b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f571c0cafb0 tx=0x7f571400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f5703fff640 1 -- 172.21.15.139:0/2205952251 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714019070 con 0x7f571c1e21f0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f5703fff640 1 -- 172.21.15.139:0/2205952251 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714006e20 con 0x7f571c1e21f0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c15ac80 con 0x7f571c1e21f0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f5703fff640 1 -- 172.21.15.139:0/2205952251 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714003bd0 con 0x7f571c1e21f0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.849+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c15b240 con 0x7f571c1e21f0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.850+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571c076d20 con 0x7f571c1e21f0 2024-04-26T17:58:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.851+0000 7f5703fff640 1 -- 172.21.15.139:0/2205952251 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f571401c070 con 0x7f571c1e21f0 2024-04-26T17:58:07.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.851+0000 7f5703fff640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f570806c8f0 0x7f570806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.851+0000 7f5703fff640 1 -- 172.21.15.139:0/2205952251 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f571408b0c0 con 0x7f571c1e21f0 2024-04-26T17:58:07.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.851+0000 7f571b7fe640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f570806c8f0 0x7f570806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.851+0000 7f571b7fe640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f570806c8f0 0x7f570806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f570c009900 tx=0x7f570c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:07.856+0000 7f5703fff640 1 -- 172.21.15.139:0/2205952251 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f571c152540 con 0x7f571c1e21f0 2024-04-26T17:58:08.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.030+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f571c14e390 con 0x7f571c1e21f0 2024-04-26T17:58:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.717+0000 7f5703fff640 1 -- 172.21.15.139:0/2205952251 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f5714059140 con 0x7f571c1e21f0 2024-04-26T17:58:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T17:58:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.720+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f570806c8f0 msgr2=0x7f570806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.720+0000 7f572219e640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f570806c8f0 0x7f570806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f570c009900 tx=0x7f570c008040 comp rx=0 tx=0).stop 2024-04-26T17:58:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.720+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f571c1e21f0 msgr2=0x7f571c152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.720+0000 7f572219e640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f571c1e21f0 0x7f571c152b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f571c0cafb0 tx=0x7f571400ff70 comp rx=0 tx=0).stop 2024-04-26T17:58:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.721+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 shutdown_connections 2024-04-26T17:58:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.721+0000 7f572219e640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f570806c8f0 0x7f570806edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.721+0000 7f572219e640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f571c1e21f0 0x7f571c152b70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.721+0000 7f572219e640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f571c0c3b60 0x7f571c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.721+0000 7f572219e640 1 --2- 172.21.15.139:0/2205952251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f57040040d0 0x7f571c1e1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.721+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 >> 172.21.15.139:0/2205952251 conn(0x7f571c06fc00 msgr2=0x7f571c070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:08.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.721+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 shutdown_connections 2024-04-26T17:58:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.722+0000 7f572219e640 1 -- 172.21.15.139:0/2205952251 wait complete. 2024-04-26T17:58:08.750 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T17:58:08.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.849+0000 7f7e64ebd640 1 Processor -- start 2024-04-26T17:58:08.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.849+0000 7f7e64ebd640 1 -- start start 2024-04-26T17:58:08.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.850+0000 7f7e64ebd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 0x7f7e600ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.850+0000 7f7e64ebd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e600c9c80 0x7f7e600c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.850+0000 7f7e64ebd640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e60158960 con 0x7f7e600c8b10 2024-04-26T17:58:08.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.850+0000 7f7e64ebd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7e60159830 con 0x7f7e600c9c80 2024-04-26T17:58:08.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.850+0000 7f7e64ebd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7e60158c20 con 0x7f7e60070230 2024-04-26T17:58:08.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.850+0000 7f7e5e59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7e600c8b10 0x7f7e6006fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55620/0 (socket says 172.21.15.139:55620) 2024-04-26T17:58:08.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.850+0000 7f7e5e59c640 1 -- 172.21.15.139:0/3665567800 learned_addr learned my addr 172.21.15.139:0/3665567800 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 0x7f7e600ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5ed9d640 1 --2- 172.21.15.139:0/3665567800 >> v2:172.21.15.143:3300/0 conn(0x7f7e600c9c80 0x7f7e600c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666303803 0 0) 0x7f7e60158960 con 0x7f7e600c8b10 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e48003520 con 0x7f7e600c8b10 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4105922522 0 0) 0x7f7e48003520 con 0x7f7e600c8b10 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 msgr2=0x7f7e600ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 0x7f7e600ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 >> v2:172.21.15.143:3300/0 conn(0x7f7e600c9c80 msgr2=0x7f7e600c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 --2- 172.21.15.139:0/3665567800 >> v2:172.21.15.143:3300/0 conn(0x7f7e600c9c80 0x7f7e600c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e60158f00 con 0x7f7e600c8b10 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f7e500019f0 con 0x7f7e600c8b10 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5ed9d640 1 --2- 172.21.15.139:0/3665567800 >> v2:172.21.15.143:3300/0 conn(0x7f7e600c9c80 0x7f7e600c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 >> v1:172.21.15.139:6789/0 conn(0x7f7e600c8b10 legacy=0x7f7e6006fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e480039b0 0x7f7e48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 0x7f7e480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7e60159830 con 0x7f7e48004800 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7e60158c20 con 0x7f7e480039b0 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4800b9c0 con 0x7f7e60070230 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5e59c640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e480039b0 0x7f7e48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5ed9d640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 0x7f7e480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5dd9b640 1 -- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 msgr2=0x7f7e480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 0x7f7e480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5dd9b640 1 -- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e480039b0 msgr2=0x7f7e48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e480039b0 0x7f7e48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5dd9b640 1 -- 172.21.15.139:0/3665567800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e48003520 con 0x7f7e48004800 2024-04-26T17:58:08.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.851+0000 7f7e5ed9d640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e60070230 0x7f7e480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.852+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e48004c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009a90 tx=0x7f7e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eae588fb5b8c1c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.852+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54036070 con 0x7f7e48004800 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.852+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e54031400 con 0x7f7e48004800 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.852+0000 7f7e5d59a640 1 -- 172.21.15.139:0/3665567800 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54009690 con 0x7f7e48004800 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.853+0000 7f7e64ebd640 1 -- 172.21.15.139:0/3665567800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 msgr2=0x7f7e48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.853+0000 7f7e64ebd640 1 --2- 172.21.15.139:0/3665567800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e48004c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009a90 tx=0x7f7e48005830 comp rx=0 tx=0).stop 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.853+0000 7f7e5ed9d640 1 -- 172.21.15.139:0/3665567800 reap_dead start 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.853+0000 7f7e64ebd640 1 -- 172.21.15.139:0/3665567800 shutdown_connections 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.853+0000 7f7e64ebd640 1 -- 172.21.15.139:0/3665567800 >> 172.21.15.139:0/3665567800 conn(0x7f7e6006dd40 msgr2=0x7f7e6006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.853+0000 7f7e64ebd640 1 -- 172.21.15.139:0/3665567800 shutdown_connections 2024-04-26T17:58:08.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.853+0000 7f7e64ebd640 1 -- 172.21.15.139:0/3665567800 wait complete. 2024-04-26T17:58:08.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.854+0000 7f7e64ebd640 1 Processor -- start 2024-04-26T17:58:08.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.854+0000 7f7e64ebd640 1 -- start start 2024-04-26T17:58:08.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e601f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e601494f0 0x7f7e6015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e600c6a50 0x7f7e6013c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7e600c2020 con 0x7f7e48004800 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7e601594c0 con 0x7f7e601494f0 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7e600cdd30 con 0x7f7e600c6a50 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e601f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e601f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54806/0 (socket says 172.21.15.139:54806) 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 -- 172.21.15.139:0/601130403 learned_addr learned my addr 172.21.15.139:0/601130403 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5ed9d640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e600c6a50 0x7f7e6013c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e601494f0 0x7f7e6015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 -- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e600c6a50 msgr2=0x7f7e6013c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e600c6a50 0x7f7e6013c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 -- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e601494f0 msgr2=0x7f7e6015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e601494f0 0x7f7e6015a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 -- 172.21.15.139:0/601130403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6015cd70 con 0x7f7e48004800 2024-04-26T17:58:08.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e601494f0 0x7f7e6015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5ed9d640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e600c6a50 0x7f7e6013c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e5e59c640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e601f4c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e50007850 tx=0x7f7e5000a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e4effd640 1 -- 172.21.15.139:0/601130403 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e500133f0 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e4effd640 1 -- 172.21.15.139:0/601130403 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e50018070 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e601585e0 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e4effd640 1 -- 172.21.15.139:0/601130403 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e500137d0 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.855+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e60159ea0 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.856+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e60076d20 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.857+0000 7f7e4effd640 1 -- 172.21.15.139:0/601130403 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e50013970 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.857+0000 7f7e4effd640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e4006c8f0 0x7f7e4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.857+0000 7f7e4effd640 1 -- 172.21.15.139:0/601130403 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f7e5008c920 con 0x7f7e48004800 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.857+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e4006c8f0 0x7f7e4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.858+0000 7f7e5dd9b640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e4006c8f0 0x7f7e4006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e54033000 tx=0x7f7e54008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:08.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:08.861+0000 7f7e4effd640 1 -- 172.21.15.139:0/601130403 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e5005a900 con 0x7f7e48004800 2024-04-26T17:58:09.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.075+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f7e6015a070 con 0x7f7e48004800 2024-04-26T17:58:09.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.744+0000 7f7e4effd640 1 -- 172.21.15.139:0/601130403 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f7e5005a200 con 0x7f7e48004800 2024-04-26T17:58:09.744 INFO:teuthology.orchestra.run.smithi139.stderr:added data pool 4 to fsmap 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.747+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e4006c8f0 msgr2=0x7f7e4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.747+0000 7f7e64ebd640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e4006c8f0 0x7f7e4006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e54033000 tx=0x7f7e54008030 comp rx=0 tx=0).stop 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.747+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 msgr2=0x7f7e601f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.747+0000 7f7e64ebd640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e601f4c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e50007850 tx=0x7f7e5000a790 comp rx=0 tx=0).stop 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 shutdown_connections 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e4006c8f0 0x7f7e4006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e600c6a50 0x7f7e6013c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e601494f0 0x7f7e6015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 --2- 172.21.15.139:0/601130403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e48004800 0x7f7e601f4c40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 >> 172.21.15.139:0/601130403 conn(0x7f7e6006dd40 msgr2=0x7f7e60071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 shutdown_connections 2024-04-26T17:58:09.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.748+0000 7f7e64ebd640 1 -- 172.21.15.139:0/601130403 wait complete. 2024-04-26T17:58:09.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:09.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.856+0000 7fc505c85640 1 Processor -- start 2024-04-26T17:58:09.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.856+0000 7fc505c85640 1 -- start start 2024-04-26T17:58:09.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc505c85640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc500153c30 0x7fc50015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc505c85640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc5000cee20 0x7fc5000cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc505c85640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5000cb520 con 0x7fc5000c5110 2024-04-26T17:58:09.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc505c85640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc500068f60 con 0x7fc5000cee20 2024-04-26T17:58:09.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc505c85640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc500068c80 con 0x7fc500153c30 2024-04-26T17:58:09.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc4f6ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc5000cee20 0x7fc5000cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc4fffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc5000c5110 0x7fc5000ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46590/0 (socket says 172.21.15.139:46590) 2024-04-26T17:58:09.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc4f6ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc5000cee20 0x7fc5000cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49340/0 (socket says 172.21.15.139:49340) 2024-04-26T17:58:09.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.857+0000 7fc4fffff640 1 -- 172.21.15.139:0/888285319 learned_addr learned my addr 172.21.15.139:0/888285319 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:09.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4ff7fe640 1 --2- 172.21.15.139:0/888285319 >> v2:172.21.15.143:3300/0 conn(0x7fc500153c30 0x7fc50015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4f6ffd640 1 -- 172.21.15.139:0/888285319 >> v2:172.21.15.143:3300/0 conn(0x7fc500153c30 msgr2=0x7fc50015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:09.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4f6ffd640 1 --2- 172.21.15.139:0/888285319 >> v2:172.21.15.143:3300/0 conn(0x7fc500153c30 0x7fc50015cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4f6ffd640 1 -- 172.21.15.139:0/888285319 >> v1:172.21.15.139:6789/0 conn(0x7fc5000c5110 legacy=0x7fc5000ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4f6ffd640 1 -- 172.21.15.139:0/888285319 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5000c8c60 con 0x7fc5000cee20 2024-04-26T17:58:09.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4feffd640 1 -- 172.21.15.139:0/888285319 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210434235 0 0) 0x7fc5000cb520 con 0x7fc5000c5110 2024-04-26T17:58:09.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4f6ffd640 1 --2- 172.21.15.139:0/888285319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc5000cad70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5000cab90 tx=0x7fc4e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e4020b88f6d2cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:09.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4feffd640 1 -- 172.21.15.139:0/888285319 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8037070 con 0x7fc5000cee20 2024-04-26T17:58:09.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4feffd640 1 -- 172.21.15.139:0/888285319 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e8032440 con 0x7fc5000cee20 2024-04-26T17:58:09.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.858+0000 7fc4feffd640 1 -- 172.21.15.139:0/888285319 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8032810 con 0x7fc5000cee20 2024-04-26T17:58:09.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 -- 172.21.15.139:0/888285319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 msgr2=0x7fc5000cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 --2- 172.21.15.139:0/888285319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc5000cad70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc5000cab90 tx=0x7fc4e802a1a0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 -- 172.21.15.139:0/888285319 shutdown_connections 2024-04-26T17:58:09.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 --2- 172.21.15.139:0/888285319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc5000cad70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 --2- 172.21.15.139:0/888285319 >> v2:172.21.15.143:3300/0 conn(0x7fc500153c30 0x7fc50015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 -- 172.21.15.139:0/888285319 >> 172.21.15.139:0/888285319 conn(0x7fc5000730d0 msgr2=0x7fc5000734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:09.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 -- 172.21.15.139:0/888285319 shutdown_connections 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.859+0000 7fc505c85640 1 -- 172.21.15.139:0/888285319 wait complete. 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.860+0000 7fc505c85640 1 Processor -- start 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.860+0000 7fc505c85640 1 -- start start 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc505c85640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5000c5110 0x7fc5001f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc505c85640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc500147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc505c85640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc500153c30 0x7fc500147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc505c85640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc5000ce7b0 con 0x7fc5000cee20 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc505c85640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc500154010 con 0x7fc5000c5110 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc505c85640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc5000ce930 con 0x7fc500153c30 2024-04-26T17:58:09.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc500147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc500147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49352/0 (socket says 172.21.15.139:49352) 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 -- 172.21.15.139:0/4249174679 learned_addr learned my addr 172.21.15.139:0/4249174679 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4ff7fe640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5000c5110 0x7fc5001f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4fffff640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc500153c30 0x7fc500147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 -- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc500153c30 msgr2=0x7fc500147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc500153c30 0x7fc500147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 -- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5000c5110 msgr2=0x7fc5001f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5000c5110 0x7fc5001f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.861+0000 7fc4f6ffd640 1 -- 172.21.15.139:0/4249174679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50015c560 con 0x7fc5000cee20 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.862+0000 7fc4f6ffd640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc500147400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009890 tx=0x7fc4e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.862+0000 7fc4fcff9640 1 -- 172.21.15.139:0/4249174679 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8037040 con 0x7fc5000cee20 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.862+0000 7fc4fcff9640 1 -- 172.21.15.139:0/4249174679 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e8042070 con 0x7fc5000cee20 2024-04-26T17:58:09.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.862+0000 7fc4fcff9640 1 -- 172.21.15.139:0/4249174679 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8030bd0 con 0x7fc5000cee20 2024-04-26T17:58:09.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.862+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50014ccf0 con 0x7fc5000cee20 2024-04-26T17:58:09.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.862+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5000ce350 con 0x7fc5000cee20 2024-04-26T17:58:09.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.863+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc500076d20 con 0x7fc5000cee20 2024-04-26T17:58:09.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.863+0000 7fc4fcff9640 1 -- 172.21.15.139:0/4249174679 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4e8047460 con 0x7fc5000cee20 2024-04-26T17:58:09.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.864+0000 7fc4fcff9640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4e006c8f0 0x7fc4e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.864+0000 7fc4fcff9640 1 -- 172.21.15.139:0/4249174679 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc4e80aca20 con 0x7fc5000cee20 2024-04-26T17:58:09.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.864+0000 7fc4ff7fe640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4e006c8f0 0x7fc4e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.866+0000 7fc4ff7fe640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4e006c8f0 0x7fc4e006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0006fd0 tx=0x7fc4f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:09.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:09.871+0000 7fc4fcff9640 1 -- 172.21.15.139:0/4249174679 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4e8032e20 con 0x7fc5000cee20 2024-04-26T17:58:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.085+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5000ce590 con 0x7fc5000cee20 2024-04-26T17:58:10.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.085+0000 7fc4fcff9640 1 -- 172.21.15.139:0/4249174679 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6822 (secure 0 0 0) 0x7fc4e8045360 con 0x7fc5000cee20 2024-04-26T17:58:10.086 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:10.087 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:09.736715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:10.088 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 6 2024-04-26T17:58:10.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4e006c8f0 msgr2=0x7fc4e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4e006c8f0 0x7fc4e006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0006fd0 tx=0x7fc4f0008040 comp rx=0 tx=0).stop 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 msgr2=0x7fc500147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc500147400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009890 tx=0x7fc4e80046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 shutdown_connections 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4e006c8f0 0x7fc4e006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc500153c30 0x7fc500147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000cee20 0x7fc500147400 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.087+0000 7fc505c85640 1 --2- 172.21.15.139:0/4249174679 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5000c5110 0x7fc5001f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.088+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 >> 172.21.15.139:0/4249174679 conn(0x7fc5000730d0 msgr2=0x7fc5000734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.088+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 shutdown_connections 2024-04-26T17:58:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.088+0000 7fc505c85640 1 -- 172.21.15.139:0/4249174679 wait complete. 2024-04-26T17:58:10.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.195+0000 7f180c724640 1 Processor -- start 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.195+0000 7f180c724640 1 -- start start 2024-04-26T17:58:10.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f180c724640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 0x7f18040c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f180c724640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18040713e0 con 0x7f1804159960 2024-04-26T17:58:10.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f180c724640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1804070990 con 0x7f1804153de0 2024-04-26T17:58:10.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f180c724640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1804070c70 con 0x7f1804070fc0 2024-04-26T17:58:10.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f180acc1640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1804159960 0x7f1804159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46592/0 (socket says 172.21.15.139:46592) 2024-04-26T17:58:10.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f180acc1640 1 -- 172.21.15.139:0/3653747438 learned_addr learned my addr 172.21.15.139:0/3653747438 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f1809cbf640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 0x7f18040c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265880828 0 0) 0x7f18040713e0 con 0x7f1804159960 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17f0003520 con 0x7f1804159960 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3057158264 0 0) 0x7f17f0003520 con 0x7f1804159960 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 msgr2=0x7f18040c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 0x7f18040c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 >> v1:172.21.15.143:6789/0 conn(0x7f1804153de0 legacy=0x7f18040cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18040ca670 con 0x7f1804159960 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f17fc0019f0 con 0x7f1804159960 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 >> v1:172.21.15.139:6789/0 conn(0x7f1804159960 legacy=0x7f1804159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 0x7f17f00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0003f20 0x7f17f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f0004d40 0x7f17f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1804070c70 con 0x7f17f0004d40 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f17f000ba20 con 0x7f17f0003f20 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17f000bc20 con 0x7f1804070fc0 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f180acc1640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f0004d40 0x7f17f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.196+0000 7f1809cbf640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0003f20 0x7f17f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f180a4c0640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 0x7f17f00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f180acc1640 1 -- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 msgr2=0x7f17f00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f180acc1640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1804070fc0 0x7f17f00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f180acc1640 1 -- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0003f20 msgr2=0x7f17f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f180acc1640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0003f20 0x7f17f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f180acc1640 1 -- 172.21.15.139:0/3653747438 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f0003520 con 0x7f17f0004d40 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f180acc1640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f0004d40 0x7f17f00051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00a880 tx=0x7f17f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54414967c370cd16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.197+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc00a4a0 con 0x7f17f0004d40 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc02f070 con 0x7f17f0004d40 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f18094be640 1 -- 172.21.15.139:0/3653747438 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc02bd20 con 0x7f17f0004d40 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f180c724640 1 -- 172.21.15.139:0/3653747438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f0004d40 msgr2=0x7f17f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f180c724640 1 --2- 172.21.15.139:0/3653747438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f0004d40 0x7f17f00051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00a880 tx=0x7f17f0005830 comp rx=0 tx=0).stop 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f180acc1640 1 -- 172.21.15.139:0/3653747438 reap_dead start 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f180c724640 1 -- 172.21.15.139:0/3653747438 shutdown_connections 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f180c724640 1 -- 172.21.15.139:0/3653747438 >> 172.21.15.139:0/3653747438 conn(0x7f1804076730 msgr2=0x7f1804068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f180c724640 1 -- 172.21.15.139:0/3653747438 shutdown_connections 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.198+0000 7f180c724640 1 -- 172.21.15.139:0/3653747438 wait complete. 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.199+0000 7f180c724640 1 Processor -- start 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.199+0000 7f180c724640 1 -- start start 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180c724640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0004d40 0x7f180414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180c724640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414e5f0 0x7f1804158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180c724640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f180414dd10 0x7f1804158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180c724640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f18040caf10 con 0x7f180414e5f0 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180c724640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f18040cac30 con 0x7f17f0004d40 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180c724640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f18040c63c0 con 0x7f180414dd10 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414e5f0 0x7f1804158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414e5f0 0x7f1804158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49374/0 (socket says 172.21.15.139:49374) 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 -- 172.21.15.139:0/2903063300 learned_addr learned my addr 172.21.15.139:0/2903063300 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180a4c0640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0004d40 0x7f180414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f180acc1640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f180414dd10 0x7f1804158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 -- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f180414dd10 msgr2=0x7f1804158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f180414dd10 0x7f1804158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 -- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0004d40 msgr2=0x7f180414c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0004d40 0x7f180414c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 -- 172.21.15.139:0/2903063300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180414d290 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.200+0000 7f1809cbf640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414e5f0 0x7f1804158570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17f40119a0 tx=0x7f17f4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.201+0000 7f17faffd640 1 -- 172.21.15.139:0/2903063300 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f400fa90 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.201+0000 7f17faffd640 1 -- 172.21.15.139:0/2903063300 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f400fc30 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.201+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180406e010 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.201+0000 7f17faffd640 1 -- 172.21.15.139:0/2903063300 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f4014440 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.201+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180406e2b0 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.202+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1804076d20 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.202+0000 7f17faffd640 1 -- 172.21.15.139:0/2903063300 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17f4012040 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.202+0000 7f17faffd640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17e806c8f0 0x7f17e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.202+0000 7f17faffd640 1 -- 172.21.15.139:0/2903063300 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f17f408c560 con 0x7f180414e5f0 2024-04-26T17:58:10.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.203+0000 7f180a4c0640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17e806c8f0 0x7f17e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.203+0000 7f180a4c0640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17e806c8f0 0x7f17e806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1800003700 tx=0x7f1800009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.207+0000 7f17faffd640 1 -- 172.21.15.139:0/2903063300 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17f4019030 con 0x7f180414e5f0 2024-04-26T17:58:10.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.382+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18040c69d0 con 0x7f180414e5f0 2024-04-26T17:58:10.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.383+0000 7f17faffd640 1 -- 172.21.15.139:0/2903063300 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f17f405a650 con 0x7f180414e5f0 2024-04-26T17:58:10.384 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:10.384 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17e806c8f0 msgr2=0x7f17e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17e806c8f0 0x7f17e806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1800003700 tx=0x7f1800009040 comp rx=0 tx=0).stop 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414e5f0 msgr2=0x7f1804158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414e5f0 0x7f1804158570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17f40119a0 tx=0x7f17f4011e60 comp rx=0 tx=0).stop 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 shutdown_connections 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17e806c8f0 0x7f17e806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f180414dd10 0x7f1804158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f180414e5f0 0x7f1804158570 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 --2- 172.21.15.139:0/2903063300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f0004d40 0x7f180414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.385+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 >> 172.21.15.139:0/2903063300 conn(0x7f1804076730 msgr2=0x7f18040cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.386+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 shutdown_connections 2024-04-26T17:58:10.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.386+0000 7f180c724640 1 -- 172.21.15.139:0/2903063300 wait complete. 2024-04-26T17:58:10.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:10.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.493+0000 7fc493132640 1 Processor -- start 2024-04-26T17:58:10.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.493+0000 7fc493132640 1 -- start start 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc493132640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc48c070fc0 0x7fc48c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc493132640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c159960 0x7fc48c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc493132640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc48c071410 con 0x7fc48c153de0 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc493132640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc48c070990 con 0x7fc48c070fc0 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc493132640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c070c70 con 0x7fc48c159960 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc48bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc48c070fc0 0x7fc48c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc490ece640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc48c153de0 0x7fc48c0cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46606/0 (socket says 172.21.15.139:46606) 2024-04-26T17:58:10.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc490ece640 1 -- 172.21.15.139:0/980932718 learned_addr learned my addr 172.21.15.139:0/980932718 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc48bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc48c070fc0 0x7fc48c0c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49378/0 (socket says 172.21.15.139:49378) 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc4916cf640 1 --2- 172.21.15.139:0/980932718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c159960 0x7fc48c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc48bfff640 1 -- 172.21.15.139:0/980932718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c159960 msgr2=0x7fc48c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc48bfff640 1 --2- 172.21.15.139:0/980932718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c159960 0x7fc48c159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc48bfff640 1 -- 172.21.15.139:0/980932718 >> v1:172.21.15.139:6789/0 conn(0x7fc48c153de0 legacy=0x7fc48c0cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc48b7fe640 1 -- 172.21.15.139:0/980932718 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556518572 0 0) 0x7fc48c071410 con 0x7fc48c153de0 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc48bfff640 1 -- 172.21.15.139:0/980932718 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c0ca670 con 0x7fc48c070fc0 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.494+0000 7fc4916cf640 1 --2- 172.21.15.139:0/980932718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c159960 0x7fc48c159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.495+0000 7fc48bfff640 1 --2- 172.21.15.139:0/980932718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c070fc0 0x7fc48c0c9cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4800097a0 tx=0x7fc48002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb2863b904f05a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.495+0000 7fc48b7fe640 1 -- 172.21.15.139:0/980932718 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480037070 con 0x7fc48c070fc0 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.495+0000 7fc48b7fe640 1 -- 172.21.15.139:0/980932718 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc480032440 con 0x7fc48c070fc0 2024-04-26T17:58:10.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.495+0000 7fc48b7fe640 1 -- 172.21.15.139:0/980932718 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480032810 con 0x7fc48c070fc0 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 -- 172.21.15.139:0/980932718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c070fc0 msgr2=0x7fc48c0c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 --2- 172.21.15.139:0/980932718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c070fc0 0x7fc48c0c9cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4800097a0 tx=0x7fc48002a210 comp rx=0 tx=0).stop 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 -- 172.21.15.139:0/980932718 shutdown_connections 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 --2- 172.21.15.139:0/980932718 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c159960 0x7fc48c159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 --2- 172.21.15.139:0/980932718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c070fc0 0x7fc48c0c9cf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 -- 172.21.15.139:0/980932718 >> 172.21.15.139:0/980932718 conn(0x7fc48c076730 msgr2=0x7fc48c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 -- 172.21.15.139:0/980932718 shutdown_connections 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.496+0000 7fc493132640 1 -- 172.21.15.139:0/980932718 wait complete. 2024-04-26T17:58:10.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.497+0000 7fc493132640 1 Processor -- start 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.497+0000 7fc493132640 1 -- start start 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c070fc0 0x7fc48c1f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc48c153de0 0x7fc48c1f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c159960 0x7fc48c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0caf10 con 0x7fc48c159960 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0cac30 con 0x7fc48c153de0 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c15a2f0 con 0x7fc48c070fc0 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c159960 0x7fc48c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c159960 0x7fc48c14f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49388/0 (socket says 172.21.15.139:49388) 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 -- 172.21.15.139:0/127704456 learned_addr learned my addr 172.21.15.139:0/127704456 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 -- 172.21.15.139:0/127704456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c070fc0 msgr2=0x7fc48c1f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c070fc0 0x7fc48c1f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 -- 172.21.15.139:0/127704456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc48c153de0 msgr2=0x7fc48c1f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc48c153de0 0x7fc48c1f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 -- 172.21.15.139:0/127704456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c14e5e0 con 0x7fc48c159960 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4916cf640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c159960 0x7fc48c14f960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc48400cd80 tx=0x7fc48400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4897fa640 1 -- 172.21.15.139:0/127704456 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48400f680 con 0x7fc48c159960 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4897fa640 1 -- 172.21.15.139:0/127704456 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48400f840 con 0x7fc48c159960 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc4897fa640 1 -- 172.21.15.139:0/127704456 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48400fc30 con 0x7fc48c159960 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c14e8c0 con 0x7fc48c159960 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.498+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c14ee80 con 0x7fc48c159960 2024-04-26T17:58:10.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.499+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48c076d20 con 0x7fc48c159960 2024-04-26T17:58:10.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.500+0000 7fc4897fa640 1 -- 172.21.15.139:0/127704456 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4840213f0 con 0x7fc48c159960 2024-04-26T17:58:10.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.500+0000 7fc4897fa640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc47806c920 0x7fc47806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.500+0000 7fc4897fa640 1 -- 172.21.15.139:0/127704456 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc48408cb20 con 0x7fc48c159960 2024-04-26T17:58:10.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.500+0000 7fc490ece640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc47806c920 0x7fc47806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.501+0000 7fc490ece640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc47806c920 0x7fc47806ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc47c007fd0 tx=0x7fc47c007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.504+0000 7fc4897fa640 1 -- 172.21.15.139:0/127704456 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc484014030 con 0x7fc48c159960 2024-04-26T17:58:10.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.680+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc48c0cfb20 con 0x7fc48c159960 2024-04-26T17:58:10.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.681+0000 7fc4897fa640 1 -- 172.21.15.139:0/127704456 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fc48405aca0 con 0x7fc48c159960 2024-04-26T17:58:10.682 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:10.682 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc47806c920 msgr2=0x7fc47806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc47806c920 0x7fc47806ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc47c007fd0 tx=0x7fc47c007920 comp rx=0 tx=0).stop 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c159960 msgr2=0x7fc48c14f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c159960 0x7fc48c14f960 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc48400cd80 tx=0x7fc48400a650 comp rx=0 tx=0).stop 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 shutdown_connections 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc47806c920 0x7fc47806ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc48c159960 0x7fc48c14f960 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc48c153de0 0x7fc48c1f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 --2- 172.21.15.139:0/127704456 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc48c070fc0 0x7fc48c1f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 >> 172.21.15.139:0/127704456 conn(0x7fc48c076730 msgr2=0x7fc48c0c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 shutdown_connections 2024-04-26T17:58:10.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.684+0000 7fc493132640 1 -- 172.21.15.139:0/127704456 wait complete. 2024-04-26T17:58:10.711 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:10.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.809+0000 7fe124dc1640 1 Processor -- start 2024-04-26T17:58:10.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.809+0000 7fe124dc1640 1 -- start start 2024-04-26T17:58:10.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe124dc1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1200ca8d0 0x7fe1200cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe124dc1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe1201534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe124dc1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe12015a8b0 con 0x7fe1200ca4f0 2024-04-26T17:58:10.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe124dc1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe120070180 con 0x7fe1200ca8d0 2024-04-26T17:58:10.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe124dc1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe120159d30 con 0x7fe120070d20 2024-04-26T17:58:10.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11ed9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe1201534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11dd9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1200ca8d0 0x7fe1200cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11dd9b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe1200ca8d0 0x7fe1200cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:52126/0 (socket says 172.21.15.139:52126) 2024-04-26T17:58:10.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11dd9b640 1 -- 172.21.15.139:0/4036720837 learned_addr learned my addr 172.21.15.139:0/4036720837 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:10.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11ed9d640 1 -- 172.21.15.139:0/4036720837 >> v2:172.21.15.143:3300/0 conn(0x7fe1200ca8d0 msgr2=0x7fe1200cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11ed9d640 1 --2- 172.21.15.139:0/4036720837 >> v2:172.21.15.143:3300/0 conn(0x7fe1200ca8d0 0x7fe1200cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11ed9d640 1 -- 172.21.15.139:0/4036720837 >> v1:172.21.15.143:6789/0 conn(0x7fe1200ca4f0 legacy=0x7fe120070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11ed9d640 1 -- 172.21.15.139:0/4036720837 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12015a010 con 0x7fe120070d20 2024-04-26T17:58:10.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.810+0000 7fe11dd9b640 1 --2- 172.21.15.139:0/4036720837 >> v2:172.21.15.143:3300/0 conn(0x7fe1200ca8d0 0x7fe1200cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:10.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.811+0000 7fe11ed9d640 1 --2- 172.21.15.139:0/4036720837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe1201534c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe120070300 tx=0x7fe11802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf48b155fdc51642 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.811+0000 7fe11d59a640 1 -- 172.21.15.139:0/4036720837 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118037070 con 0x7fe120070d20 2024-04-26T17:58:10.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.811+0000 7fe11d59a640 1 -- 172.21.15.139:0/4036720837 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe118032440 con 0x7fe120070d20 2024-04-26T17:58:10.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.811+0000 7fe11d59a640 1 -- 172.21.15.139:0/4036720837 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118032810 con 0x7fe120070d20 2024-04-26T17:58:10.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 -- 172.21.15.139:0/4036720837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 msgr2=0x7fe1201534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 --2- 172.21.15.139:0/4036720837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe1201534c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe120070300 tx=0x7fe11802a180 comp rx=0 tx=0).stop 2024-04-26T17:58:10.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 -- 172.21.15.139:0/4036720837 shutdown_connections 2024-04-26T17:58:10.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 --2- 172.21.15.139:0/4036720837 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe1201534c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 --2- 172.21.15.139:0/4036720837 >> v2:172.21.15.143:3300/0 conn(0x7fe1200ca8d0 0x7fe1200cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 -- 172.21.15.139:0/4036720837 >> 172.21.15.139:0/4036720837 conn(0x7fe120071ec0 msgr2=0x7fe1200722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 -- 172.21.15.139:0/4036720837 shutdown_connections 2024-04-26T17:58:10.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.812+0000 7fe124dc1640 1 -- 172.21.15.139:0/4036720837 wait complete. 2024-04-26T17:58:10.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.813+0000 7fe124dc1640 1 Processor -- start 2024-04-26T17:58:10.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.813+0000 7fe124dc1640 1 -- start start 2024-04-26T17:58:10.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe124dc1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe12014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe124dc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1200ca4f0 0x7fe120151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe124dc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1200ca8d0 0x7fe1201566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe124dc1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe1200cbbc0 con 0x7fe1200ca8d0 2024-04-26T17:58:10.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe124dc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe12015a5d0 con 0x7fe1200ca4f0 2024-04-26T17:58:10.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe124dc1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe120159910 con 0x7fe120070d20 2024-04-26T17:58:10.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1200ca8d0 0x7fe1201566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1200ca8d0 0x7fe1201566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49404/0 (socket says 172.21.15.139:49404) 2024-04-26T17:58:10.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 -- 172.21.15.139:0/2976354869 learned_addr learned my addr 172.21.15.139:0/2976354869 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:10.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11dd9b640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1200ca4f0 0x7fe120151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11e59c640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe12014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 -- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 msgr2=0x7fe12014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe12014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 -- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1200ca4f0 msgr2=0x7fe120151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1200ca4f0 0x7fe120151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 -- 172.21.15.139:0/2976354869 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12014d470 con 0x7fe1200ca8d0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11dd9b640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1200ca4f0 0x7fe120151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.814+0000 7fe11ed9d640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1200ca8d0 0x7fe1201566e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe118035040 tx=0x7fe1180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.815+0000 7fe116ffd640 1 -- 172.21.15.139:0/2976354869 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118037040 con 0x7fe1200ca8d0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.815+0000 7fe116ffd640 1 -- 172.21.15.139:0/2976354869 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe118042070 con 0x7fe1200ca8d0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.815+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe120157020 con 0x7fe1200ca8d0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.815+0000 7fe116ffd640 1 -- 172.21.15.139:0/2976354869 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118030880 con 0x7fe1200ca8d0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.815+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12014e600 con 0x7fe1200ca8d0 2024-04-26T17:58:10.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.816+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe120076d20 con 0x7fe1200ca8d0 2024-04-26T17:58:10.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.816+0000 7fe116ffd640 1 -- 172.21.15.139:0/2976354869 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe118030a20 con 0x7fe1200ca8d0 2024-04-26T17:58:10.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.816+0000 7fe116ffd640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe10006c8f0 0x7fe10006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.816+0000 7fe11e59c640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe10006c8f0 0x7fe10006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.816+0000 7fe116ffd640 1 -- 172.21.15.139:0/2976354869 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe1180ac7e0 con 0x7fe1200ca8d0 2024-04-26T17:58:10.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.817+0000 7fe11e59c640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe10006c8f0 0x7fe10006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe110001d40 tx=0x7fe110009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:10.821+0000 7fe116ffd640 1 -- 172.21.15.139:0/2976354869 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe11807a840 con 0x7fe1200ca8d0 2024-04-26T17:58:11.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.034+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1200cad10 con 0x7fe1200ca8d0 2024-04-26T17:58:11.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.035+0000 7fe116ffd640 1 -- 172.21.15.139:0/2976354869 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6822 (secure 0 0 0) 0x7fe11807a140 con 0x7fe1200ca8d0 2024-04-26T17:58:11.035 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:11.035 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:09.736715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:11.035 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 6 2024-04-26T17:58:11.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe10006c8f0 msgr2=0x7fe10006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe10006c8f0 0x7fe10006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe110001d40 tx=0x7fe110009040 comp rx=0 tx=0).stop 2024-04-26T17:58:11.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1200ca8d0 msgr2=0x7fe1201566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1200ca8d0 0x7fe1201566e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe118035040 tx=0x7fe1180046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 shutdown_connections 2024-04-26T17:58:11.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe10006c8f0 0x7fe10006edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1200ca8d0 0x7fe1201566e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe1200ca4f0 0x7fe120151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 --2- 172.21.15.139:0/2976354869 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe120070d20 0x7fe12014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 >> 172.21.15.139:0/2976354869 conn(0x7fe120071ec0 msgr2=0x7fe120075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 shutdown_connections 2024-04-26T17:58:11.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.037+0000 7fe124dc1640 1 -- 172.21.15.139:0/2976354869 wait complete. 2024-04-26T17:58:11.048 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:11.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.144+0000 7faa38378640 1 Processor -- start 2024-04-26T17:58:11.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.144+0000 7faa38378640 1 -- start start 2024-04-26T17:58:11.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa38378640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faa30155ff0 0x7faa3015c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa38378640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7faa30070010 0x7faa3006c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa38378640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa3006c850 0x7faa30073e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa38378640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7faa30073a00 con 0x7faa30155ff0 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa38378640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7faa30158990 con 0x7faa30070010 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa38378640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faa301563d0 con 0x7faa3006c850 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa36114640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faa30155ff0 0x7faa3015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa36114640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faa30155ff0 0x7faa3015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49418/0 (socket says 172.21.15.139:49418) 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.145+0000 7faa36114640 1 -- 172.21.15.139:0/3072899971 learned_addr learned my addr 172.21.15.139:0/3072899971 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36915640 1 --2- 172.21.15.139:0/3072899971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa3006c850 0x7faa30073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36114640 1 -- 172.21.15.139:0/3072899971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa3006c850 msgr2=0x7faa30073e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa35913640 1 --2- 172.21.15.139:0/3072899971 >> v2:172.21.15.143:3300/0 conn(0x7faa30070010 0x7faa3006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36114640 1 --2- 172.21.15.139:0/3072899971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa3006c850 0x7faa30073e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36114640 1 -- 172.21.15.139:0/3072899971 >> v2:172.21.15.143:3300/0 conn(0x7faa30070010 msgr2=0x7faa3006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36114640 1 --2- 172.21.15.139:0/3072899971 >> v2:172.21.15.143:3300/0 conn(0x7faa30070010 0x7faa3006c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36114640 1 -- 172.21.15.139:0/3072899971 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa30158c30 con 0x7faa30155ff0 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36915640 1 --2- 172.21.15.139:0/3072899971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa3006c850 0x7faa30073e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa35913640 1 --2- 172.21.15.139:0/3072899971 >> v2:172.21.15.143:3300/0 conn(0x7faa30070010 0x7faa3006c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:11.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.146+0000 7faa36114640 1 --2- 172.21.15.139:0/3072899971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa30155ff0 0x7faa3015c910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa30072740 tx=0x7faa2c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5419071b1e18231 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa35112640 1 -- 172.21.15.139:0/3072899971 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c036070 con 0x7faa30155ff0 2024-04-26T17:58:11.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa35112640 1 -- 172.21.15.139:0/3072899971 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2c031600 con 0x7faa30155ff0 2024-04-26T17:58:11.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa35112640 1 -- 172.21.15.139:0/3072899971 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c0319d0 con 0x7faa30155ff0 2024-04-26T17:58:11.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 -- 172.21.15.139:0/3072899971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa30155ff0 msgr2=0x7faa3015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 --2- 172.21.15.139:0/3072899971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa30155ff0 0x7faa3015c910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa30072740 tx=0x7faa2c02a6a0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 -- 172.21.15.139:0/3072899971 shutdown_connections 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 --2- 172.21.15.139:0/3072899971 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa3006c850 0x7faa30073e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 --2- 172.21.15.139:0/3072899971 >> v2:172.21.15.143:3300/0 conn(0x7faa30070010 0x7faa3006c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 --2- 172.21.15.139:0/3072899971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa30155ff0 0x7faa3015c910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 -- 172.21.15.139:0/3072899971 >> 172.21.15.139:0/3072899971 conn(0x7faa300ce110 msgr2=0x7faa300ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 -- 172.21.15.139:0/3072899971 shutdown_connections 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.147+0000 7faa38378640 1 -- 172.21.15.139:0/3072899971 wait complete. 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.148+0000 7faa38378640 1 Processor -- start 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.148+0000 7faa38378640 1 -- start start 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa38378640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa3006c850 0x7faa30150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa38378640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa30070010 0x7faa30151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa38378640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa30155ff0 0x7faa300c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa38378640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa301594b0 con 0x7faa3006c850 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa38378640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faa301591d0 con 0x7faa30155ff0 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa38378640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faa30159790 con 0x7faa30070010 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa3006c850 0x7faa30150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa3006c850 0x7faa30150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49428/0 (socket says 172.21.15.139:49428) 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 -- 172.21.15.139:0/2896750831 learned_addr learned my addr 172.21.15.139:0/2896750831 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36915640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa30155ff0 0x7faa300c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa35913640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa30070010 0x7faa30151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 -- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa30070010 msgr2=0x7faa30151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa30070010 0x7faa30151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 -- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa30155ff0 msgr2=0x7faa300c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa30155ff0 0x7faa300c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 -- 172.21.15.139:0/2896750831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa301f00f0 con 0x7faa3006c850 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.149+0000 7faa36114640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa3006c850 0x7faa30150b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009e20 tx=0x7faa2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.150+0000 7faa26ffd640 1 -- 172.21.15.139:0/2896750831 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c036050 con 0x7faa3006c850 2024-04-26T17:58:11.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.150+0000 7faa26ffd640 1 -- 172.21.15.139:0/2896750831 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa2c042070 con 0x7faa3006c850 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.150+0000 7faa26ffd640 1 -- 172.21.15.139:0/2896750831 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c009510 con 0x7faa3006c850 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.150+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa301f03d0 con 0x7faa3006c850 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.150+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa300c80b0 con 0x7faa3006c850 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.151+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa30076d20 con 0x7faa3006c850 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.151+0000 7faa26ffd640 1 -- 172.21.15.139:0/2896750831 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa2c007c50 con 0x7faa3006c850 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.151+0000 7faa26ffd640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faa1406c8f0 0x7faa1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.151+0000 7faa26ffd640 1 -- 172.21.15.139:0/2896750831 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faa2c0acee0 con 0x7faa3006c850 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.151+0000 7faa35913640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faa1406c8f0 0x7faa1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.152+0000 7faa35913640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faa1406c8f0 0x7faa1406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa20006fd0 tx=0x7faa20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.156+0000 7faa26ffd640 1 -- 172.21.15.139:0/2896750831 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa2c045360 con 0x7faa3006c850 2024-04-26T17:58:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.330+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa300c8db0 con 0x7faa3006c850 2024-04-26T17:58:11.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.332+0000 7faa26ffd640 1 -- 172.21.15.139:0/2896750831 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7faa2c07af40 con 0x7faa3006c850 2024-04-26T17:58:11.332 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:11.332 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:11.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faa1406c8f0 msgr2=0x7faa1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faa1406c8f0 0x7faa1406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faa20006fd0 tx=0x7faa20008040 comp rx=0 tx=0).stop 2024-04-26T17:58:11.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa3006c850 msgr2=0x7faa30150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa3006c850 0x7faa30150b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009e20 tx=0x7faa2c004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:11.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 shutdown_connections 2024-04-26T17:58:11.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faa1406c8f0 0x7faa1406edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faa30155ff0 0x7faa300c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faa30070010 0x7faa30151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 --2- 172.21.15.139:0/2896750831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa3006c850 0x7faa30150b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 >> 172.21.15.139:0/2896750831 conn(0x7faa300ce110 msgr2=0x7faa30152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 shutdown_connections 2024-04-26T17:58:11.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:11.334+0000 7faa38378640 1 -- 172.21.15.139:0/2896750831 wait complete. 2024-04-26T17:58:11.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T17:58:04.046385+0000', 'modified': '2024-04-26T17:58:09.736715+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.143:6834/19919207', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6832', 'nonce': 19919207}, {'type': 'v1', 'addr': '172.21.15.143:6834', 'nonce': 19919207}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-04-26T17:58:11.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T17:58:11.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-26T17:58:12.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.049+0000 7fd89ad89640 1 Processor -- start 2024-04-26T17:58:12.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.049+0000 7fd89ad89640 1 -- start start 2024-04-26T17:58:12.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd89ad89640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd894153a70 0x7fd89415a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd89ad89640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8940717b0 con 0x7fd894153e50 2024-04-26T17:58:12.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd89ad89640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8940c9f90 con 0x7fd8940ca750 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd89ad89640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fd89415a8b0 con 0x7fd894153a70 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd898b25640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd894153a70 0x7fd89415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd898b25640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd894153a70 0x7fd89415a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49434/0 (socket says 172.21.15.139:49434) 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd898b25640 1 -- 172.21.15.139:0/774214175 learned_addr learned my addr 172.21.15.139:0/774214175 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd893fff640 1 --1- 172.21.15.139:0/774214175 >> v1:172.21.15.139:6789/0 conn(0x7fd894153e50 0x7fd89406ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46618/0 (socket says 172.21.15.139:46618) 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd898b25640 1 -- 172.21.15.139:0/774214175 >> v1:172.21.15.143:6789/0 conn(0x7fd8940ca750 legacy=0x7fd8940cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd898b25640 1 -- 172.21.15.139:0/774214175 >> v1:172.21.15.139:6789/0 conn(0x7fd894153e50 legacy=0x7fd89406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd898b25640 1 -- 172.21.15.139:0/774214175 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd894070740 con 0x7fd894153a70 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.050+0000 7fd8937fe640 1 -- 172.21.15.139:0/774214175 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001575116 0 0) 0x7fd8940717b0 con 0x7fd894153e50 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd898b25640 1 --2- 172.21.15.139:0/774214175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd894153a70 0x7fd89415a370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd888009870 tx=0x7fd88802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2581f5d8589a3d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd8937fe640 1 -- 172.21.15.139:0/774214175 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888037070 con 0x7fd894153a70 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd8937fe640 1 -- 172.21.15.139:0/774214175 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888032640 con 0x7fd894153a70 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd8937fe640 1 -- 172.21.15.139:0/774214175 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888032a10 con 0x7fd894153a70 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd89ad89640 1 -- 172.21.15.139:0/774214175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd894153a70 msgr2=0x7fd89415a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd89ad89640 1 --2- 172.21.15.139:0/774214175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd894153a70 0x7fd89415a370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd888009870 tx=0x7fd88802a330 comp rx=0 tx=0).stop 2024-04-26T17:58:12.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd89ad89640 1 -- 172.21.15.139:0/774214175 shutdown_connections 2024-04-26T17:58:12.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd89ad89640 1 --2- 172.21.15.139:0/774214175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd894153a70 0x7fd89415a370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd89ad89640 1 -- 172.21.15.139:0/774214175 >> 172.21.15.139:0/774214175 conn(0x7fd894071de0 msgr2=0x7fd8940721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:12.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd89ad89640 1 -- 172.21.15.139:0/774214175 shutdown_connections 2024-04-26T17:58:12.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.051+0000 7fd89ad89640 1 -- 172.21.15.139:0/774214175 wait complete. 2024-04-26T17:58:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.052+0000 7fd89ad89640 1 Processor -- start 2024-04-26T17:58:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd89ad89640 1 -- start start 2024-04-26T17:58:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd89ad89640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8940ca750 0x7fd894156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd89ad89640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd894153a70 0x7fd8940c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd89ad89640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd894153e50 0x7fd8940c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd89ad89640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd894070d00 con 0x7fd8940ca750 2024-04-26T17:58:12.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd89ad89640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd894070fe0 con 0x7fd894153a70 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd89ad89640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd8940ca230 con 0x7fd894153e50 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd898b25640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8940ca750 0x7fd894156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd898b25640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8940ca750 0x7fd894156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49450/0 (socket says 172.21.15.139:49450) 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.053+0000 7fd898b25640 1 -- 172.21.15.139:0/4041609059 learned_addr learned my addr 172.21.15.139:0/4041609059 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd893fff640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd894153a70 0x7fd8940c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd899326640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd894153e50 0x7fd8940c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd898b25640 1 -- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd894153e50 msgr2=0x7fd8940c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd898b25640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd894153e50 0x7fd8940c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd898b25640 1 -- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd894153a70 msgr2=0x7fd8940c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd898b25640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd894153a70 0x7fd8940c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd898b25640 1 -- 172.21.15.139:0/4041609059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8940b3d10 con 0x7fd8940ca750 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd899326640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd894153e50 0x7fd8940c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd898b25640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8940ca750 0x7fd894156c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8880090b0 tx=0x7fd8880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd8917fa640 1 -- 172.21.15.139:0/4041609059 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888037040 con 0x7fd8940ca750 2024-04-26T17:58:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd8917fa640 1 -- 172.21.15.139:0/4041609059 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888004250 con 0x7fd8940ca750 2024-04-26T17:58:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8940b3ff0 con 0x7fd8940ca750 2024-04-26T17:58:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd8917fa640 1 -- 172.21.15.139:0/4041609059 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88803c730 con 0x7fd8940ca750 2024-04-26T17:58:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.054+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8940b45b0 con 0x7fd8940ca750 2024-04-26T17:58:12.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.055+0000 7fd8917fa640 1 -- 172.21.15.139:0/4041609059 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd88803a070 con 0x7fd8940ca750 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.056+0000 7fd8917fa640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd87806c920 0x7fd87806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.056+0000 7fd893fff640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd87806c920 0x7fd87806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.056+0000 7fd8917fa640 1 -- 172.21.15.139:0/4041609059 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd8880ac810 con 0x7fd8940ca750 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.056+0000 7fd893fff640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd87806c920 0x7fd87806ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd89414d230 tx=0x7fd880007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.057+0000 7fd89db7b740 1 Processor -- start 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.057+0000 7fd89db7b740 1 -- start start 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4b0d0 0x5590c9e481f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4c5c0 0x5590c9e4ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4b4b0 0x5590c9e9a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd89db7b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5590c9db1740 con 0x5590c9e4b0d0 2024-04-26T17:58:12.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5590c9d4d3a0 con 0x5590c9e4b4b0 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5590c9dad700 con 0x5590c9e4c5c0 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4b0d0 0x5590c9e481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4b0d0 0x5590c9e481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49456/0 (socket says 172.21.15.139:49456) 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 -- 172.21.15.139:0/1424861951 learned_addr learned my addr 172.21.15.139:0/1424861951 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd893fff640 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4c5c0 0x5590c9e4ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd899326640 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4b4b0 0x5590c9e9a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 -- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4c5c0 msgr2=0x5590c9e4ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4c5c0 0x5590c9e4ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 -- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4b4b0 msgr2=0x5590c9e9a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4b4b0 0x5590c9e9a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 -- 172.21.15.139:0/1424861951 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c9d69750 con 0x5590c9e4b0d0 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd893fff640 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4c5c0 0x5590c9e4ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd899326640 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4b4b0 0x5590c9e9a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd898b25640 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4b0d0 0x5590c9e481f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8880828b0 tx=0x7fd888009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3451bc02f31112b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd87e7fc640 1 -- 172.21.15.139:0/1424861951 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88804a040 con 0x5590c9e4b0d0 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd87e7fc640 1 -- 172.21.15.139:0/1424861951 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88807a170 con 0x5590c9e4b0d0 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.058+0000 7fd87e7fc640 1 -- 172.21.15.139:0/1424861951 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88807e520 con 0x5590c9e4b0d0 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 -- 172.21.15.139:0/1424861951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4b0d0 msgr2=0x5590c9e481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4b0d0 0x5590c9e481f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8880828b0 tx=0x7fd888009240 comp rx=0 tx=0).stop 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 -- 172.21.15.139:0/1424861951 shutdown_connections 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4b4b0 0x5590c9e9a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4c5c0 0x5590c9e4ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 --2- 172.21.15.139:0/1424861951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4b0d0 0x5590c9e481f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 -- 172.21.15.139:0/1424861951 >> 172.21.15.139:0/1424861951 conn(0x5590c9e499b0 msgr2=0x5590c9e90e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:12.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 -- 172.21.15.139:0/1424861951 shutdown_connections 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 -- 172.21.15.139:0/1424861951 wait complete. 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.059+0000 7fd89db7b740 1 -- start start 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 1 Processor -- start 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e87460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9ea2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9e942e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5590c9e491d0 con 0x5590c9e93e20 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5590c9d38fe0 con 0x5590c9e4c5c0 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5590c9e4e4e0 con 0x5590c9e4b4b0 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd89db7b740 10 client.0 _ll_register_callbacks cb 0x5590c9d4f150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd899326640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9e942e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd899326640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9e942e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49472/0 (socket says 172.21.15.139:49472) 2024-04-26T17:58:12.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd899326640 1 -- 172.21.15.139:0/75519952 learned_addr learned my addr 172.21.15.139:0/75519952 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:12.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.060+0000 7fd893fff640 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9ea2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd898b25640 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e87460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd899326640 1 -- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 msgr2=0x5590c9e87460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:12.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd899326640 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e87460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd899326640 1 -- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 msgr2=0x5590c9ea2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:12.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd899326640 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9ea2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd899326640 1 -- 172.21.15.139:0/75519952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c9ac32d0 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd899326640 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9e942e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e4d0 tx=0x7fd88c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a5dfb2616e5f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd8737fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd8737fe640 1 -- 172.21.15.139:0/75519952 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c003b80 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd8737fe640 1 -- 172.21.15.139:0/75519952 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd88c003d20 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd88807a170 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd8737fe640 1 -- 172.21.15.139:0/75519952 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd88c006b10 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 10 client.4407 fetch_fsmap learned FSMap version 6 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5590c9b8d6b0 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd8737fe640 1 -- 172.21.15.139:0/75519952 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88807a170 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd8737fe640 1 -- 172.21.15.139:0/75519952 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fd88c006cb0 con 0x5590c9e93e20 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 10 client.4407 fetch_fsmap finished waiting for FSMap version 6 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 10 client.4407 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 20 client.4407 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:12.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9e949a0 0x5590c9eb0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 4 client.4407 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:12.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.061+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590c9dbf350 con 0x5590c9e949a0 2024-04-26T17:58:12.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.062+0000 7fd898b25640 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9e949a0 0x5590c9eb0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.062+0000 7fd8737fe640 10 client.4407 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:12.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:12.062+0000 7fd898b25640 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9e949a0 0x5590c9eb0d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=625cbabd625e5ec5 server_cookie=13d521d94bee6b5e in_seq=0 out_seq=0 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd8737fe640 1 -- 172.21.15.139:0/75519952 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5590c9dbf350 con 0x5590c9e949a0 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd8737fe640 10 client.4407 handle_command_reply: tid=0 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 client.4407 shutdown 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 msgr2=0x5590c9e942e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9e942e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00e4d0 tx=0x7fd88c00e990 comp rx=0 tx=0).stop 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 shutdown_connections 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9e942e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9ea2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9e949a0 0x5590c9eb0d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 --2- 172.21.15.139:0/75519952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e87460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd8737fe640 0 client.4407 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:14.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.747+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 >> 172.21.15.139:0/75519952 conn(0x5590c9e4b0d0 msgr2=0x5590c9e476f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:14.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.748+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 shutdown_connections 2024-04-26T17:58:14.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.748+0000 7fd89db7b740 1 -- 172.21.15.139:0/75519952 wait complete. 2024-04-26T17:58:14.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.748+0000 7fd89db7b740 20 client.4407 trim_cache size 0 max 16384 2024-04-26T17:58:14.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 Processor -- start 2024-04-26T17:58:14.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 -- start start 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e91da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9e922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9eb5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd89406e1c0 con 0x5590c9e93e20 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5590c9e936f0 con 0x5590c9e4c5c0 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.767+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5590c9ea20c0 con 0x5590c9e4b4b0 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9eb5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9eb5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49480/0 (socket says 172.21.15.139:49480) 2024-04-26T17:58:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 -- 172.21.15.139:0/2377393738 learned_addr learned my addr 172.21.15.139:0/2377393738 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd898b25640 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e91da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 -- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 msgr2=0x5590c9e91da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd893fff640 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9e922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e91da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 -- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 msgr2=0x5590c9e922e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9e922e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 -- 172.21.15.139:0/2377393738 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c9ea2bd0 con 0x5590c9e93e20 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd899326640 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9eb5d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd88c002140 tx=0x7fd88c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5511ff0cd0c960 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd87dffb640 1 -- 172.21.15.139:0/2377393738 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c003c80 con 0x5590c9e93e20 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd87dffb640 1 -- 172.21.15.139:0/2377393738 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c01f460 con 0x5590c9e93e20 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.768+0000 7fd87dffb640 1 -- 172.21.15.139:0/2377393738 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88c01fa00 con 0x5590c9e93e20 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 -- 172.21.15.139:0/2377393738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 msgr2=0x5590c9eb5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9eb5d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd88c002140 tx=0x7fd88c005000 comp rx=0 tx=0).stop 2024-04-26T17:58:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 -- 172.21.15.139:0/2377393738 shutdown_connections 2024-04-26T17:58:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e93e20 0x5590c9eb5d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e4c5c0 0x5590c9e922e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2377393738 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e91da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 -- 172.21.15.139:0/2377393738 >> 172.21.15.139:0/2377393738 conn(0x5590c9e4b0d0 msgr2=0x5590c9e8db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 -- 172.21.15.139:0/2377393738 shutdown_connections 2024-04-26T17:58:14.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.769+0000 7fd89db7b740 1 -- 172.21.15.139:0/2377393738 wait complete. 2024-04-26T17:58:14.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.770+0000 7fd89db7b740 1 -- start start 2024-04-26T17:58:14.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.770+0000 7fd89db7b740 1 Processor -- start 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e71ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4c5c0 0x5590c9e84d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e93e20 0x5590c9e763d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5590c9e94e70 con 0x5590c9e4c5c0 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5590c9e94820 con 0x5590c9e93e20 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5590c9e75080 con 0x5590c9e4b4b0 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 10 client.0 _ll_register_callbacks cb 0x7fd88c001560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4c5c0 0x5590c9e84d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4c5c0 0x5590c9e84d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49492/0 (socket says 172.21.15.139:49492) 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 -- 172.21.15.139:0/2241418609 learned_addr learned my addr 172.21.15.139:0/2241418609 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd898b25640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e71ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd899326640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e93e20 0x5590c9e763d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 -- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 msgr2=0x5590c9e71ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:14.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e71ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 -- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e93e20 msgr2=0x5590c9e763d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e93e20 0x5590c9e763d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 -- 172.21.15.139:0/2241418609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c9e8e020 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd899326640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e93e20 0x5590c9e763d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd893fff640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4c5c0 0x5590c9e84d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8940cad50 tx=0x7fd880000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e1616caa01fa10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd8737fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd8737fe640 1 -- 172.21.15.139:0/2241418609 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880028060 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd8737fe640 1 -- 172.21.15.139:0/2241418609 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd880010040 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.771+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd88c01f460 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd8737fe640 1 -- 172.21.15.139:0/2241418609 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fd88002e050 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 10 client.4413 fetch_fsmap learned FSMap version 6 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5590c9e76b20 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd8737fe640 1 -- 172.21.15.139:0/2241418609 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88c01f460 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd8737fe640 1 -- 172.21.15.139:0/2241418609 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fd880031020 con 0x5590c9e4c5c0 2024-04-26T17:58:14.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 10 client.4413 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 20 client.4413 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 0x5590c9e4cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 4 client.4413 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "status"}) -- 0x5590c9db91c0 con 0x5590c9f0d4e0 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd898b25640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 0x5590c9e4cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd898b25640 1 -- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 msgr2=0x5590c9e4cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd898b25640 1 -- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 msgr2=0x5590c9e4cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd898b25640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 0x5590c9e4cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:58:14.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.772+0000 7fd898b25640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 0x5590c9e4cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:58:14.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.973+0000 7fd898b25640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 0x5590c9e4cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.973+0000 7fd898b25640 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 0x5590c9e4cfb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4da4b176b86c45fe server_cookie=843a78a7a4a6ea18 in_seq=0 out_seq=0 2024-04-26T17:58:14.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.973+0000 7fd8737fe640 10 client.4413 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:14.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd8737fe640 1 -- 172.21.15.139:0/2241418609 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5590c9db91c0 con 0x5590c9f0d4e0 2024-04-26T17:58:14.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd8737fe640 10 client.4413 handle_command_reply: tid=0 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 client.4413 shutdown 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4c5c0 msgr2=0x5590c9e84d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4c5c0 0x5590c9e84d20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd8940cad50 tx=0x7fd880000ed0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 shutdown_connections 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5590c9e93e20 0x5590c9e763d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590c9e4c5c0 0x5590c9e84d20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5590c9f0d4e0 0x5590c9e4cfb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 --2- 172.21.15.139:0/2241418609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5590c9e4b4b0 0x5590c9e71ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd8737fe640 0 client.4413 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 >> 172.21.15.139:0/2241418609 conn(0x5590c9e4b0d0 msgr2=0x5590c9e487c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 shutdown_connections 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 1 -- 172.21.15.139:0/2241418609 wait complete. 2024-04-26T17:58:14.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.974+0000 7fd89db7b740 20 client.4413 trim_cache size 0 max 16384 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "ef741c66-6f9a-4560-84cd-b0800c4824c8", 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4309, 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 10.275401219999999, 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 5, 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 24, 2024-04-26T17:58:14.976 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T17:58:14.977 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 16.284732901999998 2024-04-26T17:58:14.977 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:58:14.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd87806c920 msgr2=0x7fd87806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd87806c920 0x7fd87806ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd89414d230 tx=0x7fd880007c00 comp rx=0 tx=0).stop 2024-04-26T17:58:14.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8940ca750 msgr2=0x7fd894156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8940ca750 0x7fd894156c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8880090b0 tx=0x7fd8880046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 shutdown_connections 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd87806c920 0x7fd87806ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd894153e50 0x7fd8940c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd894153a70 0x7fd8940c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 --2- 172.21.15.139:0/4041609059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8940ca750 0x7fd894156c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 >> 172.21.15.139:0/4041609059 conn(0x7fd894071de0 msgr2=0x7fd89414dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 shutdown_connections 2024-04-26T17:58:14.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:14.975+0000 7fd89ad89640 1 -- 172.21.15.139:0/4041609059 wait complete. 2024-04-26T17:58:14.988 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T17:58:14.988 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:14.988 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T17:58:15.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.090+0000 7f0f21852640 1 Processor -- start 2024-04-26T17:58:15.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.090+0000 7f0f21852640 1 -- start start 2024-04-26T17:58:15.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f21852640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0f1c0c9bd0 0x7f0f1c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:15.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f21852640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c0ca560 con 0x7f0f1c0cc950 2024-04-26T17:58:15.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f21852640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c0cdcf0 con 0x7f0f1c155da0 2024-04-26T17:58:15.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f21852640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1c0cebe0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f1b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0f1c0c9bd0 0x7f0f1c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:15.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f1a7fc640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0f1c0cc950 0x7f0f1c0d12e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46628/0 (socket says 172.21.15.139:46628) 2024-04-26T17:58:15.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f1b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0f1c0c9bd0 0x7f0f1c0ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49496/0 (socket says 172.21.15.139:49496) 2024-04-26T17:58:15.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f1a7fc640 1 -- 172.21.15.139:0/569793955 learned_addr learned my addr 172.21.15.139:0/569793955 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:15.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f1b7fe640 1 -- 172.21.15.139:0/569793955 >> v1:172.21.15.143:6789/0 conn(0x7f0f1c155da0 legacy=0x7f0f1c15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:15.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f1b7fe640 1 -- 172.21.15.139:0/569793955 >> v1:172.21.15.139:6789/0 conn(0x7f0f1c0cc950 legacy=0x7f0f1c0d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:15.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f1b7fe640 1 -- 172.21.15.139:0/569793955 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c0cdfd0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.091+0000 7f0f19ffb640 1 -- 172.21.15.139:0/569793955 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485255893 0 0) 0x7f0f1c0ca560 con 0x7f0f1c0cc950 2024-04-26T17:58:15.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.092+0000 7f0f1b7fe640 1 --2- 172.21.15.139:0/569793955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c0ca020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f140097a0 tx=0x7f0f1402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c82ed2a5d6ff35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:15.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.092+0000 7f0f19ffb640 1 -- 172.21.15.139:0/569793955 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14037070 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.092+0000 7f0f19ffb640 1 -- 172.21.15.139:0/569793955 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f14032640 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.092+0000 7f0f19ffb640 1 -- 172.21.15.139:0/569793955 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14032a10 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.093+0000 7f0f21852640 1 -- 172.21.15.139:0/569793955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 msgr2=0x7f0f1c0ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.093+0000 7f0f21852640 1 --2- 172.21.15.139:0/569793955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c0ca020 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f140097a0 tx=0x7f0f1402a2c0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.093+0000 7f0f21852640 1 -- 172.21.15.139:0/569793955 shutdown_connections 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.093+0000 7f0f21852640 1 --2- 172.21.15.139:0/569793955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c0ca020 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.093+0000 7f0f21852640 1 -- 172.21.15.139:0/569793955 >> 172.21.15.139:0/569793955 conn(0x7f0f1c068090 msgr2=0x7f0f1c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.093+0000 7f0f21852640 1 -- 172.21.15.139:0/569793955 shutdown_connections 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.093+0000 7f0f21852640 1 -- 172.21.15.139:0/569793955 wait complete. 2024-04-26T17:58:15.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.094+0000 7f0f21852640 1 Processor -- start 2024-04-26T17:58:15.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.094+0000 7f0f21852640 1 -- start start 2024-04-26T17:58:15.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:15.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f1c0cc950 0x7f0f1c1569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f1c155da0 0x7f0f1c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c0ce870 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c0ce590 con 0x7f0f1c0cc950 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1c0cd940 con 0x7f0f1c155da0 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c1564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49510/0 (socket says 172.21.15.139:49510) 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 -- 172.21.15.139:0/3095268305 learned_addr learned my addr 172.21.15.139:0/3095268305 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1b7fe640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f1c155da0 0x7f0f1c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1a7fc640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f1c0cc950 0x7f0f1c1569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 -- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f1c155da0 msgr2=0x7f0f1c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f1c155da0 0x7f0f1c157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 -- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f1c0cc950 msgr2=0x7f0f1c1569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f1c0cc950 0x7f0f1c1569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 -- 172.21.15.139:0/3095268305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c1593c0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1a7fc640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f1c0cc950 0x7f0f1c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1b7fe640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f1c155da0 0x7f0f1c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f1affd640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c1564b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c730 tx=0x7f0f0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f03fff640 1 -- 172.21.15.139:0/3095268305 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c003b70 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f03fff640 1 -- 172.21.15.139:0/3095268305 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0c003d30 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c1554a0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f03fff640 1 -- 172.21.15.139:0/3095268305 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c00aa90 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.095+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c0b70c0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.096+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c0b72c0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.097+0000 7f0f03fff640 1 -- 172.21.15.139:0/3095268305 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f0c00ac30 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.097+0000 7f0f03fff640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f0806c8f0 0x7f0f0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:15.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.097+0000 7f0f1a7fc640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f0806c8f0 0x7f0f0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:15.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.097+0000 7f0f03fff640 1 -- 172.21.15.139:0/3095268305 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0f0c08beb0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.098+0000 7f0f1a7fc640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f0806c8f0 0x7f0f0806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c1f2990 tx=0x7f0f10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:15.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.102+0000 7f0f03fff640 1 -- 172.21.15.139:0/3095268305 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f1c0b72c0 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.316+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0f1c076d20 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.316+0000 7f0f03fff640 1 -- 172.21.15.139:0/3095268305 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f0f0c059f10 con 0x7f0f1c0c9bd0 2024-04-26T17:58:15.317 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.318+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f0806c8f0 msgr2=0x7f0f0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.318+0000 7f0f21852640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f0806c8f0 0x7f0f0806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c1f2990 tx=0x7f0f10009040 comp rx=0 tx=0).stop 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 msgr2=0x7f0f1c1564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c1564b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00c730 tx=0x7f0f0c00cbf0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 shutdown_connections 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f0806c8f0 0x7f0f0806edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0f1c155da0 0x7f0f1c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f1c0cc950 0x7f0f1c1569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 --2- 172.21.15.139:0/3095268305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f1c0c9bd0 0x7f0f1c1564b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:15.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 >> 172.21.15.139:0/3095268305 conn(0x7f0f1c068090 msgr2=0x7f0f1c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:15.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 shutdown_connections 2024-04-26T17:58:15.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15.319+0000 7f0f21852640 1 -- 172.21.15.139:0/3095268305 wait complete. 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T17:58:15.330 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T17:58:15.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:15.331 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-04-26T17:58:15.345 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T17:58:15.345 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T17:58:15.345 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:15.346 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T17:58:15.347 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42726sec preferred_lft 42726sec 2024-04-26T17:58:15.347 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::8313:5748:ab6c:453d/64 scope link noprefixroute 2024-04-26T17:58:15.347 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:15.347 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T17:58:15.347 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:15.348 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:15.348 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2024-04-26T17:58:15.348 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2024-04-26T17:58:15.348 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2024-04-26T17:58:15.348 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T17:58:15.348 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:15.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:15.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:15.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:15.703 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T17:58:15.726 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-04-26T17:58:15.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:15.728 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-04-26T17:58:15.793 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-04-26T17:58:15.793 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T17:58:15.793 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T17:58:15.793 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T17:58:15.793 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T17:58:15.794 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:15.794 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:15.794 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T17:58:15.794 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T17:58:15.794 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T17:58:15.794 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:15.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:16.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:16.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:16.060 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-04-26T17:58:16.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:16.075 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-04-26T17:58:16.130 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:16.130 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:16.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:16.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T17:58:16.130 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:16.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:16.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:16.244 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T17:58:16.245 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:16.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:16.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:16.367 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:16.367 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:16.367 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2024-04-26T17:58:16.367 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T17:58:16.367 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:16.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:16.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:16.442 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T17:58:16.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:16.442 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:16.456 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T17:58:16.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:16.456 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:16.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-04-26T17:58:16.575 DEBUG:teuthology.orchestra.run.smithi139:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T17:58:16.629 INFO:teuthology.orchestra.run.smithi139.stdout:/proc 2024-04-26T17:58:16.629 INFO:teuthology.orchestra.run.smithi139.stdout:/sys 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/dev 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/security 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/shm 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/pts 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/run 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/pstore 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/bpf 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/ 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/selinux 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/mqueue 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/hugepages 2024-04-26T17:58:16.630 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/debug 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/tracing 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/config 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/fuse/connections 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/1000 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T17:58:16.631 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T17:58:16.632 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns 2024-04-26T17:58:16.632 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:16.632 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:16.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:16.633 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-04-26T17:58:16.687 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T17:58:16.687 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T17:58:16.730 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2024-04-26T17:58:16.756 DEBUG:teuthology.orchestra.run.smithi139:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/proc 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/sys 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/dev 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/security 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/shm 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/pts 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/run 2024-04-26T17:58:16.812 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/pstore 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/bpf 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/ 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/selinux 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/mqueue 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/hugepages 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/debug 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/tracing 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/config 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/fuse/connections 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T17:58:16.813 INFO:teuthology.orchestra.run.smithi139.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/1000 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:16.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:16.815 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2024-04-26T17:58:16.834 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:2024-04-26T17:58:16.834+0000 7f851c361480 -1 init, newargv = 0x55708bb34d50 newargc=15 2024-04-26T17:58:16.834 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[41723]: starting ceph client 2024-04-26T17:58:16.839 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[41723]: starting fuse 2024-04-26T17:58:16.849 INFO:teuthology.orchestra.run.smithi139.stdout:43 2024-04-26T17:58:16.849 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-26T17:58:16.849 DEBUG:teuthology.orchestra.run.smithi139:> sudo stdin-killer -- python3 -c ' 2024-04-26T17:58:16.849 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2024-04-26T17:58:16.849 DEBUG:teuthology.orchestra.run.smithi139:> import re 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> import os 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> def _find_admin_socket(client_name): 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T17:58:16.850 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> contents = proc_f.read() 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> if mountpoint in contents: 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> return f 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> print(_find_admin_socket("client.admin")) 2024-04-26T17:58:16.851 DEBUG:teuthology.orchestra.run.smithi139:> ' 2024-04-26T17:58:16.966 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.admin.41723.asok 2024-04-26T17:58:16.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:16.976 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41723.asok 2024-04-26T17:58:16.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:16.977 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41723.asok status 2024-04-26T17:58:17.109 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1", 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "admin", 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "41723", 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2024-04-26T17:58:17.110 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4428, 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 4428 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 54966811 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2024-04-26T17:58:17.111 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 54966811 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.4428 192.168.0.1:0/54966811", 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "192.168.0.1:0/54966811", 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 5, 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 24, 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "blocklisted": false, 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2024-04-26T17:58:17.112 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:58:17.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:17.118 DEBUG:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2024-04-26T17:58:17.118 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:17.134 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2024-04-26T17:58:17.134 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:17.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:17.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:17.198 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T17:58:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:17.308 INFO:teuthology.orchestra.run.smithi139.stdout:# file: . 2024-04-26T17:58:17.308 INFO:teuthology.orchestra.run.smithi139.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T17:58:17.309 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:17.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:17.314 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:58:17.314 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T17:58:17.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T17:58:17.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.467+0000 7faacc209640 1 Processor -- start 2024-04-26T17:58:17.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.467+0000 7faacc209640 1 -- start start 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faacc209640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faac40c7ab0 0x7faac40c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faacc209640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac406e260 con 0x7faac4153d80 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faacc209640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac406e540 con 0x7faac41539a0 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faacc209640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7faac406e010 con 0x7faac40c7ab0 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faac97a4640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7faac4153d80 0x7faac40c67c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46644/0 (socket says 172.21.15.139:46644) 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faac97a4640 1 -- 172.21.15.139:0/3159438252 learned_addr learned my addr 172.21.15.139:0/3159438252 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faaca7a6640 1 --2- 172.21.15.139:0/3159438252 >> v2:172.21.15.139:3300/0 conn(0x7faac40c7ab0 0x7faac40c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faaca7a6640 1 -- 172.21.15.139:0/3159438252 >> v1:172.21.15.143:6789/0 conn(0x7faac41539a0 legacy=0x7faac415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faaca7a6640 1 -- 172.21.15.139:0/3159438252 >> v1:172.21.15.139:6789/0 conn(0x7faac4153d80 legacy=0x7faac40c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.468+0000 7faaca7a6640 1 -- 172.21.15.139:0/3159438252 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac406ee60 con 0x7faac40c7ab0 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.469+0000 7faaca7a6640 1 --2- 172.21.15.139:0/3159438252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40c99f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faabc009dc0 tx=0x7faabc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9cff85922535c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.469+0000 7faac8fa3640 1 -- 172.21.15.139:0/3159438252 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc037070 con 0x7faac40c7ab0 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.469+0000 7faac8fa3640 1 -- 172.21.15.139:0/3159438252 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc007740 con 0x7faac40c7ab0 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.469+0000 7faac8fa3640 1 -- 172.21.15.139:0/3159438252 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc007b10 con 0x7faac40c7ab0 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.470+0000 7faacc209640 1 -- 172.21.15.139:0/3159438252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 msgr2=0x7faac40c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.470+0000 7faacc209640 1 --2- 172.21.15.139:0/3159438252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40c99f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faabc009dc0 tx=0x7faabc02a7c0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.470+0000 7faacc209640 1 -- 172.21.15.139:0/3159438252 shutdown_connections 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.470+0000 7faacc209640 1 --2- 172.21.15.139:0/3159438252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40c99f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.470+0000 7faacc209640 1 -- 172.21.15.139:0/3159438252 >> 172.21.15.139:0/3159438252 conn(0x7faac40686c0 msgr2=0x7faac406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.470+0000 7faacc209640 1 -- 172.21.15.139:0/3159438252 shutdown_connections 2024-04-26T17:58:17.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.470+0000 7faacc209640 1 -- 172.21.15.139:0/3159438252 wait complete. 2024-04-26T17:58:17.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.471+0000 7faacc209640 1 Processor -- start 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.471+0000 7faacc209640 1 -- start start 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faac41539a0 0x7faac40729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faac4153d80 0x7faac414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faac406e890 con 0x7faac40c7ab0 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faac406f420 con 0x7faac41539a0 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faac40c6ed0 con 0x7faac4153d80 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49530/0 (socket says 172.21.15.139:49530) 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 -- 172.21.15.139:0/2198363450 learned_addr learned my addr 172.21.15.139:0/2198363450 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 -- 172.21.15.139:0/2198363450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faac4153d80 msgr2=0x7faac414e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faac4153d80 0x7faac414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 -- 172.21.15.139:0/2198363450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faac41539a0 msgr2=0x7faac40729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faac41539a0 0x7faac40729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 -- 172.21.15.139:0/2198363450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac41ef840 con 0x7faac40c7ab0 2024-04-26T17:58:17.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faac9fa5640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40cbf00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faac000c3f0 tx=0x7faac000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faaba7fc640 1 -- 172.21.15.139:0/2198363450 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac00052d0 con 0x7faac40c7ab0 2024-04-26T17:58:17.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faaba7fc640 1 -- 172.21.15.139:0/2198363450 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac0005490 con 0x7faac40c7ab0 2024-04-26T17:58:17.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac41e66b0 con 0x7faac40c7ab0 2024-04-26T17:58:17.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faaba7fc640 1 -- 172.21.15.139:0/2198363450 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0007260 con 0x7faac40c7ab0 2024-04-26T17:58:17.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.472+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac41efae0 con 0x7faac40c7ab0 2024-04-26T17:58:17.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.473+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac41ef630 con 0x7faac40c7ab0 2024-04-26T17:58:17.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.474+0000 7faaba7fc640 1 -- 172.21.15.139:0/2198363450 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faac0007400 con 0x7faac40c7ab0 2024-04-26T17:58:17.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.474+0000 7faaba7fc640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faaa806c920 0x7faaa806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.474+0000 7faaba7fc640 1 -- 172.21.15.139:0/2198363450 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faac008b420 con 0x7faac40c7ab0 2024-04-26T17:58:17.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.474+0000 7faac97a4640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faaa806c920 0x7faaa806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.475+0000 7faac97a4640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faaa806c920 0x7faaa806ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faac415a660 tx=0x7faab4007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.479+0000 7faaba7fc640 1 -- 172.21.15.139:0/2198363450 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faac0059480 con 0x7faac40c7ab0 2024-04-26T17:58:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.663+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faac4076d20 con 0x7faac40c7ab0 2024-04-26T17:58:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.663+0000 7faaba7fc640 1 -- 172.21.15.139:0/2198363450 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7faac0058d80 con 0x7faac40c7ab0 2024-04-26T17:58:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faaa806c920 msgr2=0x7faaa806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faaa806c920 0x7faaa806ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faac415a660 tx=0x7faab4007a40 comp rx=0 tx=0).stop 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 msgr2=0x7faac40cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40cbf00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faac000c3f0 tx=0x7faac000c8b0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 shutdown_connections 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faaa806c920 0x7faaa806ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faac4153d80 0x7faac414e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faac41539a0 0x7faac40729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 --2- 172.21.15.139:0/2198363450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac40c7ab0 0x7faac40cbf00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 >> 172.21.15.139:0/2198363450 conn(0x7faac40686c0 msgr2=0x7faac4154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:17.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 shutdown_connections 2024-04-26T17:58:17.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.666+0000 7faacc209640 1 -- 172.21.15.139:0/2198363450 wait complete. 2024-04-26T17:58:17.676 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:58:17.676 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T17:58:17.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T17:58:17.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.830+0000 7f6f572c8640 1 Processor -- start 2024-04-26T17:58:17.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.830+0000 7f6f572c8640 1 -- start start 2024-04-26T17:58:17.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f572c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f50155eb0 0x7f6f500cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f572c8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5015bca0 con 0x7f6f50073330 2024-04-26T17:58:17.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f572c8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5015bf40 con 0x7f6f50068a50 2024-04-26T17:58:17.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f572c8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6f5015c220 con 0x7f6f50155eb0 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f55865640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6f50073330 0x7f6f5015f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46646/0 (socket says 172.21.15.139:46646) 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f55865640 1 -- 172.21.15.139:0/3028241266 learned_addr learned my addr 172.21.15.139:0/3028241266 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f55064640 1 --2- 172.21.15.139:0/3028241266 >> v2:172.21.15.143:3300/0 conn(0x7f6f50155eb0 0x7f6f500cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871382729 0 0) 0x7f6f5015bca0 con 0x7f6f50073330 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f3c003520 con 0x7f6f50073330 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3744669363 0 0) 0x7f6f3c003520 con 0x7f6f50073330 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 >> v2:172.21.15.143:3300/0 conn(0x7f6f50155eb0 msgr2=0x7f6f500cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 --2- 172.21.15.139:0/3028241266 >> v2:172.21.15.143:3300/0 conn(0x7f6f50155eb0 0x7f6f500cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 >> v1:172.21.15.143:6789/0 conn(0x7f6f50068a50 legacy=0x7f6f50073c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5015c500 con 0x7f6f50073330 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f6f48001a10 con 0x7f6f50073330 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 >> v1:172.21.15.139:6789/0 conn(0x7f6f50073330 legacy=0x7f6f5015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0043b0 0x7f6f3c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c005120 0x7f6f3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5015c220 con 0x7f6f3c0039b0 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c00c060 con 0x7f6f3c005120 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.831+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3c00c260 con 0x7f6f3c0043b0 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55064640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55865640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c005120 0x7f6f3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f54863640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0043b0 0x7f6f3c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55064640 1 -- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0043b0 msgr2=0x7f6f3c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55064640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0043b0 0x7f6f3c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55064640 1 -- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c005120 msgr2=0x7f6f3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55064640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c005120 0x7f6f3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55064640 1 -- 172.21.15.139:0/3028241266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c003520 con 0x7f6f3c0039b0 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55865640 1 -- 172.21.15.139:0/3028241266 reap_dead start 2024-04-26T17:58:17.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f54863640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f3c0043b0 0x7f6f3c004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.832+0000 7f6f55064640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009ac0 tx=0x7f6f3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546b8918ee3ec96b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c036070 con 0x7f6f3c0039b0 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c031400 con 0x7f6f3c0039b0 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f47fff640 1 -- 172.21.15.139:0/3028241266 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c009690 con 0x7f6f3c0039b0 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f572c8640 1 -- 172.21.15.139:0/3028241266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c0039b0 msgr2=0x7f6f3c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f572c8640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009ac0 tx=0x7f6f3c005830 comp rx=0 tx=0).stop 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f572c8640 1 -- 172.21.15.139:0/3028241266 shutdown_connections 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f572c8640 1 --2- 172.21.15.139:0/3028241266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c0039b0 0x7f6f3c003d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f572c8640 1 -- 172.21.15.139:0/3028241266 >> 172.21.15.139:0/3028241266 conn(0x7f6f500ce340 msgr2=0x7f6f500ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f572c8640 1 -- 172.21.15.139:0/3028241266 shutdown_connections 2024-04-26T17:58:17.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.833+0000 7f6f572c8640 1 -- 172.21.15.139:0/3028241266 wait complete. 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.834+0000 7f6f572c8640 1 Processor -- start 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.834+0000 7f6f572c8640 1 -- start start 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f572c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c0039b0 0x7f6f500c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f572c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f5015b410 0x7f6f501e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f572c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f500cc990 0x7f6f500cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f572c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5015f210 con 0x7f6f500cc990 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f572c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5015cac0 con 0x7f6f3c0039b0 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f572c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6f50156290 con 0x7f6f5015b410 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f500cc990 0x7f6f500cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f500cc990 0x7f6f500cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49542/0 (socket says 172.21.15.139:49542) 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 -- 172.21.15.139:0/2986162277 learned_addr learned my addr 172.21.15.139:0/2986162277 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55064640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c0039b0 0x7f6f500c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f54863640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f5015b410 0x7f6f501e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 -- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f5015b410 msgr2=0x7f6f501e57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f5015b410 0x7f6f501e57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 -- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c0039b0 msgr2=0x7f6f500c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c0039b0 0x7f6f500c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.835+0000 7f6f55865640 1 -- 172.21.15.139:0/2986162277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f500cd350 con 0x7f6f500cc990 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.836+0000 7f6f55865640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f500cc990 0x7f6f500cce10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f5015be70 tx=0x7f6f48007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.836+0000 7f6f45ffb640 1 -- 172.21.15.139:0/2986162277 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48019070 con 0x7f6f500cc990 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.836+0000 7f6f45ffb640 1 -- 172.21.15.139:0/2986162277 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4800abf0 con 0x7f6f500cc990 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.836+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f501f5a60 con 0x7f6f500cc990 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.836+0000 7f6f45ffb640 1 -- 172.21.15.139:0/2986162277 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480133f0 con 0x7f6f500cc990 2024-04-26T17:58:17.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.836+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f501f4ee0 con 0x7f6f500cc990 2024-04-26T17:58:17.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.837+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f50076d20 con 0x7f6f500cc990 2024-04-26T17:58:17.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.837+0000 7f6f45ffb640 1 -- 172.21.15.139:0/2986162277 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f4801c070 con 0x7f6f500cc990 2024-04-26T17:58:17.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.838+0000 7f6f45ffb640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f3406c8f0 0x7f6f3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.838+0000 7f6f45ffb640 1 -- 172.21.15.139:0/2986162277 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6f4808b770 con 0x7f6f500cc990 2024-04-26T17:58:17.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.838+0000 7f6f55064640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f3406c8f0 0x7f6f3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.838+0000 7f6f55064640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f3406c8f0 0x7f6f3406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c033000 tx=0x7f6f4c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:17.842+0000 7f6f45ffb640 1 -- 172.21.15.139:0/2986162277 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f500cd350 con 0x7f6f500cc990 2024-04-26T17:58:18.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.029+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6f500cc6f0 con 0x7f6f500cc990 2024-04-26T17:58:18.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.030+0000 7f6f45ffb640 1 -- 172.21.15.139:0/2986162277 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f6f48059210 con 0x7f6f500cc990 2024-04-26T17:58:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f3406c8f0 msgr2=0x7f6f3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f3406c8f0 0x7f6f3406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c033000 tx=0x7f6f4c008030 comp rx=0 tx=0).stop 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f500cc990 msgr2=0x7f6f500cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f500cc990 0x7f6f500cce10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f5015be70 tx=0x7f6f48007a90 comp rx=0 tx=0).stop 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 shutdown_connections 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f3406c8f0 0x7f6f3406edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f500cc990 0x7f6f500cce10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f5015b410 0x7f6f501e57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 --2- 172.21.15.139:0/2986162277 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f3c0039b0 0x7f6f500c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 >> 172.21.15.139:0/2986162277 conn(0x7f6f500ce340 msgr2=0x7f6f50148da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:18.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 shutdown_connections 2024-04-26T17:58:18.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:18.032+0000 7f6f572c8640 1 -- 172.21.15.139:0/2986162277 wait complete. 2024-04-26T17:58:18.042 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2024-04-26T17:58:18.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:18.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:18.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[41723]: fuse finished with error 0 and tester_r 0 2024-04-26T17:58:18.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T17:58:19.687 INFO:tasks.ceph.mds.f.smithi143.stderr:2024-04-26T17:58:19.687+0000 7f05df07e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T17:58:24.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T17:58:24.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:24.168 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T17:58:24.199 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:24.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.348+0000 7fea1b6f8640 1 Processor -- start 2024-04-26T17:58:24.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.349+0000 7fea1b6f8640 1 -- start start 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.349+0000 7fea1b6f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fea14153c50 0x7fea140cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.349+0000 7fea1b6f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea140cfe90 0x7fea141642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.349+0000 7fea1b6f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea14159d70 con 0x7fea140caab0 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.349+0000 7fea1b6f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fea140c43a0 con 0x7fea14153c50 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.349+0000 7fea1b6f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fea1415a8d0 con 0x7fea140cfe90 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea19c95640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea140cfe90 0x7fea141642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea19494640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fea14153c50 0x7fea140cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea18c93640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fea140caab0 0x7fea1406fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:54882/0 (socket says 172.21.15.139:54882) 2024-04-26T17:58:24.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea18c93640 1 -- 172.21.15.139:0/2871336038 learned_addr learned my addr 172.21.15.139:0/2871336038 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:24.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea0bfff640 1 -- 172.21.15.139:0/2871336038 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203663732 0 0) 0x7fea14159d70 con 0x7fea140caab0 2024-04-26T17:58:24.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea0bfff640 1 -- 172.21.15.139:0/2871336038 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea00003520 con 0x7fea140caab0 2024-04-26T17:58:24.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea19494640 1 -- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea140cfe90 msgr2=0x7fea141642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:24.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea19494640 1 --2- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea140cfe90 0x7fea141642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea19494640 1 -- 172.21.15.139:0/2871336038 >> v1:172.21.15.143:6789/0 conn(0x7fea140caab0 legacy=0x7fea1406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea19494640 1 -- 172.21.15.139:0/2871336038 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea14154030 con 0x7fea14153c50 2024-04-26T17:58:24.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.350+0000 7fea19c95640 1 --2- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea140cfe90 0x7fea141642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:24.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea19494640 1 --2- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea14153c50 0x7fea140cf950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea100097a0 tx=0x7fea1002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53d170fee75e8349 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea0bfff640 1 -- 172.21.15.139:0/2871336038 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10037070 con 0x7fea14153c50 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea0bfff640 1 -- 172.21.15.139:0/2871336038 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea10032440 con 0x7fea14153c50 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea0bfff640 1 -- 172.21.15.139:0/2871336038 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea100327f0 con 0x7fea14153c50 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea1b6f8640 1 -- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea14153c50 msgr2=0x7fea140cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea14153c50 0x7fea140cf950 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea100097a0 tx=0x7fea1002a210 comp rx=0 tx=0).stop 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea1b6f8640 1 -- 172.21.15.139:0/2871336038 shutdown_connections 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea140cfe90 0x7fea141642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/2871336038 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea14153c50 0x7fea140cf950 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.351+0000 7fea1b6f8640 1 -- 172.21.15.139:0/2871336038 >> 172.21.15.139:0/2871336038 conn(0x7fea14071bf0 msgr2=0x7fea14071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.352+0000 7fea1b6f8640 1 -- 172.21.15.139:0/2871336038 shutdown_connections 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.352+0000 7fea1b6f8640 1 -- 172.21.15.139:0/2871336038 wait complete. 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 Processor -- start 2024-04-26T17:58:24.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 -- start start 2024-04-26T17:58:24.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea140caab0 0x7fea1415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea140cfe90 0x7fea140c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea14153c50 0x7fea140b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea1415a310 con 0x7fea140caab0 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fea140cf4c0 con 0x7fea140cfe90 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.353+0000 7fea1b6f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fea1415a5f0 con 0x7fea14153c50 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea140caab0 0x7fea1415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea140caab0 0x7fea1415c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48702/0 (socket says 172.21.15.139:48702) 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 -- 172.21.15.139:0/3365422454 learned_addr learned my addr 172.21.15.139:0/3365422454 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea18c93640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea140cfe90 0x7fea140c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19c95640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea14153c50 0x7fea140b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 -- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea14153c50 msgr2=0x7fea140b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea14153c50 0x7fea140b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 -- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea140cfe90 msgr2=0x7fea140c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea140cfe90 0x7fea140c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 -- 172.21.15.139:0/3365422454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1415c950 con 0x7fea140caab0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea19494640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea140caab0 0x7fea1415c0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea1002a250 tx=0x7fea100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea09ffb640 1 -- 172.21.15.139:0/3365422454 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10037040 con 0x7fea140caab0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea09ffb640 1 -- 172.21.15.139:0/3365422454 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea10042070 con 0x7fea140caab0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1415ac40 con 0x7fea140caab0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea09ffb640 1 -- 172.21.15.139:0/3365422454 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1003b870 con 0x7fea140caab0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.354+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1415b200 con 0x7fea140caab0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.355+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea14069ae0 con 0x7fea140caab0 2024-04-26T17:58:24.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.356+0000 7fea09ffb640 1 -- 172.21.15.139:0/3365422454 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea1003ba10 con 0x7fea140caab0 2024-04-26T17:58:24.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.356+0000 7fea09ffb640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9f806c8f0 0x7fe9f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.356+0000 7fea09ffb640 1 -- 172.21.15.139:0/3365422454 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fea100ac5c0 con 0x7fea140caab0 2024-04-26T17:58:24.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.356+0000 7fea18c93640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9f806c8f0 0x7fe9f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.357+0000 7fea18c93640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9f806c8f0 0x7fe9f806edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea1415c050 tx=0x7fea04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.361+0000 7fea09ffb640 1 -- 172.21.15.139:0/3365422454 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea1007a6b0 con 0x7fea140caab0 2024-04-26T17:58:24.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.538+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea14076d20 con 0x7fea140caab0 2024-04-26T17:58:24.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.539+0000 7fea09ffb640 1 -- 172.21.15.139:0/3365422454 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fea10079fb0 con 0x7fea140caab0 2024-04-26T17:58:24.538 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:24.538 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:24.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9f806c8f0 msgr2=0x7fe9f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9f806c8f0 0x7fe9f806edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea1415c050 tx=0x7fea04009040 comp rx=0 tx=0).stop 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea140caab0 msgr2=0x7fea1415c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea140caab0 0x7fea1415c0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea1002a250 tx=0x7fea100046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 shutdown_connections 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9f806c8f0 0x7fe9f806edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fea14153c50 0x7fea140b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fea140cfe90 0x7fea140c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 --2- 172.21.15.139:0/3365422454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea140caab0 0x7fea1415c0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 >> 172.21.15.139:0/3365422454 conn(0x7fea14071bf0 msgr2=0x7fea140cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 shutdown_connections 2024-04-26T17:58:24.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.541+0000 7fea1b6f8640 1 -- 172.21.15.139:0/3365422454 wait complete. 2024-04-26T17:58:24.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:24.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.649+0000 7faf91e47640 1 Processor -- start 2024-04-26T17:58:24.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.649+0000 7faf91e47640 1 -- start start 2024-04-26T17:58:24.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf91e47640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faf8c15d570 0x7faf8c0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf91e47640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8c0c7d30 con 0x7faf8c153b10 2024-04-26T17:58:24.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf91e47640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8c0c7ff0 con 0x7faf8c06e240 2024-04-26T17:58:24.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf91e47640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7faf8c06e8d0 con 0x7faf8c15d570 2024-04-26T17:58:24.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf8bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faf8c15d570 0x7faf8c0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf8b7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7faf8c153b10 0x7faf8c0cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38124/0 (socket says 172.21.15.139:38124) 2024-04-26T17:58:24.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf8b7fe640 1 -- 172.21.15.139:0/1409187294 learned_addr learned my addr 172.21.15.139:0/1409187294 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:24.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf8bfff640 1 -- 172.21.15.139:0/1409187294 >> v1:172.21.15.143:6789/0 conn(0x7faf8c06e240 legacy=0x7faf8c15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf8bfff640 1 -- 172.21.15.139:0/1409187294 >> v1:172.21.15.139:6789/0 conn(0x7faf8c153b10 legacy=0x7faf8c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.651+0000 7faf8bfff640 1 -- 172.21.15.139:0/1409187294 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c072fe0 con 0x7faf8c15d570 2024-04-26T17:58:24.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.650+0000 7faf8a7fc640 1 -- 172.21.15.139:0/1409187294 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604980842 0 0) 0x7faf8c0c7d30 con 0x7faf8c153b10 2024-04-26T17:58:24.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.651+0000 7faf8bfff640 1 --2- 172.21.15.139:0/1409187294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c15d570 0x7faf8c0c96d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf84009d90 tx=0x7faf8402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6619f440cbb941b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.651+0000 7faf8a7fc640 1 -- 172.21.15.139:0/1409187294 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84037070 con 0x7faf8c15d570 2024-04-26T17:58:24.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.651+0000 7faf8a7fc640 1 -- 172.21.15.139:0/1409187294 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf84007740 con 0x7faf8c15d570 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.651+0000 7faf8a7fc640 1 -- 172.21.15.139:0/1409187294 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84007b10 con 0x7faf8c15d570 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.652+0000 7faf91e47640 1 -- 172.21.15.139:0/1409187294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c15d570 msgr2=0x7faf8c0c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.652+0000 7faf91e47640 1 --2- 172.21.15.139:0/1409187294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c15d570 0x7faf8c0c96d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faf84009d90 tx=0x7faf8402a780 comp rx=0 tx=0).stop 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.652+0000 7faf91e47640 1 -- 172.21.15.139:0/1409187294 shutdown_connections 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.652+0000 7faf91e47640 1 --2- 172.21.15.139:0/1409187294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c15d570 0x7faf8c0c96d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.652+0000 7faf91e47640 1 -- 172.21.15.139:0/1409187294 >> 172.21.15.139:0/1409187294 conn(0x7faf8c068270 msgr2=0x7faf8c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.652+0000 7faf91e47640 1 -- 172.21.15.139:0/1409187294 shutdown_connections 2024-04-26T17:58:24.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.652+0000 7faf91e47640 1 -- 172.21.15.139:0/1409187294 wait complete. 2024-04-26T17:58:24.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.653+0000 7faf91e47640 1 Processor -- start 2024-04-26T17:58:24.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.653+0000 7faf91e47640 1 -- start start 2024-04-26T17:58:24.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf91e47640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c06e240 0x7faf8c0c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf91e47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf8c153b10 0x7faf8c0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf91e47640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf8c15d570 0x7faf8c1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf91e47640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c0735a0 con 0x7faf8c06e240 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf91e47640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c073910 con 0x7faf8c153b10 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf91e47640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faf8c153ef0 con 0x7faf8c15d570 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c06e240 0x7faf8c0c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c06e240 0x7faf8c0c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48724/0 (socket says 172.21.15.139:48724) 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 -- 172.21.15.139:0/105658453 learned_addr learned my addr 172.21.15.139:0/105658453 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 -- 172.21.15.139:0/105658453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf8c15d570 msgr2=0x7faf8c1486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf8c15d570 0x7faf8c1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 -- 172.21.15.139:0/105658453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf8c153b10 msgr2=0x7faf8c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf8c153b10 0x7faf8c0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 -- 172.21.15.139:0/105658453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c0c6710 con 0x7faf8c06e240 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf8b7fe640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c06e240 0x7faf8c0c4e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c4d0 tx=0x7faf7c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf73fff640 1 -- 172.21.15.139:0/105658453 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c018070 con 0x7faf8c06e240 2024-04-26T17:58:24.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf73fff640 1 -- 172.21.15.139:0/105658453 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c0075a0 con 0x7faf8c06e240 2024-04-26T17:58:24.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c15a950 con 0x7faf8c06e240 2024-04-26T17:58:24.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.654+0000 7faf73fff640 1 -- 172.21.15.139:0/105658453 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c004a20 con 0x7faf8c06e240 2024-04-26T17:58:24.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.655+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c0c5c30 con 0x7faf8c06e240 2024-04-26T17:58:24.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.655+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8c076d20 con 0x7faf8c06e240 2024-04-26T17:58:24.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.656+0000 7faf73fff640 1 -- 172.21.15.139:0/105658453 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf7c01b070 con 0x7faf8c06e240 2024-04-26T17:58:24.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.656+0000 7faf73fff640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faf7806c8f0 0x7faf7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.656+0000 7faf73fff640 1 -- 172.21.15.139:0/105658453 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faf7c08b130 con 0x7faf8c06e240 2024-04-26T17:58:24.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.656+0000 7faf8affd640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faf7806c8f0 0x7faf7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.657+0000 7faf8affd640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faf7806c8f0 0x7faf7806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf80000f60 tx=0x7faf800079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.661+0000 7faf73fff640 1 -- 172.21.15.139:0/105658453 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf7c0592b0 con 0x7faf8c06e240 2024-04-26T17:58:24.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.842+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf8c06eab0 con 0x7faf8c06e240 2024-04-26T17:58:24.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.843+0000 7faf73fff640 1 -- 172.21.15.139:0/105658453 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7faf7c058bb0 con 0x7faf8c06e240 2024-04-26T17:58:24.843 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:24.843 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faf7806c8f0 msgr2=0x7faf7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faf7806c8f0 0x7faf7806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf80000f60 tx=0x7faf800079b0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c06e240 msgr2=0x7faf8c0c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c06e240 0x7faf8c0c4e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c4d0 tx=0x7faf7c00c990 comp rx=0 tx=0).stop 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 shutdown_connections 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faf7806c8f0 0x7faf7806edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faf8c15d570 0x7faf8c1486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf8c153b10 0x7faf8c0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 --2- 172.21.15.139:0/105658453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf8c06e240 0x7faf8c0c4e50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.845+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 >> 172.21.15.139:0/105658453 conn(0x7faf8c068270 msgr2=0x7faf8c1431a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.846+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 shutdown_connections 2024-04-26T17:58:24.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.846+0000 7faf91e47640 1 -- 172.21.15.139:0/105658453 wait complete. 2024-04-26T17:58:24.856 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T17:58:24.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.955+0000 7fd494020640 1 Processor -- start 2024-04-26T17:58:24.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.955+0000 7fd494020640 1 -- start start 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd494020640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd48c072f20 0x7fd48c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd494020640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd494020640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd48c0c4770 con 0x7fd48c152bc0 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd494020640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd48c0733f0 con 0x7fd48c072f20 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd494020640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd48c06d2f0 con 0x7fd48c0c4ec0 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd491dbc640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd48c152bc0 0x7fd48c0c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38134/0 (socket says 172.21.15.139:38134) 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd491dbc640 1 -- 172.21.15.139:0/115671666 learned_addr learned my addr 172.21.15.139:0/115671666 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd4925bd640 1 --2- 172.21.15.139:0/115671666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.956+0000 7fd4915bb640 1 --2- 172.21.15.139:0/115671666 >> v2:172.21.15.143:3300/0 conn(0x7fd48c072f20 0x7fd48c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd490dba640 1 -- 172.21.15.139:0/115671666 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1088850846 0 0) 0x7fd48c0c4770 con 0x7fd48c152bc0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd490dba640 1 -- 172.21.15.139:0/115671666 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd478003520 con 0x7fd48c152bc0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd490dba640 1 -- 172.21.15.139:0/115671666 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3120706430 0 0) 0x7fd478003520 con 0x7fd48c152bc0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd4925bd640 1 -- 172.21.15.139:0/115671666 >> v2:172.21.15.143:3300/0 conn(0x7fd48c072f20 msgr2=0x7fd48c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd4925bd640 1 --2- 172.21.15.139:0/115671666 >> v2:172.21.15.143:3300/0 conn(0x7fd48c072f20 0x7fd48c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd4925bd640 1 -- 172.21.15.139:0/115671666 >> v1:172.21.15.139:6789/0 conn(0x7fd48c152bc0 legacy=0x7fd48c0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd4925bd640 1 -- 172.21.15.139:0/115671666 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c074470 con 0x7fd48c0c4ec0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.957+0000 7fd4915bb640 1 --2- 172.21.15.139:0/115671666 >> v2:172.21.15.143:3300/0 conn(0x7fd48c072f20 0x7fd48c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd4925bd640 1 --2- 172.21.15.139:0/115671666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0ce3e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097a0 tx=0x7fd48402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce32b3a00c96303f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd490dba640 1 -- 172.21.15.139:0/115671666 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484037070 con 0x7fd48c0c4ec0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd490dba640 1 -- 172.21.15.139:0/115671666 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48402ac30 con 0x7fd48c0c4ec0 2024-04-26T17:58:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd490dba640 1 -- 172.21.15.139:0/115671666 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4880019f0 con 0x7fd48c0c4ec0 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 -- 172.21.15.139:0/115671666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 msgr2=0x7fd48c0ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 --2- 172.21.15.139:0/115671666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0ce3e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097a0 tx=0x7fd48402a1a0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 -- 172.21.15.139:0/115671666 shutdown_connections 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 --2- 172.21.15.139:0/115671666 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0ce3e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 --2- 172.21.15.139:0/115671666 >> v2:172.21.15.143:3300/0 conn(0x7fd48c072f20 0x7fd48c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 -- 172.21.15.139:0/115671666 >> 172.21.15.139:0/115671666 conn(0x7fd48c06ed70 msgr2=0x7fd48c06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 -- 172.21.15.139:0/115671666 shutdown_connections 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.958+0000 7fd494020640 1 -- 172.21.15.139:0/115671666 wait complete. 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.959+0000 7fd494020640 1 Processor -- start 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.959+0000 7fd494020640 1 -- start start 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd494020640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd48c072f20 0x7fd48c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd494020640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd494020640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c152bc0 0x7fd48c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd494020640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c0c4250 con 0x7fd48c152bc0 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd494020640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c0c3f70 con 0x7fd48c072f20 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd494020640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd48c152fa0 con 0x7fd48c0c4ec0 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c152bc0 0x7fd48c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c152bc0 0x7fd48c14da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48740/0 (socket says 172.21.15.139:48740) 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 -- 172.21.15.139:0/3508767275 learned_addr learned my addr 172.21.15.139:0/3508767275 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4915bb640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd491dbc640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd48c072f20 0x7fd48c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 -- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 msgr2=0x7fd48c0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 -- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd48c072f20 msgr2=0x7fd48c1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd48c072f20 0x7fd48c1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.960+0000 7fd4925bd640 1 -- 172.21.15.139:0/3508767275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c14faf0 con 0x7fd48c152bc0 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.961+0000 7fd4925bd640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c152bc0 0x7fd48c14da20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097a0 tx=0x7fd4840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.961+0000 7fd4827fc640 1 -- 172.21.15.139:0/3508767275 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484037050 con 0x7fd48c152bc0 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.961+0000 7fd4827fc640 1 -- 172.21.15.139:0/3508767275 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd484038040 con 0x7fd48c152bc0 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.961+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48c14fdd0 con 0x7fd48c152bc0 2024-04-26T17:58:24.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.961+0000 7fd4827fc640 1 -- 172.21.15.139:0/3508767275 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484006e10 con 0x7fd48c152bc0 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.961+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48c1f2c00 con 0x7fd48c152bc0 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.962+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48c14d380 con 0x7fd48c152bc0 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.962+0000 7fd4827fc640 1 -- 172.21.15.139:0/3508767275 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd484003610 con 0x7fd48c152bc0 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.962+0000 7fd4827fc640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47006c8f0 0x7fd47006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.963+0000 7fd4827fc640 1 -- 172.21.15.139:0/3508767275 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd4840ac4b0 con 0x7fd48c152bc0 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.963+0000 7fd491dbc640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47006c8f0 0x7fd47006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.963+0000 7fd491dbc640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47006c8f0 0x7fd47006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd488005c00 tx=0x7fd488009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:24.967+0000 7fd4827fc640 1 -- 172.21.15.139:0/3508767275 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd484079f50 con 0x7fd48c152bc0 2024-04-26T17:58:25.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.181+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd48c076d20 con 0x7fd48c152bc0 2024-04-26T17:58:25.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.767+0000 7fd4827fc640 1 -- 172.21.15.139:0/3508767275 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fd48407e250 con 0x7fd48c152bc0 2024-04-26T17:58:25.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47006c8f0 msgr2=0x7fd47006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47006c8f0 0x7fd47006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd488005c00 tx=0x7fd488009040 comp rx=0 tx=0).stop 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c152bc0 msgr2=0x7fd48c14da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c152bc0 0x7fd48c14da20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd4840097a0 tx=0x7fd4840046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 shutdown_connections 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47006c8f0 0x7fd47006edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd48c152bc0 0x7fd48c14da20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd48c0c4ec0 0x7fd48c0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 --2- 172.21.15.139:0/3508767275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd48c072f20 0x7fd48c1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 >> 172.21.15.139:0/3508767275 conn(0x7fd48c06ed70 msgr2=0x7fd48c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 shutdown_connections 2024-04-26T17:58:25.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.769+0000 7fd494020640 1 -- 172.21.15.139:0/3508767275 wait complete. 2024-04-26T17:58:25.781 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-04-26T17:58:25.781 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T17:58:25.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.882+0000 7fc754862640 1 Processor -- start 2024-04-26T17:58:25.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.882+0000 7fc754862640 1 -- start start 2024-04-26T17:58:25.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.883+0000 7fc754862640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:25.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.883+0000 7fc754862640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7500cae60 con 0x7fc750072230 2024-04-26T17:58:25.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.883+0000 7fc754862640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc750159f60 con 0x7fc750071e50 2024-04-26T17:58:25.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.883+0000 7fc754862640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc75015a240 con 0x7fc7500cfec0 2024-04-26T17:58:25.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74ed9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc750072230 0x7fc7500cb310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38140/0 (socket says 172.21.15.139:38140) 2024-04-26T17:58:25.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74ed9d640 1 -- 172.21.15.139:0/4197288325 learned_addr learned my addr 172.21.15.139:0/4197288325 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74dd9b640 1 --2- 172.21.15.139:0/4197288325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478832235 0 0) 0x7fc7500cae60 con 0x7fc750072230 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc738003520 con 0x7fc750072230 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954347204 0 0) 0x7fc750159f60 con 0x7fc750071e50 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7500cae60 con 0x7fc750071e50 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 470022963 0 0) 0x7fc738003520 con 0x7fc750072230 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74dd9b640 1 -- 172.21.15.139:0/4197288325 >> v1:172.21.15.143:6789/0 conn(0x7fc750071e50 legacy=0x7fc7500c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74dd9b640 1 -- 172.21.15.139:0/4197288325 >> v1:172.21.15.139:6789/0 conn(0x7fc750072230 legacy=0x7fc7500cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:25.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.884+0000 7fc74dd9b640 1 -- 172.21.15.139:0/4197288325 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75015a520 con 0x7fc7500cfec0 2024-04-26T17:58:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.885+0000 7fc74dd9b640 1 --2- 172.21.15.139:0/4197288325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc744009df0 tx=0x7fc74402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182c2d0197cd2161 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:25.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.885+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740001670 con 0x7fc7500cfec0 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.885+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc744007540 con 0x7fc7500cfec0 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.885+0000 7fc74d59a640 1 -- 172.21.15.139:0/4197288325 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7440078f0 con 0x7fc7500cfec0 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.885+0000 7fc754862640 1 -- 172.21.15.139:0/4197288325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 msgr2=0x7fc7500b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.885+0000 7fc754862640 1 --2- 172.21.15.139:0/4197288325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc744009df0 tx=0x7fc74402a730 comp rx=0 tx=0).stop 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.886+0000 7fc754862640 1 -- 172.21.15.139:0/4197288325 shutdown_connections 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.886+0000 7fc754862640 1 --2- 172.21.15.139:0/4197288325 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1a20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.886+0000 7fc754862640 1 -- 172.21.15.139:0/4197288325 >> 172.21.15.139:0/4197288325 conn(0x7fc75006fe70 msgr2=0x7fc750070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.886+0000 7fc754862640 1 -- 172.21.15.139:0/4197288325 shutdown_connections 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.886+0000 7fc754862640 1 -- 172.21.15.139:0/4197288325 wait complete. 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.887+0000 7fc754862640 1 Processor -- start 2024-04-26T17:58:25.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.887+0000 7fc754862640 1 -- start start 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc750071e50 0x7fc75006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc750072230 0x7fc7501f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc75015aae0 con 0x7fc750071e50 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc750159c30 con 0x7fc750072230 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc7500cba20 con 0x7fc7500cfec0 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc750071e50 0x7fc75006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc750071e50 0x7fc75006dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48746/0 (socket says 172.21.15.139:48746) 2024-04-26T17:58:25.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 -- 172.21.15.139:0/4059303246 learned_addr learned my addr 172.21.15.139:0/4059303246 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74ed9d640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74dd9b640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc750072230 0x7fc7501f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 -- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 msgr2=0x7fc7500b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 -- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc750072230 msgr2=0x7fc7501f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc750072230 0x7fc7501f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 -- 172.21.15.139:0/4059303246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75006c490 con 0x7fc750071e50 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc74e59c640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc750071e50 0x7fc75006dea0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c490 tx=0x7fc74800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc73effd640 1 -- 172.21.15.139:0/4059303246 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7480052d0 con 0x7fc750071e50 2024-04-26T17:58:25.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc73effd640 1 -- 172.21.15.139:0/4059303246 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc748005470 con 0x7fc750071e50 2024-04-26T17:58:25.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc73effd640 1 -- 172.21.15.139:0/4059303246 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748012870 con 0x7fc750071e50 2024-04-26T17:58:25.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75006c770 con 0x7fc750071e50 2024-04-26T17:58:25.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.888+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75006d6a0 con 0x7fc750071e50 2024-04-26T17:58:25.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.889+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc750069ae0 con 0x7fc750071e50 2024-04-26T17:58:25.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.890+0000 7fc73effd640 1 -- 172.21.15.139:0/4059303246 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc748012a10 con 0x7fc750071e50 2024-04-26T17:58:25.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.890+0000 7fc73effd640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc73006c8f0 0x7fc73006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:25.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.890+0000 7fc74dd9b640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc73006c8f0 0x7fc73006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:25.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.890+0000 7fc73effd640 1 -- 172.21.15.139:0/4059303246 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc74808bbd0 con 0x7fc750071e50 2024-04-26T17:58:25.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.891+0000 7fc74dd9b640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc73006c8f0 0x7fc73006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc744034000 tx=0x7fc744033040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:25.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:25.895+0000 7fc73effd640 1 -- 172.21.15.139:0/4059303246 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc748059c30 con 0x7fc750071e50 2024-04-26T17:58:26.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.108+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc750157860 con 0x7fc750071e50 2024-04-26T17:58:26.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.775+0000 7fc73effd640 1 -- 172.21.15.139:0/4059303246 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fc750157860 con 0x7fc750071e50 2024-04-26T17:58:26.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc73006c8f0 msgr2=0x7fc73006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:26.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc73006c8f0 0x7fc73006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc744034000 tx=0x7fc744033040 comp rx=0 tx=0).stop 2024-04-26T17:58:26.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc750071e50 msgr2=0x7fc75006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:26.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc750071e50 0x7fc75006dea0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c490 tx=0x7fc74800c950 comp rx=0 tx=0).stop 2024-04-26T17:58:26.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 shutdown_connections 2024-04-26T17:58:26.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc73006c8f0 0x7fc73006edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc7500cfec0 0x7fc7500b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc750072230 0x7fc7501f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 --2- 172.21.15.139:0/4059303246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc750071e50 0x7fc75006dea0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 >> 172.21.15.139:0/4059303246 conn(0x7fc75006fe70 msgr2=0x7fc7500ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:26.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 shutdown_connections 2024-04-26T17:58:26.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.778+0000 7fc754862640 1 -- 172.21.15.139:0/4059303246 wait complete. 2024-04-26T17:58:26.790 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-26T17:58:26.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.895+0000 7f5093fac640 1 Processor -- start 2024-04-26T17:58:26.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.895+0000 7f5093fac640 1 -- start start 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5093fac640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c15a400 0x7f508c163540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5093fac640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f508c0c7a00 0x7f508c16a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5093fac640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508c0c8670 con 0x7f508c163a80 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5093fac640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f508c160fa0 con 0x7f508c0c7a00 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5093fac640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f508c1601e0 con 0x7f508c15a400 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5092549640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f508c0c7a00 0x7f508c16a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5092549640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f508c0c7a00 0x7f508c16a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48758/0 (socket says 172.21.15.139:48758) 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5091547640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f508c163a80 0x7f508c06f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38142/0 (socket says 172.21.15.139:38142) 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5092549640 1 -- 172.21.15.139:0/851217149 learned_addr learned my addr 172.21.15.139:0/851217149 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:26.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5091d48640 1 --2- 172.21.15.139:0/851217149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c15a400 0x7f508c163540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5092549640 1 -- 172.21.15.139:0/851217149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c15a400 msgr2=0x7f508c163540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5092549640 1 --2- 172.21.15.139:0/851217149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c15a400 0x7f508c163540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5092549640 1 -- 172.21.15.139:0/851217149 >> v1:172.21.15.139:6789/0 conn(0x7f508c163a80 legacy=0x7f508c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5092549640 1 -- 172.21.15.139:0/851217149 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c1604c0 con 0x7f508c0c7a00 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.896+0000 7f5090d46640 1 -- 172.21.15.139:0/851217149 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243131523 0 0) 0x7f508c0c8670 con 0x7f508c163a80 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5092549640 1 --2- 172.21.15.139:0/851217149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0c7a00 0x7f508c16a890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5084009e50 tx=0x7f508402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e832ce1b1f69e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5090d46640 1 -- 172.21.15.139:0/851217149 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084036070 con 0x7f508c0c7a00 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5090d46640 1 -- 172.21.15.139:0/851217149 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084031600 con 0x7f508c0c7a00 2024-04-26T17:58:26.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5090d46640 1 -- 172.21.15.139:0/851217149 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50840319d0 con 0x7f508c0c7a00 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5093fac640 1 -- 172.21.15.139:0/851217149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0c7a00 msgr2=0x7f508c16a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5093fac640 1 --2- 172.21.15.139:0/851217149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0c7a00 0x7f508c16a890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5084009e50 tx=0x7f508402a710 comp rx=0 tx=0).stop 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5093fac640 1 -- 172.21.15.139:0/851217149 shutdown_connections 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5093fac640 1 --2- 172.21.15.139:0/851217149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c0c7a00 0x7f508c16a890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5093fac640 1 --2- 172.21.15.139:0/851217149 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c15a400 0x7f508c163540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.897+0000 7f5093fac640 1 -- 172.21.15.139:0/851217149 >> 172.21.15.139:0/851217149 conn(0x7f508c06dd40 msgr2=0x7f508c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.898+0000 7f5093fac640 1 -- 172.21.15.139:0/851217149 shutdown_connections 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.898+0000 7f5093fac640 1 -- 172.21.15.139:0/851217149 wait complete. 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 Processor -- start 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 -- start start 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c0c7a00 0x7f508c1eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c15a400 0x7f508c0c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508c163a80 0x7f508c1ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f508c0ca810 con 0x7f508c15a400 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f508c160a80 con 0x7f508c163a80 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5093fac640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f508c070080 con 0x7f508c0c7a00 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5091547640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c15a400 0x7f508c0c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5091547640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c15a400 0x7f508c0c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48762/0 (socket says 172.21.15.139:48762) 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.899+0000 7f5091547640 1 -- 172.21.15.139:0/1276573105 learned_addr learned my addr 172.21.15.139:0/1276573105 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5091547640 1 -- 172.21.15.139:0/1276573105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c0c7a00 msgr2=0x7f508c1eafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5092549640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508c163a80 0x7f508c1ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5091547640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c0c7a00 0x7f508c1eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5091547640 1 -- 172.21.15.139:0/1276573105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508c163a80 msgr2=0x7f508c1ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5091547640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508c163a80 0x7f508c1ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5091547640 1 -- 172.21.15.139:0/1276573105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c0748d0 con 0x7f508c15a400 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5091547640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c15a400 0x7f508c0c9850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c500 tx=0x7f507c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f50827fc640 1 -- 172.21.15.139:0/1276573105 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c018070 con 0x7f508c15a400 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f50827fc640 1 -- 172.21.15.139:0/1276573105 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c007580 con 0x7f508c15a400 2024-04-26T17:58:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f50827fc640 1 -- 172.21.15.139:0/1276573105 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c004a20 con 0x7f508c15a400 2024-04-26T17:58:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c1f5960 con 0x7f508c15a400 2024-04-26T17:58:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.900+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c1f5f20 con 0x7f508c15a400 2024-04-26T17:58:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.901+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508c076d20 con 0x7f508c15a400 2024-04-26T17:58:26.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.901+0000 7f50827fc640 1 -- 172.21.15.139:0/1276573105 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f507c01b070 con 0x7f508c15a400 2024-04-26T17:58:26.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.902+0000 7f50827fc640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f507006c920 0x7f507006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:26.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.902+0000 7f50827fc640 1 -- 172.21.15.139:0/1276573105 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f507c08b1f0 con 0x7f508c15a400 2024-04-26T17:58:26.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.902+0000 7f5091d48640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f507006c920 0x7f507006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:26.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.902+0000 7f5091d48640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f507006c920 0x7f507006ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5088006fd0 tx=0x7f5088008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:26.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:26.906+0000 7f50827fc640 1 -- 172.21.15.139:0/1276573105 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f507c0592e0 con 0x7f508c15a400 2024-04-26T17:58:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.122+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f508c0c8010 con 0x7f508c15a400 2024-04-26T17:58:27.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.777+0000 7f50827fc640 1 -- 172.21.15.139:0/1276573105 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f507c058be0 con 0x7f508c15a400 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f507006c920 msgr2=0x7f507006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f507006c920 0x7f507006ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5088006fd0 tx=0x7f5088008040 comp rx=0 tx=0).stop 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c15a400 msgr2=0x7f508c0c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c15a400 0x7f508c0c9850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c500 tx=0x7f507c00c9c0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 shutdown_connections 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f507006c920 0x7f507006ede0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f508c163a80 0x7f508c1ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f508c15a400 0x7f508c0c9850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 --2- 172.21.15.139:0/1276573105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f508c0c7a00 0x7f508c1eafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 >> 172.21.15.139:0/1276573105 conn(0x7f508c06dd40 msgr2=0x7f508c163350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:27.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.779+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 shutdown_connections 2024-04-26T17:58:27.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.780+0000 7f5093fac640 1 -- 172.21.15.139:0/1276573105 wait complete. 2024-04-26T17:58:27.793 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T17:58:27.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:27.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.896+0000 7fbbe7a09640 1 Processor -- start 2024-04-26T17:58:27.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.896+0000 7fbbe7a09640 1 -- start start 2024-04-26T17:58:27.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe7a09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca140 0x7fbbe0155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe7a09640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbbe00ca520 0x7fbbe0155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe7a09640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe015bc90 con 0x7fbbe0070150 2024-04-26T17:58:27.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe7a09640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe015bf70 con 0x7fbbe00ca520 2024-04-26T17:58:27.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe7a09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe015c250 con 0x7fbbe00ca140 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe5fa6640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fbbe0070150 0x7fbbe00cbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:54900/0 (socket says 172.21.15.139:54900) 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe57a5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca140 0x7fbbe0155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe5fa6640 1 -- 172.21.15.139:0/1774603999 learned_addr learned my addr 172.21.15.139:0/1774603999 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.897+0000 7fbbe4fa4640 1 --2- 172.21.15.139:0/1774603999 >> v2:172.21.15.143:3300/0 conn(0x7fbbe00ca520 0x7fbbe0155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.898+0000 7fbbe4fa4640 1 -- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca140 msgr2=0x7fbbe0155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.898+0000 7fbbe4fa4640 1 --2- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca140 0x7fbbe0155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.898+0000 7fbbe4fa4640 1 -- 172.21.15.139:0/1774603999 >> v1:172.21.15.143:6789/0 conn(0x7fbbe0070150 legacy=0x7fbbe00cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.898+0000 7fbbe4fa4640 1 -- 172.21.15.139:0/1774603999 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe015c530 con 0x7fbbe00ca520 2024-04-26T17:58:27.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.898+0000 7fbbe57a5640 1 --2- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca140 0x7fbbe0155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.898+0000 7fbbe4fa4640 1 --2- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe00ca520 0x7fbbe0155e60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00097a0 tx=0x7fbbd002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe0c557fbf6deda server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbd7fff640 1 -- 172.21.15.139:0/1774603999 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0037070 con 0x7fbbe00ca520 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbd7fff640 1 -- 172.21.15.139:0/1774603999 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd0032440 con 0x7fbbe00ca520 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbd7fff640 1 -- 172.21.15.139:0/1774603999 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0032810 con 0x7fbbe00ca520 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 -- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe00ca520 msgr2=0x7fbbe0155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe00ca520 0x7fbbe0155e60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00097a0 tx=0x7fbbd002a180 comp rx=0 tx=0).stop 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 -- 172.21.15.139:0/1774603999 shutdown_connections 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe00ca520 0x7fbbe0155e60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/1774603999 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca140 0x7fbbe0155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 -- 172.21.15.139:0/1774603999 >> 172.21.15.139:0/1774603999 conn(0x7fbbe0071ec0 msgr2=0x7fbbe00722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 -- 172.21.15.139:0/1774603999 shutdown_connections 2024-04-26T17:58:27.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.899+0000 7fbbe7a09640 1 -- 172.21.15.139:0/1774603999 wait complete. 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.900+0000 7fbbe7a09640 1 Processor -- start 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.900+0000 7fbbe7a09640 1 -- start start 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe7a09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe0070150 0x7fbbe0154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe7a09640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe00ca140 0x7fbbe00c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe7a09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca520 0x7fbbe00c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe7a09640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00cc670 con 0x7fbbe00ca140 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe7a09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00716a0 con 0x7fbbe0070150 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe7a09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe00cc7f0 con 0x7fbbe00ca520 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe4fa4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe00ca140 0x7fbbe00c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe4fa4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe00ca140 0x7fbbe00c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48770/0 (socket says 172.21.15.139:48770) 2024-04-26T17:58:27.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe4fa4640 1 -- 172.21.15.139:0/3602154937 learned_addr learned my addr 172.21.15.139:0/3602154937 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe57a5640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe0070150 0x7fbbe0154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe5fa6640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca520 0x7fbbe00c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.901+0000 7fbbe4fa4640 1 -- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca520 msgr2=0x7fbbe00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbe4fa4640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca520 0x7fbbe00c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbe4fa4640 1 -- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe0070150 msgr2=0x7fbbe0154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbe4fa4640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe0070150 0x7fbbe0154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbe4fa4640 1 -- 172.21.15.139:0/3602154937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe01550a0 con 0x7fbbe00ca140 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbe4fa4640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe00ca140 0x7fbbe00c7450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbbd002a1c0 tx=0x7fbbd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbd5ffb640 1 -- 172.21.15.139:0/3602154937 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0041020 con 0x7fbbe00ca140 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbd5ffb640 1 -- 172.21.15.139:0/3602154937 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd0030700 con 0x7fbbe00ca140 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbd5ffb640 1 -- 172.21.15.139:0/3602154937 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0037040 con 0x7fbbe00ca140 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe00c8d40 con 0x7fbbe00ca140 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.902+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe00c6970 con 0x7fbbe00ca140 2024-04-26T17:58:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.903+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe0156b50 con 0x7fbbe00ca140 2024-04-26T17:58:27.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.903+0000 7fbbd5ffb640 1 -- 172.21.15.139:0/3602154937 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbbd0044020 con 0x7fbbe00ca140 2024-04-26T17:58:27.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.904+0000 7fbbd5ffb640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbbc406c8f0 0x7fbbc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.904+0000 7fbbd5ffb640 1 -- 172.21.15.139:0/3602154937 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbbd00ac590 con 0x7fbbe00ca140 2024-04-26T17:58:27.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.904+0000 7fbbe57a5640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbbc406c8f0 0x7fbbc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.904+0000 7fbbe57a5640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbbc406c8f0 0x7fbbc406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009bd0 tx=0x7fbbdc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:27.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:27.908+0000 7fbbd5ffb640 1 -- 172.21.15.139:0/3602154937 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbbe0156b50 con 0x7fbbe00ca140 2024-04-26T17:58:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.118+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbe0069600 con 0x7fbbe00ca140 2024-04-26T17:58:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.119+0000 7fbbd5ffb640 1 -- 172.21.15.139:0/3602154937 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fbbe0069600 con 0x7fbbe00ca140 2024-04-26T17:58:28.119 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:28.119 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbbc406c8f0 msgr2=0x7fbbc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbbc406c8f0 0x7fbbc406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009bd0 tx=0x7fbbdc00b040 comp rx=0 tx=0).stop 2024-04-26T17:58:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe00ca140 msgr2=0x7fbbe00c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe00ca140 0x7fbbe00c7450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbbd002a1c0 tx=0x7fbbd00046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 shutdown_connections 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbbc406c8f0 0x7fbbc406edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbbe00ca520 0x7fbbe00c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbe00ca140 0x7fbbe00c7450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 --2- 172.21.15.139:0/3602154937 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbbe0070150 0x7fbbe0154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 >> 172.21.15.139:0/3602154937 conn(0x7fbbe0071ec0 msgr2=0x7fbbe0156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 shutdown_connections 2024-04-26T17:58:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.121+0000 7fbbe7a09640 1 -- 172.21.15.139:0/3602154937 wait complete. 2024-04-26T17:58:28.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:28.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.228+0000 7fd49f437640 1 Processor -- start 2024-04-26T17:58:28.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.229+0000 7fd49f437640 1 -- start start 2024-04-26T17:58:28.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.229+0000 7fd49f437640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4980cf240 0x7fd4980cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.229+0000 7fd49f437640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd49815c140 0x7fd49815c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.229+0000 7fd49f437640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49815f490 con 0x7fd49806c310 2024-04-26T17:58:28.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.229+0000 7fd49f437640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd49815ca80 con 0x7fd49815c140 2024-04-26T17:58:28.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.229+0000 7fd49f437640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd498160010 con 0x7fd4980cf240 2024-04-26T17:58:28.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49d9d4640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd49806c310 0x7fd4980cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38156/0 (socket says 172.21.15.139:38156) 2024-04-26T17:58:28.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49d9d4640 1 -- 172.21.15.139:0/2296870563 learned_addr learned my addr 172.21.15.139:0/2296870563 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49d1d3640 1 --2- 172.21.15.139:0/2296870563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4980cf240 0x7fd4980cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49c9d2640 1 --2- 172.21.15.139:0/2296870563 >> v2:172.21.15.143:3300/0 conn(0x7fd49815c140 0x7fd49815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd48ffff640 1 -- 172.21.15.139:0/2296870563 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554813560 0 0) 0x7fd49815f490 con 0x7fd49806c310 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd48ffff640 1 -- 172.21.15.139:0/2296870563 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd484003520 con 0x7fd49806c310 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49d1d3640 1 -- 172.21.15.139:0/2296870563 >> v2:172.21.15.143:3300/0 conn(0x7fd49815c140 msgr2=0x7fd49815c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49d1d3640 1 --2- 172.21.15.139:0/2296870563 >> v2:172.21.15.143:3300/0 conn(0x7fd49815c140 0x7fd49815c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49d1d3640 1 -- 172.21.15.139:0/2296870563 >> v1:172.21.15.139:6789/0 conn(0x7fd49806c310 legacy=0x7fd4980cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.230+0000 7fd49d1d3640 1 -- 172.21.15.139:0/2296870563 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49815f770 con 0x7fd4980cf240 2024-04-26T17:58:28.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd49d1d3640 1 --2- 172.21.15.139:0/2296870563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4980cf240 0x7fd4980cf620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd4880097a0 tx=0x7fd48802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a2fdddd905fdda2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd48ffff640 1 -- 172.21.15.139:0/2296870563 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd488037070 con 0x7fd4980cf240 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd48ffff640 1 -- 172.21.15.139:0/2296870563 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd488032440 con 0x7fd4980cf240 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd48ffff640 1 -- 172.21.15.139:0/2296870563 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4880327f0 con 0x7fd4980cf240 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd49f437640 1 -- 172.21.15.139:0/2296870563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4980cf240 msgr2=0x7fd4980cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd49f437640 1 --2- 172.21.15.139:0/2296870563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4980cf240 0x7fd4980cf620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd4880097a0 tx=0x7fd48802a180 comp rx=0 tx=0).stop 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd49f437640 1 -- 172.21.15.139:0/2296870563 shutdown_connections 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd49f437640 1 --2- 172.21.15.139:0/2296870563 >> v2:172.21.15.143:3300/0 conn(0x7fd49815c140 0x7fd49815c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd49f437640 1 --2- 172.21.15.139:0/2296870563 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd4980cf240 0x7fd4980cf620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.231+0000 7fd49f437640 1 -- 172.21.15.139:0/2296870563 >> 172.21.15.139:0/2296870563 conn(0x7fd498076730 msgr2=0x7fd498068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.232+0000 7fd49f437640 1 -- 172.21.15.139:0/2296870563 shutdown_connections 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.232+0000 7fd49f437640 1 -- 172.21.15.139:0/2296870563 wait complete. 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 Processor -- start 2024-04-26T17:58:28.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 -- start start 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd49806c310 0x7fd498141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4980cf240 0x7fd4980ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd49815c140 0x7fd49814a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815fd30 con 0x7fd49815c140 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815bcb0 con 0x7fd4980cf240 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49f437640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd49806e2a0 con 0x7fd49806c310 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49d9d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd49815c140 0x7fd49814a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49d9d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd49815c140 0x7fd49814a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48774/0 (socket says 172.21.15.139:48774) 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.233+0000 7fd49d9d4640 1 -- 172.21.15.139:0/1088055051 learned_addr learned my addr 172.21.15.139:0/1088055051 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:28.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d1d3640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd49806c310 0x7fd498141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49c9d2640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4980cf240 0x7fd4980ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d9d4640 1 -- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd49806c310 msgr2=0x7fd498141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d9d4640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd49806c310 0x7fd498141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d9d4640 1 -- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4980cf240 msgr2=0x7fd4980ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d9d4640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4980cf240 0x7fd4980ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d9d4640 1 -- 172.21.15.139:0/1088055051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4981e5bf0 con 0x7fd49815c140 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d1d3640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd49806c310 0x7fd498141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49d9d4640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd49815c140 0x7fd49814a300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd49000caa0 tx=0x7fd49000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd48dffb640 1 -- 172.21.15.139:0/1088055051 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490017070 con 0x7fd49815c140 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd48dffb640 1 -- 172.21.15.139:0/1088055051 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd49000ac00 con 0x7fd49815c140 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd48dffb640 1 -- 172.21.15.139:0/1088055051 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490012400 con 0x7fd49815c140 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4981f21b0 con 0x7fd49815c140 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.234+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4980cd6d0 con 0x7fd49815c140 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.235+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd498076d20 con 0x7fd49815c140 2024-04-26T17:58:28.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.236+0000 7fd48dffb640 1 -- 172.21.15.139:0/1088055051 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd49001a070 con 0x7fd49815c140 2024-04-26T17:58:28.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.236+0000 7fd48dffb640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47c06c8f0 0x7fd47c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.236+0000 7fd48dffb640 1 -- 172.21.15.139:0/1088055051 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd49008bd50 con 0x7fd49815c140 2024-04-26T17:58:28.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.236+0000 7fd49d1d3640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47c06c8f0 0x7fd47c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.237+0000 7fd49d1d3640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47c06c8f0 0x7fd47c06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd488034000 tx=0x7fd48802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.240+0000 7fd48dffb640 1 -- 172.21.15.139:0/1088055051 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd49008f030 con 0x7fd49815c140 2024-04-26T17:58:28.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.416+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4981593e0 con 0x7fd49815c140 2024-04-26T17:58:28.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.417+0000 7fd48dffb640 1 -- 172.21.15.139:0/1088055051 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fd490059db0 con 0x7fd49815c140 2024-04-26T17:58:28.417 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:28.418 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:28.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47c06c8f0 msgr2=0x7fd47c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47c06c8f0 0x7fd47c06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd488034000 tx=0x7fd48802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd49815c140 msgr2=0x7fd49814a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd49815c140 0x7fd49814a300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd49000caa0 tx=0x7fd49000cf60 comp rx=0 tx=0).stop 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 shutdown_connections 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd47c06c8f0 0x7fd47c06edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd49815c140 0x7fd49814a300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd4980cf240 0x7fd4980ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 --2- 172.21.15.139:0/1088055051 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd49806c310 0x7fd498141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 >> 172.21.15.139:0/1088055051 conn(0x7fd498076730 msgr2=0x7fd498068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 shutdown_connections 2024-04-26T17:58:28.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.419+0000 7fd49f437640 1 -- 172.21.15.139:0/1088055051 wait complete. 2024-04-26T17:58:28.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T17:58:28.433 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:28.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.530+0000 7f1775845640 1 Processor -- start 2024-04-26T17:58:28.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.530+0000 7f1775845640 1 -- start start 2024-04-26T17:58:28.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f1775845640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1770155da0 0x7f177015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f1775845640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f17700cd840 0x7f17700c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f1775845640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f177015f2a0 con 0x7f1770156180 2024-04-26T17:58:28.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f1775845640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f177015cbc0 con 0x7f1770155da0 2024-04-26T17:58:28.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f1775845640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f17700cc730 con 0x7f17700cd840 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176effd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1770155da0 0x7f177015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176e7fc640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1770156180 0x7f17700d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38168/0 (socket says 172.21.15.139:38168) 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176effd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1770155da0 0x7f177015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48790/0 (socket says 172.21.15.139:48790) 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176e7fc640 1 -- 172.21.15.139:0/1391273464 learned_addr learned my addr 172.21.15.139:0/1391273464 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176f7fe640 1 --2- 172.21.15.139:0/1391273464 >> v2:172.21.15.143:3300/0 conn(0x7f17700cd840 0x7f17700c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176effd640 1 -- 172.21.15.139:0/1391273464 >> v2:172.21.15.143:3300/0 conn(0x7f17700cd840 msgr2=0x7f17700c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176effd640 1 --2- 172.21.15.139:0/1391273464 >> v2:172.21.15.143:3300/0 conn(0x7f17700cd840 0x7f17700c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176effd640 1 -- 172.21.15.139:0/1391273464 >> v1:172.21.15.139:6789/0 conn(0x7f1770156180 legacy=0x7f17700d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.531+0000 7f176effd640 1 -- 172.21.15.139:0/1391273464 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177015f580 con 0x7f1770155da0 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.532+0000 7f176effd640 1 --2- 172.21.15.139:0/1391273464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177015c680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17700c97d0 tx=0x7f176802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adf9be15168e7e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.532+0000 7f176dffb640 1 -- 172.21.15.139:0/1391273464 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768037070 con 0x7f1770155da0 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.532+0000 7f176dffb640 1 -- 172.21.15.139:0/1391273464 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1768032440 con 0x7f1770155da0 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.532+0000 7f176dffb640 1 -- 172.21.15.139:0/1391273464 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176802ae60 con 0x7f1770155da0 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 -- 172.21.15.139:0/1391273464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 msgr2=0x7f177015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 --2- 172.21.15.139:0/1391273464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177015c680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17700c97d0 tx=0x7f176802a110 comp rx=0 tx=0).stop 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 -- 172.21.15.139:0/1391273464 shutdown_connections 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 --2- 172.21.15.139:0/1391273464 >> v2:172.21.15.143:3300/0 conn(0x7f17700cd840 0x7f17700c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 --2- 172.21.15.139:0/1391273464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177015c680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 -- 172.21.15.139:0/1391273464 >> 172.21.15.139:0/1391273464 conn(0x7f1770068090 msgr2=0x7f17700684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 -- 172.21.15.139:0/1391273464 shutdown_connections 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.533+0000 7f1775845640 1 -- 172.21.15.139:0/1391273464 wait complete. 2024-04-26T17:58:28.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.534+0000 7f1775845640 1 Processor -- start 2024-04-26T17:58:28.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.534+0000 7f1775845640 1 -- start start 2024-04-26T17:58:28.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17700cd840 0x7f17701f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177014a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17700d0140 0x7f1770158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f17700d19d0 con 0x7f1770155da0 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f177015fb40 con 0x7f17700cd840 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17700d1b50 con 0x7f17700d0140 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177014a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177014a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48796/0 (socket says 172.21.15.139:48796) 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 -- 172.21.15.139:0/3159091781 learned_addr learned my addr 172.21.15.139:0/3159091781 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176effd640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17700cd840 0x7f17701f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176f7fe640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17700d0140 0x7f1770158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 -- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17700d0140 msgr2=0x7f1770158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17700d0140 0x7f1770158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 -- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17700cd840 msgr2=0x7f17701f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17700cd840 0x7f17701f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 -- 172.21.15.139:0/3159091781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17701f2830 con 0x7f1770155da0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176effd640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17700cd840 0x7f17701f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176f7fe640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17700d0140 0x7f1770158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f176e7fc640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177014a080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f175800c470 tx=0x7f175800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1767fff640 1 -- 172.21.15.139:0/3159091781 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758017070 con 0x7f1770155da0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1767fff640 1 -- 172.21.15.139:0/3159091781 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1758005ce0 con 0x7f1770155da0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1767fff640 1 -- 172.21.15.139:0/3159091781 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17580072d0 con 0x7f1770155da0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17700cfa50 con 0x7f1770155da0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.535+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17701f1af0 con 0x7f1770155da0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.536+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17701f18e0 con 0x7f1770155da0 2024-04-26T17:58:28.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.537+0000 7f1767fff640 1 -- 172.21.15.139:0/3159091781 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f175801a070 con 0x7f1770155da0 2024-04-26T17:58:28.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.537+0000 7f1767fff640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f175006c8f0 0x7f175006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.537+0000 7f1767fff640 1 -- 172.21.15.139:0/3159091781 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f175808b120 con 0x7f1770155da0 2024-04-26T17:58:28.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.537+0000 7f176effd640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f175006c8f0 0x7f175006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.538+0000 7f176effd640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f175006c8f0 0x7f175006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1768034000 tx=0x7f176802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.542+0000 7f1767fff640 1 -- 172.21.15.139:0/3159091781 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1758058b30 con 0x7f1770155da0 2024-04-26T17:58:28.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.715+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17700cf800 con 0x7f175006c8f0 2024-04-26T17:58:28.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.725+0000 7f1767fff640 1 -- 172.21.15.139:0/3159091781 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f17700cf800 con 0x7f175006c8f0 2024-04-26T17:58:28.729 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:28.731 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T17:58:28.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f175006c8f0 msgr2=0x7f175006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f175006c8f0 0x7f175006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1768034000 tx=0x7f176802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 msgr2=0x7f177014a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177014a080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f175800c470 tx=0x7f175800c930 comp rx=0 tx=0).stop 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 shutdown_connections 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f175006c8f0 0x7f175006edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17700d0140 0x7f1770158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770155da0 0x7f177014a080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 --2- 172.21.15.139:0/3159091781 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17700cd840 0x7f17701f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 >> 172.21.15.139:0/3159091781 conn(0x7f1770068090 msgr2=0x7f1770153aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 shutdown_connections 2024-04-26T17:58:28.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.728+0000 7f1775845640 1 -- 172.21.15.139:0/3159091781 wait complete. 2024-04-26T17:58:28.739 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-26T17:58:27.031198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002879"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867920+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T17:58:09.867920+0000","last_peered":"2024-04-26T17:58:09.867920+0000","last_clean":"2024-04-26T17:58:09.867920+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T17:58:09.867920+0000","last_undegraded":"2024-04-26T17:58:09.867920+0000","last_fullsized":"2024-04-26T17:58:09.867920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866709+0000","last_change":"2024-04-26T17:58:04.721568+0000","last_active":"2024-04-26T17:58:09.866709+0000","last_peered":"2024-04-26T17:58:09.866709+0000","last_clean":"2024-04-26T17:58:09.866709+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T17:58:09.866709+0000","last_undegraded":"2024-04-26T17:58:09.866709+0000","last_fullsized":"2024-04-26T17:58:09.866709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:24.906240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867369+0000","last_change":"2024-04-26T17:58:08.737557+0000","last_active":"2024-04-26T17:58:09.867369+0000","last_peered":"2024-04-26T17:58:09.867369+0000","last_clean":"2024-04-26T17:58:09.867369+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T17:58:09.867369+0000","last_undegraded":"2024-04-26T17:58:09.867369+0000","last_fullsized":"2024-04-26T17:58:09.867369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:29.013280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866886+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T17:58:09.866886+0000","last_peered":"2024-04-26T17:58:09.866886+0000","last_clean":"2024-04-26T17:58:09.866886+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T17:58:09.866886+0000","last_undegraded":"2024-04-26T17:58:09.866886+0000","last_fullsized":"2024-04-26T17:58:09.866886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867706+0000","last_change":"2024-04-26T17:58:04.725200+0000","last_active":"2024-04-26T17:58:09.867706+0000","last_peered":"2024-04-26T17:58:09.867706+0000","last_clean":"2024-04-26T17:58:09.867706+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T17:58:09.867706+0000","last_undegraded":"2024-04-26T17:58:09.867706+0000","last_fullsized":"2024-04-26T17:58:09.867706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:15.882481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866726+0000","last_change":"2024-04-26T17:58:08.747272+0000","last_active":"2024-04-26T17:58:09.866726+0000","last_peered":"2024-04-26T17:58:09.866726+0000","last_clean":"2024-04-26T17:58:09.866726+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T17:58:09.866726+0000","last_undegraded":"2024-04-26T17:58:09.866726+0000","last_fullsized":"2024-04-26T17:58:09.866726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:08.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741319+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T17:58:09.741319+0000","last_peered":"2024-04-26T17:58:09.741319+0000","last_clean":"2024-04-26T17:58:09.741319+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T17:58:09.741319+0000","last_undegraded":"2024-04-26T17:58:09.741319+0000","last_fullsized":"2024-04-26T17:58:09.741319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867042+0000","last_change":"2024-04-26T17:58:04.723700+0000","last_active":"2024-04-26T17:58:09.867042+0000","last_peered":"2024-04-26T17:58:09.867042+0000","last_clean":"2024-04-26T17:58:09.867042+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T17:58:09.867042+0000","last_undegraded":"2024-04-26T17:58:09.867042+0000","last_fullsized":"2024-04-26T17:58:09.867042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:05.637900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866801+0000","last_change":"2024-04-26T17:58:08.746662+0000","last_active":"2024-04-26T17:58:09.866801+0000","last_peered":"2024-04-26T17:58:09.866801+0000","last_clean":"2024-04-26T17:58:09.866801+0000","last_became_active":"2024-04-26T17:58:08.746200+0000","last_became_peered":"2024-04-26T17:58:08.746200+0000","last_unstale":"2024-04-26T17:58:09.866801+0000","last_undegraded":"2024-04-26T17:58:09.866801+0000","last_fullsized":"2024-04-26T17:58:09.866801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:05.431076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740881+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T17:58:09.740881+0000","last_peered":"2024-04-26T17:58:09.740881+0000","last_clean":"2024-04-26T17:58:09.740881+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T17:58:09.740881+0000","last_undegraded":"2024-04-26T17:58:09.740881+0000","last_fullsized":"2024-04-26T17:58:09.740881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867441+0000","last_change":"2024-04-26T17:58:04.723945+0000","last_active":"2024-04-26T17:58:09.867441+0000","last_peered":"2024-04-26T17:58:09.867441+0000","last_clean":"2024-04-26T17:58:09.867441+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T17:58:09.867441+0000","last_undegraded":"2024-04-26T17:58:09.867441+0000","last_fullsized":"2024-04-26T17:58:09.867441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:58.454180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:08.743082+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:56.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742051+0000","last_change":"2024-04-26T17:58:04.715624+0000","last_active":"2024-04-26T17:58:09.742051+0000","last_peered":"2024-04-26T17:58:09.742051+0000","last_clean":"2024-04-26T17:58:09.742051+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T17:58:09.742051+0000","last_undegraded":"2024-04-26T17:58:09.742051+0000","last_fullsized":"2024-04-26T17:58:09.742051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:45.282546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741089+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T17:58:09.741089+0000","last_peered":"2024-04-26T17:58:09.741089+0000","last_clean":"2024-04-26T17:58:09.741089+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T17:58:09.741089+0000","last_undegraded":"2024-04-26T17:58:09.741089+0000","last_fullsized":"2024-04-26T17:58:09.741089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867178+0000","last_change":"2024-04-26T17:58:08.747055+0000","last_active":"2024-04-26T17:58:09.867178+0000","last_peered":"2024-04-26T17:58:09.867178+0000","last_clean":"2024-04-26T17:58:09.867178+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T17:58:09.867178+0000","last_undegraded":"2024-04-26T17:58:09.867178+0000","last_fullsized":"2024-04-26T17:58:09.867178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:38.260141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867917+0000","last_change":"2024-04-26T17:58:04.717982+0000","last_active":"2024-04-26T17:58:09.867917+0000","last_peered":"2024-04-26T17:58:09.867917+0000","last_clean":"2024-04-26T17:58:09.867917+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T17:58:09.867917+0000","last_undegraded":"2024-04-26T17:58:09.867917+0000","last_fullsized":"2024-04-26T17:58:09.867917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:54.094898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868688+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T17:58:09.868688+0000","last_peered":"2024-04-26T17:58:09.868688+0000","last_clean":"2024-04-26T17:58:09.868688+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T17:58:09.868688+0000","last_undegraded":"2024-04-26T17:58:09.868688+0000","last_fullsized":"2024-04-26T17:58:09.868688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867590+0000","last_change":"2024-04-26T17:58:08.747263+0000","last_active":"2024-04-26T17:58:09.867590+0000","last_peered":"2024-04-26T17:58:09.867590+0000","last_clean":"2024-04-26T17:58:09.867590+0000","last_became_active":"2024-04-26T17:58:08.746835+0000","last_became_peered":"2024-04-26T17:58:08.746835+0000","last_unstale":"2024-04-26T17:58:09.867590+0000","last_undegraded":"2024-04-26T17:58:09.867590+0000","last_fullsized":"2024-04-26T17:58:09.867590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:03.581123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867258+0000","last_change":"2024-04-26T17:58:04.717948+0000","last_active":"2024-04-26T17:58:09.867258+0000","last_peered":"2024-04-26T17:58:09.867258+0000","last_clean":"2024-04-26T17:58:09.867258+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T17:58:09.867258+0000","last_undegraded":"2024-04-26T17:58:09.867258+0000","last_fullsized":"2024-04-26T17:58:09.867258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.344820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867168+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T17:58:09.867168+0000","last_peered":"2024-04-26T17:58:09.867168+0000","last_clean":"2024-04-26T17:58:09.867168+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T17:58:09.867168+0000","last_undegraded":"2024-04-26T17:58:09.867168+0000","last_fullsized":"2024-04-26T17:58:09.867168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867165+0000","last_change":"2024-04-26T17:58:08.743822+0000","last_active":"2024-04-26T17:58:09.867165+0000","last_peered":"2024-04-26T17:58:09.867165+0000","last_clean":"2024-04-26T17:58:09.867165+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T17:58:09.867165+0000","last_undegraded":"2024-04-26T17:58:09.867165+0000","last_fullsized":"2024-04-26T17:58:09.867165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:12.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867993+0000","last_change":"2024-04-26T17:58:04.712440+0000","last_active":"2024-04-26T17:58:09.867993+0000","last_peered":"2024-04-26T17:58:09.867993+0000","last_clean":"2024-04-26T17:58:09.867993+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T17:58:09.867993+0000","last_undegraded":"2024-04-26T17:58:09.867993+0000","last_fullsized":"2024-04-26T17:58:09.867993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:30.916890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740538+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T17:58:09.740538+0000","last_peered":"2024-04-26T17:58:09.740538+0000","last_clean":"2024-04-26T17:58:09.740538+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T17:58:09.740538+0000","last_undegraded":"2024-04-26T17:58:09.740538+0000","last_fullsized":"2024-04-26T17:58:09.740538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866990+0000","last_change":"2024-04-26T17:58:08.747104+0000","last_active":"2024-04-26T17:58:09.866990+0000","last_peered":"2024-04-26T17:58:09.866990+0000","last_clean":"2024-04-26T17:58:09.866990+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T17:58:09.866990+0000","last_undegraded":"2024-04-26T17:58:09.866990+0000","last_fullsized":"2024-04-26T17:58:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:19.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867840+0000","last_change":"2024-04-26T17:58:04.715359+0000","last_active":"2024-04-26T17:58:09.867840+0000","last_peered":"2024-04-26T17:58:09.867840+0000","last_clean":"2024-04-26T17:58:09.867840+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T17:58:09.867840+0000","last_undegraded":"2024-04-26T17:58:09.867840+0000","last_fullsized":"2024-04-26T17:58:09.867840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:11.014077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742339+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T17:58:09.742339+0000","last_peered":"2024-04-26T17:58:09.742339+0000","last_clean":"2024-04-26T17:58:09.742339+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T17:58:09.742339+0000","last_undegraded":"2024-04-26T17:58:09.742339+0000","last_fullsized":"2024-04-26T17:58:09.742339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867794+0000","last_change":"2024-04-26T17:58:08.742685+0000","last_active":"2024-04-26T17:58:09.867794+0000","last_peered":"2024-04-26T17:58:09.867794+0000","last_clean":"2024-04-26T17:58:09.867794+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T17:58:09.867794+0000","last_undegraded":"2024-04-26T17:58:09.867794+0000","last_fullsized":"2024-04-26T17:58:09.867794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:49.952963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867465+0000","last_change":"2024-04-26T17:58:04.713980+0000","last_active":"2024-04-26T17:58:09.867465+0000","last_peered":"2024-04-26T17:58:09.867465+0000","last_clean":"2024-04-26T17:58:09.867465+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T17:58:09.867465+0000","last_undegraded":"2024-04-26T17:58:09.867465+0000","last_fullsized":"2024-04-26T17:58:09.867465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:48.678130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867971+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T17:58:09.867971+0000","last_peered":"2024-04-26T17:58:09.867971+0000","last_clean":"2024-04-26T17:58:09.867971+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T17:58:09.867971+0000","last_undegraded":"2024-04-26T17:58:09.867971+0000","last_fullsized":"2024-04-26T17:58:09.867971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867029+0000","last_change":"2024-04-26T17:58:08.746201+0000","last_active":"2024-04-26T17:58:09.867029+0000","last_peered":"2024-04-26T17:58:09.867029+0000","last_clean":"2024-04-26T17:58:09.867029+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T17:58:09.867029+0000","last_undegraded":"2024-04-26T17:58:09.867029+0000","last_fullsized":"2024-04-26T17:58:09.867029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:23.961683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866770+0000","last_change":"2024-04-26T17:58:04.712662+0000","last_active":"2024-04-26T17:58:09.866770+0000","last_peered":"2024-04-26T17:58:09.866770+0000","last_clean":"2024-04-26T17:58:09.866770+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T17:58:09.866770+0000","last_undegraded":"2024-04-26T17:58:09.866770+0000","last_fullsized":"2024-04-26T17:58:09.866770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:37.557975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741512+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T17:58:09.741512+0000","last_peered":"2024-04-26T17:58:09.741512+0000","last_clean":"2024-04-26T17:58:09.741512+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T17:58:09.741512+0000","last_undegraded":"2024-04-26T17:58:09.741512+0000","last_fullsized":"2024-04-26T17:58:09.741512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868118+0000","last_change":"2024-04-26T17:58:08.740345+0000","last_active":"2024-04-26T17:58:09.868118+0000","last_peered":"2024-04-26T17:58:09.868118+0000","last_clean":"2024-04-26T17:58:09.868118+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T17:58:09.868118+0000","last_undegraded":"2024-04-26T17:58:09.868118+0000","last_fullsized":"2024-04-26T17:58:09.868118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:49.324368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867513+0000","last_change":"2024-04-26T17:58:04.726233+0000","last_active":"2024-04-26T17:58:09.867513+0000","last_peered":"2024-04-26T17:58:09.867513+0000","last_clean":"2024-04-26T17:58:09.867513+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T17:58:09.867513+0000","last_undegraded":"2024-04-26T17:58:09.867513+0000","last_fullsized":"2024-04-26T17:58:09.867513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:04.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866859+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T17:58:09.866859+0000","last_peered":"2024-04-26T17:58:09.866859+0000","last_clean":"2024-04-26T17:58:09.866859+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T17:58:09.866859+0000","last_undegraded":"2024-04-26T17:58:09.866859+0000","last_fullsized":"2024-04-26T17:58:09.866859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868258+0000","last_change":"2024-04-26T17:58:08.742909+0000","last_active":"2024-04-26T17:58:09.868258+0000","last_peered":"2024-04-26T17:58:09.868258+0000","last_clean":"2024-04-26T17:58:09.868258+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T17:58:09.868258+0000","last_undegraded":"2024-04-26T17:58:09.868258+0000","last_fullsized":"2024-04-26T17:58:09.868258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:50.554497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867397+0000","last_change":"2024-04-26T17:58:04.708024+0000","last_active":"2024-04-26T17:58:09.867397+0000","last_peered":"2024-04-26T17:58:09.867397+0000","last_clean":"2024-04-26T17:58:09.867397+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T17:58:09.867397+0000","last_undegraded":"2024-04-26T17:58:09.867397+0000","last_fullsized":"2024-04-26T17:58:09.867397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867406+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T17:58:09.867406+0000","last_peered":"2024-04-26T17:58:09.867406+0000","last_clean":"2024-04-26T17:58:09.867406+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T17:58:09.867406+0000","last_undegraded":"2024-04-26T17:58:09.867406+0000","last_fullsized":"2024-04-26T17:58:09.867406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866674+0000","last_change":"2024-04-26T17:58:08.739726+0000","last_active":"2024-04-26T17:58:09.866674+0000","last_peered":"2024-04-26T17:58:09.866674+0000","last_clean":"2024-04-26T17:58:09.866674+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T17:58:09.866674+0000","last_undegraded":"2024-04-26T17:58:09.866674+0000","last_fullsized":"2024-04-26T17:58:09.866674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:08.315753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866446+0000","last_change":"2024-04-26T17:58:04.712446+0000","last_active":"2024-04-26T17:58:09.866446+0000","last_peered":"2024-04-26T17:58:09.866446+0000","last_clean":"2024-04-26T17:58:09.866446+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T17:58:09.866446+0000","last_undegraded":"2024-04-26T17:58:09.866446+0000","last_fullsized":"2024-04-26T17:58:09.866446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:52.484069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739473+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T17:58:09.739473+0000","last_peered":"2024-04-26T17:58:09.739473+0000","last_clean":"2024-04-26T17:58:09.739473+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T17:58:09.739473+0000","last_undegraded":"2024-04-26T17:58:09.739473+0000","last_fullsized":"2024-04-26T17:58:09.739473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867315+0000","last_change":"2024-04-26T17:58:08.742536+0000","last_active":"2024-04-26T17:58:09.867315+0000","last_peered":"2024-04-26T17:58:09.867315+0000","last_clean":"2024-04-26T17:58:09.867315+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T17:58:09.867315+0000","last_undegraded":"2024-04-26T17:58:09.867315+0000","last_fullsized":"2024-04-26T17:58:09.867315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:49.364705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866653+0000","last_change":"2024-04-26T17:58:04.711535+0000","last_active":"2024-04-26T17:58:09.866653+0000","last_peered":"2024-04-26T17:58:09.866653+0000","last_clean":"2024-04-26T17:58:09.866653+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T17:58:09.866653+0000","last_undegraded":"2024-04-26T17:58:09.866653+0000","last_fullsized":"2024-04-26T17:58:09.866653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:11.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740669+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T17:58:09.740669+0000","last_peered":"2024-04-26T17:58:09.740669+0000","last_clean":"2024-04-26T17:58:09.740669+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T17:58:09.740669+0000","last_undegraded":"2024-04-26T17:58:09.740669+0000","last_fullsized":"2024-04-26T17:58:09.740669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867764+0000","last_change":"2024-04-26T17:58:08.734543+0000","last_active":"2024-04-26T17:58:09.867764+0000","last_peered":"2024-04-26T17:58:09.867764+0000","last_clean":"2024-04-26T17:58:09.867764+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T17:58:09.867764+0000","last_undegraded":"2024-04-26T17:58:09.867764+0000","last_fullsized":"2024-04-26T17:58:09.867764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:55.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866271+0000","last_change":"2024-04-26T17:58:04.727199+0000","last_active":"2024-04-26T17:58:09.866271+0000","last_peered":"2024-04-26T17:58:09.866271+0000","last_clean":"2024-04-26T17:58:09.866271+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T17:58:09.866271+0000","last_undegraded":"2024-04-26T17:58:09.866271+0000","last_fullsized":"2024-04-26T17:58:09.866271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:06.483618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867639+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T17:58:09.867639+0000","last_peered":"2024-04-26T17:58:09.867639+0000","last_clean":"2024-04-26T17:58:09.867639+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T17:58:09.867639+0000","last_undegraded":"2024-04-26T17:58:09.867639+0000","last_fullsized":"2024-04-26T17:58:09.867639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740780+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T17:58:09.740780+0000","last_peered":"2024-04-26T17:58:09.740780+0000","last_clean":"2024-04-26T17:58:09.740780+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T17:58:09.740780+0000","last_undegraded":"2024-04-26T17:58:09.740780+0000","last_fullsized":"2024-04-26T17:58:09.740780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741715+0000","last_change":"2024-04-26T17:58:08.737072+0000","last_active":"2024-04-26T17:58:09.741715+0000","last_peered":"2024-04-26T17:58:09.741715+0000","last_clean":"2024-04-26T17:58:09.741715+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T17:58:09.741715+0000","last_undegraded":"2024-04-26T17:58:09.741715+0000","last_fullsized":"2024-04-26T17:58:09.741715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:11.217370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740782+0000","last_change":"2024-04-26T17:58:04.724798+0000","last_active":"2024-04-26T17:58:09.740782+0000","last_peered":"2024-04-26T17:58:09.740782+0000","last_clean":"2024-04-26T17:58:09.740782+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T17:58:09.740782+0000","last_undegraded":"2024-04-26T17:58:09.740782+0000","last_fullsized":"2024-04-26T17:58:09.740782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.707135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739785+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T17:58:09.739785+0000","last_peered":"2024-04-26T17:58:09.739785+0000","last_clean":"2024-04-26T17:58:09.739785+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T17:58:09.739785+0000","last_undegraded":"2024-04-26T17:58:09.739785+0000","last_fullsized":"2024-04-26T17:58:09.739785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741890+0000","last_change":"2024-04-26T17:58:08.735010+0000","last_active":"2024-04-26T17:58:09.741890+0000","last_peered":"2024-04-26T17:58:09.741890+0000","last_clean":"2024-04-26T17:58:09.741890+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T17:58:09.741890+0000","last_undegraded":"2024-04-26T17:58:09.741890+0000","last_fullsized":"2024-04-26T17:58:09.741890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.377179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867215+0000","last_change":"2024-04-26T17:58:04.726744+0000","last_active":"2024-04-26T17:58:09.867215+0000","last_peered":"2024-04-26T17:58:09.867215+0000","last_clean":"2024-04-26T17:58:09.867215+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T17:58:09.867215+0000","last_undegraded":"2024-04-26T17:58:09.867215+0000","last_fullsized":"2024-04-26T17:58:09.867215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:06.654631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868255+0000","last_change":"2024-04-26T17:58:08.748124+0000","last_active":"2024-04-26T17:58:09.868255+0000","last_peered":"2024-04-26T17:58:09.868255+0000","last_clean":"2024-04-26T17:58:09.868255+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T17:58:09.868255+0000","last_undegraded":"2024-04-26T17:58:09.868255+0000","last_fullsized":"2024-04-26T17:58:09.868255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:07.600726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741479+0000","last_change":"2024-04-26T17:58:04.716933+0000","last_active":"2024-04-26T17:58:09.741479+0000","last_peered":"2024-04-26T17:58:09.741479+0000","last_clean":"2024-04-26T17:58:09.741479+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T17:58:09.741479+0000","last_undegraded":"2024-04-26T17:58:09.741479+0000","last_fullsized":"2024-04-26T17:58:09.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:25.360981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739660+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T17:58:09.739660+0000","last_peered":"2024-04-26T17:58:09.739660+0000","last_clean":"2024-04-26T17:58:09.739660+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T17:58:09.739660+0000","last_undegraded":"2024-04-26T17:58:09.739660+0000","last_fullsized":"2024-04-26T17:58:09.739660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866386+0000","last_change":"2024-04-26T17:58:08.737297+0000","last_active":"2024-04-26T17:58:09.866386+0000","last_peered":"2024-04-26T17:58:09.866386+0000","last_clean":"2024-04-26T17:58:09.866386+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T17:58:09.866386+0000","last_undegraded":"2024-04-26T17:58:09.866386+0000","last_fullsized":"2024-04-26T17:58:09.866386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:34.582604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741116+0000","last_change":"2024-04-26T17:58:04.716850+0000","last_active":"2024-04-26T17:58:09.741116+0000","last_peered":"2024-04-26T17:58:09.741116+0000","last_clean":"2024-04-26T17:58:09.741116+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T17:58:09.741116+0000","last_undegraded":"2024-04-26T17:58:09.741116+0000","last_fullsized":"2024-04-26T17:58:09.741116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:35.530627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867994+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T17:58:09.867994+0000","last_peered":"2024-04-26T17:58:09.867994+0000","last_clean":"2024-04-26T17:58:09.867994+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T17:58:09.867994+0000","last_undegraded":"2024-04-26T17:58:09.867994+0000","last_fullsized":"2024-04-26T17:58:09.867994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866728+0000","last_change":"2024-04-26T17:58:08.747644+0000","last_active":"2024-04-26T17:58:09.866728+0000","last_peered":"2024-04-26T17:58:09.866728+0000","last_clean":"2024-04-26T17:58:09.866728+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T17:58:09.866728+0000","last_undegraded":"2024-04-26T17:58:09.866728+0000","last_fullsized":"2024-04-26T17:58:09.866728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.713815+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:08.918386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739376+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T17:58:09.739376+0000","last_peered":"2024-04-26T17:58:09.739376+0000","last_clean":"2024-04-26T17:58:09.739376+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T17:58:09.739376+0000","last_undegraded":"2024-04-26T17:58:09.739376+0000","last_fullsized":"2024-04-26T17:58:09.739376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867630+0000","last_change":"2024-04-26T17:58:08.739259+0000","last_active":"2024-04-26T17:58:09.867630+0000","last_peered":"2024-04-26T17:58:09.867630+0000","last_clean":"2024-04-26T17:58:09.867630+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T17:58:09.867630+0000","last_undegraded":"2024-04-26T17:58:09.867630+0000","last_fullsized":"2024-04-26T17:58:09.867630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:42.110881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740479+0000","last_change":"2024-04-26T17:58:04.717008+0000","last_active":"2024-04-26T17:58:09.740479+0000","last_peered":"2024-04-26T17:58:09.740479+0000","last_clean":"2024-04-26T17:58:09.740479+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T17:58:09.740479+0000","last_undegraded":"2024-04-26T17:58:09.740479+0000","last_fullsized":"2024-04-26T17:58:09.740479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:10.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741681+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T17:58:09.741681+0000","last_peered":"2024-04-26T17:58:09.741681+0000","last_clean":"2024-04-26T17:58:09.741681+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T17:58:09.741681+0000","last_undegraded":"2024-04-26T17:58:09.741681+0000","last_fullsized":"2024-04-26T17:58:09.741681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867276+0000","last_change":"2024-04-26T17:58:08.742774+0000","last_active":"2024-04-26T17:58:09.867276+0000","last_peered":"2024-04-26T17:58:09.867276+0000","last_clean":"2024-04-26T17:58:09.867276+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T17:58:09.867276+0000","last_undegraded":"2024-04-26T17:58:09.867276+0000","last_fullsized":"2024-04-26T17:58:09.867276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:04.231921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741023+0000","last_change":"2024-04-26T17:58:04.712970+0000","last_active":"2024-04-26T17:58:09.741023+0000","last_peered":"2024-04-26T17:58:09.741023+0000","last_clean":"2024-04-26T17:58:09.741023+0000","last_became_active":"2024-04-26T17:58:04.712645+0000","last_became_peered":"2024-04-26T17:58:04.712645+0000","last_unstale":"2024-04-26T17:58:09.741023+0000","last_undegraded":"2024-04-26T17:58:09.741023+0000","last_fullsized":"2024-04-26T17:58:09.741023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:06.746889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867322+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T17:58:09.867322+0000","last_peered":"2024-04-26T17:58:09.867322+0000","last_clean":"2024-04-26T17:58:09.867322+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T17:58:09.867322+0000","last_undegraded":"2024-04-26T17:58:09.867322+0000","last_fullsized":"2024-04-26T17:58:09.867322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868215+0000","last_change":"2024-04-26T17:58:08.741761+0000","last_active":"2024-04-26T17:58:09.868215+0000","last_peered":"2024-04-26T17:58:09.868215+0000","last_clean":"2024-04-26T17:58:09.868215+0000","last_became_active":"2024-04-26T17:58:08.741401+0000","last_became_peered":"2024-04-26T17:58:08.741401+0000","last_unstale":"2024-04-26T17:58:09.868215+0000","last_undegraded":"2024-04-26T17:58:09.868215+0000","last_fullsized":"2024-04-26T17:58:09.868215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:44.837522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867967+0000","last_change":"2024-04-26T17:58:04.705981+0000","last_active":"2024-04-26T17:58:09.867967+0000","last_peered":"2024-04-26T17:58:09.867967+0000","last_clean":"2024-04-26T17:58:09.867967+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T17:58:09.867967+0000","last_undegraded":"2024-04-26T17:58:09.867967+0000","last_fullsized":"2024-04-26T17:58:09.867967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868393+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T17:58:09.868393+0000","last_peered":"2024-04-26T17:58:09.868393+0000","last_clean":"2024-04-26T17:58:09.868393+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T17:58:09.868393+0000","last_undegraded":"2024-04-26T17:58:09.868393+0000","last_fullsized":"2024-04-26T17:58:09.868393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867400+0000","last_change":"2024-04-26T17:58:08.739520+0000","last_active":"2024-04-26T17:58:09.867400+0000","last_peered":"2024-04-26T17:58:09.867400+0000","last_clean":"2024-04-26T17:58:09.867400+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T17:58:09.867400+0000","last_undegraded":"2024-04-26T17:58:09.867400+0000","last_fullsized":"2024-04-26T17:58:09.867400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:10.313792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.719394+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:33.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.307724+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T17:58:17.307724+0000","last_peered":"2024-04-26T17:58:17.307724+0000","last_clean":"2024-04-26T17:58:17.307724+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T17:58:17.307724+0000","last_undegraded":"2024-04-26T17:58:17.307724+0000","last_fullsized":"2024-04-26T17:58:17.307724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868423+0000","last_change":"2024-04-26T17:58:08.736275+0000","last_active":"2024-04-26T17:58:09.868423+0000","last_peered":"2024-04-26T17:58:09.868423+0000","last_clean":"2024-04-26T17:58:09.868423+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T17:58:09.868423+0000","last_undegraded":"2024-04-26T17:58:09.868423+0000","last_fullsized":"2024-04-26T17:58:09.868423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:07.103401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867796+0000","last_change":"2024-04-26T17:58:04.712316+0000","last_active":"2024-04-26T17:58:09.867796+0000","last_peered":"2024-04-26T17:58:09.867796+0000","last_clean":"2024-04-26T17:58:09.867796+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T17:58:09.867796+0000","last_undegraded":"2024-04-26T17:58:09.867796+0000","last_fullsized":"2024-04-26T17:58:09.867796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:49.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866776+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T17:58:09.866776+0000","last_peered":"2024-04-26T17:58:09.866776+0000","last_clean":"2024-04-26T17:58:09.866776+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T17:58:09.866776+0000","last_undegraded":"2024-04-26T17:58:09.866776+0000","last_fullsized":"2024-04-26T17:58:09.866776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867058+0000","last_change":"2024-04-26T17:58:08.742746+0000","last_active":"2024-04-26T17:58:09.867058+0000","last_peered":"2024-04-26T17:58:09.867058+0000","last_clean":"2024-04-26T17:58:09.867058+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T17:58:09.867058+0000","last_undegraded":"2024-04-26T17:58:09.867058+0000","last_fullsized":"2024-04-26T17:58:09.867058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:51.352617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868076+0000","last_change":"2024-04-26T17:58:04.723214+0000","last_active":"2024-04-26T17:58:09.868076+0000","last_peered":"2024-04-26T17:58:09.868076+0000","last_clean":"2024-04-26T17:58:09.868076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T17:58:09.868076+0000","last_undegraded":"2024-04-26T17:58:09.868076+0000","last_fullsized":"2024-04-26T17:58:09.868076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:08.558197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867696+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T17:58:09.867696+0000","last_peered":"2024-04-26T17:58:09.867696+0000","last_clean":"2024-04-26T17:58:09.867696+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T17:58:09.867696+0000","last_undegraded":"2024-04-26T17:58:09.867696+0000","last_fullsized":"2024-04-26T17:58:09.867696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867239+0000","last_change":"2024-04-26T17:58:08.745044+0000","last_active":"2024-04-26T17:58:09.867239+0000","last_peered":"2024-04-26T17:58:09.867239+0000","last_clean":"2024-04-26T17:58:09.867239+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T17:58:09.867239+0000","last_undegraded":"2024-04-26T17:58:09.867239+0000","last_fullsized":"2024-04-26T17:58:09.867239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:53.339198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867490+0000","last_change":"2024-04-26T17:58:04.720903+0000","last_active":"2024-04-26T17:58:09.867490+0000","last_peered":"2024-04-26T17:58:09.867490+0000","last_clean":"2024-04-26T17:58:09.867490+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T17:58:09.867490+0000","last_undegraded":"2024-04-26T17:58:09.867490+0000","last_fullsized":"2024-04-26T17:58:09.867490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:46.583637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742161+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T17:58:09.742161+0000","last_peered":"2024-04-26T17:58:09.742161+0000","last_clean":"2024-04-26T17:58:09.742161+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T17:58:09.742161+0000","last_undegraded":"2024-04-26T17:58:09.742161+0000","last_fullsized":"2024-04-26T17:58:09.742161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867269+0000","last_change":"2024-04-26T17:58:08.743119+0000","last_active":"2024-04-26T17:58:09.867269+0000","last_peered":"2024-04-26T17:58:09.867269+0000","last_clean":"2024-04-26T17:58:09.867269+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T17:58:09.867269+0000","last_undegraded":"2024-04-26T17:58:09.867269+0000","last_fullsized":"2024-04-26T17:58:09.867269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:41.640200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867500+0000","last_change":"2024-04-26T17:58:08.739999+0000","last_active":"2024-04-26T17:58:09.867500+0000","last_peered":"2024-04-26T17:58:09.867500+0000","last_clean":"2024-04-26T17:58:09.867500+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T17:58:09.867500+0000","last_undegraded":"2024-04-26T17:58:09.867500+0000","last_fullsized":"2024-04-26T17:58:09.867500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:30.637006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866996+0000","last_change":"2024-04-26T17:58:04.719069+0000","last_active":"2024-04-26T17:58:09.866996+0000","last_peered":"2024-04-26T17:58:09.866996+0000","last_clean":"2024-04-26T17:58:09.866996+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T17:58:09.866996+0000","last_undegraded":"2024-04-26T17:58:09.866996+0000","last_fullsized":"2024-04-26T17:58:09.866996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:09.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867009+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T17:58:09.867009+0000","last_peered":"2024-04-26T17:58:09.867009+0000","last_clean":"2024-04-26T17:58:09.867009+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T17:58:09.867009+0000","last_undegraded":"2024-04-26T17:58:09.867009+0000","last_fullsized":"2024-04-26T17:58:09.867009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741957+0000","last_change":"2024-04-26T17:58:08.738167+0000","last_active":"2024-04-26T17:58:09.741957+0000","last_peered":"2024-04-26T17:58:09.741957+0000","last_clean":"2024-04-26T17:58:09.741957+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T17:58:09.741957+0000","last_undegraded":"2024-04-26T17:58:09.741957+0000","last_fullsized":"2024-04-26T17:58:09.741957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:42.434088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867177+0000","last_change":"2024-04-26T17:58:04.717580+0000","last_active":"2024-04-26T17:58:09.867177+0000","last_peered":"2024-04-26T17:58:09.867177+0000","last_clean":"2024-04-26T17:58:09.867177+0000","last_became_active":"2024-04-26T17:58:04.717313+0000","last_became_peered":"2024-04-26T17:58:04.717313+0000","last_unstale":"2024-04-26T17:58:09.867177+0000","last_undegraded":"2024-04-26T17:58:09.867177+0000","last_fullsized":"2024-04-26T17:58:09.867177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:54.802557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867508+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T17:58:09.867508+0000","last_peered":"2024-04-26T17:58:09.867508+0000","last_clean":"2024-04-26T17:58:09.867508+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T17:58:09.867508+0000","last_undegraded":"2024-04-26T17:58:09.867508+0000","last_fullsized":"2024-04-26T17:58:09.867508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742229+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T17:58:09.742229+0000","last_peered":"2024-04-26T17:58:09.742229+0000","last_clean":"2024-04-26T17:58:09.742229+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T17:58:09.742229+0000","last_undegraded":"2024-04-26T17:58:09.742229+0000","last_fullsized":"2024-04-26T17:58:09.742229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868345+0000","last_change":"2024-04-26T17:58:04.713025+0000","last_active":"2024-04-26T17:58:09.868345+0000","last_peered":"2024-04-26T17:58:09.868345+0000","last_clean":"2024-04-26T17:58:09.868345+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T17:58:09.868345+0000","last_undegraded":"2024-04-26T17:58:09.868345+0000","last_fullsized":"2024-04-26T17:58:09.868345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:35.294319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739719+0000","last_change":"2024-04-26T17:58:08.739580+0000","last_active":"2024-04-26T17:58:09.739719+0000","last_peered":"2024-04-26T17:58:09.739719+0000","last_clean":"2024-04-26T17:58:09.739719+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T17:58:09.739719+0000","last_undegraded":"2024-04-26T17:58:09.739719+0000","last_fullsized":"2024-04-26T17:58:09.739719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.613945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868520+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T17:58:09.868520+0000","last_peered":"2024-04-26T17:58:09.868520+0000","last_clean":"2024-04-26T17:58:09.868520+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T17:58:09.868520+0000","last_undegraded":"2024-04-26T17:58:09.868520+0000","last_fullsized":"2024-04-26T17:58:09.868520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867109+0000","last_change":"2024-04-26T17:58:04.712809+0000","last_active":"2024-04-26T17:58:09.867109+0000","last_peered":"2024-04-26T17:58:09.867109+0000","last_clean":"2024-04-26T17:58:09.867109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T17:58:09.867109+0000","last_undegraded":"2024-04-26T17:58:09.867109+0000","last_fullsized":"2024-04-26T17:58:09.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:27.667789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866917+0000","last_change":"2024-04-26T17:58:08.738098+0000","last_active":"2024-04-26T17:58:09.866917+0000","last_peered":"2024-04-26T17:58:09.866917+0000","last_clean":"2024-04-26T17:58:09.866917+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T17:58:09.866917+0000","last_undegraded":"2024-04-26T17:58:09.866917+0000","last_fullsized":"2024-04-26T17:58:09.866917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:46.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740387+0000","last_change":"2024-04-26T17:58:04.717040+0000","last_active":"2024-04-26T17:58:09.740387+0000","last_peered":"2024-04-26T17:58:09.740387+0000","last_clean":"2024-04-26T17:58:09.740387+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T17:58:09.740387+0000","last_undegraded":"2024-04-26T17:58:09.740387+0000","last_fullsized":"2024-04-26T17:58:09.740387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739474+0000","last_change":"2024-04-26T17:58:04.717913+0000","last_active":"2024-04-26T17:58:09.739474+0000","last_peered":"2024-04-26T17:58:09.739474+0000","last_clean":"2024-04-26T17:58:09.739474+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T17:58:09.739474+0000","last_undegraded":"2024-04-26T17:58:09.739474+0000","last_fullsized":"2024-04-26T17:58:09.739474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:58.220321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867259+0000","last_change":"2024-04-26T17:58:04.726316+0000","last_active":"2024-04-26T17:58:09.867259+0000","last_peered":"2024-04-26T17:58:09.867259+0000","last_clean":"2024-04-26T17:58:09.867259+0000","last_became_active":"2024-04-26T17:58:04.726079+0000","last_became_peered":"2024-04-26T17:58:04.726079+0000","last_unstale":"2024-04-26T17:58:09.867259+0000","last_undegraded":"2024-04-26T17:58:09.867259+0000","last_fullsized":"2024-04-26T17:58:09.867259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:52.023348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868301+0000","last_change":"2024-04-26T17:58:04.718894+0000","last_active":"2024-04-26T17:58:09.868301+0000","last_peered":"2024-04-26T17:58:09.868301+0000","last_clean":"2024-04-26T17:58:09.868301+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T17:58:09.868301+0000","last_undegraded":"2024-04-26T17:58:09.868301+0000","last_fullsized":"2024-04-26T17:58:09.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:08.169756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868428+0000","last_change":"2024-04-26T17:58:04.717545+0000","last_active":"2024-04-26T17:58:09.868428+0000","last_peered":"2024-04-26T17:58:09.868428+0000","last_clean":"2024-04-26T17:58:09.868428+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T17:58:09.868428+0000","last_undegraded":"2024-04-26T17:58:09.868428+0000","last_fullsized":"2024-04-26T17:58:09.868428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:22.541323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866628+0000","last_change":"2024-04-26T17:58:04.719000+0000","last_active":"2024-04-26T17:58:09.866628+0000","last_peered":"2024-04-26T17:58:09.866628+0000","last_clean":"2024-04-26T17:58:09.866628+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T17:58:09.866628+0000","last_undegraded":"2024-04-26T17:58:09.866628+0000","last_fullsized":"2024-04-26T17:58:09.866628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:39.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741672+0000","last_change":"2024-04-26T17:58:04.719202+0000","last_active":"2024-04-26T17:58:09.741672+0000","last_peered":"2024-04-26T17:58:09.741672+0000","last_clean":"2024-04-26T17:58:09.741672+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T17:58:09.741672+0000","last_undegraded":"2024-04-26T17:58:09.741672+0000","last_fullsized":"2024-04-26T17:58:09.741672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:09.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867378+0000","last_change":"2024-04-26T17:58:04.717329+0000","last_active":"2024-04-26T17:58:09.867378+0000","last_peered":"2024-04-26T17:58:09.867378+0000","last_clean":"2024-04-26T17:58:09.867378+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T17:58:09.867378+0000","last_undegraded":"2024-04-26T17:58:09.867378+0000","last_fullsized":"2024-04-26T17:58:09.867378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:05.365008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866573+0000","last_change":"2024-04-26T17:58:04.727246+0000","last_active":"2024-04-26T17:58:09.866573+0000","last_peered":"2024-04-26T17:58:09.866573+0000","last_clean":"2024-04-26T17:58:09.866573+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T17:58:09.866573+0000","last_undegraded":"2024-04-26T17:58:09.866573+0000","last_fullsized":"2024-04-26T17:58:09.866573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:48.343210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867408+0000","last_change":"2024-04-26T17:58:04.713698+0000","last_active":"2024-04-26T17:58:09.867408+0000","last_peered":"2024-04-26T17:58:09.867408+0000","last_clean":"2024-04-26T17:58:09.867408+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T17:58:09.867408+0000","last_undegraded":"2024-04-26T17:58:09.867408+0000","last_fullsized":"2024-04-26T17:58:09.867408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:46.523995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867161+0000","last_change":"2024-04-26T17:58:04.724480+0000","last_active":"2024-04-26T17:58:09.867161+0000","last_peered":"2024-04-26T17:58:09.867161+0000","last_clean":"2024-04-26T17:58:09.867161+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T17:58:09.867161+0000","last_undegraded":"2024-04-26T17:58:09.867161+0000","last_fullsized":"2024-04-26T17:58:09.867161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:55.314208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868176+0000","last_change":"2024-04-26T17:58:04.708369+0000","last_active":"2024-04-26T17:58:09.868176+0000","last_peered":"2024-04-26T17:58:09.868176+0000","last_clean":"2024-04-26T17:58:09.868176+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T17:58:09.868176+0000","last_undegraded":"2024-04-26T17:58:09.868176+0000","last_fullsized":"2024-04-26T17:58:09.868176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:03.947874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741418+0000","last_change":"2024-04-26T17:58:04.714104+0000","last_active":"2024-04-26T17:58:09.741418+0000","last_peered":"2024-04-26T17:58:09.741418+0000","last_clean":"2024-04-26T17:58:09.741418+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T17:58:09.741418+0000","last_undegraded":"2024-04-26T17:58:09.741418+0000","last_fullsized":"2024-04-26T17:58:09.741418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:00.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741424+0000","last_change":"2024-04-26T17:58:04.714925+0000","last_active":"2024-04-26T17:58:09.741424+0000","last_peered":"2024-04-26T17:58:09.741424+0000","last_clean":"2024-04-26T17:58:09.741424+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T17:58:09.741424+0000","last_undegraded":"2024-04-26T17:58:09.741424+0000","last_fullsized":"2024-04-26T17:58:09.741424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.669034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739622+0000","last_change":"2024-04-26T17:58:04.714674+0000","last_active":"2024-04-26T17:58:09.739622+0000","last_peered":"2024-04-26T17:58:09.739622+0000","last_clean":"2024-04-26T17:58:09.739622+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T17:58:09.739622+0000","last_undegraded":"2024-04-26T17:58:09.739622+0000","last_fullsized":"2024-04-26T17:58:09.739622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:12.918478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867942+0000","last_change":"2024-04-26T17:58:04.722294+0000","last_active":"2024-04-26T17:58:09.867942+0000","last_peered":"2024-04-26T17:58:09.867942+0000","last_clean":"2024-04-26T17:58:09.867942+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T17:58:09.867942+0000","last_undegraded":"2024-04-26T17:58:09.867942+0000","last_fullsized":"2024-04-26T17:58:09.867942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:31.169681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866409+0000","last_change":"2024-04-26T17:58:04.725629+0000","last_active":"2024-04-26T17:58:09.866409+0000","last_peered":"2024-04-26T17:58:09.866409+0000","last_clean":"2024-04-26T17:58:09.866409+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T17:58:09.866409+0000","last_undegraded":"2024-04-26T17:58:09.866409+0000","last_fullsized":"2024-04-26T17:58:09.866409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:06.389060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867083+0000","last_change":"2024-04-26T17:58:04.716814+0000","last_active":"2024-04-26T17:58:09.867083+0000","last_peered":"2024-04-26T17:58:09.867083+0000","last_clean":"2024-04-26T17:58:09.867083+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T17:58:09.867083+0000","last_undegraded":"2024-04-26T17:58:09.867083+0000","last_fullsized":"2024-04-26T17:58:09.867083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:38.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867941+0000","last_change":"2024-04-26T17:58:04.715233+0000","last_active":"2024-04-26T17:58:09.867941+0000","last_peered":"2024-04-26T17:58:09.867941+0000","last_clean":"2024-04-26T17:58:09.867941+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T17:58:09.867941+0000","last_undegraded":"2024-04-26T17:58:09.867941+0000","last_fullsized":"2024-04-26T17:58:09.867941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:24.469756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867686+0000","last_change":"2024-04-26T17:58:04.722576+0000","last_active":"2024-04-26T17:58:09.867686+0000","last_peered":"2024-04-26T17:58:09.867686+0000","last_clean":"2024-04-26T17:58:09.867686+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T17:58:09.867686+0000","last_undegraded":"2024-04-26T17:58:09.867686+0000","last_fullsized":"2024-04-26T17:58:09.867686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:33.150267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867768+0000","last_change":"2024-04-26T17:58:04.712057+0000","last_active":"2024-04-26T17:58:09.867768+0000","last_peered":"2024-04-26T17:58:09.867768+0000","last_clean":"2024-04-26T17:58:09.867768+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T17:58:09.867768+0000","last_undegraded":"2024-04-26T17:58:09.867768+0000","last_fullsized":"2024-04-26T17:58:09.867768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:12.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741771+0000","last_change":"2024-04-26T17:58:04.727743+0000","last_active":"2024-04-26T17:58:09.741771+0000","last_peered":"2024-04-26T17:58:09.741771+0000","last_clean":"2024-04-26T17:58:09.741771+0000","last_became_active":"2024-04-26T17:58:04.727395+0000","last_became_peered":"2024-04-26T17:58:04.727395+0000","last_unstale":"2024-04-26T17:58:09.741771+0000","last_undegraded":"2024-04-26T17:58:09.741771+0000","last_fullsized":"2024-04-26T17:58:09.741771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:07.625978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741634+0000","last_change":"2024-04-26T17:58:04.727074+0000","last_active":"2024-04-26T17:58:09.741634+0000","last_peered":"2024-04-26T17:58:09.741634+0000","last_clean":"2024-04-26T17:58:09.741634+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T17:58:09.741634+0000","last_undegraded":"2024-04-26T17:58:09.741634+0000","last_fullsized":"2024-04-26T17:58:09.741634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:17.157157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741450+0000","last_change":"2024-04-26T17:58:04.723761+0000","last_active":"2024-04-26T17:58:09.741450+0000","last_peered":"2024-04-26T17:58:09.741450+0000","last_clean":"2024-04-26T17:58:09.741450+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T17:58:09.741450+0000","last_undegraded":"2024-04-26T17:58:09.741450+0000","last_fullsized":"2024-04-26T17:58:09.741450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:02.783054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867096+0000","last_change":"2024-04-26T17:58:04.724094+0000","last_active":"2024-04-26T17:58:09.867096+0000","last_peered":"2024-04-26T17:58:09.867096+0000","last_clean":"2024-04-26T17:58:09.867096+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T17:58:09.867096+0000","last_undegraded":"2024-04-26T17:58:09.867096+0000","last_fullsized":"2024-04-26T17:58:09.867096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:26.825638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740858+0000","last_change":"2024-04-26T17:58:04.713653+0000","last_active":"2024-04-26T17:58:09.740858+0000","last_peered":"2024-04-26T17:58:09.740858+0000","last_clean":"2024-04-26T17:58:09.740858+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T17:58:09.740858+0000","last_undegraded":"2024-04-26T17:58:09.740858+0000","last_fullsized":"2024-04-26T17:58:09.740858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:10.715579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867111+0000","last_change":"2024-04-26T17:58:04.725695+0000","last_active":"2024-04-26T17:58:09.867111+0000","last_peered":"2024-04-26T17:58:09.867111+0000","last_clean":"2024-04-26T17:58:09.867111+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T17:58:09.867111+0000","last_undegraded":"2024-04-26T17:58:09.867111+0000","last_fullsized":"2024-04-26T17:58:09.867111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:16.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740772+0000","last_change":"2024-04-26T17:58:04.712059+0000","last_active":"2024-04-26T17:58:09.740772+0000","last_peered":"2024-04-26T17:58:09.740772+0000","last_clean":"2024-04-26T17:58:09.740772+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T17:58:09.740772+0000","last_undegraded":"2024-04-26T17:58:09.740772+0000","last_fullsized":"2024-04-26T17:58:09.740772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:53.798495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867547+0000","last_change":"2024-04-26T17:58:04.726921+0000","last_active":"2024-04-26T17:58:09.867547+0000","last_peered":"2024-04-26T17:58:09.867547+0000","last_clean":"2024-04-26T17:58:09.867547+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T17:58:09.867547+0000","last_undegraded":"2024-04-26T17:58:09.867547+0000","last_fullsized":"2024-04-26T17:58:09.867547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:10.889230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867692+0000","last_change":"2024-04-26T17:58:04.714479+0000","last_active":"2024-04-26T17:58:09.867692+0000","last_peered":"2024-04-26T17:58:09.867692+0000","last_clean":"2024-04-26T17:58:09.867692+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T17:58:09.867692+0000","last_undegraded":"2024-04-26T17:58:09.867692+0000","last_fullsized":"2024-04-26T17:58:09.867692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:11.224793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867830+0000","last_change":"2024-04-26T17:58:04.715128+0000","last_active":"2024-04-26T17:58:09.867830+0000","last_peered":"2024-04-26T17:58:09.867830+0000","last_clean":"2024-04-26T17:58:09.867830+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T17:58:09.867830+0000","last_undegraded":"2024-04-26T17:58:09.867830+0000","last_fullsized":"2024-04-26T17:58:09.867830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:28.531949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741199+0000","last_change":"2024-04-26T17:58:04.719415+0000","last_active":"2024-04-26T17:58:09.741199+0000","last_peered":"2024-04-26T17:58:09.741199+0000","last_clean":"2024-04-26T17:58:09.741199+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T17:58:09.741199+0000","last_undegraded":"2024-04-26T17:58:09.741199+0000","last_fullsized":"2024-04-26T17:58:09.741199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:55.030120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:28.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:28.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.876+0000 7f95e5b04640 1 Processor -- start 2024-04-26T17:58:28.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.876+0000 7f95e5b04640 1 -- start start 2024-04-26T17:58:28.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95e5b04640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f95e00ce100 0x7f95e00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95e5b04640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f95e00cc4f0 0x7f95e015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95e5b04640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e00738c0 con 0x7f95e00b5970 2024-04-26T17:58:28.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95e5b04640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f95e0160160 con 0x7f95e00ce100 2024-04-26T17:58:28.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95e5b04640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f95e00729d0 con 0x7f95e00cc4f0 2024-04-26T17:58:28.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95df7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f95e00ce100 0x7f95e00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95df7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f95e00ce100 0x7f95e00ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48812/0 (socket says 172.21.15.139:48812) 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95df7fe640 1 -- 172.21.15.139:0/3542941332 learned_addr learned my addr 172.21.15.139:0/3542941332 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95dffff640 1 --1- 172.21.15.139:0/3542941332 >> v1:172.21.15.139:6789/0 conn(0x7f95e00b5970 0x7f95e00b5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38180/0 (socket says 172.21.15.139:38180) 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95deffd640 1 --2- 172.21.15.139:0/3542941332 >> v2:172.21.15.143:3300/0 conn(0x7f95e00cc4f0 0x7f95e015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95df7fe640 1 -- 172.21.15.139:0/3542941332 >> v2:172.21.15.143:3300/0 conn(0x7f95e00cc4f0 msgr2=0x7f95e015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95df7fe640 1 --2- 172.21.15.139:0/3542941332 >> v2:172.21.15.143:3300/0 conn(0x7f95e00cc4f0 0x7f95e015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95df7fe640 1 -- 172.21.15.139:0/3542941332 >> v1:172.21.15.139:6789/0 conn(0x7f95e00b5970 legacy=0x7f95e00b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95de7fc640 1 -- 172.21.15.139:0/3542941332 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074423552 0 0) 0x7f95e00738c0 con 0x7f95e00b5970 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95df7fe640 1 -- 172.21.15.139:0/3542941332 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e0072cb0 con 0x7f95e00ce100 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.877+0000 7f95deffd640 1 --2- 172.21.15.139:0/3542941332 >> v2:172.21.15.143:3300/0 conn(0x7f95e00cc4f0 0x7f95e015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.878+0000 7f95df7fe640 1 --2- 172.21.15.139:0/3542941332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e00ce4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95e0073ad0 tx=0x7f95d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34359de0877fd5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.878+0000 7f95de7fc640 1 -- 172.21.15.139:0/3542941332 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0037070 con 0x7f95e00ce100 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.878+0000 7f95de7fc640 1 -- 172.21.15.139:0/3542941332 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d0032440 con 0x7f95e00ce100 2024-04-26T17:58:28.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.878+0000 7f95de7fc640 1 -- 172.21.15.139:0/3542941332 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0032810 con 0x7f95e00ce100 2024-04-26T17:58:28.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 -- 172.21.15.139:0/3542941332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 msgr2=0x7f95e00ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 --2- 172.21.15.139:0/3542941332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e00ce4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f95e0073ad0 tx=0x7f95d002a1e0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 -- 172.21.15.139:0/3542941332 shutdown_connections 2024-04-26T17:58:28.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 --2- 172.21.15.139:0/3542941332 >> v2:172.21.15.143:3300/0 conn(0x7f95e00cc4f0 0x7f95e015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 --2- 172.21.15.139:0/3542941332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e00ce4e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 -- 172.21.15.139:0/3542941332 >> 172.21.15.139:0/3542941332 conn(0x7f95e0068270 msgr2=0x7f95e0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 -- 172.21.15.139:0/3542941332 shutdown_connections 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.879+0000 7f95e5b04640 1 -- 172.21.15.139:0/3542941332 wait complete. 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.880+0000 7f95e5b04640 1 Processor -- start 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.880+0000 7f95e5b04640 1 -- start start 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95e5b04640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e00b5970 0x7f95e0158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95e5b04640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95e00cc4f0 0x7f95e01f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95e5b04640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e01f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95e5b04640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0073550 con 0x7f95e00ce100 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95e5b04640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0073270 con 0x7f95e00b5970 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95e5b04640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f95e0156360 con 0x7f95e00cc4f0 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e01f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e01f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48816/0 (socket says 172.21.15.139:48816) 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 -- 172.21.15.139:0/895810400 learned_addr learned my addr 172.21.15.139:0/895810400 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95df7fe640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e00b5970 0x7f95e0158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95deffd640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95e00cc4f0 0x7f95e01f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 -- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95e00cc4f0 msgr2=0x7f95e01f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95e00cc4f0 0x7f95e01f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 -- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e00b5970 msgr2=0x7f95e0158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e00b5970 0x7f95e0158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 -- 172.21.15.139:0/895810400 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e01f4670 con 0x7f95e00ce100 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.881+0000 7f95dffff640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e01f2d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c7a0 tx=0x7f95d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.882+0000 7f95c7fff640 1 -- 172.21.15.139:0/895810400 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8018070 con 0x7f95e00ce100 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.882+0000 7f95c7fff640 1 -- 172.21.15.139:0/895810400 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d800a640 con 0x7f95e00ce100 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.882+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e01583d0 con 0x7f95e00ce100 2024-04-26T17:58:28.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.882+0000 7f95c7fff640 1 -- 172.21.15.139:0/895810400 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d800aab0 con 0x7f95e00ce100 2024-04-26T17:58:28.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.882+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e01f4c10 con 0x7f95e00ce100 2024-04-26T17:58:28.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.883+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e008e2b0 con 0x7f95e00ce100 2024-04-26T17:58:28.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.883+0000 7f95c7fff640 1 -- 172.21.15.139:0/895810400 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95d801b070 con 0x7f95e00ce100 2024-04-26T17:58:28.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.883+0000 7f95c7fff640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f95cc06c920 0x7f95cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.884+0000 7f95c7fff640 1 -- 172.21.15.139:0/895810400 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f95d808b4b0 con 0x7f95e00ce100 2024-04-26T17:58:28.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.884+0000 7f95df7fe640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f95cc06c920 0x7f95cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.884+0000 7f95df7fe640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f95cc06c920 0x7f95cc06ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95d0034000 tx=0x7f95d002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:28.888+0000 7f95c7fff640 1 -- 172.21.15.139:0/895810400 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95e008e2b0 con 0x7f95e00ce100 2024-04-26T17:58:29.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.058+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95e0076d20 con 0x7f95cc06c920 2024-04-26T17:58:29.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.065+0000 7f95c7fff640 1 -- 172.21.15.139:0/895810400 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f95e0076d20 con 0x7f95cc06c920 2024-04-26T17:58:29.069 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f95cc06c920 msgr2=0x7f95cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f95cc06c920 0x7f95cc06ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95d0034000 tx=0x7f95d002e000 comp rx=0 tx=0).stop 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 msgr2=0x7f95e01f2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e01f2d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c7a0 tx=0x7f95d800cc60 comp rx=0 tx=0).stop 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 shutdown_connections 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f95cc06c920 0x7f95cc06ede0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95e00ce100 0x7f95e01f2d00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f95e00cc4f0 0x7f95e01f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 --2- 172.21.15.139:0/895810400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95e00b5970 0x7f95e0158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 >> 172.21.15.139:0/895810400 conn(0x7f95e0068270 msgr2=0x7f95e00b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 shutdown_connections 2024-04-26T17:58:29.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.069+0000 7f95e5b04640 1 -- 172.21.15.139:0/895810400 wait complete. 2024-04-26T17:58:29.080 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-26T17:58:29.031580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002698"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867920+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T17:58:09.867920+0000","last_peered":"2024-04-26T17:58:09.867920+0000","last_clean":"2024-04-26T17:58:09.867920+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T17:58:09.867920+0000","last_undegraded":"2024-04-26T17:58:09.867920+0000","last_fullsized":"2024-04-26T17:58:09.867920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866709+0000","last_change":"2024-04-26T17:58:04.721568+0000","last_active":"2024-04-26T17:58:09.866709+0000","last_peered":"2024-04-26T17:58:09.866709+0000","last_clean":"2024-04-26T17:58:09.866709+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T17:58:09.866709+0000","last_undegraded":"2024-04-26T17:58:09.866709+0000","last_fullsized":"2024-04-26T17:58:09.866709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:24.906240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867369+0000","last_change":"2024-04-26T17:58:08.737557+0000","last_active":"2024-04-26T17:58:09.867369+0000","last_peered":"2024-04-26T17:58:09.867369+0000","last_clean":"2024-04-26T17:58:09.867369+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T17:58:09.867369+0000","last_undegraded":"2024-04-26T17:58:09.867369+0000","last_fullsized":"2024-04-26T17:58:09.867369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:29.013280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866886+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T17:58:09.866886+0000","last_peered":"2024-04-26T17:58:09.866886+0000","last_clean":"2024-04-26T17:58:09.866886+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T17:58:09.866886+0000","last_undegraded":"2024-04-26T17:58:09.866886+0000","last_fullsized":"2024-04-26T17:58:09.866886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867706+0000","last_change":"2024-04-26T17:58:04.725200+0000","last_active":"2024-04-26T17:58:09.867706+0000","last_peered":"2024-04-26T17:58:09.867706+0000","last_clean":"2024-04-26T17:58:09.867706+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T17:58:09.867706+0000","last_undegraded":"2024-04-26T17:58:09.867706+0000","last_fullsized":"2024-04-26T17:58:09.867706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:15.882481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866726+0000","last_change":"2024-04-26T17:58:08.747272+0000","last_active":"2024-04-26T17:58:09.866726+0000","last_peered":"2024-04-26T17:58:09.866726+0000","last_clean":"2024-04-26T17:58:09.866726+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T17:58:09.866726+0000","last_undegraded":"2024-04-26T17:58:09.866726+0000","last_fullsized":"2024-04-26T17:58:09.866726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:08.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741319+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T17:58:09.741319+0000","last_peered":"2024-04-26T17:58:09.741319+0000","last_clean":"2024-04-26T17:58:09.741319+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T17:58:09.741319+0000","last_undegraded":"2024-04-26T17:58:09.741319+0000","last_fullsized":"2024-04-26T17:58:09.741319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867042+0000","last_change":"2024-04-26T17:58:04.723700+0000","last_active":"2024-04-26T17:58:09.867042+0000","last_peered":"2024-04-26T17:58:09.867042+0000","last_clean":"2024-04-26T17:58:09.867042+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T17:58:09.867042+0000","last_undegraded":"2024-04-26T17:58:09.867042+0000","last_fullsized":"2024-04-26T17:58:09.867042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:05.637900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866801+0000","last_change":"2024-04-26T17:58:08.746662+0000","last_active":"2024-04-26T17:58:09.866801+0000","last_peered":"2024-04-26T17:58:09.866801+0000","last_clean":"2024-04-26T17:58:09.866801+0000","last_became_active":"2024-04-26T17:58:08.746200+0000","last_became_peered":"2024-04-26T17:58:08.746200+0000","last_unstale":"2024-04-26T17:58:09.866801+0000","last_undegraded":"2024-04-26T17:58:09.866801+0000","last_fullsized":"2024-04-26T17:58:09.866801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:05.431076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740881+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T17:58:09.740881+0000","last_peered":"2024-04-26T17:58:09.740881+0000","last_clean":"2024-04-26T17:58:09.740881+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T17:58:09.740881+0000","last_undegraded":"2024-04-26T17:58:09.740881+0000","last_fullsized":"2024-04-26T17:58:09.740881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867441+0000","last_change":"2024-04-26T17:58:04.723945+0000","last_active":"2024-04-26T17:58:09.867441+0000","last_peered":"2024-04-26T17:58:09.867441+0000","last_clean":"2024-04-26T17:58:09.867441+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T17:58:09.867441+0000","last_undegraded":"2024-04-26T17:58:09.867441+0000","last_fullsized":"2024-04-26T17:58:09.867441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:58.454180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:08.743082+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:56.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742051+0000","last_change":"2024-04-26T17:58:04.715624+0000","last_active":"2024-04-26T17:58:09.742051+0000","last_peered":"2024-04-26T17:58:09.742051+0000","last_clean":"2024-04-26T17:58:09.742051+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T17:58:09.742051+0000","last_undegraded":"2024-04-26T17:58:09.742051+0000","last_fullsized":"2024-04-26T17:58:09.742051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:45.282546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741089+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T17:58:09.741089+0000","last_peered":"2024-04-26T17:58:09.741089+0000","last_clean":"2024-04-26T17:58:09.741089+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T17:58:09.741089+0000","last_undegraded":"2024-04-26T17:58:09.741089+0000","last_fullsized":"2024-04-26T17:58:09.741089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867178+0000","last_change":"2024-04-26T17:58:08.747055+0000","last_active":"2024-04-26T17:58:09.867178+0000","last_peered":"2024-04-26T17:58:09.867178+0000","last_clean":"2024-04-26T17:58:09.867178+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T17:58:09.867178+0000","last_undegraded":"2024-04-26T17:58:09.867178+0000","last_fullsized":"2024-04-26T17:58:09.867178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:38.260141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867917+0000","last_change":"2024-04-26T17:58:04.717982+0000","last_active":"2024-04-26T17:58:09.867917+0000","last_peered":"2024-04-26T17:58:09.867917+0000","last_clean":"2024-04-26T17:58:09.867917+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T17:58:09.867917+0000","last_undegraded":"2024-04-26T17:58:09.867917+0000","last_fullsized":"2024-04-26T17:58:09.867917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:54.094898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868688+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T17:58:09.868688+0000","last_peered":"2024-04-26T17:58:09.868688+0000","last_clean":"2024-04-26T17:58:09.868688+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T17:58:09.868688+0000","last_undegraded":"2024-04-26T17:58:09.868688+0000","last_fullsized":"2024-04-26T17:58:09.868688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867590+0000","last_change":"2024-04-26T17:58:08.747263+0000","last_active":"2024-04-26T17:58:09.867590+0000","last_peered":"2024-04-26T17:58:09.867590+0000","last_clean":"2024-04-26T17:58:09.867590+0000","last_became_active":"2024-04-26T17:58:08.746835+0000","last_became_peered":"2024-04-26T17:58:08.746835+0000","last_unstale":"2024-04-26T17:58:09.867590+0000","last_undegraded":"2024-04-26T17:58:09.867590+0000","last_fullsized":"2024-04-26T17:58:09.867590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:03.581123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867258+0000","last_change":"2024-04-26T17:58:04.717948+0000","last_active":"2024-04-26T17:58:09.867258+0000","last_peered":"2024-04-26T17:58:09.867258+0000","last_clean":"2024-04-26T17:58:09.867258+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T17:58:09.867258+0000","last_undegraded":"2024-04-26T17:58:09.867258+0000","last_fullsized":"2024-04-26T17:58:09.867258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.344820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867168+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T17:58:09.867168+0000","last_peered":"2024-04-26T17:58:09.867168+0000","last_clean":"2024-04-26T17:58:09.867168+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T17:58:09.867168+0000","last_undegraded":"2024-04-26T17:58:09.867168+0000","last_fullsized":"2024-04-26T17:58:09.867168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867165+0000","last_change":"2024-04-26T17:58:08.743822+0000","last_active":"2024-04-26T17:58:09.867165+0000","last_peered":"2024-04-26T17:58:09.867165+0000","last_clean":"2024-04-26T17:58:09.867165+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T17:58:09.867165+0000","last_undegraded":"2024-04-26T17:58:09.867165+0000","last_fullsized":"2024-04-26T17:58:09.867165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:12.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867993+0000","last_change":"2024-04-26T17:58:04.712440+0000","last_active":"2024-04-26T17:58:09.867993+0000","last_peered":"2024-04-26T17:58:09.867993+0000","last_clean":"2024-04-26T17:58:09.867993+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T17:58:09.867993+0000","last_undegraded":"2024-04-26T17:58:09.867993+0000","last_fullsized":"2024-04-26T17:58:09.867993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:30.916890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740538+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T17:58:09.740538+0000","last_peered":"2024-04-26T17:58:09.740538+0000","last_clean":"2024-04-26T17:58:09.740538+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T17:58:09.740538+0000","last_undegraded":"2024-04-26T17:58:09.740538+0000","last_fullsized":"2024-04-26T17:58:09.740538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866990+0000","last_change":"2024-04-26T17:58:08.747104+0000","last_active":"2024-04-26T17:58:09.866990+0000","last_peered":"2024-04-26T17:58:09.866990+0000","last_clean":"2024-04-26T17:58:09.866990+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T17:58:09.866990+0000","last_undegraded":"2024-04-26T17:58:09.866990+0000","last_fullsized":"2024-04-26T17:58:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:19.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867840+0000","last_change":"2024-04-26T17:58:04.715359+0000","last_active":"2024-04-26T17:58:09.867840+0000","last_peered":"2024-04-26T17:58:09.867840+0000","last_clean":"2024-04-26T17:58:09.867840+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T17:58:09.867840+0000","last_undegraded":"2024-04-26T17:58:09.867840+0000","last_fullsized":"2024-04-26T17:58:09.867840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:11.014077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742339+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T17:58:09.742339+0000","last_peered":"2024-04-26T17:58:09.742339+0000","last_clean":"2024-04-26T17:58:09.742339+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T17:58:09.742339+0000","last_undegraded":"2024-04-26T17:58:09.742339+0000","last_fullsized":"2024-04-26T17:58:09.742339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867794+0000","last_change":"2024-04-26T17:58:08.742685+0000","last_active":"2024-04-26T17:58:09.867794+0000","last_peered":"2024-04-26T17:58:09.867794+0000","last_clean":"2024-04-26T17:58:09.867794+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T17:58:09.867794+0000","last_undegraded":"2024-04-26T17:58:09.867794+0000","last_fullsized":"2024-04-26T17:58:09.867794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:49.952963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867465+0000","last_change":"2024-04-26T17:58:04.713980+0000","last_active":"2024-04-26T17:58:09.867465+0000","last_peered":"2024-04-26T17:58:09.867465+0000","last_clean":"2024-04-26T17:58:09.867465+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T17:58:09.867465+0000","last_undegraded":"2024-04-26T17:58:09.867465+0000","last_fullsized":"2024-04-26T17:58:09.867465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:48.678130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867971+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T17:58:09.867971+0000","last_peered":"2024-04-26T17:58:09.867971+0000","last_clean":"2024-04-26T17:58:09.867971+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T17:58:09.867971+0000","last_undegraded":"2024-04-26T17:58:09.867971+0000","last_fullsized":"2024-04-26T17:58:09.867971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867029+0000","last_change":"2024-04-26T17:58:08.746201+0000","last_active":"2024-04-26T17:58:09.867029+0000","last_peered":"2024-04-26T17:58:09.867029+0000","last_clean":"2024-04-26T17:58:09.867029+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T17:58:09.867029+0000","last_undegraded":"2024-04-26T17:58:09.867029+0000","last_fullsized":"2024-04-26T17:58:09.867029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:23.961683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866770+0000","last_change":"2024-04-26T17:58:04.712662+0000","last_active":"2024-04-26T17:58:09.866770+0000","last_peered":"2024-04-26T17:58:09.866770+0000","last_clean":"2024-04-26T17:58:09.866770+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T17:58:09.866770+0000","last_undegraded":"2024-04-26T17:58:09.866770+0000","last_fullsized":"2024-04-26T17:58:09.866770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:37.557975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741512+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T17:58:09.741512+0000","last_peered":"2024-04-26T17:58:09.741512+0000","last_clean":"2024-04-26T17:58:09.741512+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T17:58:09.741512+0000","last_undegraded":"2024-04-26T17:58:09.741512+0000","last_fullsized":"2024-04-26T17:58:09.741512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868118+0000","last_change":"2024-04-26T17:58:08.740345+0000","last_active":"2024-04-26T17:58:09.868118+0000","last_peered":"2024-04-26T17:58:09.868118+0000","last_clean":"2024-04-26T17:58:09.868118+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T17:58:09.868118+0000","last_undegraded":"2024-04-26T17:58:09.868118+0000","last_fullsized":"2024-04-26T17:58:09.868118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:49.324368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867513+0000","last_change":"2024-04-26T17:58:04.726233+0000","last_active":"2024-04-26T17:58:09.867513+0000","last_peered":"2024-04-26T17:58:09.867513+0000","last_clean":"2024-04-26T17:58:09.867513+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T17:58:09.867513+0000","last_undegraded":"2024-04-26T17:58:09.867513+0000","last_fullsized":"2024-04-26T17:58:09.867513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:04.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866859+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T17:58:09.866859+0000","last_peered":"2024-04-26T17:58:09.866859+0000","last_clean":"2024-04-26T17:58:09.866859+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T17:58:09.866859+0000","last_undegraded":"2024-04-26T17:58:09.866859+0000","last_fullsized":"2024-04-26T17:58:09.866859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868258+0000","last_change":"2024-04-26T17:58:08.742909+0000","last_active":"2024-04-26T17:58:09.868258+0000","last_peered":"2024-04-26T17:58:09.868258+0000","last_clean":"2024-04-26T17:58:09.868258+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T17:58:09.868258+0000","last_undegraded":"2024-04-26T17:58:09.868258+0000","last_fullsized":"2024-04-26T17:58:09.868258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:50.554497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867397+0000","last_change":"2024-04-26T17:58:04.708024+0000","last_active":"2024-04-26T17:58:09.867397+0000","last_peered":"2024-04-26T17:58:09.867397+0000","last_clean":"2024-04-26T17:58:09.867397+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T17:58:09.867397+0000","last_undegraded":"2024-04-26T17:58:09.867397+0000","last_fullsized":"2024-04-26T17:58:09.867397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867406+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T17:58:09.867406+0000","last_peered":"2024-04-26T17:58:09.867406+0000","last_clean":"2024-04-26T17:58:09.867406+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T17:58:09.867406+0000","last_undegraded":"2024-04-26T17:58:09.867406+0000","last_fullsized":"2024-04-26T17:58:09.867406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866674+0000","last_change":"2024-04-26T17:58:08.739726+0000","last_active":"2024-04-26T17:58:09.866674+0000","last_peered":"2024-04-26T17:58:09.866674+0000","last_clean":"2024-04-26T17:58:09.866674+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T17:58:09.866674+0000","last_undegraded":"2024-04-26T17:58:09.866674+0000","last_fullsized":"2024-04-26T17:58:09.866674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:08.315753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866446+0000","last_change":"2024-04-26T17:58:04.712446+0000","last_active":"2024-04-26T17:58:09.866446+0000","last_peered":"2024-04-26T17:58:09.866446+0000","last_clean":"2024-04-26T17:58:09.866446+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T17:58:09.866446+0000","last_undegraded":"2024-04-26T17:58:09.866446+0000","last_fullsized":"2024-04-26T17:58:09.866446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:52.484069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739473+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T17:58:09.739473+0000","last_peered":"2024-04-26T17:58:09.739473+0000","last_clean":"2024-04-26T17:58:09.739473+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T17:58:09.739473+0000","last_undegraded":"2024-04-26T17:58:09.739473+0000","last_fullsized":"2024-04-26T17:58:09.739473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867315+0000","last_change":"2024-04-26T17:58:08.742536+0000","last_active":"2024-04-26T17:58:09.867315+0000","last_peered":"2024-04-26T17:58:09.867315+0000","last_clean":"2024-04-26T17:58:09.867315+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T17:58:09.867315+0000","last_undegraded":"2024-04-26T17:58:09.867315+0000","last_fullsized":"2024-04-26T17:58:09.867315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:49.364705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866653+0000","last_change":"2024-04-26T17:58:04.711535+0000","last_active":"2024-04-26T17:58:09.866653+0000","last_peered":"2024-04-26T17:58:09.866653+0000","last_clean":"2024-04-26T17:58:09.866653+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T17:58:09.866653+0000","last_undegraded":"2024-04-26T17:58:09.866653+0000","last_fullsized":"2024-04-26T17:58:09.866653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:11.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740669+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T17:58:09.740669+0000","last_peered":"2024-04-26T17:58:09.740669+0000","last_clean":"2024-04-26T17:58:09.740669+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T17:58:09.740669+0000","last_undegraded":"2024-04-26T17:58:09.740669+0000","last_fullsized":"2024-04-26T17:58:09.740669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867764+0000","last_change":"2024-04-26T17:58:08.734543+0000","last_active":"2024-04-26T17:58:09.867764+0000","last_peered":"2024-04-26T17:58:09.867764+0000","last_clean":"2024-04-26T17:58:09.867764+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T17:58:09.867764+0000","last_undegraded":"2024-04-26T17:58:09.867764+0000","last_fullsized":"2024-04-26T17:58:09.867764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:55.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866271+0000","last_change":"2024-04-26T17:58:04.727199+0000","last_active":"2024-04-26T17:58:09.866271+0000","last_peered":"2024-04-26T17:58:09.866271+0000","last_clean":"2024-04-26T17:58:09.866271+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T17:58:09.866271+0000","last_undegraded":"2024-04-26T17:58:09.866271+0000","last_fullsized":"2024-04-26T17:58:09.866271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:06.483618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867639+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T17:58:09.867639+0000","last_peered":"2024-04-26T17:58:09.867639+0000","last_clean":"2024-04-26T17:58:09.867639+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T17:58:09.867639+0000","last_undegraded":"2024-04-26T17:58:09.867639+0000","last_fullsized":"2024-04-26T17:58:09.867639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740780+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T17:58:09.740780+0000","last_peered":"2024-04-26T17:58:09.740780+0000","last_clean":"2024-04-26T17:58:09.740780+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T17:58:09.740780+0000","last_undegraded":"2024-04-26T17:58:09.740780+0000","last_fullsized":"2024-04-26T17:58:09.740780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741715+0000","last_change":"2024-04-26T17:58:08.737072+0000","last_active":"2024-04-26T17:58:09.741715+0000","last_peered":"2024-04-26T17:58:09.741715+0000","last_clean":"2024-04-26T17:58:09.741715+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T17:58:09.741715+0000","last_undegraded":"2024-04-26T17:58:09.741715+0000","last_fullsized":"2024-04-26T17:58:09.741715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:11.217370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740782+0000","last_change":"2024-04-26T17:58:04.724798+0000","last_active":"2024-04-26T17:58:09.740782+0000","last_peered":"2024-04-26T17:58:09.740782+0000","last_clean":"2024-04-26T17:58:09.740782+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T17:58:09.740782+0000","last_undegraded":"2024-04-26T17:58:09.740782+0000","last_fullsized":"2024-04-26T17:58:09.740782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.707135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739785+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T17:58:09.739785+0000","last_peered":"2024-04-26T17:58:09.739785+0000","last_clean":"2024-04-26T17:58:09.739785+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T17:58:09.739785+0000","last_undegraded":"2024-04-26T17:58:09.739785+0000","last_fullsized":"2024-04-26T17:58:09.739785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741890+0000","last_change":"2024-04-26T17:58:08.735010+0000","last_active":"2024-04-26T17:58:09.741890+0000","last_peered":"2024-04-26T17:58:09.741890+0000","last_clean":"2024-04-26T17:58:09.741890+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T17:58:09.741890+0000","last_undegraded":"2024-04-26T17:58:09.741890+0000","last_fullsized":"2024-04-26T17:58:09.741890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.377179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867215+0000","last_change":"2024-04-26T17:58:04.726744+0000","last_active":"2024-04-26T17:58:09.867215+0000","last_peered":"2024-04-26T17:58:09.867215+0000","last_clean":"2024-04-26T17:58:09.867215+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T17:58:09.867215+0000","last_undegraded":"2024-04-26T17:58:09.867215+0000","last_fullsized":"2024-04-26T17:58:09.867215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:06.654631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868255+0000","last_change":"2024-04-26T17:58:08.748124+0000","last_active":"2024-04-26T17:58:09.868255+0000","last_peered":"2024-04-26T17:58:09.868255+0000","last_clean":"2024-04-26T17:58:09.868255+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T17:58:09.868255+0000","last_undegraded":"2024-04-26T17:58:09.868255+0000","last_fullsized":"2024-04-26T17:58:09.868255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:07.600726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741479+0000","last_change":"2024-04-26T17:58:04.716933+0000","last_active":"2024-04-26T17:58:09.741479+0000","last_peered":"2024-04-26T17:58:09.741479+0000","last_clean":"2024-04-26T17:58:09.741479+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T17:58:09.741479+0000","last_undegraded":"2024-04-26T17:58:09.741479+0000","last_fullsized":"2024-04-26T17:58:09.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:25.360981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739660+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T17:58:09.739660+0000","last_peered":"2024-04-26T17:58:09.739660+0000","last_clean":"2024-04-26T17:58:09.739660+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T17:58:09.739660+0000","last_undegraded":"2024-04-26T17:58:09.739660+0000","last_fullsized":"2024-04-26T17:58:09.739660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866386+0000","last_change":"2024-04-26T17:58:08.737297+0000","last_active":"2024-04-26T17:58:09.866386+0000","last_peered":"2024-04-26T17:58:09.866386+0000","last_clean":"2024-04-26T17:58:09.866386+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T17:58:09.866386+0000","last_undegraded":"2024-04-26T17:58:09.866386+0000","last_fullsized":"2024-04-26T17:58:09.866386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:34.582604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741116+0000","last_change":"2024-04-26T17:58:04.716850+0000","last_active":"2024-04-26T17:58:09.741116+0000","last_peered":"2024-04-26T17:58:09.741116+0000","last_clean":"2024-04-26T17:58:09.741116+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T17:58:09.741116+0000","last_undegraded":"2024-04-26T17:58:09.741116+0000","last_fullsized":"2024-04-26T17:58:09.741116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:35.530627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867994+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T17:58:09.867994+0000","last_peered":"2024-04-26T17:58:09.867994+0000","last_clean":"2024-04-26T17:58:09.867994+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T17:58:09.867994+0000","last_undegraded":"2024-04-26T17:58:09.867994+0000","last_fullsized":"2024-04-26T17:58:09.867994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866728+0000","last_change":"2024-04-26T17:58:08.747644+0000","last_active":"2024-04-26T17:58:09.866728+0000","last_peered":"2024-04-26T17:58:09.866728+0000","last_clean":"2024-04-26T17:58:09.866728+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T17:58:09.866728+0000","last_undegraded":"2024-04-26T17:58:09.866728+0000","last_fullsized":"2024-04-26T17:58:09.866728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.713815+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:08.918386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739376+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T17:58:09.739376+0000","last_peered":"2024-04-26T17:58:09.739376+0000","last_clean":"2024-04-26T17:58:09.739376+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T17:58:09.739376+0000","last_undegraded":"2024-04-26T17:58:09.739376+0000","last_fullsized":"2024-04-26T17:58:09.739376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867630+0000","last_change":"2024-04-26T17:58:08.739259+0000","last_active":"2024-04-26T17:58:09.867630+0000","last_peered":"2024-04-26T17:58:09.867630+0000","last_clean":"2024-04-26T17:58:09.867630+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T17:58:09.867630+0000","last_undegraded":"2024-04-26T17:58:09.867630+0000","last_fullsized":"2024-04-26T17:58:09.867630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:42.110881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740479+0000","last_change":"2024-04-26T17:58:04.717008+0000","last_active":"2024-04-26T17:58:09.740479+0000","last_peered":"2024-04-26T17:58:09.740479+0000","last_clean":"2024-04-26T17:58:09.740479+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T17:58:09.740479+0000","last_undegraded":"2024-04-26T17:58:09.740479+0000","last_fullsized":"2024-04-26T17:58:09.740479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:10.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741681+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T17:58:09.741681+0000","last_peered":"2024-04-26T17:58:09.741681+0000","last_clean":"2024-04-26T17:58:09.741681+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T17:58:09.741681+0000","last_undegraded":"2024-04-26T17:58:09.741681+0000","last_fullsized":"2024-04-26T17:58:09.741681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867276+0000","last_change":"2024-04-26T17:58:08.742774+0000","last_active":"2024-04-26T17:58:09.867276+0000","last_peered":"2024-04-26T17:58:09.867276+0000","last_clean":"2024-04-26T17:58:09.867276+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T17:58:09.867276+0000","last_undegraded":"2024-04-26T17:58:09.867276+0000","last_fullsized":"2024-04-26T17:58:09.867276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:04.231921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741023+0000","last_change":"2024-04-26T17:58:04.712970+0000","last_active":"2024-04-26T17:58:09.741023+0000","last_peered":"2024-04-26T17:58:09.741023+0000","last_clean":"2024-04-26T17:58:09.741023+0000","last_became_active":"2024-04-26T17:58:04.712645+0000","last_became_peered":"2024-04-26T17:58:04.712645+0000","last_unstale":"2024-04-26T17:58:09.741023+0000","last_undegraded":"2024-04-26T17:58:09.741023+0000","last_fullsized":"2024-04-26T17:58:09.741023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:06.746889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867322+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T17:58:09.867322+0000","last_peered":"2024-04-26T17:58:09.867322+0000","last_clean":"2024-04-26T17:58:09.867322+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T17:58:09.867322+0000","last_undegraded":"2024-04-26T17:58:09.867322+0000","last_fullsized":"2024-04-26T17:58:09.867322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868215+0000","last_change":"2024-04-26T17:58:08.741761+0000","last_active":"2024-04-26T17:58:09.868215+0000","last_peered":"2024-04-26T17:58:09.868215+0000","last_clean":"2024-04-26T17:58:09.868215+0000","last_became_active":"2024-04-26T17:58:08.741401+0000","last_became_peered":"2024-04-26T17:58:08.741401+0000","last_unstale":"2024-04-26T17:58:09.868215+0000","last_undegraded":"2024-04-26T17:58:09.868215+0000","last_fullsized":"2024-04-26T17:58:09.868215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:44.837522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867967+0000","last_change":"2024-04-26T17:58:04.705981+0000","last_active":"2024-04-26T17:58:09.867967+0000","last_peered":"2024-04-26T17:58:09.867967+0000","last_clean":"2024-04-26T17:58:09.867967+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T17:58:09.867967+0000","last_undegraded":"2024-04-26T17:58:09.867967+0000","last_fullsized":"2024-04-26T17:58:09.867967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868393+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T17:58:09.868393+0000","last_peered":"2024-04-26T17:58:09.868393+0000","last_clean":"2024-04-26T17:58:09.868393+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T17:58:09.868393+0000","last_undegraded":"2024-04-26T17:58:09.868393+0000","last_fullsized":"2024-04-26T17:58:09.868393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867400+0000","last_change":"2024-04-26T17:58:08.739520+0000","last_active":"2024-04-26T17:58:09.867400+0000","last_peered":"2024-04-26T17:58:09.867400+0000","last_clean":"2024-04-26T17:58:09.867400+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T17:58:09.867400+0000","last_undegraded":"2024-04-26T17:58:09.867400+0000","last_fullsized":"2024-04-26T17:58:09.867400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:10.313792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.719394+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:33.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.307724+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T17:58:17.307724+0000","last_peered":"2024-04-26T17:58:17.307724+0000","last_clean":"2024-04-26T17:58:17.307724+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T17:58:17.307724+0000","last_undegraded":"2024-04-26T17:58:17.307724+0000","last_fullsized":"2024-04-26T17:58:17.307724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868423+0000","last_change":"2024-04-26T17:58:08.736275+0000","last_active":"2024-04-26T17:58:09.868423+0000","last_peered":"2024-04-26T17:58:09.868423+0000","last_clean":"2024-04-26T17:58:09.868423+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T17:58:09.868423+0000","last_undegraded":"2024-04-26T17:58:09.868423+0000","last_fullsized":"2024-04-26T17:58:09.868423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:07.103401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867796+0000","last_change":"2024-04-26T17:58:04.712316+0000","last_active":"2024-04-26T17:58:09.867796+0000","last_peered":"2024-04-26T17:58:09.867796+0000","last_clean":"2024-04-26T17:58:09.867796+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T17:58:09.867796+0000","last_undegraded":"2024-04-26T17:58:09.867796+0000","last_fullsized":"2024-04-26T17:58:09.867796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:49.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866776+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T17:58:09.866776+0000","last_peered":"2024-04-26T17:58:09.866776+0000","last_clean":"2024-04-26T17:58:09.866776+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T17:58:09.866776+0000","last_undegraded":"2024-04-26T17:58:09.866776+0000","last_fullsized":"2024-04-26T17:58:09.866776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867058+0000","last_change":"2024-04-26T17:58:08.742746+0000","last_active":"2024-04-26T17:58:09.867058+0000","last_peered":"2024-04-26T17:58:09.867058+0000","last_clean":"2024-04-26T17:58:09.867058+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T17:58:09.867058+0000","last_undegraded":"2024-04-26T17:58:09.867058+0000","last_fullsized":"2024-04-26T17:58:09.867058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:51.352617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868076+0000","last_change":"2024-04-26T17:58:04.723214+0000","last_active":"2024-04-26T17:58:09.868076+0000","last_peered":"2024-04-26T17:58:09.868076+0000","last_clean":"2024-04-26T17:58:09.868076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T17:58:09.868076+0000","last_undegraded":"2024-04-26T17:58:09.868076+0000","last_fullsized":"2024-04-26T17:58:09.868076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:08.558197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867696+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T17:58:09.867696+0000","last_peered":"2024-04-26T17:58:09.867696+0000","last_clean":"2024-04-26T17:58:09.867696+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T17:58:09.867696+0000","last_undegraded":"2024-04-26T17:58:09.867696+0000","last_fullsized":"2024-04-26T17:58:09.867696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867239+0000","last_change":"2024-04-26T17:58:08.745044+0000","last_active":"2024-04-26T17:58:09.867239+0000","last_peered":"2024-04-26T17:58:09.867239+0000","last_clean":"2024-04-26T17:58:09.867239+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T17:58:09.867239+0000","last_undegraded":"2024-04-26T17:58:09.867239+0000","last_fullsized":"2024-04-26T17:58:09.867239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:53.339198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867490+0000","last_change":"2024-04-26T17:58:04.720903+0000","last_active":"2024-04-26T17:58:09.867490+0000","last_peered":"2024-04-26T17:58:09.867490+0000","last_clean":"2024-04-26T17:58:09.867490+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T17:58:09.867490+0000","last_undegraded":"2024-04-26T17:58:09.867490+0000","last_fullsized":"2024-04-26T17:58:09.867490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:46.583637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742161+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T17:58:09.742161+0000","last_peered":"2024-04-26T17:58:09.742161+0000","last_clean":"2024-04-26T17:58:09.742161+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T17:58:09.742161+0000","last_undegraded":"2024-04-26T17:58:09.742161+0000","last_fullsized":"2024-04-26T17:58:09.742161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867269+0000","last_change":"2024-04-26T17:58:08.743119+0000","last_active":"2024-04-26T17:58:09.867269+0000","last_peered":"2024-04-26T17:58:09.867269+0000","last_clean":"2024-04-26T17:58:09.867269+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T17:58:09.867269+0000","last_undegraded":"2024-04-26T17:58:09.867269+0000","last_fullsized":"2024-04-26T17:58:09.867269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:41.640200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867500+0000","last_change":"2024-04-26T17:58:08.739999+0000","last_active":"2024-04-26T17:58:09.867500+0000","last_peered":"2024-04-26T17:58:09.867500+0000","last_clean":"2024-04-26T17:58:09.867500+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T17:58:09.867500+0000","last_undegraded":"2024-04-26T17:58:09.867500+0000","last_fullsized":"2024-04-26T17:58:09.867500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:30.637006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866996+0000","last_change":"2024-04-26T17:58:04.719069+0000","last_active":"2024-04-26T17:58:09.866996+0000","last_peered":"2024-04-26T17:58:09.866996+0000","last_clean":"2024-04-26T17:58:09.866996+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T17:58:09.866996+0000","last_undegraded":"2024-04-26T17:58:09.866996+0000","last_fullsized":"2024-04-26T17:58:09.866996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:09.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867009+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T17:58:09.867009+0000","last_peered":"2024-04-26T17:58:09.867009+0000","last_clean":"2024-04-26T17:58:09.867009+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T17:58:09.867009+0000","last_undegraded":"2024-04-26T17:58:09.867009+0000","last_fullsized":"2024-04-26T17:58:09.867009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741957+0000","last_change":"2024-04-26T17:58:08.738167+0000","last_active":"2024-04-26T17:58:09.741957+0000","last_peered":"2024-04-26T17:58:09.741957+0000","last_clean":"2024-04-26T17:58:09.741957+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T17:58:09.741957+0000","last_undegraded":"2024-04-26T17:58:09.741957+0000","last_fullsized":"2024-04-26T17:58:09.741957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:42.434088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867177+0000","last_change":"2024-04-26T17:58:04.717580+0000","last_active":"2024-04-26T17:58:09.867177+0000","last_peered":"2024-04-26T17:58:09.867177+0000","last_clean":"2024-04-26T17:58:09.867177+0000","last_became_active":"2024-04-26T17:58:04.717313+0000","last_became_peered":"2024-04-26T17:58:04.717313+0000","last_unstale":"2024-04-26T17:58:09.867177+0000","last_undegraded":"2024-04-26T17:58:09.867177+0000","last_fullsized":"2024-04-26T17:58:09.867177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:54.802557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867508+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T17:58:09.867508+0000","last_peered":"2024-04-26T17:58:09.867508+0000","last_clean":"2024-04-26T17:58:09.867508+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T17:58:09.867508+0000","last_undegraded":"2024-04-26T17:58:09.867508+0000","last_fullsized":"2024-04-26T17:58:09.867508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742229+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T17:58:09.742229+0000","last_peered":"2024-04-26T17:58:09.742229+0000","last_clean":"2024-04-26T17:58:09.742229+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T17:58:09.742229+0000","last_undegraded":"2024-04-26T17:58:09.742229+0000","last_fullsized":"2024-04-26T17:58:09.742229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868345+0000","last_change":"2024-04-26T17:58:04.713025+0000","last_active":"2024-04-26T17:58:09.868345+0000","last_peered":"2024-04-26T17:58:09.868345+0000","last_clean":"2024-04-26T17:58:09.868345+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T17:58:09.868345+0000","last_undegraded":"2024-04-26T17:58:09.868345+0000","last_fullsized":"2024-04-26T17:58:09.868345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:35.294319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739719+0000","last_change":"2024-04-26T17:58:08.739580+0000","last_active":"2024-04-26T17:58:09.739719+0000","last_peered":"2024-04-26T17:58:09.739719+0000","last_clean":"2024-04-26T17:58:09.739719+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T17:58:09.739719+0000","last_undegraded":"2024-04-26T17:58:09.739719+0000","last_fullsized":"2024-04-26T17:58:09.739719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.613945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868520+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T17:58:09.868520+0000","last_peered":"2024-04-26T17:58:09.868520+0000","last_clean":"2024-04-26T17:58:09.868520+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T17:58:09.868520+0000","last_undegraded":"2024-04-26T17:58:09.868520+0000","last_fullsized":"2024-04-26T17:58:09.868520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867109+0000","last_change":"2024-04-26T17:58:04.712809+0000","last_active":"2024-04-26T17:58:09.867109+0000","last_peered":"2024-04-26T17:58:09.867109+0000","last_clean":"2024-04-26T17:58:09.867109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T17:58:09.867109+0000","last_undegraded":"2024-04-26T17:58:09.867109+0000","last_fullsized":"2024-04-26T17:58:09.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:27.667789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866917+0000","last_change":"2024-04-26T17:58:08.738098+0000","last_active":"2024-04-26T17:58:09.866917+0000","last_peered":"2024-04-26T17:58:09.866917+0000","last_clean":"2024-04-26T17:58:09.866917+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T17:58:09.866917+0000","last_undegraded":"2024-04-26T17:58:09.866917+0000","last_fullsized":"2024-04-26T17:58:09.866917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:46.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740387+0000","last_change":"2024-04-26T17:58:04.717040+0000","last_active":"2024-04-26T17:58:09.740387+0000","last_peered":"2024-04-26T17:58:09.740387+0000","last_clean":"2024-04-26T17:58:09.740387+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T17:58:09.740387+0000","last_undegraded":"2024-04-26T17:58:09.740387+0000","last_fullsized":"2024-04-26T17:58:09.740387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739474+0000","last_change":"2024-04-26T17:58:04.717913+0000","last_active":"2024-04-26T17:58:09.739474+0000","last_peered":"2024-04-26T17:58:09.739474+0000","last_clean":"2024-04-26T17:58:09.739474+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T17:58:09.739474+0000","last_undegraded":"2024-04-26T17:58:09.739474+0000","last_fullsized":"2024-04-26T17:58:09.739474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:58.220321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867259+0000","last_change":"2024-04-26T17:58:04.726316+0000","last_active":"2024-04-26T17:58:09.867259+0000","last_peered":"2024-04-26T17:58:09.867259+0000","last_clean":"2024-04-26T17:58:09.867259+0000","last_became_active":"2024-04-26T17:58:04.726079+0000","last_became_peered":"2024-04-26T17:58:04.726079+0000","last_unstale":"2024-04-26T17:58:09.867259+0000","last_undegraded":"2024-04-26T17:58:09.867259+0000","last_fullsized":"2024-04-26T17:58:09.867259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:52.023348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868301+0000","last_change":"2024-04-26T17:58:04.718894+0000","last_active":"2024-04-26T17:58:09.868301+0000","last_peered":"2024-04-26T17:58:09.868301+0000","last_clean":"2024-04-26T17:58:09.868301+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T17:58:09.868301+0000","last_undegraded":"2024-04-26T17:58:09.868301+0000","last_fullsized":"2024-04-26T17:58:09.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:08.169756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868428+0000","last_change":"2024-04-26T17:58:04.717545+0000","last_active":"2024-04-26T17:58:09.868428+0000","last_peered":"2024-04-26T17:58:09.868428+0000","last_clean":"2024-04-26T17:58:09.868428+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T17:58:09.868428+0000","last_undegraded":"2024-04-26T17:58:09.868428+0000","last_fullsized":"2024-04-26T17:58:09.868428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:22.541323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866628+0000","last_change":"2024-04-26T17:58:04.719000+0000","last_active":"2024-04-26T17:58:09.866628+0000","last_peered":"2024-04-26T17:58:09.866628+0000","last_clean":"2024-04-26T17:58:09.866628+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T17:58:09.866628+0000","last_undegraded":"2024-04-26T17:58:09.866628+0000","last_fullsized":"2024-04-26T17:58:09.866628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:39.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741672+0000","last_change":"2024-04-26T17:58:04.719202+0000","last_active":"2024-04-26T17:58:09.741672+0000","last_peered":"2024-04-26T17:58:09.741672+0000","last_clean":"2024-04-26T17:58:09.741672+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T17:58:09.741672+0000","last_undegraded":"2024-04-26T17:58:09.741672+0000","last_fullsized":"2024-04-26T17:58:09.741672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:09.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867378+0000","last_change":"2024-04-26T17:58:04.717329+0000","last_active":"2024-04-26T17:58:09.867378+0000","last_peered":"2024-04-26T17:58:09.867378+0000","last_clean":"2024-04-26T17:58:09.867378+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T17:58:09.867378+0000","last_undegraded":"2024-04-26T17:58:09.867378+0000","last_fullsized":"2024-04-26T17:58:09.867378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:05.365008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866573+0000","last_change":"2024-04-26T17:58:04.727246+0000","last_active":"2024-04-26T17:58:09.866573+0000","last_peered":"2024-04-26T17:58:09.866573+0000","last_clean":"2024-04-26T17:58:09.866573+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T17:58:09.866573+0000","last_undegraded":"2024-04-26T17:58:09.866573+0000","last_fullsized":"2024-04-26T17:58:09.866573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:48.343210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867408+0000","last_change":"2024-04-26T17:58:04.713698+0000","last_active":"2024-04-26T17:58:09.867408+0000","last_peered":"2024-04-26T17:58:09.867408+0000","last_clean":"2024-04-26T17:58:09.867408+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T17:58:09.867408+0000","last_undegraded":"2024-04-26T17:58:09.867408+0000","last_fullsized":"2024-04-26T17:58:09.867408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:46.523995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867161+0000","last_change":"2024-04-26T17:58:04.724480+0000","last_active":"2024-04-26T17:58:09.867161+0000","last_peered":"2024-04-26T17:58:09.867161+0000","last_clean":"2024-04-26T17:58:09.867161+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T17:58:09.867161+0000","last_undegraded":"2024-04-26T17:58:09.867161+0000","last_fullsized":"2024-04-26T17:58:09.867161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:55.314208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868176+0000","last_change":"2024-04-26T17:58:04.708369+0000","last_active":"2024-04-26T17:58:09.868176+0000","last_peered":"2024-04-26T17:58:09.868176+0000","last_clean":"2024-04-26T17:58:09.868176+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T17:58:09.868176+0000","last_undegraded":"2024-04-26T17:58:09.868176+0000","last_fullsized":"2024-04-26T17:58:09.868176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:03.947874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741418+0000","last_change":"2024-04-26T17:58:04.714104+0000","last_active":"2024-04-26T17:58:09.741418+0000","last_peered":"2024-04-26T17:58:09.741418+0000","last_clean":"2024-04-26T17:58:09.741418+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T17:58:09.741418+0000","last_undegraded":"2024-04-26T17:58:09.741418+0000","last_fullsized":"2024-04-26T17:58:09.741418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:00.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741424+0000","last_change":"2024-04-26T17:58:04.714925+0000","last_active":"2024-04-26T17:58:09.741424+0000","last_peered":"2024-04-26T17:58:09.741424+0000","last_clean":"2024-04-26T17:58:09.741424+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T17:58:09.741424+0000","last_undegraded":"2024-04-26T17:58:09.741424+0000","last_fullsized":"2024-04-26T17:58:09.741424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.669034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739622+0000","last_change":"2024-04-26T17:58:04.714674+0000","last_active":"2024-04-26T17:58:09.739622+0000","last_peered":"2024-04-26T17:58:09.739622+0000","last_clean":"2024-04-26T17:58:09.739622+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T17:58:09.739622+0000","last_undegraded":"2024-04-26T17:58:09.739622+0000","last_fullsized":"2024-04-26T17:58:09.739622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:12.918478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867942+0000","last_change":"2024-04-26T17:58:04.722294+0000","last_active":"2024-04-26T17:58:09.867942+0000","last_peered":"2024-04-26T17:58:09.867942+0000","last_clean":"2024-04-26T17:58:09.867942+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T17:58:09.867942+0000","last_undegraded":"2024-04-26T17:58:09.867942+0000","last_fullsized":"2024-04-26T17:58:09.867942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:31.169681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866409+0000","last_change":"2024-04-26T17:58:04.725629+0000","last_active":"2024-04-26T17:58:09.866409+0000","last_peered":"2024-04-26T17:58:09.866409+0000","last_clean":"2024-04-26T17:58:09.866409+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T17:58:09.866409+0000","last_undegraded":"2024-04-26T17:58:09.866409+0000","last_fullsized":"2024-04-26T17:58:09.866409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:06.389060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867083+0000","last_change":"2024-04-26T17:58:04.716814+0000","last_active":"2024-04-26T17:58:09.867083+0000","last_peered":"2024-04-26T17:58:09.867083+0000","last_clean":"2024-04-26T17:58:09.867083+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T17:58:09.867083+0000","last_undegraded":"2024-04-26T17:58:09.867083+0000","last_fullsized":"2024-04-26T17:58:09.867083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:38.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867941+0000","last_change":"2024-04-26T17:58:04.715233+0000","last_active":"2024-04-26T17:58:09.867941+0000","last_peered":"2024-04-26T17:58:09.867941+0000","last_clean":"2024-04-26T17:58:09.867941+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T17:58:09.867941+0000","last_undegraded":"2024-04-26T17:58:09.867941+0000","last_fullsized":"2024-04-26T17:58:09.867941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:24.469756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867686+0000","last_change":"2024-04-26T17:58:04.722576+0000","last_active":"2024-04-26T17:58:09.867686+0000","last_peered":"2024-04-26T17:58:09.867686+0000","last_clean":"2024-04-26T17:58:09.867686+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T17:58:09.867686+0000","last_undegraded":"2024-04-26T17:58:09.867686+0000","last_fullsized":"2024-04-26T17:58:09.867686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:33.150267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867768+0000","last_change":"2024-04-26T17:58:04.712057+0000","last_active":"2024-04-26T17:58:09.867768+0000","last_peered":"2024-04-26T17:58:09.867768+0000","last_clean":"2024-04-26T17:58:09.867768+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T17:58:09.867768+0000","last_undegraded":"2024-04-26T17:58:09.867768+0000","last_fullsized":"2024-04-26T17:58:09.867768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:12.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741771+0000","last_change":"2024-04-26T17:58:04.727743+0000","last_active":"2024-04-26T17:58:09.741771+0000","last_peered":"2024-04-26T17:58:09.741771+0000","last_clean":"2024-04-26T17:58:09.741771+0000","last_became_active":"2024-04-26T17:58:04.727395+0000","last_became_peered":"2024-04-26T17:58:04.727395+0000","last_unstale":"2024-04-26T17:58:09.741771+0000","last_undegraded":"2024-04-26T17:58:09.741771+0000","last_fullsized":"2024-04-26T17:58:09.741771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:07.625978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741634+0000","last_change":"2024-04-26T17:58:04.727074+0000","last_active":"2024-04-26T17:58:09.741634+0000","last_peered":"2024-04-26T17:58:09.741634+0000","last_clean":"2024-04-26T17:58:09.741634+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T17:58:09.741634+0000","last_undegraded":"2024-04-26T17:58:09.741634+0000","last_fullsized":"2024-04-26T17:58:09.741634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:17.157157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741450+0000","last_change":"2024-04-26T17:58:04.723761+0000","last_active":"2024-04-26T17:58:09.741450+0000","last_peered":"2024-04-26T17:58:09.741450+0000","last_clean":"2024-04-26T17:58:09.741450+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T17:58:09.741450+0000","last_undegraded":"2024-04-26T17:58:09.741450+0000","last_fullsized":"2024-04-26T17:58:09.741450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:02.783054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867096+0000","last_change":"2024-04-26T17:58:04.724094+0000","last_active":"2024-04-26T17:58:09.867096+0000","last_peered":"2024-04-26T17:58:09.867096+0000","last_clean":"2024-04-26T17:58:09.867096+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T17:58:09.867096+0000","last_undegraded":"2024-04-26T17:58:09.867096+0000","last_fullsized":"2024-04-26T17:58:09.867096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:26.825638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740858+0000","last_change":"2024-04-26T17:58:04.713653+0000","last_active":"2024-04-26T17:58:09.740858+0000","last_peered":"2024-04-26T17:58:09.740858+0000","last_clean":"2024-04-26T17:58:09.740858+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T17:58:09.740858+0000","last_undegraded":"2024-04-26T17:58:09.740858+0000","last_fullsized":"2024-04-26T17:58:09.740858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:10.715579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867111+0000","last_change":"2024-04-26T17:58:04.725695+0000","last_active":"2024-04-26T17:58:09.867111+0000","last_peered":"2024-04-26T17:58:09.867111+0000","last_clean":"2024-04-26T17:58:09.867111+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T17:58:09.867111+0000","last_undegraded":"2024-04-26T17:58:09.867111+0000","last_fullsized":"2024-04-26T17:58:09.867111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:16.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740772+0000","last_change":"2024-04-26T17:58:04.712059+0000","last_active":"2024-04-26T17:58:09.740772+0000","last_peered":"2024-04-26T17:58:09.740772+0000","last_clean":"2024-04-26T17:58:09.740772+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T17:58:09.740772+0000","last_undegraded":"2024-04-26T17:58:09.740772+0000","last_fullsized":"2024-04-26T17:58:09.740772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:53.798495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867547+0000","last_change":"2024-04-26T17:58:04.726921+0000","last_active":"2024-04-26T17:58:09.867547+0000","last_peered":"2024-04-26T17:58:09.867547+0000","last_clean":"2024-04-26T17:58:09.867547+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T17:58:09.867547+0000","last_undegraded":"2024-04-26T17:58:09.867547+0000","last_fullsized":"2024-04-26T17:58:09.867547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:10.889230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867692+0000","last_change":"2024-04-26T17:58:04.714479+0000","last_active":"2024-04-26T17:58:09.867692+0000","last_peered":"2024-04-26T17:58:09.867692+0000","last_clean":"2024-04-26T17:58:09.867692+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T17:58:09.867692+0000","last_undegraded":"2024-04-26T17:58:09.867692+0000","last_fullsized":"2024-04-26T17:58:09.867692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:11.224793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867830+0000","last_change":"2024-04-26T17:58:04.715128+0000","last_active":"2024-04-26T17:58:09.867830+0000","last_peered":"2024-04-26T17:58:09.867830+0000","last_clean":"2024-04-26T17:58:09.867830+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T17:58:09.867830+0000","last_undegraded":"2024-04-26T17:58:09.867830+0000","last_fullsized":"2024-04-26T17:58:09.867830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:28.531949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741199+0000","last_change":"2024-04-26T17:58:04.719415+0000","last_active":"2024-04-26T17:58:09.741199+0000","last_peered":"2024-04-26T17:58:09.741199+0000","last_clean":"2024-04-26T17:58:09.741199+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T17:58:09.741199+0000","last_undegraded":"2024-04-26T17:58:09.741199+0000","last_fullsized":"2024-04-26T17:58:09.741199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:55.030120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:29.085 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T17:58:29.085 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T17:58:29.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T17:58:29.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T17:58:29.086 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T17:58:29.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.216+0000 7f10a7ada640 1 Processor -- start 2024-04-26T17:58:29.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.216+0000 7f10a7ada640 1 -- start start 2024-04-26T17:58:29.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a7ada640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00ce100 0x7f10a00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a7ada640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f10a00b5970 0x7f10a00b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a7ada640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a00738c0 con 0x7f10a00cc4f0 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a7ada640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f10a00b6310 con 0x7f10a00b5970 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a7ada640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10a00729d0 con 0x7f10a00ce100 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a6077640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f10a00b5970 0x7f10a00b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a6077640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f10a00b5970 0x7f10a00b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48830/0 (socket says 172.21.15.139:48830) 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a5075640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f10a00cc4f0 0x7f10a015fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38192/0 (socket says 172.21.15.139:38192) 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a6077640 1 -- 172.21.15.139:0/3175490201 learned_addr learned my addr 172.21.15.139:0/3175490201 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a5876640 1 --2- 172.21.15.139:0/3175490201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00ce100 0x7f10a00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a6077640 1 -- 172.21.15.139:0/3175490201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00ce100 msgr2=0x7f10a00ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a6077640 1 --2- 172.21.15.139:0/3175490201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00ce100 0x7f10a00ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a6077640 1 -- 172.21.15.139:0/3175490201 >> v1:172.21.15.139:6789/0 conn(0x7f10a00cc4f0 legacy=0x7f10a015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a6077640 1 -- 172.21.15.139:0/3175490201 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0072cb0 con 0x7f10a00b5970 2024-04-26T17:58:29.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.217+0000 7f10a4874640 1 -- 172.21.15.139:0/3175490201 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245870051 0 0) 0x7f10a00738c0 con 0x7f10a00cc4f0 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.218+0000 7f10a6077640 1 --2- 172.21.15.139:0/3175490201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a00b5dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1098009e50 tx=0x7f109802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e201d2b1c35b75c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.218+0000 7f10a4874640 1 -- 172.21.15.139:0/3175490201 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098036070 con 0x7f10a00b5970 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.218+0000 7f10a4874640 1 -- 172.21.15.139:0/3175490201 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098031600 con 0x7f10a00b5970 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.218+0000 7f10a4874640 1 -- 172.21.15.139:0/3175490201 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10980319d0 con 0x7f10a00b5970 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 -- 172.21.15.139:0/3175490201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 msgr2=0x7f10a00b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 --2- 172.21.15.139:0/3175490201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a00b5dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1098009e50 tx=0x7f109802a6a0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 -- 172.21.15.139:0/3175490201 shutdown_connections 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 --2- 172.21.15.139:0/3175490201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a00b5dd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 --2- 172.21.15.139:0/3175490201 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00ce100 0x7f10a00ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 -- 172.21.15.139:0/3175490201 >> 172.21.15.139:0/3175490201 conn(0x7f10a0068270 msgr2=0x7f10a0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 -- 172.21.15.139:0/3175490201 shutdown_connections 2024-04-26T17:58:29.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.219+0000 7f10a7ada640 1 -- 172.21.15.139:0/3175490201 wait complete. 2024-04-26T17:58:29.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.220+0000 7f10a7ada640 1 Processor -- start 2024-04-26T17:58:29.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.220+0000 7f10a7ada640 1 -- start start 2024-04-26T17:58:29.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.220+0000 7f10a7ada640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a01487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.220+0000 7f10a7ada640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00cc4f0 0x7f10a01473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.220+0000 7f10a7ada640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10a00ce100 0x7f10a01491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.220+0000 7f10a7ada640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0073550 con 0x7f10a00b5970 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.220+0000 7f10a7ada640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0073270 con 0x7f10a00ce100 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a7ada640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10a0156360 con 0x7f10a00cc4f0 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a01487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a01487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48836/0 (socket says 172.21.15.139:48836) 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 -- 172.21.15.139:0/401493237 learned_addr learned my addr 172.21.15.139:0/401493237 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5075640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00cc4f0 0x7f10a01473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a6077640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10a00ce100 0x7f10a01491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 -- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00cc4f0 msgr2=0x7f10a01473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00cc4f0 0x7f10a01473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 -- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10a00ce100 msgr2=0x7f10a01491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10a00ce100 0x7f10a01491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 -- 172.21.15.139:0/401493237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0147920 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a5876640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a01487d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e870 tx=0x7f109c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10967fc640 1 -- 172.21.15.139:0/401493237 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c017070 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10967fc640 1 -- 172.21.15.139:0/401493237 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c00c940 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a01f2180 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10967fc640 1 -- 172.21.15.139:0/401493237 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c00cd30 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.221+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a0146be0 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.222+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a0151fe0 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.223+0000 7f10967fc640 1 -- 172.21.15.139:0/401493237 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f109c01a070 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.223+0000 7f10967fc640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108406c8f0 0x7f108406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.223+0000 7f10967fc640 1 -- 172.21.15.139:0/401493237 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f109c08bd60 con 0x7f10a00b5970 2024-04-26T17:58:29.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.223+0000 7f10a5075640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108406c8f0 0x7f108406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.223+0000 7f10a5075640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108406c8f0 0x7f108406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f10a0159840 tx=0x7f1090007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.227+0000 7f10967fc640 1 -- 172.21.15.139:0/401493237 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10a0151fe0 con 0x7f10a00b5970 2024-04-26T17:58:29.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.447+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f10a0152250 con 0x7f10a00b5970 2024-04-26T17:58:29.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.450+0000 7f10967fc640 1 -- 172.21.15.139:0/401493237 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7f10a0152250 con 0x7f10a00b5970 2024-04-26T17:58:29.452 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108406c8f0 msgr2=0x7f108406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108406c8f0 0x7f108406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f10a0159840 tx=0x7f1090007b70 comp rx=0 tx=0).stop 2024-04-26T17:58:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 msgr2=0x7f10a01487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a01487d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e870 tx=0x7f109c00ed30 comp rx=0 tx=0).stop 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 shutdown_connections 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108406c8f0 0x7f108406edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10a00ce100 0x7f10a01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a00cc4f0 0x7f10a01473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 --2- 172.21.15.139:0/401493237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a00b5970 0x7f10a01487d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.452+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 >> 172.21.15.139:0/401493237 conn(0x7f10a0068270 msgr2=0x7f10a0068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.453+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 shutdown_connections 2024-04-26T17:58:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.453+0000 7f10a7ada640 1 -- 172.21.15.139:0/401493237 wait complete. 2024-04-26T17:58:29.464 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2404745913},{"type":"v1","addr":"172.21.15.139:6833","nonce":2404745913}]},"active_addr":"172.21.15.139:6833/2404745913","active_change":"2024-04-26T17:57:45.017239+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":473367472}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":4291450522}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":3944644754}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":3894189674}]}]} 2024-04-26T17:58:29.468 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T17:58:29.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T17:58:29.469 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.564+0000 7fc36ff78640 1 Processor -- start 2024-04-26T17:58:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.565+0000 7fc36ff78640 1 -- start start 2024-04-26T17:58:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.565+0000 7fc36ff78640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc368155d90 0x7fc3680c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.565+0000 7fc36ff78640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc368072980 0x7fc3680cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.565+0000 7fc36ff78640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680734c0 con 0x7fc368072dc0 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.565+0000 7fc36ff78640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc3680737a0 con 0x7fc368072980 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.565+0000 7fc36ff78640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc368073a80 con 0x7fc368155d90 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36d513640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc368072980 0x7fc3680cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36e515640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc368072dc0 0x7fc36815be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40336/0 (socket says 172.21.15.139:40336) 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36e515640 1 -- 172.21.15.139:0/131696537 learned_addr learned my addr 172.21.15.139:0/131696537 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36dd14640 1 --2- 172.21.15.139:0/131696537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc368155d90 0x7fc3680c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36d513640 1 -- 172.21.15.139:0/131696537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc368155d90 msgr2=0x7fc3680c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36d513640 1 --2- 172.21.15.139:0/131696537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc368155d90 0x7fc3680c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36d513640 1 -- 172.21.15.139:0/131696537 >> v1:172.21.15.139:6789/0 conn(0x7fc368072dc0 legacy=0x7fc36815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36d513640 1 -- 172.21.15.139:0/131696537 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc368073d60 con 0x7fc368072980 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.566+0000 7fc36cd12640 1 -- 172.21.15.139:0/131696537 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384750105 0 0) 0x7fc3680734c0 con 0x7fc368072dc0 2024-04-26T17:58:29.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36d513640 1 --2- 172.21.15.139:0/131696537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3680cdb70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097a0 tx=0x7fc35802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ff213d3fc58fa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36cd12640 1 -- 172.21.15.139:0/131696537 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358037070 con 0x7fc368072980 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36cd12640 1 -- 172.21.15.139:0/131696537 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc358032440 con 0x7fc368072980 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36cd12640 1 -- 172.21.15.139:0/131696537 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358032810 con 0x7fc368072980 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 -- 172.21.15.139:0/131696537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 msgr2=0x7fc3680cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 --2- 172.21.15.139:0/131696537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3680cdb70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097a0 tx=0x7fc35802a210 comp rx=0 tx=0).stop 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 -- 172.21.15.139:0/131696537 shutdown_connections 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 --2- 172.21.15.139:0/131696537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3680cdb70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 --2- 172.21.15.139:0/131696537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc368155d90 0x7fc3680c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 -- 172.21.15.139:0/131696537 >> 172.21.15.139:0/131696537 conn(0x7fc36806e570 msgr2=0x7fc36806e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 -- 172.21.15.139:0/131696537 shutdown_connections 2024-04-26T17:58:29.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.567+0000 7fc36ff78640 1 -- 172.21.15.139:0/131696537 wait complete. 2024-04-26T17:58:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.568+0000 7fc36ff78640 1 Processor -- start 2024-04-26T17:58:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.568+0000 7fc36ff78640 1 -- start start 2024-04-26T17:58:29.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36ff78640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3681e87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36ff78640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc368155d90 0x7fc3681e6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36ff78640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3681f21d0 0x7fc3681e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36ff78640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc368074040 con 0x7fc368072980 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36ff78640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc368156170 con 0x7fc368155d90 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36ff78640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc36815c570 con 0x7fc3681f21d0 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36dd14640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3681e87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36dd14640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3681e87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36314/0 (socket says 172.21.15.139:36314) 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36dd14640 1 -- 172.21.15.139:0/3780955220 learned_addr learned my addr 172.21.15.139:0/3780955220 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36e515640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3681f21d0 0x7fc3681e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36d513640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc368155d90 0x7fc3681e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36dd14640 1 -- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3681f21d0 msgr2=0x7fc3681e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36dd14640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3681f21d0 0x7fc3681e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36dd14640 1 -- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc368155d90 msgr2=0x7fc3681e6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.569+0000 7fc36dd14640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc368155d90 0x7fc3681e6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc36dd14640 1 -- 172.21.15.139:0/3780955220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3681e7a80 con 0x7fc368072980 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc36e515640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3681f21d0 0x7fc3681e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc36dd14640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3681e87f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e870 tx=0x7fc36000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc35e7fc640 1 -- 172.21.15.139:0/3780955220 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360017070 con 0x7fc368072980 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc35e7fc640 1 -- 172.21.15.139:0/3780955220 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc36000c8e0 con 0x7fc368072980 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3681e7d20 con 0x7fc368072980 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc35e7fc640 1 -- 172.21.15.139:0/3780955220 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36000ccd0 con 0x7fc368072980 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.570+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3681e6160 con 0x7fc368072980 2024-04-26T17:58:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.571+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc368076d20 con 0x7fc368072980 2024-04-26T17:58:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.571+0000 7fc35e7fc640 1 -- 172.21.15.139:0/3780955220 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc36001a070 con 0x7fc368072980 2024-04-26T17:58:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.572+0000 7fc35e7fc640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc34c06c920 0x7fc34c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.572+0000 7fc35e7fc640 1 -- 172.21.15.139:0/3780955220 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc36008c0c0 con 0x7fc368072980 2024-04-26T17:58:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.572+0000 7fc36d513640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc34c06c920 0x7fc34c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.572+0000 7fc36d513640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc34c06c920 0x7fc34c06ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc358034000 tx=0x7fc35802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.576+0000 7fc35e7fc640 1 -- 172.21.15.139:0/3780955220 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc36005a120 con 0x7fc368072980 2024-04-26T17:58:29.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.751+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3680c8fa0 con 0x7fc368072980 2024-04-26T17:58:29.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.752+0000 7fc35e7fc640 1 -- 172.21.15.139:0/3780955220 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fc360059a20 con 0x7fc368072980 2024-04-26T17:58:29.753 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:29.753 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc34c06c920 msgr2=0x7fc34c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc34c06c920 0x7fc34c06ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc358034000 tx=0x7fc35802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 msgr2=0x7fc3681e87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3681e87f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e870 tx=0x7fc36000ed30 comp rx=0 tx=0).stop 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 shutdown_connections 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc34c06c920 0x7fc34c06ede0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3681f21d0 0x7fc3681e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc368155d90 0x7fc3681e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 --2- 172.21.15.139:0/3780955220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc368072980 0x7fc3681e87f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 >> 172.21.15.139:0/3780955220 conn(0x7fc36806e570 msgr2=0x7fc3680ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:29.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 shutdown_connections 2024-04-26T17:58:29.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.754+0000 7fc36ff78640 1 -- 172.21.15.139:0/3780955220 wait complete. 2024-04-26T17:58:29.765 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T17:58:29.766 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:29.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.863+0000 7eff9f499640 1 Processor -- start 2024-04-26T17:58:29.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.863+0000 7eff9f499640 1 -- start start 2024-04-26T17:58:29.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff9f499640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7eff980c89f0 0x7eff9815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff9f499640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff980736a0 con 0x7eff98152cb0 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff9f499640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff980c62e0 con 0x7eff980c7c20 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff9f499640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7eff98073940 con 0x7eff980c89f0 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff9d235640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7eff98152cb0 0x7eff980cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40348/0 (socket says 172.21.15.139:40348) 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff9d235640 1 -- 172.21.15.139:0/1323153179 learned_addr learned my addr 172.21.15.139:0/1323153179 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff9ca34640 1 --2- 172.21.15.139:0/1323153179 >> v2:172.21.15.143:3300/0 conn(0x7eff980c89f0 0x7eff9815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120030176 0 0) 0x7eff980736a0 con 0x7eff98152cb0 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.864+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff84003520 con 0x7eff98152cb0 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520431566 0 0) 0x7eff980c62e0 con 0x7eff980c7c20 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff980736a0 con 0x7eff980c7c20 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 891700721 0 0) 0x7eff84003520 con 0x7eff98152cb0 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 >> v2:172.21.15.143:3300/0 conn(0x7eff980c89f0 msgr2=0x7eff9815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 --2- 172.21.15.139:0/1323153179 >> v2:172.21.15.143:3300/0 conn(0x7eff980c89f0 0x7eff9815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 >> v1:172.21.15.143:6789/0 conn(0x7eff980c7c20 legacy=0x7eff981630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff980c48c0 con 0x7eff98152cb0 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7eff94001670 con 0x7eff98152cb0 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 >> v1:172.21.15.139:6789/0 conn(0x7eff98152cb0 legacy=0x7eff980cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff84003b40 0x7eff84003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff840051c0 0x7eff8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7eff98073940 con 0x7eff84004800 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7eff8400bfb0 con 0x7eff840051c0 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7eff8400c1b0 con 0x7eff84003b40 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9ca34640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9d235640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff84003b40 0x7eff84003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9da36640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff840051c0 0x7eff8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9ca34640 1 -- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff84003b40 msgr2=0x7eff84003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:29.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9ca34640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff84003b40 0x7eff84003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9ca34640 1 -- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff840051c0 msgr2=0x7eff8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9ca34640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff840051c0 0x7eff8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9da36640 1 -- 172.21.15.139:0/1323153179 reap_dead start 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.865+0000 7eff9ca34640 1 -- 172.21.15.139:0/1323153179 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff84003520 con 0x7eff84004800 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.866+0000 7eff9ca34640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff84004c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff88009a90 tx=0x7eff84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb7b8a5049881ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.866+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88036070 con 0x7eff84004800 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.866+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff88031400 con 0x7eff84004800 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.866+0000 7eff8ffff640 1 -- 172.21.15.139:0/1323153179 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88009690 con 0x7eff84004800 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.866+0000 7eff9f499640 1 -- 172.21.15.139:0/1323153179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 msgr2=0x7eff84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.866+0000 7eff9f499640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff84004c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff88009a90 tx=0x7eff84005830 comp rx=0 tx=0).stop 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.867+0000 7eff9f499640 1 -- 172.21.15.139:0/1323153179 shutdown_connections 2024-04-26T17:58:29.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.867+0000 7eff9f499640 1 --2- 172.21.15.139:0/1323153179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff84004c80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.867+0000 7eff9f499640 1 -- 172.21.15.139:0/1323153179 >> 172.21.15.139:0/1323153179 conn(0x7eff98068270 msgr2=0x7eff98068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:29.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.867+0000 7eff9f499640 1 -- 172.21.15.139:0/1323153179 shutdown_connections 2024-04-26T17:58:29.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.867+0000 7eff9f499640 1 -- 172.21.15.139:0/1323153179 wait complete. 2024-04-26T17:58:29.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 Processor -- start 2024-04-26T17:58:29.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 -- start start 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff981580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff9814b1b0 0x7eff9814a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff981e5960 0x7eff98144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7eff980c4d20 con 0x7eff84004800 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7eff980c4ba0 con 0x7eff981e5960 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.868+0000 7eff9f499640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7eff980c84a0 con 0x7eff9814b1b0 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff981580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff981580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36332/0 (socket says 172.21.15.139:36332) 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 -- 172.21.15.139:0/3335477977 learned_addr learned my addr 172.21.15.139:0/3335477977 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9ca34640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff9814b1b0 0x7eff9814a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9da36640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff981e5960 0x7eff98144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 -- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff9814b1b0 msgr2=0x7eff9814a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff9814b1b0 0x7eff9814a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 -- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff981e5960 msgr2=0x7eff98144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff981e5960 0x7eff98144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 -- 172.21.15.139:0/3335477977 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff981efc90 con 0x7eff84004800 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9da36640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff981e5960 0x7eff98144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9d235640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff981580f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff94007290 tx=0x7eff94007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff8dffb640 1 -- 172.21.15.139:0/3335477977 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94001630 con 0x7eff84004800 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff8dffb640 1 -- 172.21.15.139:0/3335477977 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94018070 con 0x7eff84004800 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff8dffb640 1 -- 172.21.15.139:0/3335477977 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9400fba0 con 0x7eff84004800 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff981eff70 con 0x7eff84004800 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.869+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff981f0530 con 0x7eff84004800 2024-04-26T17:58:29.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.870+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff98076d20 con 0x7eff84004800 2024-04-26T17:58:29.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.871+0000 7eff8dffb640 1 -- 172.21.15.139:0/3335477977 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff9400fd40 con 0x7eff84004800 2024-04-26T17:58:29.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.871+0000 7eff8dffb640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff7c06c8f0 0x7eff7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:29.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.871+0000 7eff8dffb640 1 -- 172.21.15.139:0/3335477977 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7eff9408be20 con 0x7eff84004800 2024-04-26T17:58:29.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.871+0000 7eff9ca34640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff7c06c8f0 0x7eff7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:29.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.871+0000 7eff9ca34640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff7c06c8f0 0x7eff7c06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff88009a90 tx=0x7eff88008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:29.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:29.875+0000 7eff8dffb640 1 -- 172.21.15.139:0/3335477977 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff94059e80 con 0x7eff84004800 2024-04-26T17:58:30.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.050+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff9814e2e0 con 0x7eff84004800 2024-04-26T17:58:30.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.052+0000 7eff8dffb640 1 -- 172.21.15.139:0/3335477977 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7eff94059780 con 0x7eff84004800 2024-04-26T17:58:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:30.052 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff7c06c8f0 msgr2=0x7eff7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff7c06c8f0 0x7eff7c06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff88009a90 tx=0x7eff88008030 comp rx=0 tx=0).stop 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 msgr2=0x7eff981580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff981580f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff94007290 tx=0x7eff94007750 comp rx=0 tx=0).stop 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 shutdown_connections 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff7c06c8f0 0x7eff7c06edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff981e5960 0x7eff98144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff9814b1b0 0x7eff9814a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 --2- 172.21.15.139:0/3335477977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff84004800 0x7eff981580f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 >> 172.21.15.139:0/3335477977 conn(0x7eff98068270 msgr2=0x7eff980c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 shutdown_connections 2024-04-26T17:58:30.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.054+0000 7eff9f499640 1 -- 172.21.15.139:0/3335477977 wait complete. 2024-04-26T17:58:30.065 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T17:58:30.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T17:58:30.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T17:58:30.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T17:58:30.067 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T17:58:30.067 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T17:58:30.067 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T17:58:30.068 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T17:58:30.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7f0d48f79640 1 Processor -- start 2024-04-26T17:58:30.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7fd65b2d1640 1 Processor -- start 2024-04-26T17:58:30.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7fd65b2d1640 1 -- start start 2024-04-26T17:58:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7efd3b5f0640 1 Processor -- start 2024-04-26T17:58:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7efd3b5f0640 1 -- start start 2024-04-26T17:58:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7f9b0f045640 1 Processor -- start 2024-04-26T17:58:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7f9b0f045640 1 -- start start 2024-04-26T17:58:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7ff91359e640 1 Processor -- start 2024-04-26T17:58:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7f6648997640 1 Processor -- start 2024-04-26T17:58:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7f6648997640 1 -- start start 2024-04-26T17:58:30.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7fa5fd652640 1 Processor -- start 2024-04-26T17:58:30.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7fa5fd652640 1 -- start start 2024-04-26T17:58:30.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7fdd87fff640 1 Processor -- start 2024-04-26T17:58:30.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7f9b0f045640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b08152330 0x7f9b08157f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7f9b0f045640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9b08158460 0x7f9b080c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7f9b0f045640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b080c99b0 con 0x7f9b080c8ec0 2024-04-26T17:58:30.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7f9b0f045640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9b08152710 con 0x7f9b08158460 2024-04-26T17:58:30.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7f9b0f045640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0815bdc0 con 0x7f9b08152330 2024-04-26T17:58:30.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.236+0000 7f0d48f79640 1 -- start start 2024-04-26T17:58:30.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7efd3b5f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b4f0 0x7efd2c0dac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f9b0d5e2640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f9b080c8ec0 0x7f9b080ca070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39748/0 (socket says 172.21.15.139:39748) 2024-04-26T17:58:30.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7fd65b2d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0d9240 0x7fd64c039e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7fd65b2d1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd64c0e0480 0x7fd64c04ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7fd65b2d1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64c03a4a0 con 0x7fd64c0dfa90 2024-04-26T17:58:30.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7fd65b2d1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fd64c050500 con 0x7fd64c0e0480 2024-04-26T17:58:30.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7fd65b2d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c04ef20 con 0x7fd64c0d9240 2024-04-26T17:58:30.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d48f79640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d3c04e660 0x7f0d3c047260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d48f79640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c0dd520 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d48f79640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d3c0dd800 con 0x7f0d3c0d6c90 2024-04-26T17:58:30.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d48f79640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0d3c0477a0 con 0x7f0d3c04e660 2024-04-26T17:58:30.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7efd3b5f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efd2c04b8d0 0x7efd2c005e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f9b0d5e2640 1 -- 172.21.15.139:0/1724612296 learned_addr learned my addr 172.21.15.139:0/1724612296 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7efd3938c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b4f0 0x7efd2c0dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f9b0cde1640 1 --2- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b08152330 0x7f9b08157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d42d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d3c04e660 0x7f0d3c047260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d42d9d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d3c04e660 0x7f0d3c047260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:56846/0 (socket says 172.21.15.139:56846) 2024-04-26T17:58:30.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1016281071 learned_addr learned my addr 172.21.15.139:0/1016281071 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7efd3938c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b4f0 0x7efd2c0dac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54180/0 (socket says 172.21.15.139:54180) 2024-04-26T17:58:30.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.237+0000 7ff91359e640 1 -- start start 2024-04-26T17:58:30.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7ff91359e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff90c0cc040 0x7ff90c163f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7ff91359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0b5360 0x7ff90c0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7ff91359e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c1604a0 con 0x7ff90c0cd3c0 2024-04-26T17:58:30.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7ff91359e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ff90c163a70 con 0x7ff90c0cc040 2024-04-26T17:58:30.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7ff91359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff90c0b57a0 con 0x7ff90c0b5360 2024-04-26T17:58:30.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f9b07fff640 1 --2- 172.21.15.139:0/1724612296 >> v2:172.21.15.143:3300/0 conn(0x7f9b08158460 0x7f9b080c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7efd3938c640 1 -- 172.21.15.139:0/2116214834 learned_addr learned my addr 172.21.15.139:0/2116214834 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1016281071 >> v1:172.21.15.143:6789/0 conn(0x7f0d3c0d6c90 legacy=0x7f0d3c0dcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7f6648997640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f663c04b080 0x7f663c04b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7efd38b8b640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.143:3300/0 conn(0x7efd2c04b8d0 0x7efd2c005e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f664259c640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f663c0d51f0 0x7f663c0db820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39762/0 (socket says 172.21.15.139:39762) 2024-04-26T17:58:30.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f664259c640 1 -- 172.21.15.139:0/3055631312 learned_addr learned my addr 172.21.15.139:0/3055631312 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.139:3300/0 conn(0x7efd2c0063c0 0x7efd2c034a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7ff912d9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff90c0cd3c0 0x7ff90c15fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40374/0 (socket says 172.21.15.139:40374) 2024-04-26T17:58:30.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.238+0000 7fdd87fff640 1 -- start start 2024-04-26T17:58:30.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7ff912d9d640 1 -- 172.21.15.139:0/1667918493 learned_addr learned my addr 172.21.15.139:0/1667918493 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f6641d9b640 1 --2- 172.21.15.139:0/3055631312 >> v2:172.21.15.143:3300/0 conn(0x7f663c04b080 0x7f663c04b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f9b077fe640 1 -- 172.21.15.139:0/1724612296 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107316106 0 0) 0x7f9b080c99b0 con 0x7f9b080c8ec0 2024-04-26T17:58:30.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f6648997640 1 --2- 172.21.15.139:0/3055631312 >> v2:172.21.15.139:3300/0 conn(0x7f663c005e80 0x7f663c045320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fd65986e640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd64c0dfa90 0x7fd64c0071a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40362/0 (socket says 172.21.15.139:40362) 2024-04-26T17:58:30.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fd65986e640 1 -- 172.21.15.139:0/1306381531 learned_addr learned my addr 172.21.15.139:0/1306381531 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fd65906d640 1 --2- 172.21.15.139:0/1306381531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0d9240 0x7fd64c039e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fd65886c640 1 --2- 172.21.15.139:0/1306381531 >> v2:172.21.15.139:3300/0 conn(0x7fd64c0e0480 0x7fd64c04ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f9b077fe640 1 -- 172.21.15.139:0/1724612296 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af0003520 con 0x7f9b080c8ec0 2024-04-26T17:58:30.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fa5f6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa5f00d51f0 0x7fa5f00db820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39772/0 (socket says 172.21.15.139:39772) 2024-04-26T17:58:30.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fa5f6ffd640 1 -- 172.21.15.139:0/1166095400 learned_addr learned my addr 172.21.15.139:0/1166095400 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1016281071 >> v1:172.21.15.139:6789/0 conn(0x7f0d3c0e0d20 legacy=0x7f0d3c04d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1016281071 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c0e0240 con 0x7f0d3c04e660 2024-04-26T17:58:30.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fa5fd652640 1 --2- 172.21.15.139:0/1166095400 >> v2:172.21.15.143:3300/0 conn(0x7fa5f000e290 0x7fa5f004b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663c045ec0 con 0x7f663c0d51f0 2024-04-26T17:58:30.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f663c046f20 con 0x7f663c005e80 2024-04-26T17:58:30.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f0045ec0 con 0x7fa5f004b080 2024-04-26T17:58:30.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f663c046160 con 0x7f663c04b080 2024-04-26T17:58:30.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fd65886c640 1 -- 172.21.15.139:0/1306381531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0d9240 msgr2=0x7fd64c039e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fd65886c640 1 --2- 172.21.15.139:0/1306381531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0d9240 0x7fd64c039e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fd65886c640 1 -- 172.21.15.139:0/1306381531 >> v1:172.21.15.139:6789/0 conn(0x7fd64c0dfa90 legacy=0x7fd64c0071a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fa5f77fe640 1 --2- 172.21.15.139:0/1166095400 >> v2:172.21.15.143:3300/0 conn(0x7fa5f000e290 0x7fa5f004b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f0046f20 con 0x7fa5f00d51f0 2024-04-26T17:58:30.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f0046160 con 0x7fa5f000e290 2024-04-26T17:58:30.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c007700 con 0x7efd2c0063c0 2024-04-26T17:58:30.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7efd2c0068a0 con 0x7efd2c04b8d0 2024-04-26T17:58:30.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c006b80 con 0x7efd2c04b4f0 2024-04-26T17:58:30.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7ff91259c640 1 --2- 172.21.15.139:0/1667918493 >> v2:172.21.15.139:3300/0 conn(0x7ff90c0cc040 0x7ff90c163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7ff911d9b640 1 --2- 172.21.15.139:0/1667918493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0b5360 0x7ff90c0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f6642d9d640 1 --2- 172.21.15.139:0/3055631312 >> v2:172.21.15.139:3300/0 conn(0x7f663c005e80 0x7f663c045320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f664159a640 1 -- 172.21.15.139:0/3055631312 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112668223 0 0) 0x7f663c045ec0 con 0x7f663c0d51f0 2024-04-26T17:58:30.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f664159a640 1 -- 172.21.15.139:0/3055631312 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f662c003520 con 0x7f663c0d51f0 2024-04-26T17:58:30.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fd65886c640 1 -- 172.21.15.139:0/1306381531 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c04f200 con 0x7fd64c0e0480 2024-04-26T17:58:30.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fa5f5ffb640 1 -- 172.21.15.139:0/1166095400 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1291554200 0 0) 0x7fa5f0046f20 con 0x7fa5f00d51f0 2024-04-26T17:58:30.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fa5f5ffb640 1 -- 172.21.15.139:0/1166095400 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5e0003440 con 0x7fa5f00d51f0 2024-04-26T17:58:30.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7ff91159a640 1 -- 172.21.15.139:0/1667918493 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280993734 0 0) 0x7ff908001490 con 0x7ff90c0cd3c0 2024-04-26T17:58:30.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7ff91159a640 1 -- 172.21.15.139:0/1667918493 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f8003520 con 0x7ff90c0cd3c0 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fd65906d640 1 --2- 172.21.15.139:0/1306381531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0d9240 0x7fd64c039e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fa5f77fe640 1 -- 172.21.15.139:0/1166095400 >> v1:172.21.15.143:6789/0 conn(0x7fa5f00d51f0 legacy=0x7fa5f00db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fa5f77fe640 1 -- 172.21.15.139:0/1166095400 >> v1:172.21.15.139:6789/0 conn(0x7fa5f004b080 legacy=0x7fa5f0005e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fa5f77fe640 1 -- 172.21.15.139:0/1166095400 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f0046440 con 0x7fa5f000e290 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f0d42d9d640 1 --2- 172.21.15.139:0/1016281071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 0x7f0d3c047260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009870 tx=0x7f0d3402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18da6a1ef370e51b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7efd39b8d640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.139:3300/0 conn(0x7efd2c0063c0 0x7efd2c034a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f9b07fff640 1 -- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b08152330 msgr2=0x7f9b08157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f9b07fff640 1 --2- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b08152330 0x7f9b08157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f9b07fff640 1 -- 172.21.15.139:0/1724612296 >> v1:172.21.15.143:6789/0 conn(0x7f9b080c8ec0 legacy=0x7f9b080ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.239+0000 7f9b07fff640 1 -- 172.21.15.139:0/1724612296 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b080c9c90 con 0x7f9b08158460 2024-04-26T17:58:30.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7ff911d9b640 1 -- 172.21.15.139:0/1667918493 >> v2:172.21.15.139:3300/0 conn(0x7ff90c0cc040 msgr2=0x7ff90c163f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7ff911d9b640 1 --2- 172.21.15.139:0/1667918493 >> v2:172.21.15.139:3300/0 conn(0x7ff90c0cc040 0x7ff90c163f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7ff911d9b640 1 -- 172.21.15.139:0/1667918493 >> v1:172.21.15.139:6789/0 conn(0x7ff90c0cd3c0 legacy=0x7ff90c15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7ff911d9b640 1 -- 172.21.15.139:0/1667918493 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c160720 con 0x7ff90c0b5360 2024-04-26T17:58:30.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7efd3938c640 1 -- 172.21.15.139:0/2116214834 >> v2:172.21.15.143:3300/0 conn(0x7efd2c04b8d0 msgr2=0x7efd2c005e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f0d4159a640 1 -- 172.21.15.139:0/1016281071 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34037070 con 0x7f0d3c04e660 2024-04-26T17:58:30.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f0d4159a640 1 -- 172.21.15.139:0/1016281071 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d34032640 con 0x7f0d3c04e660 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f0d4159a640 1 -- 172.21.15.139:0/1016281071 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34032a10 con 0x7f0d3c04e660 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f6641d9b640 1 -- 172.21.15.139:0/3055631312 >> v2:172.21.15.139:3300/0 conn(0x7f663c005e80 msgr2=0x7f663c045320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f6641d9b640 1 --2- 172.21.15.139:0/3055631312 >> v2:172.21.15.139:3300/0 conn(0x7f663c005e80 0x7f663c045320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f6641d9b640 1 -- 172.21.15.139:0/3055631312 >> v1:172.21.15.143:6789/0 conn(0x7f663c0d51f0 legacy=0x7f663c0db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7f6641d9b640 1 -- 172.21.15.139:0/3055631312 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c046440 con 0x7f663c04b080 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7efd3938c640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.143:3300/0 conn(0x7efd2c04b8d0 0x7efd2c005e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7efd3938c640 1 -- 172.21.15.139:0/2116214834 >> v2:172.21.15.139:3300/0 conn(0x7efd2c0063c0 msgr2=0x7efd2c034a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.240+0000 7fdd87fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdd880c9a20 0x7fdd880cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd87fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdd880cbbc0 0x7fdd881641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd87fff640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd880b46c0 con 0x7fdd8815da50 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd87fff640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fdd880b3ed0 con 0x7fdd880c9a20 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd87fff640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fdd880ca1e0 con 0x7fdd880cbbc0 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd86ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fdd8815da50 0x7fdd880cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40394/0 (socket says 172.21.15.139:40394) 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd86ffd640 1 -- 172.21.15.139:0/2894009421 learned_addr learned my addr 172.21.15.139:0/2894009421 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f6641d9b640 1 --2- 172.21.15.139:0/3055631312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c04b080 0x7f663c04b610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f663c04b010 tx=0x7f663402c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd82c3e6520ef76c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd877fe640 1 --2- 172.21.15.139:0/2894009421 >> v2:172.21.15.143:3300/0 conn(0x7fdd880cbbc0 0x7fdd881641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd867fc640 1 --2- 172.21.15.139:0/2894009421 >> v2:172.21.15.139:3300/0 conn(0x7fdd880c9a20 0x7fdd880cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fa5f77fe640 1 --2- 172.21.15.139:0/1166095400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f000e290 0x7fa5f004b610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802e060 tx=0x7fa5f80abc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2c51f8fec2dbf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fd65886c640 1 --2- 172.21.15.139:0/1306381531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0e0480 0x7fd64c04ffc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd6500097a0 tx=0x7fd65002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d0ddccbbe37e6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f9b07fff640 1 --2- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b08158460 0x7f9b080c8980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9af800ba40 tx=0x7f9af802c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d7b7ed137abfbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fa5f5ffb640 1 -- 172.21.15.139:0/1166095400 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80ad9e0 con 0x7fa5f000e290 2024-04-26T17:58:30.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7efd3938c640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.139:3300/0 conn(0x7efd2c0063c0 0x7efd2c034a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7efd3938c640 1 -- 172.21.15.139:0/2116214834 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c006e60 con 0x7efd2c04b4f0 2024-04-26T17:58:30.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f0d48f79640 1 -- 172.21.15.139:0/1016281071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 msgr2=0x7f0d3c047260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f0d48f79640 1 --2- 172.21.15.139:0/1016281071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 0x7f0d3c047260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009870 tx=0x7f0d3402a300 comp rx=0 tx=0).stop 2024-04-26T17:58:30.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd877fe640 1 -- 172.21.15.139:0/2894009421 >> v2:172.21.15.139:3300/0 conn(0x7fdd880c9a20 msgr2=0x7fdd880cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd877fe640 1 --2- 172.21.15.139:0/2894009421 >> v2:172.21.15.139:3300/0 conn(0x7fdd880c9a20 0x7fdd880cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd877fe640 1 -- 172.21.15.139:0/2894009421 >> v1:172.21.15.139:6789/0 conn(0x7fdd8815da50 legacy=0x7fdd880cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fdd877fe640 1 -- 172.21.15.139:0/2894009421 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88070690 con 0x7fdd880cbbc0 2024-04-26T17:58:30.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fa5f5ffb640 1 -- 172.21.15.139:0/1166095400 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f80adb80 con 0x7fa5f000e290 2024-04-26T17:58:30.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7fa5f5ffb640 1 -- 172.21.15.139:0/1166095400 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80ac440 con 0x7fa5f000e290 2024-04-26T17:58:30.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7efd39b8d640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.139:3300/0 conn(0x7efd2c0063c0 0x7efd2c034a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:30.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f9b077fe640 1 -- 172.21.15.139:0/1724612296 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8004030 con 0x7f9b08158460 2024-04-26T17:58:30.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f9b077fe640 1 -- 172.21.15.139:0/1724612296 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af80041d0 con 0x7f9b08158460 2024-04-26T17:58:30.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f9b077fe640 1 -- 172.21.15.139:0/1724612296 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8003610 con 0x7f9b08158460 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f664159a640 1 -- 172.21.15.139:0/3055631312 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634038070 con 0x7f663c04b080 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f664159a640 1 -- 172.21.15.139:0/3055631312 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6634031710 con 0x7f663c04b080 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.241+0000 7f664159a640 1 -- 172.21.15.139:0/3055631312 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634031b20 con 0x7f663c04b080 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f0d48f79640 1 -- 172.21.15.139:0/1016281071 shutdown_connections 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f0d48f79640 1 --2- 172.21.15.139:0/1016281071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 0x7f0d3c047260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f0d48f79640 1 -- 172.21.15.139:0/1016281071 >> 172.21.15.139:0/1016281071 conn(0x7f0d3c00e0b0 msgr2=0x7f0d3c00e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7fd64bfff640 1 -- 172.21.15.139:0/1306381531 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650037070 con 0x7fd64c0e0480 2024-04-26T17:58:30.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7fd64bfff640 1 -- 172.21.15.139:0/1306381531 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650032440 con 0x7fd64c0e0480 2024-04-26T17:58:30.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7fd64bfff640 1 -- 172.21.15.139:0/1306381531 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650032810 con 0x7fd64c0e0480 2024-04-26T17:58:30.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f0d48f79640 1 -- 172.21.15.139:0/1016281071 shutdown_connections 2024-04-26T17:58:30.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7efd3938c640 1 --2- 172.21.15.139:0/2116214834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b4f0 0x7efd2c0dac50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd2c008500 tx=0x7efd3002c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4563f47134fbc970 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7ff911d9b640 1 --2- 172.21.15.139:0/1667918493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0b5360 0x7ff90c0cc420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9000097a0 tx=0x7ff90002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba87e083f32d3eae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7ff91159a640 1 -- 172.21.15.139:0/1667918493 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff900037070 con 0x7ff90c0b5360 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7ff91159a640 1 -- 172.21.15.139:0/1667918493 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff900032440 con 0x7ff90c0b5360 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c04b080 msgr2=0x7f663c04b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 --2- 172.21.15.139:0/3055631312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c04b080 0x7f663c04b610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f663c04b010 tx=0x7f663402c480 comp rx=0 tx=0).stop 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 shutdown_connections 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 --2- 172.21.15.139:0/3055631312 >> v2:172.21.15.139:3300/0 conn(0x7f663c005e80 0x7f663c045320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 --2- 172.21.15.139:0/3055631312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c04b080 0x7f663c04b610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 >> 172.21.15.139:0/3055631312 conn(0x7f663c050170 msgr2=0x7f663c050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 shutdown_connections 2024-04-26T17:58:30.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f9b0f045640 1 -- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b08158460 msgr2=0x7f9b080c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f9b0f045640 1 --2- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b08158460 0x7f9b080c8980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9af800ba40 tx=0x7f9af802c6e0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7fdd877fe640 1 --2- 172.21.15.139:0/2894009421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd880cbbc0 0x7fdd881641b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd880b2db0 tx=0x7fdd8002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612cb76278c5d43f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7efd2bfff640 1 -- 172.21.15.139:0/2116214834 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30008be0 con 0x7efd2c04b4f0 2024-04-26T17:58:30.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7efd2bfff640 1 -- 172.21.15.139:0/2116214834 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd30008d80 con 0x7efd2c04b4f0 2024-04-26T17:58:30.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7efd2bfff640 1 -- 172.21.15.139:0/2116214834 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3000a2f0 con 0x7efd2c04b4f0 2024-04-26T17:58:30.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f9b0f045640 1 -- 172.21.15.139:0/1724612296 shutdown_connections 2024-04-26T17:58:30.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f0d48f79640 1 -- 172.21.15.139:0/1016281071 wait complete. 2024-04-26T17:58:30.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f9b0f045640 1 --2- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b08158460 0x7f9b080c8980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f9b0f045640 1 --2- 172.21.15.139:0/1724612296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b08152330 0x7f9b08157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f9b0f045640 1 -- 172.21.15.139:0/1724612296 >> 172.21.15.139:0/1724612296 conn(0x7f9b0806c310 msgr2=0x7f9b0806c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1306381531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0e0480 msgr2=0x7fd64c04ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 --2- 172.21.15.139:0/1306381531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0e0480 0x7fd64c04ffc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd6500097a0 tx=0x7fd65002a210 comp rx=0 tx=0).stop 2024-04-26T17:58:30.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fdd85ffb640 1 -- 172.21.15.139:0/2894009421 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80007740 con 0x7fdd880cbbc0 2024-04-26T17:58:30.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fdd85ffb640 1 -- 172.21.15.139:0/2894009421 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd800078e0 con 0x7fdd880cbbc0 2024-04-26T17:58:30.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fdd85ffb640 1 -- 172.21.15.139:0/2894009421 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80007cb0 con 0x7fdd880cbbc0 2024-04-26T17:58:30.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7f9b0f045640 1 -- 172.21.15.139:0/1724612296 shutdown_connections 2024-04-26T17:58:30.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7f9b0f045640 1 -- 172.21.15.139:0/1724612296 wait complete. 2024-04-26T17:58:30.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f000e290 msgr2=0x7fa5f004b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fa5fd652640 1 --2- 172.21.15.139:0/1166095400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f000e290 0x7fa5f004b610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802e060 tx=0x7fa5f80abc80 comp rx=0 tx=0).stop 2024-04-26T17:58:30.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 shutdown_connections 2024-04-26T17:58:30.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1306381531 shutdown_connections 2024-04-26T17:58:30.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 --2- 172.21.15.139:0/1306381531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0e0480 0x7fd64c04ffc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 --2- 172.21.15.139:0/1306381531 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0d9240 0x7fd64c039e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1306381531 >> 172.21.15.139:0/1306381531 conn(0x7fd64c00e150 msgr2=0x7fd64c00e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fa5fd652640 1 --2- 172.21.15.139:0/1166095400 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f000e290 0x7fa5f004b610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7ff91359e640 1 -- 172.21.15.139:0/1667918493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0b5360 msgr2=0x7ff90c0cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 >> 172.21.15.139:0/1166095400 conn(0x7fa5f0050170 msgr2=0x7fa5f0050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1306381531 shutdown_connections 2024-04-26T17:58:30.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7ff91159a640 1 -- 172.21.15.139:0/1667918493 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff900037070 con 0x7ff90c0b5360 2024-04-26T17:58:30.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7ff91359e640 1 --2- 172.21.15.139:0/1667918493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0b5360 0x7ff90c0cc420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9000097a0 tx=0x7ff90002a180 comp rx=0 tx=0).stop 2024-04-26T17:58:30.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7ff91359e640 1 -- 172.21.15.139:0/1667918493 shutdown_connections 2024-04-26T17:58:30.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7ff91359e640 1 --2- 172.21.15.139:0/1667918493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c0b5360 0x7ff90c0cc420 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9000097a0 tx=0x7ff90002a180 comp rx=0 tx=0).stop 2024-04-26T17:58:30.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7ff91359e640 1 --2- 172.21.15.139:0/1667918493 >> v2:172.21.15.139:3300/0 conn(0x7ff90c0cc040 0x7ff90c163f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7ff91359e640 1 -- 172.21.15.139:0/1667918493 >> 172.21.15.139:0/1667918493 conn(0x7ff90c0764f0 msgr2=0x7ff90c073c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 -- 172.21.15.139:0/2894009421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd880cbbc0 msgr2=0x7fdd881641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 --2- 172.21.15.139:0/2894009421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd880cbbc0 0x7fdd881641b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd880b2db0 tx=0x7fdd8002a680 comp rx=0 tx=0).stop 2024-04-26T17:58:30.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.243+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1306381531 wait complete. 2024-04-26T17:58:30.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 -- 172.21.15.139:0/2894009421 shutdown_connections 2024-04-26T17:58:30.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 --2- 172.21.15.139:0/2894009421 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd880cbbc0 0x7fdd881641b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 --2- 172.21.15.139:0/2894009421 >> v2:172.21.15.139:3300/0 conn(0x7fdd880c9a20 0x7fdd880cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 -- 172.21.15.139:0/2894009421 >> 172.21.15.139:0/2894009421 conn(0x7fdd88068090 msgr2=0x7fdd880684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 shutdown_connections 2024-04-26T17:58:30.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fa5fd652640 1 -- 172.21.15.139:0/1166095400 wait complete. 2024-04-26T17:58:30.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.242+0000 7f6648997640 1 -- 172.21.15.139:0/3055631312 wait complete. 2024-04-26T17:58:30.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7ff91359e640 1 -- 172.21.15.139:0/1667918493 shutdown_connections 2024-04-26T17:58:30.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 -- 172.21.15.139:0/2894009421 shutdown_connections 2024-04-26T17:58:30.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7f0d48f79640 1 Processor -- start 2024-04-26T17:58:30.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7f6648997640 1 Processor -- start 2024-04-26T17:58:30.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7fdd87fff640 1 -- 172.21.15.139:0/2894009421 wait complete. 2024-04-26T17:58:30.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7f9b0f045640 1 Processor -- start 2024-04-26T17:58:30.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7f6648997640 1 -- start start 2024-04-26T17:58:30.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7f9b0f045640 1 -- start start 2024-04-26T17:58:30.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b4f0 msgr2=0x7efd2c0dac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2116214834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b4f0 0x7efd2c0dac50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd2c008500 tx=0x7efd3002c360 comp rx=0 tx=0).stop 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 shutdown_connections 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.139:3300/0 conn(0x7efd2c0063c0 0x7efd2c034a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2116214834 >> v2:172.21.15.143:3300/0 conn(0x7efd2c04b8d0 0x7efd2c005e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2116214834 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b4f0 0x7efd2c0dac50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 >> 172.21.15.139:0/2116214834 conn(0x7efd2c050170 msgr2=0x7efd2c050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7fd65b2d1640 1 Processor -- start 2024-04-26T17:58:30.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7ff91359e640 1 -- 172.21.15.139:0/1667918493 wait complete. 2024-04-26T17:58:30.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7fd65b2d1640 1 -- start start 2024-04-26T17:58:30.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.244+0000 7f0d48f79640 1 -- start start 2024-04-26T17:58:30.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7f0d48f79640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 0x7f0d3c0d7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7f0d48f79640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3c0d6c90 0x7f0d3c0d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7f0d48f79640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d3c0e0d20 0x7f0d3c0d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7f0d48f79640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c04ea90 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7f0d48f79640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3c0e0800 con 0x7f0d3c04e660 2024-04-26T17:58:30.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.245+0000 7f0d48f79640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3c0dd1c0 con 0x7f0d3c0d6c90 2024-04-26T17:58:30.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f6648997640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c005e80 0x7f663c177220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0f045640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b080c8ec0 0x7f9b081ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f6648997640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f663c04b080 0x7f663c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 shutdown_connections 2024-04-26T17:58:30.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d3c0e0d20 0x7f0d3c0d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d3c0e0d20 0x7f0d3c0d8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36394/0 (socket says 172.21.15.139:36394) 2024-04-26T17:58:30.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0f045640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b08152330 0x7f9b080c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1775652166 learned_addr learned my addr 172.21.15.139:0/1775652166 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0f045640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b081562b0 0x7f9b081e2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0f045640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0815ba50 con 0x7f9b08152330 2024-04-26T17:58:30.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b07fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b08152330 0x7f9b080c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b07fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b08152330 0x7f9b080c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36402/0 (socket says 172.21.15.139:36402) 2024-04-26T17:58:30.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b07fff640 1 -- 172.21.15.139:0/2152039551 learned_addr learned my addr 172.21.15.139:0/2152039551 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7fa5fd652640 1 Processor -- start 2024-04-26T17:58:30.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0f045640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0815b770 con 0x7f9b080c8ec0 2024-04-26T17:58:30.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0f045640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0815c250 con 0x7f9b081562b0 2024-04-26T17:58:30.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7fa5fd652640 1 -- start start 2024-04-26T17:58:30.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d4259c640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 0x7f0d3c0d7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d41d9b640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3c0d6c90 0x7f0d3c0d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7fdd87fff640 1 Processor -- start 2024-04-26T17:58:30.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7fdd87fff640 1 -- start start 2024-04-26T17:58:30.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0d5e2640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b081562b0 0x7f9b081e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1775652166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3c0d6c90 msgr2=0x7f0d3c0d88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3c0d6c90 0x7f0d3c0d88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1775652166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 msgr2=0x7f0d3c0d7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d3c04e660 0x7f0d3c0d7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1775652166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c051830 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f0d41d9b640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d3c0d6c90 0x7f0d3c0d88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:30.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f9b0cde1640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b080c8ec0 0x7f9b081ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f6641d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f663c04b080 0x7f663c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f664259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c005e80 0x7f663c177220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f664259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c005e80 0x7f663c177220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:56904/0 (socket says 172.21.15.139:56904) 2024-04-26T17:58:30.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f6648997640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663c0d51f0 0x7f663c0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.246+0000 7f6648997640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f663c00e290 con 0x7f663c04b080 2024-04-26T17:58:30.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f664259c640 1 -- 172.21.15.139:0/3128752425 learned_addr learned my addr 172.21.15.139:0/3128752425 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2116214834 wait complete. 2024-04-26T17:58:30.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65b2d1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0d9240 0x7fd64c049260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65b2d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd64c0dfa90 0x7fd64c0d4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65b2d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0e0480 0x7fd64c1750e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65b2d1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c04faa0 con 0x7fd64c0d9240 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65b2d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c04f7c0 con 0x7fd64c0dfa90 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65b2d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c0dff20 con 0x7fd64c0e0480 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f9b0d5e2640 1 -- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b080c8ec0 msgr2=0x7f9b081ed900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f9b0d5e2640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b080c8ec0 0x7f9b081ed900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f9b0d5e2640 1 -- 172.21.15.139:0/2152039551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b08152330 msgr2=0x7f9b080c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f9b0d5e2640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b08152330 0x7f9b080c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f9b0d5e2640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b08156ae0 con 0x7f9b081562b0 2024-04-26T17:58:30.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f0d42d9d640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d3c0e0d20 0x7f0d3c0d8de0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009990 tx=0x7f0d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f6642d9d640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663c0d51f0 0x7f663c0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0e0480 0x7fd64c1750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0e0480 0x7fd64c1750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54226/0 (socket says 172.21.15.139:54226) 2024-04-26T17:58:30.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 -- 172.21.15.139:0/1901146812 learned_addr learned my addr 172.21.15.139:0/1901146812 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65886c640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd64c0dfa90 0x7fd64c0d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34037040 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65906d640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0d9240 0x7fd64c049260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f6648997640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f663c046a00 con 0x7f663c005e80 2024-04-26T17:58:30.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f6648997640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f663c00e410 con 0x7f663c0d51f0 2024-04-26T17:58:30.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c0366d0 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d3c0d9fb0 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 -- 172.21.15.139:0/1901146812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd64c0dfa90 msgr2=0x7fd64c0d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fa5fd652640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f000e290 0x7fa5f00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd880c9a20 0x7fdd880c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd64c0dfa90 0x7fd64c0d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 -- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0d9240 msgr2=0x7fd64c049260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5fd652640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f004b080 0x7fa5f00481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0d9240 0x7fd64c049260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65986e640 1 -- 172.21.15.139:0/1901146812 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c0497a0 con 0x7fd64c0e0480 2024-04-26T17:58:30.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5f6ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f000e290 0x7fa5f00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5f6ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f000e290 0x7fa5f00cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54238/0 (socket says 172.21.15.139:54238) 2024-04-26T17:58:30.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f9b0d5e2640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b081562b0 0x7f9b081e2210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000ca70 tx=0x7f9b0000cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd880cbbc0 0x7fdd880c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5f6ffd640 1 -- 172.21.15.139:0/1822508471 learned_addr learned my addr 172.21.15.139:0/1822508471 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd8815da50 0x7fdd8806d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7fd65906d640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd64c0d9240 0x7fd64c049260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5f67fc640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f004b080 0x7fa5f00481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5fd652640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00d51f0 0x7fa5f01705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d340325e0 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd86ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd880c9a20 0x7fdd880c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd87fff640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880c6620 con 0x7fdd880c9a20 2024-04-26T17:58:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd87fff640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880b43e0 con 0x7fdd8815da50 2024-04-26T17:58:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd86ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd880c9a20 0x7fdd880c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36424/0 (socket says 172.21.15.139:36424) 2024-04-26T17:58:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd87fff640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdd88070aa0 con 0x7fdd880cbbc0 2024-04-26T17:58:30.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd86ffd640 1 -- 172.21.15.139:0/3652717867 learned_addr learned my addr 172.21.15.139:0/3652717867 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd877fe640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd8815da50 0x7fdd8806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0006590 con 0x7fa5f00d51f0 2024-04-26T17:58:30.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0046a00 con 0x7fa5f004b080 2024-04-26T17:58:30.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd867fc640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd880cbbc0 0x7fdd880c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f0045320 con 0x7fa5f000e290 2024-04-26T17:58:30.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34037040 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d28001030 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fd65986e640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0e0480 0x7fd64c1750e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd65406b1d0 tx=0x7fd65406a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654091070 con 0x7fd64c0e0480 2024-04-26T17:58:30.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fa5f77fe640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00d51f0 0x7fa5f01705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f6641d9b640 1 -- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663c0d51f0 msgr2=0x7f663c0ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.247+0000 7f6641d9b640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f663c0d51f0 0x7f663c0ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f6641d9b640 1 -- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c005e80 msgr2=0x7f663c177220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f6641d9b640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f663c005e80 0x7f663c177220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f6641d9b640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c174390 con 0x7f663c04b080 2024-04-26T17:58:30.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f6641d9b640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f663c04b080 0x7f663c0ca210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6634033000 tx=0x7f66340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c0484b0 con 0x7fd64c0e0480 2024-04-26T17:58:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634038040 con 0x7f663c04b080 2024-04-26T17:58:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd877fe640 1 -- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd880cbbc0 msgr2=0x7fdd880c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd877fe640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd880cbbc0 0x7fdd880c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd877fe640 1 -- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd880c9a20 msgr2=0x7fdd880c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd877fe640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd880c9a20 0x7fdd880c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7fdd877fe640 1 -- 172.21.15.139:0/3652717867 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8806c3b0 con 0x7fdd8815da50 2024-04-26T17:58:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fdd867fc640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdd880cbbc0 0x7fdd880c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fdd877fe640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd8815da50 0x7fdd8806d130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd880ca360 tx=0x7fdd80004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c048a70 con 0x7fd64c0e0480 2024-04-26T17:58:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7efd3b5f0640 1 Processor -- start 2024-04-26T17:58:30.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.248+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00017070 con 0x7f9b081562b0 2024-04-26T17:58:30.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7f9b0f045640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b08156dc0 con 0x7f9b081562b0 2024-04-26T17:58:30.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7f9b0f045640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b08157380 con 0x7f9b081562b0 2024-04-26T17:58:30.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7f6648997640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663c04e290 con 0x7f663c04b080 2024-04-26T17:58:30.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7f6648997640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663c1737b0 con 0x7f663c04b080 2024-04-26T17:58:30.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7efd3b5f0640 1 -- start start 2024-04-26T17:58:30.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fa5f6ffd640 1 -- 172.21.15.139:0/1822508471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f004b080 msgr2=0x7fa5f00481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fa5f6ffd640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5f004b080 0x7fa5f00481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fa5f6ffd640 1 -- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00d51f0 msgr2=0x7fa5f01705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7ff91359e640 1 Processor -- start 2024-04-26T17:58:30.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fa5f6ffd640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5f00d51f0 0x7fa5f01705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7fa5f6ffd640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f00ce0f0 con 0x7fa5f000e290 2024-04-26T17:58:30.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7ff91359e640 1 -- start start 2024-04-26T17:58:30.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6634043070 con 0x7f663c04b080 2024-04-26T17:58:30.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654072900 con 0x7fd64c0e0480 2024-04-26T17:58:30.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7fa5f6ffd640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f000e290 0x7fa5f00cd430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8001460 tx=0x7fa5e8001920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80031b40 con 0x7fdd8815da50 2024-04-26T17:58:30.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd80031ce0 con 0x7fdd8815da50 2024-04-26T17:58:30.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0000ab70 con 0x7f9b081562b0 2024-04-26T17:58:30.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.249+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00012400 con 0x7f9b081562b0 2024-04-26T17:58:30.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7fdd87fff640 1 -- 172.21.15.139:0/3652717867 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd881f2000 con 0x7fdd8815da50 2024-04-26T17:58:30.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7efd3b5f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd2c0063c0 0x7efd2c0d76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7efd3b5f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd2c04b4f0 0x7efd2c0d6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7efd3b5f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b8d0 0x7efd2c173bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd3938c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd2c0063c0 0x7efd2c0d76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd3b5f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c04bcf0 con 0x7efd2c04b4f0 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd3b5f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c007420 con 0x7efd2c0063c0 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd3b5f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd2c0d4ff0 con 0x7efd2c04b8d0 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd3938c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd2c0063c0 0x7efd2c0d76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:56938/0 (socket says 172.21.15.139:56938) 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd3938c640 1 -- 172.21.15.139:0/2029043108 learned_addr learned my addr 172.21.15.139:0/2029043108 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd39b8d640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b8d0 0x7efd2c173bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd38b8b640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd2c04b4f0 0x7efd2c0d6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd39b8d640 1 -- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd2c0063c0 msgr2=0x7efd2c0d76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd39b8d640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd2c0063c0 0x7efd2c0d76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd39b8d640 1 -- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd2c04b4f0 msgr2=0x7efd2c0d6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7f9b0f045640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ae8001030 con 0x7f9b081562b0 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91359e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0cc040 0x7ff90c14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91359e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c0cd3c0 0x7ff90c0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91359e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c144a70 0x7ff90c0c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91359e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c163700 con 0x7ff90c0cd3c0 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91359e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c163420 con 0x7ff90c0cc040 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91359e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff90c160ce0 con 0x7ff90c144a70 2024-04-26T17:58:30.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0cc040 0x7ff90c14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91259c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0cc040 0x7ff90c14b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:56944/0 (socket says 172.21.15.139:56944) 2024-04-26T17:58:30.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91259c640 1 -- 172.21.15.139:0/1457591721 learned_addr learned my addr 172.21.15.139:0/1457591721 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff911d9b640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c0cd3c0 0x7ff90c0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7efd39b8d640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd2c04b4f0 0x7efd2c0d6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd39b8d640 1 -- 172.21.15.139:0/2029043108 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c0d5540 con 0x7efd2c04b8d0 2024-04-26T17:58:30.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7fdd87fff640 1 -- 172.21.15.139:0/3652717867 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8806c930 con 0x7fdd8815da50 2024-04-26T17:58:30.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd3938c640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd2c0063c0 0x7efd2c0d76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:30.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd38b8b640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd2c04b4f0 0x7efd2c0d6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:30.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff91259c640 1 -- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c144a70 msgr2=0x7ff90c0c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7ff912d9d640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c144a70 0x7ff90c0c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654072b50 con 0x7fd64c0e0480 2024-04-26T17:58:30.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.251+0000 7fd63f7fe640 1 -- 172.21.15.139:0/1901146812 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd62c001030 con 0x7fd64c0e0480 2024-04-26T17:58:30.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd39b8d640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b8d0 0x7efd2c173bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd34000b60 tx=0x7efd3406a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7ff91259c640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c144a70 0x7ff90c0c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7ff91259c640 1 -- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c0cd3c0 msgr2=0x7ff90c0c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7ff91259c640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c0cd3c0 0x7ff90c0c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7ff91259c640 1 -- 172.21.15.139:0/1457591721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c15b0f0 con 0x7ff90c0cc040 2024-04-26T17:58:30.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800f700 con 0x7fa5f000e290 2024-04-26T17:58:30.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7ff911d9b640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c0cd3c0 0x7ff90c0c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7ff912d9d640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff90c144a70 0x7ff90c0c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d3403a070 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7f0d32ffd640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d2406cd20 0x7f0d2406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0d34004030 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f0d32ffd640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7f0d24076fe0 0x7f0d24079480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 --> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d24079b50 con 0x7f0d24076fe0 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0d34076970 con 0x7f0d3c0e0d20 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f0d4259c640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d2406cd20 0x7f0d2406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8003c620 con 0x7fdd8815da50 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd80039040 con 0x7fdd8815da50 2024-04-26T17:58:30.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd880506c0 con 0x7fdd8815da50 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fdd6f7fe640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdd7406c940 0x7fdd7406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdd800acf10 con 0x7fdd8815da50 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fdd86ffd640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdd7406c940 0x7fdd7406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fdd6f7fe640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7fdd740760b0 0x7fdd740784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 --> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd80004810 con 0x7fdd740760b0 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdd800b2060 con 0x7fdd8815da50 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd654094070 con 0x7fd64c0e0480 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fd649ffb640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd63806c9c0 0x7fd63806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd654108e70 con 0x7fd64c0e0480 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fd65906d640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd63806c9c0 0x7fd63806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fd649ffb640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fd638076130 0x7fd638078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e8015020 con 0x7fa5f000e290 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800faa0 con 0x7fa5f000e290 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f0047330 con 0x7fa5f000e290 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f00ce9a0 con 0x7fa5f000e290 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7fa5dd7fa640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5f0005380 con 0x7fa5f000e290 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34074930 con 0x7efd2c04b8d0 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd34075870 con 0x7efd2c04b8d0 2024-04-26T17:58:30.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c0d57c0 con 0x7efd2c04b8d0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34075ca0 con 0x7efd2c04b8d0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c0d5d80 con 0x7efd2c04b8d0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd34071420 con 0x7efd2c04b8d0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b0001a070 con 0x7f9b081562b0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f9b057fa640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9af406c9c0 0x7f9af406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9b0008bd20 con 0x7f9b081562b0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f9b0cde1640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9af406c9c0 0x7f9af406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f9b057fa640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f9af4076130 0x7f9af4078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9af4078c40 con 0x7f9af4076130 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9b0008c110 con 0x7f9b081562b0 2024-04-26T17:58:30.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7f9b07fff640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f9af4076130 0x7f9af4078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7f9b07fff640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f9af4076130 0x7f9af4078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7ff91259c640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0cc040 0x7ff90c14b300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff90400e990 tx=0x7ff90400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7ff8feffd640 1 -- 172.21.15.139:0/1457591721 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904017070 con 0x7ff90c0cc040 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7ff8feffd640 1 -- 172.21.15.139:0/1457591721 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90400c9e0 con 0x7ff90c0cc040 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7ff8feffd640 1 -- 172.21.15.139:0/1457591721 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90400cdd0 con 0x7ff90c0cc040 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90c14a840 con 0x7ff90c0cc040 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff90c06fd70 con 0x7ff90c0cc040 2024-04-26T17:58:30.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634033a10 con 0x7f663c04b080 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.250+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f663c173e70 con 0x7f663c04b080 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.252+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6634009280 con 0x7f663c04b080 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.253+0000 7f6632ffd640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f662406c8f0 0x7f662406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7f664259c640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f662406c8f0 0x7f662406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f66340ad2c0 con 0x7f663c04b080 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7f6632ffd640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f6624076060 0x7f66240784a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6634031710 con 0x7f6624076060 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f66340ad6b0 con 0x7f663c04b080 2024-04-26T17:58:30.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5e800fc40 con 0x7fa5f000e290 2024-04-26T17:58:30.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7f9b0cde1640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9af406c9c0 0x7f9af406ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009ad0 tx=0x7f9afc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7f0d4259c640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d2406cd20 0x7f0d2406f1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d38004f60 tx=0x7f0d38007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.254+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd14001030 con 0x7efd2c04b8d0 2024-04-26T17:58:30.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7f664259c640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f662406c8f0 0x7f662406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66380011e0 tx=0x7f6638009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fd65906d640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd63806c9c0 0x7fd63806ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd644009560 tx=0x7fd644009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fdd86ffd640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdd7406c940 0x7fdd7406ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001720 tx=0x7fdd78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7f6642d9d640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f6624076060 0x7f66240784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 --> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd654072900 con 0x7fd638076130 2024-04-26T17:58:30.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fd65886c640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fd638076130 0x7fd638078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd65410b4d0 con 0x7fd64c0e0480 2024-04-26T17:58:30.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fa5df7fe640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa5e406c940 0x7fa5e406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== osd.5 v2:172.21.15.143:6808/3412241994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9af4078c40 con 0x7f9af4076130 2024-04-26T17:58:30.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fdd867fc640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7fdd740760b0 0x7fdd740784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.255+0000 7fa5f67fc640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa5e406c940 0x7fa5e406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7efd29ffb640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd1806c9c0 0x7efd1806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7f6642d9d640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f6624076060 0x7f66240784a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa5e808c890 con 0x7fa5f000e290 2024-04-26T17:58:30.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd341090c0 con 0x7efd2c04b8d0 2024-04-26T17:58:30.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7fa5df7fe640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7fa5e40760b0 0x7fa5e40784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7efd3938c640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd1806c9c0 0x7efd1806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5e803ae80 con 0x7fa5e40760b0 2024-04-26T17:58:30.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa5e808cc40 con 0x7fa5f000e290 2024-04-26T17:58:30.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7efd29ffb640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7efd18076130 0x7efd18078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7fa5f77fe640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7fa5e40760b0 0x7fa5e40784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7fa5f67fc640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa5e406c940 0x7fa5e406ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00332c0 tx=0x7fa5ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 --> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd3409ae80 con 0x7efd18076130 2024-04-26T17:58:30.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efd34110050 con 0x7efd2c04b8d0 2024-04-26T17:58:30.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7fdd867fc640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7fdd740760b0 0x7fdd740784f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7f0d41d9b640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7f0d24076fe0 0x7f0d24079480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7ff8feffd640 1 -- 172.21.15.139:0/1457591721 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff90401a070 con 0x7ff90c0cc040 2024-04-26T17:58:30.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7fa5f77fe640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7fa5e40760b0 0x7fa5e40784f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== osd.7 v2:172.21.15.143:6824/735298849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6634031710 con 0x7f6624076060 2024-04-26T17:58:30.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7ff8feffd640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8f006c9f0 0x7ff8f006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7f0d41d9b640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7f0d24076fe0 0x7f0d24079480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7fd65886c640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fd638076130 0x7fd638078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7ff8feffd640 1 -- 172.21.15.139:0/1457591721 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff90408be40 con 0x7ff90c0cc040 2024-04-26T17:58:30.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.256+0000 7efd3938c640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd1806c9c0 0x7efd1806ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd300071a0 tx=0x7efd30030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7efd38b8b640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7efd18076130 0x7efd18078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== osd.1 v2:172.21.15.139:6824/1977806301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd80004810 con 0x7fdd740760b0 2024-04-26T17:58:30.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7ff91359e640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7ff90c14aa10 0x7ff90c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7efd38b8b640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7efd18076130 0x7efd18078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.257+0000 7ff911d9b640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8f006c9f0 0x7ff8f006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 --> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff90c0506c0 con 0x7ff90c14aa10 2024-04-26T17:58:30.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7ff912d9d640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7ff90c14aa10 0x7ff90c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== osd.3 v2:172.21.15.139:6816/797802605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5e803ae80 con 0x7fa5e40760b0 2024-04-26T17:58:30.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== osd.0 v2:172.21.15.139:6800/1771669412 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d24079b50 con 0x7f0d24076fe0 2024-04-26T17:58:30.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7ff911d9b640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8f006c9f0 0x7ff8f006eeb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff900034000 tx=0x7ff90002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7ff912d9d640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7ff90c14aa10 0x7ff90c15f790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.258+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== osd.4 v2:172.21.15.143:6800/1263839422 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd3409ae80 con 0x7efd18076130 2024-04-26T17:58:30.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.259+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== osd.2 v2:172.21.15.139:6808/522876570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd654072900 con 0x7fd638076130 2024-04-26T17:58:30.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.260+0000 7ff8feffd640 1 -- 172.21.15.139:0/1457591721 <== osd.6 v2:172.21.15.143:6816/3661563662 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff90c0506c0 con 0x7ff90c14aa10 2024-04-26T17:58:30.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.287+0000 7f9b0f045640 1 -- 172.21.15.139:0/2152039551 --> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ae8002dd0 con 0x7f9af4076130 2024-04-26T17:58:30.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.288+0000 7f9b057fa640 1 -- 172.21.15.139:0/2152039551 <== osd.5 v2:172.21.15.143:6808/3412241994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ae8002dd0 con 0x7f9af4076130 2024-04-26T17:58:30.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 --> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f663c033340 con 0x7f6624076060 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f9aeeffd640 1 -- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f9af4076130 msgr2=0x7f9af4078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f9aeeffd640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f9af4076130 0x7f9af4078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f9aeeffd640 1 -- 172.21.15.139:0/2152039551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9af406c9c0 msgr2=0x7f9af406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f9aeeffd640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9af406c9c0 0x7f9af406ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009ad0 tx=0x7f9afc008040 comp rx=0 tx=0).stop 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f9aeeffd640 1 -- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b081562b0 msgr2=0x7f9b081e2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f9aeeffd640 1 --2- 172.21.15.139:0/2152039551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9b081562b0 0x7f9b081e2210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000ca70 tx=0x7f9b0000cf30 comp rx=0 tx=0).stop 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.289+0000 7f9b0d5e2640 1 -- 172.21.15.139:0/2152039551 reap_dead start 2024-04-26T17:58:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f6632ffd640 1 -- 172.21.15.139:0/3128752425 <== osd.7 v2:172.21.15.143:6824/735298849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f663c033340 con 0x7f6624076060 2024-04-26T17:58:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f9aeeffd640 1 -- 172.21.15.139:0/2152039551 shutdown_connections 2024-04-26T17:58:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f9aeeffd640 1 -- 172.21.15.139:0/2152039551 >> 172.21.15.139:0/2152039551 conn(0x7f9b0806c310 msgr2=0x7f9b08073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f9aeeffd640 1 -- 172.21.15.139:0/2152039551 shutdown_connections 2024-04-26T17:58:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f9aeeffd640 1 -- 172.21.15.139:0/2152039551 wait complete. 2024-04-26T17:58:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f6624076060 msgr2=0x7f66240784a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f6630ff9640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f6624076060 0x7f66240784a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 --> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff90c0ccbf0 con 0x7ff90c14aa10 2024-04-26T17:58:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 --> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d28002dd0 con 0x7f0d24076fe0 2024-04-26T17:58:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 --> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd14002d50 con 0x7efd18076130 2024-04-26T17:58:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f662406c8f0 msgr2=0x7f662406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.290+0000 7f6630ff9640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f662406c8f0 0x7f662406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f66380011e0 tx=0x7f6638009040 comp rx=0 tx=0).stop 2024-04-26T17:58:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f663c04b080 msgr2=0x7f663c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f6630ff9640 1 --2- 172.21.15.139:0/3128752425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f663c04b080 0x7f663c0ca210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6634033000 tx=0x7f66340046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f6642d9d640 1 -- 172.21.15.139:0/3128752425 reap_dead start 2024-04-26T17:58:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 shutdown_connections 2024-04-26T17:58:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 >> 172.21.15.139:0/3128752425 conn(0x7f663c050170 msgr2=0x7f663c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f0d32ffd640 1 -- 172.21.15.139:0/1775652166 <== osd.0 v2:172.21.15.139:6800/1771669412 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0d28002dd0 con 0x7f0d24076fe0 2024-04-26T17:58:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 shutdown_connections 2024-04-26T17:58:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7efd29ffb640 1 -- 172.21.15.139:0/2029043108 <== osd.4 v2:172.21.15.143:6800/1263839422 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd14002d50 con 0x7efd18076130 2024-04-26T17:58:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7ff8feffd640 1 -- 172.21.15.139:0/1457591721 <== osd.6 v2:172.21.15.143:6816/3661563662 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff90c0ccbf0 con 0x7ff90c14aa10 2024-04-26T17:58:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f6630ff9640 1 -- 172.21.15.139:0/3128752425 wait complete. 2024-04-26T17:58:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7f0d24076fe0 msgr2=0x7f0d24079480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7f0d48f79640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7f0d24076fe0 0x7f0d24079480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d2406cd20 msgr2=0x7f0d2406f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d2406cd20 0x7f0d2406f1e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0d38004f60 tx=0x7f0d38007e30 comp rx=0 tx=0).stop 2024-04-26T17:58:30.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7fa5dd7fa640 1 -- 172.21.15.139:0/1822508471 --> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5f004bc50 con 0x7fa5e40760b0 2024-04-26T17:58:30.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d3c0e0d20 msgr2=0x7f0d3c0d8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 --2- 172.21.15.139:0/1775652166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d3c0e0d20 0x7f0d3c0d8de0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009990 tx=0x7f0d340046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.291+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 --> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd880506c0 con 0x7fdd740760b0 2024-04-26T17:58:30.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7ff90c14aa10 msgr2=0x7ff90c15f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7ff90c14aa10 0x7ff90c15f790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d42d9d640 1 -- 172.21.15.139:0/1775652166 reap_dead start 2024-04-26T17:58:30.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 shutdown_connections 2024-04-26T17:58:30.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 >> 172.21.15.139:0/1775652166 conn(0x7f0d3c00e0b0 msgr2=0x7f0d3c0c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7efd18076130 msgr2=0x7efd18078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8f006c9f0 msgr2=0x7ff8f006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff8f006c9f0 0x7ff8f006eeb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff900034000 tx=0x7ff90002e000 comp rx=0 tx=0).stop 2024-04-26T17:58:30.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7efd18076130 0x7efd18078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0cc040 msgr2=0x7ff90c14b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 --2- 172.21.15.139:0/1457591721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0cc040 0x7ff90c14b300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff90400e990 tx=0x7ff90400ee50 comp rx=0 tx=0).stop 2024-04-26T17:58:30.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff912d9d640 1 -- 172.21.15.139:0/1457591721 reap_dead start 2024-04-26T17:58:30.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 shutdown_connections 2024-04-26T17:58:30.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7f0d48f79640 1 -- 172.21.15.139:0/1775652166 wait complete. 2024-04-26T17:58:30.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7fdd6f7fe640 1 -- 172.21.15.139:0/3652717867 <== osd.1 v2:172.21.15.139:6824/1977806301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdd880506c0 con 0x7fdd740760b0 2024-04-26T17:58:30.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7fa5df7fe640 1 -- 172.21.15.139:0/1822508471 <== osd.3 v2:172.21.15.139:6816/797802605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa5f004bc50 con 0x7fa5e40760b0 2024-04-26T17:58:30.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 shutdown_connections 2024-04-26T17:58:30.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.292+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 >> 172.21.15.139:0/1457591721 conn(0x7ff90c0764f0 msgr2=0x7ff90c0cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd1806c9c0 msgr2=0x7efd1806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd1806c9c0 0x7efd1806ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd300071a0 tx=0x7efd30030000 comp rx=0 tx=0).stop 2024-04-26T17:58:30.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b8d0 msgr2=0x7efd2c173bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 --2- 172.21.15.139:0/2029043108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd2c04b8d0 0x7efd2c173bf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd34000b60 tx=0x7efd3406a0e0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd39b8d640 1 -- 172.21.15.139:0/2029043108 reap_dead start 2024-04-26T17:58:30.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 shutdown_connections 2024-04-26T17:58:30.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 >> 172.21.15.139:0/2029043108 conn(0x7efd2c050170 msgr2=0x7efd2c0d3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7fa5e40760b0 msgr2=0x7fa5e40784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7fa5e40760b0 0x7fa5e40784f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 shutdown_connections 2024-04-26T17:58:30.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7ff91359e640 1 -- 172.21.15.139:0/1457591721 wait complete. 2024-04-26T17:58:30.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fd63f7fe640 1 -- 172.21.15.139:0/1901146812 --> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd62c002dd0 con 0x7fd638076130 2024-04-26T17:58:30.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa5e406c940 msgr2=0x7fa5e406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa5e406c940 0x7fa5e406ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00332c0 tx=0x7fa5ec009040 comp rx=0 tx=0).stop 2024-04-26T17:58:30.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7fdd740760b0 msgr2=0x7fdd740784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fdd6d7fa640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7fdd740760b0 0x7fdd740784f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f000e290 msgr2=0x7fa5f00cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 --2- 172.21.15.139:0/1822508471 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5f000e290 0x7fa5f00cd430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8001460 tx=0x7fa5e8001920 comp rx=0 tx=0).stop 2024-04-26T17:58:30.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5f77fe640 1 -- 172.21.15.139:0/1822508471 reap_dead start 2024-04-26T17:58:30.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 shutdown_connections 2024-04-26T17:58:30.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 >> 172.21.15.139:0/1822508471 conn(0x7fa5f0050170 msgr2=0x7fa5f00d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 shutdown_connections 2024-04-26T17:58:30.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdd7406c940 msgr2=0x7fdd7406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fdd6d7fa640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdd7406c940 0x7fdd7406ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd78001720 tx=0x7fdd78009040 comp rx=0 tx=0).stop 2024-04-26T17:58:30.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7efd3b5f0640 1 -- 172.21.15.139:0/2029043108 wait complete. 2024-04-26T17:58:30.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd8815da50 msgr2=0x7fdd8806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fdd6d7fa640 1 --2- 172.21.15.139:0/3652717867 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdd8815da50 0x7fdd8806d130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd880ca360 tx=0x7fdd80004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:30.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.293+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 shutdown_connections 2024-04-26T17:58:30.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fa5fd652640 1 -- 172.21.15.139:0/1822508471 wait complete. 2024-04-26T17:58:30.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fdd877fe640 1 -- 172.21.15.139:0/3652717867 reap_dead start 2024-04-26T17:58:30.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fd649ffb640 1 -- 172.21.15.139:0/1901146812 <== osd.2 v2:172.21.15.139:6808/522876570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd62c002dd0 con 0x7fd638076130 2024-04-26T17:58:30.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 shutdown_connections 2024-04-26T17:58:30.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 >> 172.21.15.139:0/3652717867 conn(0x7fdd88068090 msgr2=0x7fdd880cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 shutdown_connections 2024-04-26T17:58:30.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fdd6d7fa640 1 -- 172.21.15.139:0/3652717867 wait complete. 2024-04-26T17:58:30.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fd638076130 msgr2=0x7fd638078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.294+0000 7fd65b2d1640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fd638076130 0x7fd638078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.295+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd63806c9c0 msgr2=0x7fd63806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.295+0000 7fd65b2d1640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd63806c9c0 0x7fd63806ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd644009560 tx=0x7fd644009190 comp rx=0 tx=0).stop 2024-04-26T17:58:30.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.295+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0e0480 msgr2=0x7fd64c1750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.295+0000 7fd65b2d1640 1 --2- 172.21.15.139:0/1901146812 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd64c0e0480 0x7fd64c1750e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd65406b1d0 tx=0x7fd65406a0e0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.295+0000 7fd65986e640 1 -- 172.21.15.139:0/1901146812 reap_dead start 2024-04-26T17:58:30.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.295+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 shutdown_connections 2024-04-26T17:58:30.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.295+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 >> 172.21.15.139:0/1901146812 conn(0x7fd64c00e150 msgr2=0x7fd64c0d7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.296+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 shutdown_connections 2024-04-26T17:58:30.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.296+0000 7fd65b2d1640 1 -- 172.21.15.139:0/1901146812 wait complete. 2024-04-26T17:58:30.362 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:30.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T17:58:30.363 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:30.363 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T17:58:30.364 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:30.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T17:58:30.365 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:30.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T17:58:30.366 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:30.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T17:58:30.367 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:30.367 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T17:58:30.368 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:30.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T17:58:30.369 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:30.370 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T17:58:30.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.568+0000 7f4b1b59e640 1 Processor -- start 2024-04-26T17:58:30.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.568+0000 7f4b1b59e640 1 -- start start 2024-04-26T17:58:30.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b1b59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0ca580 0x7f4b1c0c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b1b59e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4b1c0c8270 0x7f4b1c073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b1b59e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b1c0c4170 con 0x7f4b1c0737c0 2024-04-26T17:58:30.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b1b59e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1c0c8bd0 con 0x7f4b1c0c8270 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b1b59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1c0c93b0 con 0x7f4b1c0ca580 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b1ad9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f4b1c0737c0 0x7f4b1c0c29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40410/0 (socket says 172.21.15.139:40410) 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b1ad9d640 1 -- 172.21.15.139:0/945605991 learned_addr learned my addr 172.21.15.139:0/945605991 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7f4b19d9b640 1 --2- 172.21.15.139:0/945605991 >> v2:172.21.15.139:3300/0 conn(0x7f4b1c0c8270 0x7f4b1c073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661270949 0 0) 0x7f4b1c0c4170 con 0x7f4b1c0737c0 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b04003520 con 0x7f4b1c0737c0 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1108483645 0 0) 0x7f4b04003520 con 0x7f4b1c0737c0 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0ca580 msgr2=0x7f4b1c0c3c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0ca580 0x7f4b1c0c3c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 >> v2:172.21.15.139:3300/0 conn(0x7f4b1c0c8270 msgr2=0x7f4b1c073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 --2- 172.21.15.139:0/945605991 >> v2:172.21.15.139:3300/0 conn(0x7f4b1c0c8270 0x7f4b1c073280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c0c9690 con 0x7f4b1c0737c0 2024-04-26T17:58:30.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b19d9b640 1 --2- 172.21.15.139:0/945605991 >> v2:172.21.15.139:3300/0 conn(0x7f4b1c0c8270 0x7f4b1c073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7fb03cab1640 1 Processor -- start 2024-04-26T17:58:30.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.570+0000 7fb03cab1640 1 -- start start 2024-04-26T17:58:30.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb03cab1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb03815a170 0x7fb038072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb03cab1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380732e0 0x7fb038160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb03cab1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb038073730 con 0x7fb0380c80c0 2024-04-26T17:58:30.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb03cab1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb0380c3190 con 0x7fb03815a170 2024-04-26T17:58:30.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb03cab1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0380c3a30 con 0x7fb0380732e0 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f4b140019f0 con 0x7f4b1c0737c0 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 >> v1:172.21.15.139:6789/0 conn(0x7f4b1c0737c0 legacy=0x7f4b1c0c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b040039b0 0x7f4b04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0ca580 0x7f4b04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7f4b1959a640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c0c93b0 con 0x7f4b04004d40 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0400bb30 con 0x7f4b040039b0 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0400bd30 con 0x7f4b1c0ca580 2024-04-26T17:58:30.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb035d9b640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fb0380c80c0 0x7fb03815fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39776/0 (socket says 172.21.15.139:39776) 2024-04-26T17:58:30.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb035d9b640 1 -- 172.21.15.139:0/3191789585 learned_addr learned my addr 172.21.15.139:0/3191789585 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.571+0000 7fb036d9d640 1 --2- 172.21.15.139:0/3191789585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380732e0 0x7fb038160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7f3f9c808640 1 Processor -- start 2024-04-26T17:58:30.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7f4b1a59c640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b040039b0 0x7f4b04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7f4b19d9b640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0ca580 0x7f4b04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7f8f3ecd3640 1 Processor -- start 2024-04-26T17:58:30.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7fb036d9d640 1 -- 172.21.15.139:0/3191789585 >> v2:172.21.15.139:3300/0 conn(0x7fb03815a170 msgr2=0x7fb038072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7fb036d9d640 1 --2- 172.21.15.139:0/3191789585 >> v2:172.21.15.139:3300/0 conn(0x7fb03815a170 0x7fb038072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7fb036d9d640 1 -- 172.21.15.139:0/3191789585 >> v1:172.21.15.143:6789/0 conn(0x7fb0380c80c0 legacy=0x7fb03815fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.572+0000 7fb036d9d640 1 -- 172.21.15.139:0/3191789585 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0380c8e30 con 0x7fb0380732e0 2024-04-26T17:58:30.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7f4b1ad9d640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7fb036d9d640 1 --2- 172.21.15.139:0/3191789585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380732e0 0x7fb038160520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb030009d90 tx=0x7fb03002a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8451b3820eb98a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7fb03559a640 1 -- 172.21.15.139:0/3191789585 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030007740 con 0x7fb0380732e0 2024-04-26T17:58:30.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7f82cd542640 1 Processor -- start 2024-04-26T17:58:30.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7f82cd542640 1 -- start start 2024-04-26T17:58:30.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7fb03559a640 1 -- 172.21.15.139:0/3191789585 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0300078e0 con 0x7fb0380732e0 2024-04-26T17:58:30.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7fb03559a640 1 -- 172.21.15.139:0/3191789585 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030007cb0 con 0x7fb0380732e0 2024-04-26T17:58:30.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7f3f9c808640 1 -- start start 2024-04-26T17:58:30.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f46bd77f640 1 Processor -- start 2024-04-26T17:58:30.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f4b1ad9d640 1 -- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0ca580 msgr2=0x7f4b04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f4b1ad9d640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0ca580 0x7f4b04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f4b1ad9d640 1 -- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b040039b0 msgr2=0x7f4b04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f4b1ad9d640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b040039b0 0x7f4b04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f4b1ad9d640 1 -- 172.21.15.139:0/945605991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b04003520 con 0x7f4b04004d40 2024-04-26T17:58:30.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f3f9c808640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f3f980c3ea0 0x7f3f980c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f3f9c808640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f9815b010 con 0x7f3f98073280 2024-04-26T17:58:30.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f3f9c808640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f980c93b0 con 0x7f3f980c30d0 2024-04-26T17:58:30.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f3f9c808640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f3f980c8bd0 con 0x7f3f980c3ea0 2024-04-26T17:58:30.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.573+0000 7f8f3ecd3640 1 -- start start 2024-04-26T17:58:30.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f3ecd3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f3815ffa0 0x7f8f380c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f3ecd3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f380c7ab0 0x7f8f380c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f3ecd3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f380c9080 con 0x7f8f3815a190 2024-04-26T17:58:30.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f3ecd3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8f38072030 con 0x7f8f3815ffa0 2024-04-26T17:58:30.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f3ecd3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8f38072560 con 0x7f8f380c7ab0 2024-04-26T17:58:30.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f3f9759e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f3f980c30d0 0x7f3f981623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39780/0 (socket says 172.21.15.139:39780) 2024-04-26T17:58:30.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f3f9759e640 1 -- 172.21.15.139:0/2761477226 learned_addr learned my addr 172.21.15.139:0/2761477226 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/2761477226 >> v2:172.21.15.143:3300/0 conn(0x7f3f980c3ea0 0x7f3f980c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f37fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f3815ffa0 0x7f8f380c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f37fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8f3815ffa0 0x7f8f380c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:56960/0 (socket says 172.21.15.139:56960) 2024-04-26T17:58:30.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f8f37fff640 1 -- 172.21.15.139:0/1837128633 learned_addr learned my addr 172.21.15.139:0/1837128633 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.574+0000 7f46bd77f640 1 -- start start 2024-04-26T17:58:30.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f8f3d270640 1 --2- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f380c7ab0 0x7f8f380c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f8f37fff640 1 -- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f380c7ab0 msgr2=0x7f8f380c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832057610 0 0) 0x7f3f9815b010 con 0x7f3f98073280 2024-04-26T17:58:30.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f84003520 con 0x7f3f98073280 2024-04-26T17:58:30.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609638847 0 0) 0x7f3f980c93b0 con 0x7f3f980c30d0 2024-04-26T17:58:30.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f4b1ad9d640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b040051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400a7c0 tx=0x7f4b04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24ab4b90417575 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f9815b010 con 0x7f3f980c30d0 2024-04-26T17:58:30.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82c7fff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f82c8155dc0 0x7f82c80cc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39796/0 (socket says 172.21.15.139:39796) 2024-04-26T17:58:30.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f8f377fe640 1 -- 172.21.15.139:0/1837128633 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544649515 0 0) 0x7f8f380c9080 con 0x7f8f3815a190 2024-04-26T17:58:30.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82cd542640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c80cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82cd542640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c80c75e0 con 0x7f82c80c6b50 2024-04-26T17:58:30.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82cd542640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c81561a0 con 0x7f82c8155dc0 2024-04-26T17:58:30.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82cd542640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f82c80cc0e0 con 0x7f82c815f750 2024-04-26T17:58:30.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82c7fff640 1 -- 172.21.15.139:0/1325005244 learned_addr learned my addr 172.21.15.139:0/1325005244 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:30.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 153249865 0 0) 0x7f3f84003520 con 0x7f3f98073280 2024-04-26T17:58:30.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 >> v2:172.21.15.143:3300/0 conn(0x7f3f980c3ea0 msgr2=0x7f3f980c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 --2- 172.21.15.139:0/2761477226 >> v2:172.21.15.143:3300/0 conn(0x7f3f980c3ea0 0x7f3f980c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 >> v1:172.21.15.143:6789/0 conn(0x7f3f980c30d0 legacy=0x7f3f981623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f980c9690 con 0x7f3f98073280 2024-04-26T17:58:30.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82ccd41640 1 --2- 172.21.15.139:0/1325005244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c80cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f82c6ffd640 1 -- 172.21.15.139:0/1325005244 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273746906 0 0) 0x7f82c80c75e0 con 0x7f82c80c6b50 2024-04-26T17:58:30.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f3f90001670 con 0x7f3f98073280 2024-04-26T17:58:30.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 >> v1:172.21.15.139:6789/0 conn(0x7f3f98073280 legacy=0x7f3f980c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f46bd77f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b80c9ac0 0x7f46b806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f46bd77f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f46b808eb90 0x7f46b808efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f46bd77f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b815bb20 con 0x7f46b8152a90 2024-04-26T17:58:30.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f46bd77f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f46b806d3b0 con 0x7f46b808eb90 2024-04-26T17:58:30.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f46bd77f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f46b806d690 con 0x7f46b80c9ac0 2024-04-26T17:58:30.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f3f95d9b640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f84003be0 0x7f3f84003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400a410 con 0x7f4b04004d40 2024-04-26T17:58:30.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1402f070 con 0x7f4b04004d40 2024-04-26T17:58:30.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f8f37fff640 1 --2- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f380c7ab0 0x7f8f380c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f8f37fff640 1 -- 172.21.15.139:0/1837128633 >> v1:172.21.15.143:6789/0 conn(0x7f8f3815a190 legacy=0x7f8f38073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.575+0000 7f8f37fff640 1 -- 172.21.15.139:0/1837128633 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f38070600 con 0x7f8f3815ffa0 2024-04-26T17:58:30.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f8f3d270640 1 --2- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f380c7ab0 0x7f8f380c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:30.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f8f37fff640 1 --2- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f3815ffa0 0x7f8f380c9a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009e50 tx=0x7f8f3002a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd2357030207eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7fb03cab1640 1 -- 172.21.15.139:0/3191789585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380732e0 msgr2=0x7fb038160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7fb03cab1640 1 --2- 172.21.15.139:0/3191789585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380732e0 0x7fb038160520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb030009d90 tx=0x7fb03002a550 comp rx=0 tx=0).stop 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7fb03cab1640 1 -- 172.21.15.139:0/3191789585 shutdown_connections 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7fb03cab1640 1 --2- 172.21.15.139:0/3191789585 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380732e0 0x7fb038160520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7fb03cab1640 1 --2- 172.21.15.139:0/3191789585 >> v2:172.21.15.139:3300/0 conn(0x7fb03815a170 0x7fb038072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7fb03cab1640 1 -- 172.21.15.139:0/3191789585 >> 172.21.15.139:0/3191789585 conn(0x7fb0380cd000 msgr2=0x7fb0380cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f3f95d9b640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f3f95d9b640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f840053c0 0x7f3f8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8400c190 con 0x7f3f84004800 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8400c340 con 0x7f3f840053c0 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8400c540 con 0x7f3f84003be0 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f46b7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f46b808eb90 0x7f46b808efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f46b7fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f46b808eb90 0x7f46b808efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:56982/0 (socket says 172.21.15.139:56982) 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f46b7fff640 1 -- 172.21.15.139:0/1344725882 learned_addr learned my addr 172.21.15.139:0/1344725882 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f82ccd41640 1 -- 172.21.15.139:0/1325005244 >> v1:172.21.15.143:6789/0 conn(0x7f82c8155dc0 legacy=0x7f82c80cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f82ccd41640 1 -- 172.21.15.139:0/1325005244 >> v1:172.21.15.139:6789/0 conn(0x7f82c80c6b50 legacy=0x7f82c815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f82ccd41640 1 -- 172.21.15.139:0/1325005244 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80c7020 con 0x7f82c815f750 2024-04-26T17:58:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f8f377fe640 1 -- 172.21.15.139:0/1837128633 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30036070 con 0x7f8f3815ffa0 2024-04-26T17:58:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f8f377fe640 1 -- 172.21.15.139:0/1837128633 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30031600 con 0x7f8f3815ffa0 2024-04-26T17:58:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f8f377fe640 1 -- 172.21.15.139:0/1837128633 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30031a10 con 0x7f8f3815ffa0 2024-04-26T17:58:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f46b7fff640 1 -- 172.21.15.139:0/1344725882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b80c9ac0 msgr2=0x7f46b806c310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T17:58:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f3f9659c640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f46b7fff640 1 --2- 172.21.15.139:0/1344725882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b80c9ac0 0x7f46b806c310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f46b7fff640 1 -- 172.21.15.139:0/1344725882 >> v1:172.21.15.139:6789/0 conn(0x7f46b8152a90 legacy=0x7f46b815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f46b7fff640 1 -- 172.21.15.139:0/1344725882 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b815bda0 con 0x7f46b808eb90 2024-04-26T17:58:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f53a8319640 1 Processor -- start 2024-04-26T17:58:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.576+0000 7f4b1959a640 1 -- 172.21.15.139:0/945605991 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1402bc20 con 0x7f4b04004d40 2024-04-26T17:58:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f4b1b59e640 1 -- 172.21.15.139:0/945605991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 msgr2=0x7f4b040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f4b1b59e640 1 --2- 172.21.15.139:0/945605991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b040051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400a7c0 tx=0x7f4b04005830 comp rx=0 tx=0).stop 2024-04-26T17:58:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f4b1ad9d640 1 -- 172.21.15.139:0/945605991 reap_dead start 2024-04-26T17:58:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f84003be0 0x7f3f84003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f9759e640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f840053c0 0x7f3f8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f53a8319640 1 -- start start 2024-04-26T17:58:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f4b1b59e640 1 -- 172.21.15.139:0/945605991 shutdown_connections 2024-04-26T17:58:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7fd82ec83640 1 Processor -- start 2024-04-26T17:58:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7fb03cab1640 1 -- 172.21.15.139:0/3191789585 shutdown_connections 2024-04-26T17:58:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f4b1b59e640 1 -- 172.21.15.139:0/945605991 >> 172.21.15.139:0/945605991 conn(0x7f4b1c0c9a90 msgr2=0x7f4b1c0c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f96d9d640 1 -- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f840053c0 msgr2=0x7f3f8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f840053c0 0x7f3f8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f96d9d640 1 -- 172.21.15.139:0/2761477226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f84004800 msgr2=0x7f3f84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f9759e640 1 -- 172.21.15.139:0/2761477226 reap_dead start 2024-04-26T17:58:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f96d9d640 1 -- 172.21.15.139:0/2761477226 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f84003520 con 0x7f3f84003be0 2024-04-26T17:58:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f4b1b59e640 1 -- 172.21.15.139:0/945605991 shutdown_connections 2024-04-26T17:58:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f3f9659c640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7fb03cab1640 1 -- 172.21.15.139:0/3191789585 wait complete. 2024-04-26T17:58:30.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f4b1b59e640 1 -- 172.21.15.139:0/945605991 wait complete. 2024-04-26T17:58:30.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f3815ffa0 msgr2=0x7f8f380c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f8f3ecd3640 1 --2- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f3815ffa0 0x7f8f380c9a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009e50 tx=0x7f8f3002a6c0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/1837128633 shutdown_connections 2024-04-26T17:58:30.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f8f3ecd3640 1 --2- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f380c7ab0 0x7f8f380c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f8f3ecd3640 1 --2- 172.21.15.139:0/1837128633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f3815ffa0 0x7f8f380c9a10 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009e50 tx=0x7f8f3002a6c0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/1837128633 >> 172.21.15.139:0/1837128633 conn(0x7f8f380686c0 msgr2=0x7f8f3806fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f46b7fff640 1 --2- 172.21.15.139:0/1344725882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b808eb90 0x7f46b808efe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c70498bae462c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7f82ccd41640 1 --2- 172.21.15.139:0/1325005244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c80cbba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009750 tx=0x7f82b802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8337e3d107be1f8e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f82c6ffd640 1 -- 172.21.15.139:0/1325005244 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8037070 con 0x7f82c815f750 2024-04-26T17:58:30.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f82c6ffd640 1 -- 172.21.15.139:0/1325005244 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b802adb0 con 0x7f82c815f750 2024-04-26T17:58:30.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f82c6ffd640 1 -- 172.21.15.139:0/1325005244 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8032660 con 0x7f82c815f750 2024-04-26T17:58:30.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f46b5ffb640 1 -- 172.21.15.139:0/1344725882 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8037070 con 0x7f46b808eb90 2024-04-26T17:58:30.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f46b5ffb640 1 -- 172.21.15.139:0/1344725882 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a8032440 con 0x7f46b808eb90 2024-04-26T17:58:30.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f84003be0 0x7f3f84003fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3f80011dc0 tx=0x7f3f84005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5809ed790764f0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8003c070 con 0x7f3f84003be0 2024-04-26T17:58:30.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46b5ffb640 1 -- 172.21.15.139:0/1344725882 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8032810 con 0x7f46b808eb90 2024-04-26T17:58:30.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f82cd542640 1 -- 172.21.15.139:0/1325005244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 msgr2=0x7f82c80cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f82cd542640 1 --2- 172.21.15.139:0/1325005244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c80cbba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009750 tx=0x7f82b802a0a0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/1837128633 shutdown_connections 2024-04-26T17:58:30.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f3f95d9b640 1 -- 172.21.15.139:0/2761477226 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f80037410 con 0x7f3f84003be0 2024-04-26T17:58:30.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.577+0000 7fd82ec83640 1 -- start start 2024-04-26T17:58:30.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f82cd542640 1 -- 172.21.15.139:0/1325005244 shutdown_connections 2024-04-26T17:58:30.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f82cd542640 1 --2- 172.21.15.139:0/1325005244 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c80cbba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f82cd542640 1 -- 172.21.15.139:0/1325005244 >> 172.21.15.139:0/1325005244 conn(0x7f82c8073ca0 msgr2=0x7f82c80740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f53a8319640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53a00c9cc0 0x7f53a00c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f53a8319640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f53a015c840 0x7f53a01558e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f53a8319640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a00c80a0 con 0x7f53a006efb0 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f53a8319640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f53a0073000 con 0x7f53a015c840 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f53a8319640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f53a00732c0 con 0x7f53a00c9cc0 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.578+0000 7f53a60b5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53a00c9cc0 0x7f53a00c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f53a60b5640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f53a00c9cc0 0x7f53a00c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:57006/0 (socket says 172.21.15.139:57006) 2024-04-26T17:58:30.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f53a60b5640 1 -- 172.21.15.139:0/1091799922 learned_addr learned my addr 172.21.15.139:0/1091799922 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7fb03cab1640 1 Processor -- start 2024-04-26T17:58:30.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7fb03cab1640 1 -- start start 2024-04-26T17:58:30.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 -- 172.21.15.139:0/1344725882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b808eb90 msgr2=0x7f46b808efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 --2- 172.21.15.139:0/1344725882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b808eb90 0x7f46b808efe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009870 tx=0x7f46a802a230 comp rx=0 tx=0).stop 2024-04-26T17:58:30.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f82cd542640 1 -- 172.21.15.139:0/1325005244 shutdown_connections 2024-04-26T17:58:30.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f82cd542640 1 -- 172.21.15.139:0/1325005244 wait complete. 2024-04-26T17:58:30.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 -- 172.21.15.139:0/1344725882 shutdown_connections 2024-04-26T17:58:30.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 --2- 172.21.15.139:0/1344725882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b808eb90 0x7f46b808efe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f4b1b59e640 1 Processor -- start 2024-04-26T17:58:30.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 --2- 172.21.15.139:0/1344725882 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b80c9ac0 0x7f46b806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 -- 172.21.15.139:0/1344725882 >> 172.21.15.139:0/1344725882 conn(0x7f46b80767e0 msgr2=0x7f46b806ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f53a68b6640 1 --2- 172.21.15.139:0/1091799922 >> v2:172.21.15.139:3300/0 conn(0x7f53a015c840 0x7f53a01558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 -- 172.21.15.139:0/1344725882 shutdown_connections 2024-04-26T17:58:30.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f4b1b59e640 1 -- start start 2024-04-26T17:58:30.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f53a68b6640 1 -- 172.21.15.139:0/1091799922 >> v2:172.21.15.143:3300/0 conn(0x7f53a00c9cc0 msgr2=0x7f53a00c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f53a68b6640 1 --2- 172.21.15.139:0/1091799922 >> v2:172.21.15.143:3300/0 conn(0x7f53a00c9cc0 0x7f53a00c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f53a68b6640 1 -- 172.21.15.139:0/1091799922 >> v1:172.21.15.139:6789/0 conn(0x7f53a006efb0 legacy=0x7f53a015c130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T17:58:30.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f3f9c808640 1 -- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f84003be0 msgr2=0x7f3f84003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f53a68b6640 1 -- 172.21.15.139:0/1091799922 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a00735a0 con 0x7f53a015c840 2024-04-26T17:58:30.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f3f9c808640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f84003be0 0x7f3f84003fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3f80011dc0 tx=0x7f3f84005830 comp rx=0 tx=0).stop 2024-04-26T17:58:30.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f3f9c808640 1 -- 172.21.15.139:0/2761477226 shutdown_connections 2024-04-26T17:58:30.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb03cab1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0380732e0 0x7fb038147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb03cab1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380c80c0 0x7fb038148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f3f9c808640 1 --2- 172.21.15.139:0/2761477226 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f84003be0 0x7f3f84003fe0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3f80011dc0 tx=0x7f3f84005830 comp rx=0 tx=0).stop 2024-04-26T17:58:30.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb03cab1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb03815a170 0x7fb0380c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f3f9c808640 1 -- 172.21.15.139:0/2761477226 >> 172.21.15.139:0/2761477226 conn(0x7f3f980c9a90 msgr2=0x7f3f980c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb03cab1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0380c90f0 con 0x7fb0380732e0 2024-04-26T17:58:30.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb03cab1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb0380c8bd0 con 0x7fb03815a170 2024-04-26T17:58:30.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f4b1b59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b1c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f4b1b59e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0c5e40 0x7f4b1c144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f4b1b59e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b1c15ab40 0x7f4b1c144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb03cab1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0380c33e0 con 0x7fb0380c80c0 2024-04-26T17:58:30.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f4b1b59e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c15b870 con 0x7f4b04004d40 2024-04-26T17:58:30.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f4b1b59e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c15b590 con 0x7f4b1c15ab40 2024-04-26T17:58:30.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7f4b1b59e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1c0c86b0 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f46bd77f640 1 -- 172.21.15.139:0/1344725882 wait complete. 2024-04-26T17:58:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb035d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380c80c0 0x7fb038148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb035d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380c80c0 0x7fb038148000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54362/0 (socket says 172.21.15.139:54362) 2024-04-26T17:58:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb035d9b640 1 -- 172.21.15.139:0/3190860974 learned_addr learned my addr 172.21.15.139:0/3190860974 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb036d9d640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb03815a170 0x7fb0380c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.580+0000 7fb03659c640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0380732e0 0x7fb038147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/1837128633 wait complete. 2024-04-26T17:58:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0c5e40 0x7f4b1c144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f3f9c808640 1 -- 172.21.15.139:0/2761477226 shutdown_connections 2024-04-26T17:58:30.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f3f9c808640 1 -- 172.21.15.139:0/2761477226 wait complete. 2024-04-26T17:58:30.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0c5e40 0x7f4b1c144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54366/0 (socket says 172.21.15.139:54366) 2024-04-26T17:58:30.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 -- 172.21.15.139:0/4220829198 learned_addr learned my addr 172.21.15.139:0/4220829198 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f8f3ecd3640 1 Processor -- start 2024-04-26T17:58:30.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b1ad9d640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b1c15ab40 0x7f4b1c144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b1a59c640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b1c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fb035d9b640 1 -- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb03815a170 msgr2=0x7fb0380c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fb035d9b640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb03815a170 0x7fb0380c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fb035d9b640 1 -- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0380732e0 msgr2=0x7fb038147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fb035d9b640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0380732e0 0x7fb038147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fb035d9b640 1 -- 172.21.15.139:0/3190860974 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb038141290 con 0x7fb0380c80c0 2024-04-26T17:58:30.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f46bd77f640 1 Processor -- start 2024-04-26T17:58:30.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f46bd77f640 1 -- start start 2024-04-26T17:58:30.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.579+0000 7fd82ec83640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd8280c98e0 0x7fd8281585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd82ec83640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd828072460 0x7fd8280c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd82ec83640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd82815b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 -- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b1c15ab40 msgr2=0x7f4b1c144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b1c15ab40 0x7f4b1c144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 -- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 msgr2=0x7f4b1c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b1c0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd82ec83640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fd8280c9450 con 0x7fd8280c98e0 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd82ec83640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd828158af0 con 0x7fd828072460 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd82ec83640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd8280c85f0 con 0x7fd828068ad0 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd827fff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd828072460 0x7fd8280c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd82d220640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd82815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b19d9b640 1 -- 172.21.15.139:0/4220829198 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1c159b20 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f4b1ad9d640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b1c15ab40 0x7f4b1c144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fd82d220640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd82815b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54378/0 (socket says 172.21.15.139:54378) 2024-04-26T17:58:30.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fd82d220640 1 -- 172.21.15.139:0/675596311 learned_addr learned my addr 172.21.15.139:0/675596311 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f82cd542640 1 Processor -- start 2024-04-26T17:58:30.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7fb035d9b640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380c80c0 0x7fb038148000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c750 tx=0x7fb02800cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fb026ffd640 1 -- 172.21.15.139:0/3190860974 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028017070 con 0x7fb0380c80c0 2024-04-26T17:58:30.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fb03cab1640 1 -- 172.21.15.139:0/3190860974 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb038141530 con 0x7fb0380c80c0 2024-04-26T17:58:30.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fb026ffd640 1 -- 172.21.15.139:0/3190860974 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb028005ab0 con 0x7fb0380c80c0 2024-04-26T17:58:30.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f4b19d9b640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0c5e40 0x7f4b1c144560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c011930 tx=0x7f4b0c011df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f82cd542640 1 -- start start 2024-04-26T17:58:30.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.581+0000 7f8f3ecd3640 1 -- start start 2024-04-26T17:58:30.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f46bd77f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b808eb90 0x7f46b80b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f46bd77f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b8152a90 0x7f46b80cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f46bd77f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b8155df0 0x7f46b80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f8f3ecd3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f380c7ab0 0x7f8f3815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f8f3ecd3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f3815a190 0x7f8f38144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f46bd77f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f46b806d050 con 0x7f46b808eb90 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f46bd77f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f46b815c360 con 0x7f46b8155df0 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f46bd77f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f46b806c850 con 0x7f46b8152a90 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fd82ca1f640 1 --2- 172.21.15.139:0/675596311 >> v2:172.21.15.139:3300/0 conn(0x7fd8280c98e0 0x7fd8281585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fd82d220640 1 -- 172.21.15.139:0/675596311 >> v2:172.21.15.143:3300/0 conn(0x7fd828072460 msgr2=0x7fd8280c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fd82d220640 1 --2- 172.21.15.139:0/675596311 >> v2:172.21.15.143:3300/0 conn(0x7fd828072460 0x7fd8280c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fd82d220640 1 -- 172.21.15.139:0/675596311 >> v2:172.21.15.139:3300/0 conn(0x7fd8280c98e0 msgr2=0x7fd8281585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fd82d220640 1 --2- 172.21.15.139:0/675596311 >> v2:172.21.15.139:3300/0 conn(0x7fd8280c98e0 0x7fd8281585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fd82d220640 1 -- 172.21.15.139:0/675596311 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8280c88d0 con 0x7fd828068ad0 2024-04-26T17:58:30.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f46b6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b808eb90 0x7f46b80b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fb026ffd640 1 -- 172.21.15.139:0/3190860974 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028005e60 con 0x7fb0380c80c0 2024-04-26T17:58:30.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7fb03cab1640 1 -- 172.21.15.139:0/3190860974 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0380c4b00 con 0x7fb0380c80c0 2024-04-26T17:58:30.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b808eb90 0x7f46b80b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36518/0 (socket says 172.21.15.139:36518) 2024-04-26T17:58:30.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b6ffd640 1 -- 172.21.15.139:0/3290293569 learned_addr learned my addr 172.21.15.139:0/3290293569 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f53a68b6640 1 --2- 172.21.15.139:0/1091799922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 0x7f53a01558e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53a006f5e0 tx=0x7f539c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b276beb4d9ec8392 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f8f3ecd3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f38143da0 0x7f8f380c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f8f3ecd3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38072e00 con 0x7f8f380c7ab0 2024-04-26T17:58:30.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f8f3ecd3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8f38072280 con 0x7f8f38143da0 2024-04-26T17:58:30.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.582+0000 7f8f3ecd3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8f380730e0 con 0x7f8f3815a190 2024-04-26T17:58:30.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b7fff640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b8155df0 0x7f46b80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b6ffd640 1 -- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b8152a90 msgr2=0x7f46b80cc3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T17:58:30.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b67fc640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b8152a90 0x7f46b80cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b6ffd640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b8152a90 0x7f46b80cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f8f37fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f3815a190 0x7f8f38144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f8f37fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f3815a190 0x7f8f38144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54384/0 (socket says 172.21.15.139:54384) 2024-04-26T17:58:30.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f8f37fff640 1 -- 172.21.15.139:0/3927354109 learned_addr learned my addr 172.21.15.139:0/3927354109 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b6ffd640 1 -- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b8155df0 msgr2=0x7f46b80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f3f9c808640 1 Processor -- start 2024-04-26T17:58:30.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b6ffd640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b8155df0 0x7f46b80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f53a50b3640 1 -- 172.21.15.139:0/1091799922 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c037070 con 0x7f53a015c840 2024-04-26T17:58:30.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f8f3ca6f640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f380c7ab0 0x7f8f3815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b6ffd640 1 -- 172.21.15.139:0/3290293569 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80cff50 con 0x7f46b808eb90 2024-04-26T17:58:30.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f53a50b3640 1 -- 172.21.15.139:0/1091799922 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c032440 con 0x7f53a015c840 2024-04-26T17:58:30.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f3f9c808640 1 -- start start 2024-04-26T17:58:30.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f53a50b3640 1 -- 172.21.15.139:0/1091799922 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c037070 con 0x7f53a015c840 2024-04-26T17:58:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b7fff640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b8155df0 0x7f46b80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f4b0affd640 1 -- 172.21.15.139:0/4220829198 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00fbd0 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f4b0affd640 1 -- 172.21.15.139:0/4220829198 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00fd70 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f46b67fc640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b8152a90 0x7f46b80cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f4b0affd640 1 -- 172.21.15.139:0/4220829198 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c015660 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b1c15a510 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.583+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b1c0c65a0 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7fd82d220640 1 --2- 172.21.15.139:0/675596311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd82815b120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8280ce150 tx=0x7fd82002a600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaabeb0f4efe622f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f3ca6f640 1 -- 172.21.15.139:0/3927354109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f3815a190 msgr2=0x7f8f38144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f3ca6f640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f3815a190 0x7f8f38144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f3ca6f640 1 -- 172.21.15.139:0/3927354109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f38143da0 msgr2=0x7f8f380c9910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T17:58:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f3ca6f640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f38143da0 0x7f8f380c9910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f3ca6f640 1 -- 172.21.15.139:0/3927354109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f38149dc0 con 0x7f8f380c7ab0 2024-04-26T17:58:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f3ca6f640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f380c7ab0 0x7f8f3815d560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c3e0 tx=0x7f8f2800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7fb03cab1640 1 -- 172.21.15.139:0/3190860974 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0380506c0 con 0x7fb0380c80c0 2024-04-26T17:58:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f357fa640 1 -- 172.21.15.139:0/3927354109 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28017070 con 0x7f8f380c7ab0 2024-04-26T17:58:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f357fa640 1 -- 172.21.15.139:0/3927354109 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f280035f0 con 0x7f8f380c7ab0 2024-04-26T17:58:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f8f357fa640 1 -- 172.21.15.139:0/3927354109 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280039a0 con 0x7f8f380c7ab0 2024-04-26T17:58:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f53a8319640 1 -- 172.21.15.139:0/1091799922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 msgr2=0x7f53a01558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f53a8319640 1 --2- 172.21.15.139:0/1091799922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 0x7f53a01558e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53a006f5e0 tx=0x7f539c02a180 comp rx=0 tx=0).stop 2024-04-26T17:58:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f3f9c808640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f9815a390 0x7f3f98156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/3927354109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3814a0a0 con 0x7f8f380c7ab0 2024-04-26T17:58:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f3f9c808640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f9815a770 0x7f3f98157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f3f9c808640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f9814d5f0 0x7f3f98147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/3927354109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3814a660 con 0x7f8f380c7ab0 2024-04-26T17:58:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f46b6ffd640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b808eb90 0x7f46b80b6db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46b000ba50 tx=0x7f46b000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f469f7fe640 1 -- 172.21.15.139:0/3290293569 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0019070 con 0x7f46b808eb90 2024-04-26T17:58:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b80cad00 con 0x7f46b808eb90 2024-04-26T17:58:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b80cb600 con 0x7f46b808eb90 2024-04-26T17:58:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7f469f7fe640 1 -- 172.21.15.139:0/3290293569 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b000cc10 con 0x7f46b808eb90 2024-04-26T17:58:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.584+0000 7fd8277fe640 1 -- 172.21.15.139:0/675596311 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820036070 con 0x7fd828068ad0 2024-04-26T17:58:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7fd8277fe640 1 -- 172.21.15.139:0/675596311 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd820031600 con 0x7fd828068ad0 2024-04-26T17:58:30.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f469f7fe640 1 -- 172.21.15.139:0/3290293569 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0019070 con 0x7f46b808eb90 2024-04-26T17:58:30.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7fd8277fe640 1 -- 172.21.15.139:0/675596311 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8200319d0 con 0x7fd828068ad0 2024-04-26T17:58:30.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 -- 172.21.15.139:0/675596311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 msgr2=0x7fd82815b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 --2- 172.21.15.139:0/675596311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd82815b120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8280ce150 tx=0x7fd82002a600 comp rx=0 tx=0).stop 2024-04-26T17:58:30.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b00005290 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f53a8319640 1 -- 172.21.15.139:0/1091799922 shutdown_connections 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f53a8319640 1 --2- 172.21.15.139:0/1091799922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 0x7f53a01558e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f53a8319640 1 --2- 172.21.15.139:0/1091799922 >> v2:172.21.15.143:3300/0 conn(0x7f53a00c9cc0 0x7f53a00c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f53a8319640 1 -- 172.21.15.139:0/1091799922 >> 172.21.15.139:0/1091799922 conn(0x7f53a00686c0 msgr2=0x7f53a006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f53a8319640 1 -- 172.21.15.139:0/1091799922 shutdown_connections 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7fb026ffd640 1 -- 172.21.15.139:0/3190860974 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb02801a070 con 0x7fb0380c80c0 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fb026ffd640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb01806c9c0 0x7fb01806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fb026ffd640 1 -- 172.21.15.139:0/3190860974 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb02808b1e0 con 0x7fb0380c80c0 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 -- 172.21.15.139:0/675596311 shutdown_connections 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 --2- 172.21.15.139:0/675596311 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd82815b120 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 --2- 172.21.15.139:0/675596311 >> v2:172.21.15.143:3300/0 conn(0x7fd828072460 0x7fd8280c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 --2- 172.21.15.139:0/675596311 >> v2:172.21.15.139:3300/0 conn(0x7fd8280c98e0 0x7fd8281585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 -- 172.21.15.139:0/675596311 >> 172.21.15.139:0/675596311 conn(0x7fd8280686c0 msgr2=0x7fd82806fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f3f96d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f9815a390 0x7f3f98156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f3f96d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f9815a390 0x7f3f98156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54396/0 (socket says 172.21.15.139:54396) 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f3f9659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f9815a770 0x7f3f98157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.585+0000 7f3f9659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f9815a770 0x7f3f98157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:57064/0 (socket says 172.21.15.139:57064) 2024-04-26T17:58:30.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f3f9c808640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9815b870 con 0x7f3f9814d5f0 2024-04-26T17:58:30.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f3f9c808640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9815b590 con 0x7f3f9815a770 2024-04-26T17:58:30.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f3f9c808640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3f980c8fb0 con 0x7f3f9815a390 2024-04-26T17:58:30.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f3f96d9d640 1 -- 172.21.15.139:0/3381784125 learned_addr learned my addr 172.21.15.139:0/3381784125 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fb03659c640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb01806c9c0 0x7fb01806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/3927354109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3814a8a0 con 0x7f8f380c7ab0 2024-04-26T17:58:30.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f3f9759e640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f9814d5f0 0x7f3f98147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f82cd542640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82c80c6b50 0x7f82c814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 -- 172.21.15.139:0/675596311 shutdown_connections 2024-04-26T17:58:30.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7fd82ec83640 1 -- 172.21.15.139:0/675596311 wait complete. 2024-04-26T17:58:30.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.586+0000 7f82cd542640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82c8155dc0 0x7f82c814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f3f96d9d640 1 -- 172.21.15.139:0/3381784125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f9815a770 msgr2=0x7f3f98157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f9815a770 0x7f3f98157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f3f96d9d640 1 -- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f9814d5f0 msgr2=0x7f3f98147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f9814d5f0 0x7f3f98147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f3f96d9d640 1 -- 172.21.15.139:0/3381784125 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f981567d0 con 0x7f3f9815a390 2024-04-26T17:58:30.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7fb03659c640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb01806c9c0 0x7fb01806ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009990 tx=0x7fb02c009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f3f96d9d640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f9815a390 0x7f3f98156af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3f80011ee0 tx=0x7f3f800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f4b0affd640 1 -- 172.21.15.139:0/4220829198 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b0c015800 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4698005290 con 0x7f46b808eb90 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82c80c6b50 0x7f82c814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82c80c6b50 0x7f82c814b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:57076/0 (socket says 172.21.15.139:57076) 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 -- 172.21.15.139:0/1078639637 learned_addr learned my addr 172.21.15.139:0/1078639637 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82cd542640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c81f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80cd120 con 0x7f82c8155dc0 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80cd770 con 0x7f82c80c6b50 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f82c80cd400 con 0x7f82c815f750 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82ccd41640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c81f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f53a8319640 1 -- 172.21.15.139:0/1091799922 wait complete. 2024-04-26T17:58:30.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c77fe640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82c8155dc0 0x7f82c814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 -- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 msgr2=0x7f82c81f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c81f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 -- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82c8155dc0 msgr2=0x7f82c814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82c8155dc0 0x7f82c814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.587+0000 7f82c7fff640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80b5e20 con 0x7f82c80c6b50 2024-04-26T17:58:30.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f8f357fa640 1 -- 172.21.15.139:0/3927354109 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f2801a070 con 0x7f8f380c7ab0 2024-04-26T17:58:30.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f4b0affd640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4afc06c9c0 0x7f4afc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82c77fe640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82c8155dc0 0x7f82c814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:30.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82ccd41640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c81f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:30.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82c7fff640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82c80c6b50 0x7f82c814b280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82c000caf0 tx=0x7f82c00020a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7fd82ec83640 1 Processor -- start 2024-04-26T17:58:30.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f4b0affd640 1 -- 172.21.15.139:0/4220829198 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b0c08c970 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7fd82ec83640 1 -- start start 2024-04-26T17:58:30.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82c4ff9640 1 -- 172.21.15.139:0/1078639637 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0018070 con 0x7f82c80c6b50 2024-04-26T17:58:30.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82c4ff9640 1 -- 172.21.15.139:0/1078639637 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c000a700 con 0x7f82c80c6b50 2024-04-26T17:58:30.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c814fcb0 con 0x7f82c80c6b50 2024-04-26T17:58:30.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82c4ff9640 1 -- 172.21.15.139:0/1078639637 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c000aaf0 con 0x7f82c80c6b50 2024-04-26T17:58:30.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f4b1a59c640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4afc06c9c0 0x7f4afc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c80b47f0 con 0x7f82c80c6b50 2024-04-26T17:58:30.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f53a8319640 1 Processor -- start 2024-04-26T17:58:30.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7f4b1a59c640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4afc06c9c0 0x7f4afc06ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4b100099c0 tx=0x7f4b10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82ec83640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd828154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82ec83640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd828072460 0x7fd8280cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82ec83640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8280c98e0 0x7fd8280cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82ec83640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280c9170 con 0x7fd828072460 2024-04-26T17:58:30.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82ec83640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd8280c8e90 con 0x7fd8280c98e0 2024-04-26T17:58:30.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82ec83640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd8280ca200 con 0x7fd828068ad0 2024-04-26T17:58:30.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f53a8319640 1 -- start start 2024-04-26T17:58:30.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f8f357fa640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8f2406c8f0 0x7f8f2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.588+0000 7f8f357fa640 1 -- 172.21.15.139:0/3927354109 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8f2808b0b0 con 0x7f8f380c7ab0 2024-04-26T17:58:30.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7f8f37fff640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8f2406c8f0 0x7f8f2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7f8f37fff640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8f2406c8f0 0x7f8f2406edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f3002ac30 tx=0x7f8f30009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82d220640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8280c98e0 0x7fd8280cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82ca1f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd828154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82d220640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8280c98e0 0x7fd8280cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:57080/0 (socket says 172.21.15.139:57080) 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.589+0000 7fd82d220640 1 -- 172.21.15.139:0/958814893 learned_addr learned my addr 172.21.15.139:0/958814893 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd827fff640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd828072460 0x7fd8280cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a8319640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53a006efb0 0x7f53a00cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a8319640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53a00c9cc0 0x7f53a01f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a8319640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 0x7f53a0150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a8319640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53a015bc10 con 0x7f53a015c840 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a8319640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0073b60 con 0x7f53a00c9cc0 2024-04-26T17:58:30.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a8319640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f53a0072030 con 0x7f53a006efb0 2024-04-26T17:58:30.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c80506c0 con 0x7f82c80c6b50 2024-04-26T17:58:30.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53a006efb0 0x7f53a00cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53a006efb0 0x7f53a00cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54430/0 (socket says 172.21.15.139:54430) 2024-04-26T17:58:30.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 -- 172.21.15.139:0/1982319532 learned_addr learned my addr 172.21.15.139:0/1982319532 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:30.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a58b4640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53a00c9cc0 0x7f53a01f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f469f7fe640 1 -- 172.21.15.139:0/3290293569 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46b001c070 con 0x7f46b808eb90 2024-04-26T17:58:30.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a68b6640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 0x7f53a0150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 -- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53a00c9cc0 msgr2=0x7f53a01f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53a00c9cc0 0x7f53a01f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 -- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 msgr2=0x7f53a0150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 0x7f53a0150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 -- 172.21.15.139:0/1982319532 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a00cb1f0 con 0x7f53a006efb0 2024-04-26T17:58:30.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a58b4640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53a00c9cc0 0x7f53a01f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd82ca1f640 1 -- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8280c98e0 msgr2=0x7fd8280cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd82ca1f640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8280c98e0 0x7fd8280cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd82ca1f640 1 -- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd828072460 msgr2=0x7fd8280cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd82ca1f640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd828072460 0x7fd8280cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd82ca1f640 1 -- 172.21.15.139:0/958814893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd828158170 con 0x7fd828068ad0 2024-04-26T17:58:30.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd82ca1f640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd828154c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00e870 tx=0x7fd81c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7fd82d220640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8280c98e0 0x7fd8280cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:30.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f82c4ff9640 1 -- 172.21.15.139:0/1078639637 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82c001b070 con 0x7f82c80c6b50 2024-04-26T17:58:30.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f469f7fe640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f46a406ccf0 0x7f46a406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f469f7fe640 1 -- 172.21.15.139:0/3290293569 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f46b000ca10 con 0x7f46b808eb90 2024-04-26T17:58:30.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f46b67fc640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f46a406ccf0 0x7f46a406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7fb026ffd640 1 -- 172.21.15.139:0/3190860974 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb028058cf0 con 0x7fb0380c80c0 2024-04-26T17:58:30.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f3f8f7fe640 1 -- 172.21.15.139:0/3381784125 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80043b80 con 0x7f3f9815a390 2024-04-26T17:58:30.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9814a860 con 0x7f3f9815a390 2024-04-26T17:58:30.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9814ae20 con 0x7f3f9815a390 2024-04-26T17:58:30.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7fd8257fa640 1 -- 172.21.15.139:0/958814893 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00ee60 con 0x7fd828068ad0 2024-04-26T17:58:30.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd828158450 con 0x7fd828068ad0 2024-04-26T17:58:30.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd828155e60 con 0x7fd828068ad0 2024-04-26T17:58:30.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f82c4ff9640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f82b406c9f0 0x7f82b406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f82c4ff9640 1 -- 172.21.15.139:0/1078639637 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82c008b7c0 con 0x7f82c80c6b50 2024-04-26T17:58:30.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.591+0000 7f82c77fe640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f82b406c9f0 0x7f82b406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.590+0000 7f53a60b5640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53a006efb0 0x7f53a00cc030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5390011fd0 tx=0x7f53900154a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.592+0000 7f82c77fe640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f82b406c9f0 0x7f82b406eeb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82bc007fd0 tx=0x7f82bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.592+0000 7f46b67fc640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f46a406ccf0 0x7f46a406f1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46b80d25f0 tx=0x7f46ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.592+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f980cb950 con 0x7f3f9815a390 2024-04-26T17:58:30.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.592+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd828076d20 con 0x7fd828068ad0 2024-04-26T17:58:30.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.595+0000 7f8f357fa640 1 -- 172.21.15.139:0/3927354109 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f3814a8a0 con 0x7f8f380c7ab0 2024-04-26T17:58:30.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.595+0000 7f3f8f7fe640 1 -- 172.21.15.139:0/3381784125 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f80037620 con 0x7f3f9815a390 2024-04-26T17:58:30.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.595+0000 7f3f8f7fe640 1 -- 172.21.15.139:0/3381784125 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80043d20 con 0x7f3f9815a390 2024-04-26T17:58:30.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.595+0000 7fd8257fa640 1 -- 172.21.15.139:0/958814893 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81c01e070 con 0x7fd828068ad0 2024-04-26T17:58:30.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.595+0000 7fd8257fa640 1 -- 172.21.15.139:0/958814893 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c005b90 con 0x7fd828068ad0 2024-04-26T17:58:30.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.596+0000 7f4b0affd640 1 -- 172.21.15.139:0/4220829198 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b0c019030 con 0x7f4b1c0c5e40 2024-04-26T17:58:30.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.595+0000 7f5396ffd640 1 -- 172.21.15.139:0/1982319532 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390022070 con 0x7f53a006efb0 2024-04-26T17:58:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.596+0000 7f82c4ff9640 1 -- 172.21.15.139:0/1078639637 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f82c0059800 con 0x7f82c80c6b50 2024-04-26T17:58:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.595+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a00cb4b0 con 0x7f53a006efb0 2024-04-26T17:58:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.596+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a00cba70 con 0x7f53a006efb0 2024-04-26T17:58:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.597+0000 7f5396ffd640 1 -- 172.21.15.139:0/1982319532 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539001d600 con 0x7f53a006efb0 2024-04-26T17:58:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.597+0000 7f5396ffd640 1 -- 172.21.15.139:0/1982319532 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539002c060 con 0x7f53a006efb0 2024-04-26T17:58:30.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.598+0000 7f3f8f7fe640 1 -- 172.21.15.139:0/3381784125 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f800111c0 con 0x7f3f9815a390 2024-04-26T17:58:30.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.598+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5388005290 con 0x7f53a006efb0 2024-04-26T17:58:30.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.598+0000 7f5396ffd640 1 -- 172.21.15.139:0/1982319532 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5390025070 con 0x7f53a006efb0 2024-04-26T17:58:30.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.598+0000 7f3f8f7fe640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3f7806c920 0x7f3f7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.598+0000 7f3f8f7fe640 1 -- 172.21.15.139:0/3381784125 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3f800b4700 con 0x7f3f9815a390 2024-04-26T17:58:30.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.599+0000 7f5396ffd640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538406c920 0x7f538406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.599+0000 7f3f9659c640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3f7806c920 0x7f3f7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.599+0000 7f53a58b4640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538406c920 0x7f538406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.599+0000 7f3f9659c640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3f7806c920 0x7f3f7806ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f980c75d0 tx=0x7f3f90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.600+0000 7fd8257fa640 1 -- 172.21.15.139:0/958814893 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd81c00c8e0 con 0x7fd828068ad0 2024-04-26T17:58:30.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.600+0000 7f53a58b4640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538406c920 0x7f538406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53a0070150 tx=0x7f539800d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.600+0000 7fd8257fa640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd80c06c920 0x7fd80c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.601+0000 7fd8257fa640 1 -- 172.21.15.139:0/958814893 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd81c090d90 con 0x7fd828068ad0 2024-04-26T17:58:30.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.601+0000 7fd827fff640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd80c06c920 0x7fd80c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.601+0000 7f3f8f7fe640 1 -- 172.21.15.139:0/3381784125 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f980cb950 con 0x7f3f9815a390 2024-04-26T17:58:30.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.601+0000 7fd827fff640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd80c06c920 0x7fd80c06ede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8281ec3c0 tx=0x7fd814009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.603+0000 7f469f7fe640 1 -- 172.21.15.139:0/3290293569 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46b0058f20 con 0x7f46b808eb90 2024-04-26T17:58:30.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.606+0000 7fd8257fa640 1 -- 172.21.15.139:0/958814893 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd81c05e810 con 0x7fd828068ad0 2024-04-26T17:58:30.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.606+0000 7f5396ffd640 1 -- 172.21.15.139:0/1982319532 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5390092300 con 0x7f53a006efb0 2024-04-26T17:58:30.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:30.610+0000 7f5396ffd640 1 -- 172.21.15.139:0/1982319532 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5390018070 con 0x7f53a006efb0 2024-04-26T17:58:31.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.005+0000 7fb03cab1640 1 -- 172.21.15.139:0/3190860974 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb03816b540 con 0x7fb0380c80c0 2024-04-26T17:58:31.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.005+0000 7fb026ffd640 1 -- 172.21.15.139:0/3190860974 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb02805cff0 con 0x7fb0380c80c0 2024-04-26T17:58:31.005 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:31.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.008+0000 7fb024ff9640 1 -- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb01806c9c0 msgr2=0x7fb01806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb01806c9c0 0x7fb01806ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009990 tx=0x7fb02c009110 comp rx=0 tx=0).stop 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 -- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380c80c0 msgr2=0x7fb038148000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380c80c0 0x7fb038148000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c750 tx=0x7fb02800cb50 comp rx=0 tx=0).stop 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 -- 172.21.15.139:0/3190860974 shutdown_connections 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb01806c9c0 0x7fb01806ee80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb03815a170 0x7fb0380c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0380c80c0 0x7fb038148000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 --2- 172.21.15.139:0/3190860974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0380732e0 0x7fb038147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 -- 172.21.15.139:0/3190860974 >> 172.21.15.139:0/3190860974 conn(0x7fb0380cd000 msgr2=0x7fb03814c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7f8f3ecd3640 1 -- 172.21.15.139:0/3927354109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8f38076d20 con 0x7f8f380c7ab0 2024-04-26T17:58:31.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 -- 172.21.15.139:0/3190860974 shutdown_connections 2024-04-26T17:58:31.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.009+0000 7fb024ff9640 1 -- 172.21.15.139:0/3190860974 wait complete. 2024-04-26T17:58:31.010 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:31.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.010+0000 7f8f357fa640 1 -- 172.21.15.139:0/3927354109 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f28058ac0 con 0x7f8f380c7ab0 2024-04-26T17:58:31.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.013+0000 7f8f1effd640 1 -- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8f2406c8f0 msgr2=0x7f8f2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.013+0000 7f8f1effd640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8f2406c8f0 0x7f8f2406edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f3002ac30 tx=0x7f8f30009000 comp rx=0 tx=0).stop 2024-04-26T17:58:31.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.013+0000 7f8f1effd640 1 -- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f380c7ab0 msgr2=0x7f8f3815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.013+0000 7f8f1effd640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f380c7ab0 0x7f8f3815d560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c3e0 tx=0x7f8f2800c8a0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 -- 172.21.15.139:0/3927354109 shutdown_connections 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8f2406c8f0 0x7f8f2406edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f38143da0 0x7f8f380c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8f3815a190 0x7f8f38144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 --2- 172.21.15.139:0/3927354109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f380c7ab0 0x7f8f3815d560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 -- 172.21.15.139:0/3927354109 >> 172.21.15.139:0/3927354109 conn(0x7f8f380686c0 msgr2=0x7f8f3806eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 -- 172.21.15.139:0/3927354109 shutdown_connections 2024-04-26T17:58:31.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.014+0000 7f8f1effd640 1 -- 172.21.15.139:0/3927354109 wait complete. 2024-04-26T17:58:31.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.020+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f82c814c490 con 0x7f82c80c6b50 2024-04-26T17:58:31.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.021+0000 7f82c4ff9640 1 -- 172.21.15.139:0/1078639637 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82c0059100 con 0x7f82c80c6b50 2024-04-26T17:58:31.021 INFO:teuthology.orchestra.run.smithi139.stdout:55834574857 2024-04-26T17:58:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.023+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4b00005580 con 0x7f4b1c0c5e40 2024-04-26T17:58:31.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.024+0000 7f4b0affd640 1 -- 172.21.15.139:0/4220829198 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b0c05aa40 con 0x7f4b1c0c5e40 2024-04-26T17:58:31.024 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:31.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.024+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3f980506c0 con 0x7f3f9815a390 2024-04-26T17:58:31.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f82b406c9f0 msgr2=0x7f82b406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f82b406c9f0 0x7f82b406eeb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f82bc007fd0 tx=0x7f82bc009040 comp rx=0 tx=0).stop 2024-04-26T17:58:31.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f3f8f7fe640 1 -- 172.21.15.139:0/3381784125 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3f80053020 con 0x7f3f9815a390 2024-04-26T17:58:31.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82c80c6b50 msgr2=0x7f82c814b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.025 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82c80c6b50 0x7f82c814b280 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82c000caf0 tx=0x7f82c00020a0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 shutdown_connections 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f82b406c9f0 0x7f82b406eeb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f82c815f750 0x7f82c81f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82c8155dc0 0x7f82c814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.025+0000 7f82cd542640 1 --2- 172.21.15.139:0/1078639637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82c80c6b50 0x7f82c814b280 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.026+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 >> 172.21.15.139:0/1078639637 conn(0x7f82c8073ca0 msgr2=0x7f82c8154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.026+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 shutdown_connections 2024-04-26T17:58:31.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.026+0000 7f82cd542640 1 -- 172.21.15.139:0/1078639637 wait complete. 2024-04-26T17:58:31.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.027+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4afc06c9c0 msgr2=0x7f4afc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4afc06c9c0 0x7f4afc06ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4b100099c0 tx=0x7f4b10008040 comp rx=0 tx=0).stop 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0c5e40 msgr2=0x7f4b1c144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0c5e40 0x7f4b1c144560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c011930 tx=0x7f4b0c011df0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 shutdown_connections 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4afc06c9c0 0x7f4afc06ee80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b1c15ab40 0x7f4b1c144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b1c0c5e40 0x7f4b1c144560 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 --2- 172.21.15.139:0/4220829198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b04004d40 0x7f4b1c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.028+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 >> 172.21.15.139:0/4220829198 conn(0x7f4b1c0c9a90 msgr2=0x7f4b1c0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-04-26T17:58:31.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 shutdown_connections 2024-04-26T17:58:31.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f4b1b59e640 1 -- 172.21.15.139:0/4220829198 wait complete. 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3f7806c920 msgr2=0x7f3f7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f3f9c808640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3f7806c920 0x7f3f7806ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f980c75d0 tx=0x7f3f90009040 comp rx=0 tx=0).stop 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f9815a390 msgr2=0x7f3f98156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f3f9c808640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f9815a390 0x7f3f98156af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3f80011ee0 tx=0x7f3f800046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 shutdown_connections 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.029+0000 7f3f9c808640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3f7806c920 0x7f3f7806ede0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7f3f9c808640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3f9814d5f0 0x7f3f98147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7f3f9c808640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3f9815a770 0x7f3f98157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7f3f9c808640 1 --2- 172.21.15.139:0/3381784125 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3f9815a390 0x7f3f98156af0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 >> 172.21.15.139:0/3381784125 conn(0x7f3f980c9a90 msgr2=0x7f3f9806d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd828072990 con 0x7fd828068ad0 2024-04-26T17:58:31.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 shutdown_connections 2024-04-26T17:58:31.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7f3f9c808640 1 -- 172.21.15.139:0/3381784125 wait complete. 2024-04-26T17:58:31.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.030+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5388005580 con 0x7f53a006efb0 2024-04-26T17:58:31.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.031+0000 7fd8257fa640 1 -- 172.21.15.139:0/958814893 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd81c062b10 con 0x7fd828068ad0 2024-04-26T17:58:31.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.031+0000 7f5396ffd640 1 -- 172.21.15.139:0/1982319532 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5390061a50 con 0x7f53a006efb0 2024-04-26T17:58:31.033 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:31.034 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:31.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538406c920 msgr2=0x7f538406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538406c920 0x7f538406ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53a0070150 tx=0x7f539800d040 comp rx=0 tx=0).stop 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53a006efb0 msgr2=0x7f53a00cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53a006efb0 0x7f53a00cc030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5390011fd0 tx=0x7f53900154a0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 shutdown_connections 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538406c920 0x7f538406ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a015c840 0x7f53a0150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f53a00c9cc0 0x7f53a01f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 --2- 172.21.15.139:0/1982319532 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f53a006efb0 0x7f53a00cc030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 >> 172.21.15.139:0/1982319532 conn(0x7f53a00686c0 msgr2=0x7f53a014ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd80c06c920 msgr2=0x7fd80c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.034+0000 7fd82ec83640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd80c06c920 0x7fd80c06ede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8281ec3c0 tx=0x7fd814009190 comp rx=0 tx=0).stop 2024-04-26T17:58:31.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 msgr2=0x7fd828154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd828154c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00e870 tx=0x7fd81c00ed30 comp rx=0 tx=0).stop 2024-04-26T17:58:31.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 shutdown_connections 2024-04-26T17:58:31.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7f53a8319640 1 -- 172.21.15.139:0/1982319532 wait complete. 2024-04-26T17:58:31.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 shutdown_connections 2024-04-26T17:58:31.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd80c06c920 0x7fd80c06ede0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd8280c98e0 0x7fd8280cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd828072460 0x7fd8280cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 --2- 172.21.15.139:0/958814893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd828068ad0 0x7fd828154c50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 >> 172.21.15.139:0/958814893 conn(0x7fd8280686c0 msgr2=0x7fd82814c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 shutdown_connections 2024-04-26T17:58:31.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.035+0000 7fd82ec83640 1 -- 172.21.15.139:0/958814893 wait complete. 2024-04-26T17:58:31.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.036+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4698005850 con 0x7f46b808eb90 2024-04-26T17:58:31.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.036+0000 7f469f7fe640 1 -- 172.21.15.139:0/3290293569 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46b005d220 con 0x7f46b808eb90 2024-04-26T17:58:31.038 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:31.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f46a406ccf0 msgr2=0x7f46a406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f46a406ccf0 0x7f46a406f1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f46b80d25f0 tx=0x7f46ac008040 comp rx=0 tx=0).stop 2024-04-26T17:58:31.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b808eb90 msgr2=0x7f46b80b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b808eb90 0x7f46b80b6db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46b000ba50 tx=0x7f46b000bf10 comp rx=0 tx=0).stop 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 shutdown_connections 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f46a406ccf0 0x7f46a406f1b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b8155df0 0x7f46b80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f46b8152a90 0x7f46b80cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 --2- 172.21.15.139:0/3290293569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46b808eb90 0x7f46b80b6db0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.040+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 >> 172.21.15.139:0/3290293569 conn(0x7f46b80767e0 msgr2=0x7f46b815ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.041+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 shutdown_connections 2024-04-26T17:58:31.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:31.041+0000 7f46bd77f640 1 -- 172.21.15.139:0/3290293569 wait complete. 2024-04-26T17:58:31.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-04-26T17:58:31.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-04-26T17:58:31.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-04-26T17:58:31.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-04-26T17:58:31.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-04-26T17:58:31.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-04-26T17:58:32.031 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T17:58:32.034 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T17:58:32.047 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T17:58:32.047 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T17:58:32.054 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T17:58:32.056 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T17:58:32.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T17:58:32.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.191+0000 7fe90b338640 1 Processor -- start 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.191+0000 7fe90b338640 1 -- start start 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.192+0000 7fe90b338640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe904159ff0 0x7fe904163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.192+0000 7fe90b338640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904164180 0x7fe9040d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.192+0000 7fe90b338640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90415a710 con 0x7fe9040d1860 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.192+0000 7fe90b338640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe9040c6270 con 0x7fe904159ff0 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.192+0000 7fe90b338640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe904160f10 con 0x7fe904164180 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.193+0000 7fe9088d3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904164180 0x7fe9040d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.193+0000 7fe9088d3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904164180 0x7fe9040d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54432/0 (socket says 172.21.15.139:54432) 2024-04-26T17:58:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.193+0000 7fe9088d3640 1 -- 172.21.15.139:0/2262158538 learned_addr learned my addr 172.21.15.139:0/2262158538 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.193+0000 7fe9090d4640 1 --2- 172.21.15.139:0/2262158538 >> v2:172.21.15.143:3300/0 conn(0x7fe904159ff0 0x7fe904163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.194+0000 7fe8fbfff640 1 -- 172.21.15.139:0/2262158538 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017193962 0 0) 0x7fe8fc001490 con 0x7fe9040d1860 2024-04-26T17:58:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.194+0000 7fe8fbfff640 1 -- 172.21.15.139:0/2262158538 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f0003520 con 0x7fe9040d1860 2024-04-26T17:58:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.194+0000 7fe9090d4640 1 -- 172.21.15.139:0/2262158538 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904164180 msgr2=0x7fe9040d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.194+0000 7fe9090d4640 1 --2- 172.21.15.139:0/2262158538 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904164180 0x7fe9040d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.194+0000 7fe9090d4640 1 -- 172.21.15.139:0/2262158538 >> v1:172.21.15.143:6789/0 conn(0x7fe9040d1860 legacy=0x7fe9040cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.194+0000 7fe9090d4640 1 -- 172.21.15.139:0/2262158538 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe904160110 con 0x7fe904159ff0 2024-04-26T17:58:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.195+0000 7fe9090d4640 1 --2- 172.21.15.139:0/2262158538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe904159ff0 0x7fe904163c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f661e9c052eee202 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.196+0000 7fe8fbfff640 1 -- 172.21.15.139:0/2262158538 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4037070 con 0x7fe904159ff0 2024-04-26T17:58:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.196+0000 7fe8fbfff640 1 -- 172.21.15.139:0/2262158538 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f4032440 con 0x7fe904159ff0 2024-04-26T17:58:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.197+0000 7fe90b338640 1 -- 172.21.15.139:0/2262158538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe904159ff0 msgr2=0x7fe904163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.197+0000 7fe90b338640 1 --2- 172.21.15.139:0/2262158538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe904159ff0 0x7fe904163c40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40097a0 tx=0x7fe8f402a1c0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.197+0000 7fe90b338640 1 -- 172.21.15.139:0/2262158538 shutdown_connections 2024-04-26T17:58:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.197+0000 7fe90b338640 1 --2- 172.21.15.139:0/2262158538 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904164180 0x7fe9040d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.197+0000 7fe90b338640 1 --2- 172.21.15.139:0/2262158538 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe904159ff0 0x7fe904163c40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.197+0000 7fe90b338640 1 -- 172.21.15.139:0/2262158538 >> 172.21.15.139:0/2262158538 conn(0x7fe9040762e0 msgr2=0x7fe904073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.198+0000 7fe90b338640 1 -- 172.21.15.139:0/2262158538 shutdown_connections 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.198+0000 7fe90b338640 1 -- 172.21.15.139:0/2262158538 wait complete. 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.200+0000 7fe90b338640 1 Processor -- start 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.200+0000 7fe90b338640 1 -- start start 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe90b338640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9040d1860 0x7fe9041611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe90b338640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904159ff0 0x7fe9040ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe90b338640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe904164180 0x7fe9040c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe90b338640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe904160950 con 0x7fe904164180 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe90b338640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe904160670 con 0x7fe9040d1860 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe90b338640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe904160c30 con 0x7fe904159ff0 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe9098d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe904164180 0x7fe9040c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe9098d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe904164180 0x7fe9040c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36586/0 (socket says 172.21.15.139:36586) 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe9098d5640 1 -- 172.21.15.139:0/967494380 learned_addr learned my addr 172.21.15.139:0/967494380 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.201+0000 7fe9088d3640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904159ff0 0x7fe9040ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.202+0000 7fe9098d5640 1 -- 172.21.15.139:0/967494380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904159ff0 msgr2=0x7fe9040ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.202+0000 7fe9098d5640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904159ff0 0x7fe9040ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.202+0000 7fe9098d5640 1 -- 172.21.15.139:0/967494380 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9040d1860 msgr2=0x7fe9041611c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.202+0000 7fe9098d5640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9040d1860 0x7fe9041611c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.202+0000 7fe9098d5640 1 -- 172.21.15.139:0/967494380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe904135d80 con 0x7fe904164180 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.202+0000 7fe9098d5640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe904164180 0x7fe9040c8840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc001630 tx=0x7fe8fc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.204+0000 7fe8f9ffb640 1 -- 172.21.15.139:0/967494380 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc003b70 con 0x7fe904164180 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.204+0000 7fe90b338640 1 -- 172.21.15.139:0/967494380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe904136060 con 0x7fe904164180 2024-04-26T17:58:32.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.204+0000 7fe90b338640 1 -- 172.21.15.139:0/967494380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe904136620 con 0x7fe904164180 2024-04-26T17:58:32.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.207+0000 7fe8f9ffb640 1 -- 172.21.15.139:0/967494380 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8fc003d30 con 0x7fe904164180 2024-04-26T17:58:32.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.207+0000 7fe8f9ffb640 1 -- 172.21.15.139:0/967494380 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc005310 con 0x7fe904164180 2024-04-26T17:58:32.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.207+0000 7fe8f9ffb640 1 -- 172.21.15.139:0/967494380 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8fc005530 con 0x7fe904164180 2024-04-26T17:58:32.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.208+0000 7fe8f9ffb640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe8e806ca20 0x7fe8e806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.208+0000 7fe8f9ffb640 1 -- 172.21.15.139:0/967494380 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8fc08be20 con 0x7fe904164180 2024-04-26T17:58:32.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.208+0000 7fe9090d4640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe8e806ca20 0x7fe8e806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.210+0000 7fe9090d4640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe8e806ca20 0x7fe8e806eee0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4034000 tx=0x7fe8f402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.211+0000 7fe90b338640 1 -- 172.21.15.139:0/967494380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e4005290 con 0x7fe904164180 2024-04-26T17:58:32.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.220+0000 7fe8f9ffb640 1 -- 172.21.15.139:0/967494380 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe90415a710 con 0x7fe904164180 2024-04-26T17:58:32.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.244+0000 7fe6b7fff640 1 Processor -- start 2024-04-26T17:58:32.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.244+0000 7fe6b7fff640 1 -- start start 2024-04-26T17:58:32.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.245+0000 7fe6b7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b80d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.245+0000 7fe6b7fff640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b81643a0 con 0x7fe6b80c61f0 2024-04-26T17:58:32.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.245+0000 7fe6b77fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe6b80c61f0 0x7fe6b816a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40458/0 (socket says 172.21.15.139:40458) 2024-04-26T17:58:32.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.245+0000 7fe6b77fe640 1 -- 172.21.15.139:0/2478082609 learned_addr learned my addr 172.21.15.139:0/2478082609 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:32.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.246+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2478082609 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b8163820 con 0x7fe6b80d1670 2024-04-26T17:58:32.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.246+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2478082609 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b8163b00 con 0x7fe6b815a2b0 2024-04-26T17:58:32.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.246+0000 7fe6b6ffd640 1 --2- 172.21.15.139:0/2478082609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b80d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.246+0000 7fe6b67fc640 1 -- 172.21.15.139:0/2478082609 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723258165 0 0) 0x7fe6b81643a0 con 0x7fe6b80c61f0 2024-04-26T17:58:32.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.247+0000 7fe6b67fc640 1 -- 172.21.15.139:0/2478082609 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6a4003520 con 0x7fe6b80c61f0 2024-04-26T17:58:32.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.247+0000 7f42c2069640 1 Processor -- start 2024-04-26T17:58:32.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.247+0000 7fe6b6ffd640 1 -- 172.21.15.139:0/2478082609 >> v1:172.21.15.143:6789/0 conn(0x7fe6b80d1670 legacy=0x7fe6b8160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.247+0000 7f42c2069640 1 -- start start 2024-04-26T17:58:32.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.247+0000 7fe6b6ffd640 1 -- 172.21.15.139:0/2478082609 >> v1:172.21.15.139:6789/0 conn(0x7fe6b80c61f0 legacy=0x7fe6b816a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.247+0000 7fe6b6ffd640 1 -- 172.21.15.139:0/2478082609 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b8163de0 con 0x7fe6b815a2b0 2024-04-26T17:58:32.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.248+0000 7f42c2069640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f42b40dd4e0 0x7f42b4045570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.248+0000 7f42c2069640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b40dd8c0 con 0x7f42b4046520 2024-04-26T17:58:32.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.248+0000 7f42c2069640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b40e34e0 con 0x7f42b4045ab0 2024-04-26T17:58:32.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.248+0000 7f42c2069640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f42b40e4060 con 0x7f42b40dd4e0 2024-04-26T17:58:32.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.248+0000 7f0fe4751640 1 Processor -- start 2024-04-26T17:58:32.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.248+0000 7f42baffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f42b4045ab0 0x7f42b404beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39834/0 (socket says 172.21.15.139:39834) 2024-04-26T17:58:32.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7f42baffd640 1 -- 172.21.15.139:0/3665169946 learned_addr learned my addr 172.21.15.139:0/3665169946 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:32.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7f42bb7fe640 1 --2- 172.21.15.139:0/3665169946 >> v2:172.21.15.139:3300/0 conn(0x7f42b40dd4e0 0x7f42b4045570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7f439499d640 1 Processor -- start 2024-04-26T17:58:32.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.248+0000 7f0fe4751640 1 -- start start 2024-04-26T17:58:32.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7f42bb7fe640 1 -- 172.21.15.139:0/3665169946 >> v1:172.21.15.143:6789/0 conn(0x7f42b4045ab0 legacy=0x7f42b404beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7f42bb7fe640 1 -- 172.21.15.139:0/3665169946 >> v1:172.21.15.139:6789/0 conn(0x7f42b4046520 legacy=0x7f42b4046940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7f42bb7fe640 1 -- 172.21.15.139:0/3665169946 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b40e37c0 con 0x7f42b40dd4e0 2024-04-26T17:58:32.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7fd605264640 1 Processor -- start 2024-04-26T17:58:32.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7f439499d640 1 -- start start 2024-04-26T17:58:32.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.249+0000 7fe6b6ffd640 1 --2- 172.21.15.139:0/2478082609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b80d1130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80097d0 tx=0x7fe6a802a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51da08823b64636 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7fd605264640 1 -- start start 2024-04-26T17:58:32.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f0fe4751640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0fdc155da0 0x7f0fdc15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f439499d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f439015ffa0 0x7f43900c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7fe6b67fc640 1 -- 172.21.15.139:0/2478082609 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8037070 con 0x7fe6b815a2b0 2024-04-26T17:58:32.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f439499d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f43900c7ab0 0x7f43900c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7fe6b67fc640 1 -- 172.21.15.139:0/2478082609 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a8032440 con 0x7fe6b815a2b0 2024-04-26T17:58:32.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f439499d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43900c9080 con 0x7f439015a190 2024-04-26T17:58:32.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f438dd9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f439015ffa0 0x7f43900c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f439499d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4390072030 con 0x7f43900c7ab0 2024-04-26T17:58:32.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f439499d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4390072560 con 0x7f439015ffa0 2024-04-26T17:58:32.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f438dd9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f439015ffa0 0x7f43900c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54470/0 (socket says 172.21.15.139:54470) 2024-04-26T17:58:32.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.250+0000 7f438dd9b640 1 -- 172.21.15.139:0/37564208 learned_addr learned my addr 172.21.15.139:0/37564208 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f438ed9d640 1 --2- 172.21.15.139:0/37564208 >> v2:172.21.15.143:3300/0 conn(0x7f43900c7ab0 0x7f43900c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe4751640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe4751640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0fdc0d12e0 0x7f0fdc0d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f42bb7fe640 1 --2- 172.21.15.139:0/3665169946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b40dd4e0 0x7f42b4045570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42b00097a0 tx=0x7f42b002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befe62e16224cac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe4751640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0fdc0cd8b0 con 0x7f0fdc155da0 2024-04-26T17:58:32.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7fd605264640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe4751640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0fdc15ffd0 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe4751640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fdc0cc490 con 0x7f0fdc0c63b0 2024-04-26T17:58:32.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f438dd9b640 1 -- 172.21.15.139:0/37564208 >> v2:172.21.15.143:3300/0 conn(0x7f43900c7ab0 msgr2=0x7f43900c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f438dd9b640 1 --2- 172.21.15.139:0/37564208 >> v2:172.21.15.143:3300/0 conn(0x7f43900c7ab0 0x7f43900c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f438dd9b640 1 -- 172.21.15.139:0/37564208 >> v1:172.21.15.139:6789/0 conn(0x7f439015a190 legacy=0x7f4390073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f438dd9b640 1 -- 172.21.15.139:0/37564208 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4390070600 con 0x7f439015ffa0 2024-04-26T17:58:32.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7fd605264640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd600160ad0 0x7fd6000c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7fd605264640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60006cd70 con 0x7fd60015ffa0 2024-04-26T17:58:32.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7fd605264640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd60006d050 con 0x7fd600160ad0 2024-04-26T17:58:32.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7fd605264640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd60006d330 con 0x7fd60015a1e0 2024-04-26T17:58:32.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f42ba7fc640 1 -- 172.21.15.139:0/3665169946 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0037070 con 0x7f42b40dd4e0 2024-04-26T17:58:32.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f42ba7fc640 1 -- 172.21.15.139:0/3665169946 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0032640 con 0x7f42b40dd4e0 2024-04-26T17:58:32.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f438dd9b640 1 --2- 172.21.15.139:0/37564208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f439015ffa0 0x7f43900c9a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43840098a0 tx=0x7f438402a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c26caac84ed10dbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2478082609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 msgr2=0x7fe6b80d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2478082609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b80d1130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80097d0 tx=0x7fe6a802a2a0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2478082609 shutdown_connections 2024-04-26T17:58:32.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2478082609 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b80d1130 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2478082609 >> 172.21.15.139:0/2478082609 conn(0x7fe6b8076520 msgr2=0x7fe6b8073c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2478082609 shutdown_connections 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe24ed640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0fdc155da0 0x7f0fdc15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe24ed640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0fdc155da0 0x7f0fdc15fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36610/0 (socket says 172.21.15.139:36610) 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe24ed640 1 -- 172.21.15.139:0/494465610 learned_addr learned my addr 172.21.15.139:0/494465610 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe1cec640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.251+0000 7f0fe2cee640 1 --2- 172.21.15.139:0/494465610 >> v2:172.21.15.143:3300/0 conn(0x7f0fdc0d12e0 0x7f0fdc0d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5feffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5feffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54496/0 (socket says 172.21.15.139:54496) 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5feffd640 1 -- 172.21.15.139:0/326407486 learned_addr learned my addr 172.21.15.139:0/326407486 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5ff7fe640 1 --2- 172.21.15.139:0/326407486 >> v2:172.21.15.143:3300/0 conn(0x7fd600160ad0 0x7fd6000c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5feffd640 1 -- 172.21.15.139:0/326407486 >> v2:172.21.15.143:3300/0 conn(0x7fd600160ad0 msgr2=0x7fd6000c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5feffd640 1 --2- 172.21.15.139:0/326407486 >> v2:172.21.15.143:3300/0 conn(0x7fd600160ad0 0x7fd6000c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5feffd640 1 -- 172.21.15.139:0/326407486 >> v1:172.21.15.143:6789/0 conn(0x7fd60015ffa0 legacy=0x7fd6001603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fd5feffd640 1 -- 172.21.15.139:0/326407486 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd600070560 con 0x7fd60015a1e0 2024-04-26T17:58:32.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f438d59a640 1 -- 172.21.15.139:0/37564208 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384037070 con 0x7f439015ffa0 2024-04-26T17:58:32.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f438d59a640 1 -- 172.21.15.139:0/37564208 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4384032440 con 0x7f439015ffa0 2024-04-26T17:58:32.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f438d59a640 1 -- 172.21.15.139:0/37564208 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384032810 con 0x7f439015ffa0 2024-04-26T17:58:32.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2478082609 wait complete. 2024-04-26T17:58:32.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7fe9e7096640 1 Processor -- start 2024-04-26T17:58:32.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42ba7fc640 1 -- 172.21.15.139:0/3665169946 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0032a10 con 0x7f42b40dd4e0 2024-04-26T17:58:32.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42c2069640 1 -- 172.21.15.139:0/3665169946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b40dd4e0 msgr2=0x7f42b4045570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42c2069640 1 --2- 172.21.15.139:0/3665169946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b40dd4e0 0x7f42b4045570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42b00097a0 tx=0x7f42b002a2c0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7fe9e7096640 1 -- start start 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f0fe24ed640 1 -- 172.21.15.139:0/494465610 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 msgr2=0x7f0fdc0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f0fe24ed640 1 --2- 172.21.15.139:0/494465610 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc0ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f0fe24ed640 1 -- 172.21.15.139:0/494465610 >> v2:172.21.15.143:3300/0 conn(0x7f0fdc0d12e0 msgr2=0x7f0fdc0d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f0fe24ed640 1 --2- 172.21.15.139:0/494465610 >> v2:172.21.15.143:3300/0 conn(0x7f0fdc0d12e0 0x7f0fdc0d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.252+0000 7f0fe24ed640 1 -- 172.21.15.139:0/494465610 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fdc0cc770 con 0x7f0fdc155da0 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f0fe24ed640 1 --2- 172.21.15.139:0/494465610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc15fa90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0cb950 tx=0x7f0fd402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfbfb81088c21d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7fd5feffd640 1 --2- 172.21.15.139:0/326407486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c9d50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009870 tx=0x7fd5f002a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d39561761a10f7a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42c2069640 1 -- 172.21.15.139:0/3665169946 shutdown_connections 2024-04-26T17:58:32.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42c2069640 1 --2- 172.21.15.139:0/3665169946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b40dd4e0 0x7f42b4045570 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42c2069640 1 -- 172.21.15.139:0/3665169946 >> 172.21.15.139:0/3665169946 conn(0x7f42b40505d0 msgr2=0x7f42b40509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42c2069640 1 -- 172.21.15.139:0/3665169946 shutdown_connections 2024-04-26T17:58:32.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7fd5fe7fc640 1 -- 172.21.15.139:0/326407486 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0037070 con 0x7fd60015a1e0 2024-04-26T17:58:32.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7fd5fe7fc640 1 -- 172.21.15.139:0/326407486 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0032440 con 0x7fd60015a1e0 2024-04-26T17:58:32.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7fd5fe7fc640 1 -- 172.21.15.139:0/326407486 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0032810 con 0x7fd60015a1e0 2024-04-26T17:58:32.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f439499d640 1 -- 172.21.15.139:0/37564208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f439015ffa0 msgr2=0x7f43900c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f439499d640 1 --2- 172.21.15.139:0/37564208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f439015ffa0 0x7f43900c9a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43840098a0 tx=0x7f438402a1f0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7f439499d640 1 -- 172.21.15.139:0/37564208 shutdown_connections 2024-04-26T17:58:32.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7f439499d640 1 --2- 172.21.15.139:0/37564208 >> v2:172.21.15.143:3300/0 conn(0x7f43900c7ab0 0x7f43900c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7f439499d640 1 --2- 172.21.15.139:0/37564208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f439015ffa0 0x7f43900c9a10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7f439499d640 1 -- 172.21.15.139:0/37564208 >> 172.21.15.139:0/37564208 conn(0x7f43900686c0 msgr2=0x7f439006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7fe6b7fff640 1 Processor -- start 2024-04-26T17:58:32.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f0fe14eb640 1 -- 172.21.15.139:0/494465610 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4036070 con 0x7f0fdc155da0 2024-04-26T17:58:32.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f0fe14eb640 1 -- 172.21.15.139:0/494465610 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd4031600 con 0x7f0fdc155da0 2024-04-26T17:58:32.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f0fe14eb640 1 -- 172.21.15.139:0/494465610 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4031a10 con 0x7f0fdc155da0 2024-04-26T17:58:32.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f42c2069640 1 -- 172.21.15.139:0/3665169946 wait complete. 2024-04-26T17:58:32.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f0ce0778640 1 Processor -- start 2024-04-26T17:58:32.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.253+0000 7f0ce0778640 1 -- start start 2024-04-26T17:58:32.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7fd605264640 1 -- 172.21.15.139:0/326407486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 msgr2=0x7fd6000c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7fd605264640 1 --2- 172.21.15.139:0/326407486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c9d50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009870 tx=0x7fd5f002a2a0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7fe6b7fff640 1 -- start start 2024-04-26T17:58:32.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7fe9e7096640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e015da50 0x7fe9e00cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.254+0000 7f0fe4751640 1 -- 172.21.15.139:0/494465610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 msgr2=0x7f0fdc15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f439499d640 1 -- 172.21.15.139:0/37564208 shutdown_connections 2024-04-26T17:58:32.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0fe4751640 1 --2- 172.21.15.139:0/494465610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc15fa90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0cb950 tx=0x7f0fd402a6d0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe9e6094640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e015da50 0x7fe9e00cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6b80c61f0 0x7fe6b8155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe9e7096640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e00b46c0 con 0x7fe9e00c9a20 2024-04-26T17:58:32.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f439499d640 1 -- 172.21.15.139:0/37564208 wait complete. 2024-04-26T17:58:32.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe9e6094640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e015da50 0x7fe9e00cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54508/0 (socket says 172.21.15.139:54508) 2024-04-26T17:58:32.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe9e6094640 1 -- 172.21.15.139:0/2395916306 learned_addr learned my addr 172.21.15.139:0/2395916306 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe9e7096640 1 -- 172.21.15.139:0/2395916306 --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e0070690 con 0x7fe9e0070fd0 2024-04-26T17:58:32.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b80d1670 0x7fe6b8151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b7fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b81f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b7fff640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8163450 con 0x7fe6b80d1670 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b7fff640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8160000 con 0x7fe6b80c61f0 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b7fff640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b81635d0 con 0x7fe6b815a2b0 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0ce0778640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd815a190 0x7f0cd8160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0ce0778640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0cd80c7340 0x7f0cd80c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0ce0778640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd80c7ea0 con 0x7f0cd815a570 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0ce0778640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd80c8fe0 con 0x7f0cd80c7340 2024-04-26T17:58:32.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0ce0778640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd80725a0 con 0x7f0cd815a190 2024-04-26T17:58:32.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe9e5893640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe9e00c9a20 0x7fe9e00ca670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40468/0 (socket says 172.21.15.139:40468) 2024-04-26T17:58:32.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe9e7096640 1 -- 172.21.15.139:0/2395916306 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e00b3ed0 con 0x7fe9e015da50 2024-04-26T17:58:32.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b77fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b81f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f42c2069640 1 Processor -- start 2024-04-26T17:58:32.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fd605264640 1 -- 172.21.15.139:0/326407486 shutdown_connections 2024-04-26T17:58:32.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fd605264640 1 --2- 172.21.15.139:0/326407486 >> v2:172.21.15.143:3300/0 conn(0x7fd600160ad0 0x7fd6000c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fd605264640 1 --2- 172.21.15.139:0/326407486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c9d50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fd605264640 1 -- 172.21.15.139:0/326407486 >> 172.21.15.139:0/326407486 conn(0x7fd600071d70 msgr2=0x7fd600072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b6ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6b80c61f0 0x7fe6b8155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b77fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b81f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54522/0 (socket says 172.21.15.139:54522) 2024-04-26T17:58:32.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6b77fe640 1 -- 172.21.15.139:0/2033022875 learned_addr learned my addr 172.21.15.139:0/2033022875 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0cded15640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0cd80c7340 0x7f0cd80c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0cddd13640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f0cd815a570 0x7f0cd8073250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39866/0 (socket says 172.21.15.139:39866) 2024-04-26T17:58:32.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0cddd13640 1 -- 172.21.15.139:0/1174065218 learned_addr learned my addr 172.21.15.139:0/1174065218 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:32.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0fe4751640 1 -- 172.21.15.139:0/494465610 shutdown_connections 2024-04-26T17:58:32.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0fe4751640 1 --2- 172.21.15.139:0/494465610 >> v2:172.21.15.143:3300/0 conn(0x7f0fdc0d12e0 0x7f0fdc0d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0fe4751640 1 --2- 172.21.15.139:0/494465610 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0fe4751640 1 --2- 172.21.15.139:0/494465610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc15fa90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0fe4751640 1 -- 172.21.15.139:0/494465610 >> 172.21.15.139:0/494465610 conn(0x7f0fdc068090 msgr2=0x7f0fdc0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fd605264640 1 -- 172.21.15.139:0/326407486 shutdown_connections 2024-04-26T17:58:32.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f42c2069640 1 -- start start 2024-04-26T17:58:32.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fd605264640 1 -- 172.21.15.139:0/326407486 wait complete. 2024-04-26T17:58:32.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7f0cde514640 1 --2- 172.21.15.139:0/1174065218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd815a190 0x7f0cd8160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.255+0000 7fe6affff640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b80d1670 0x7fe6b8151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe6b77fe640 1 -- 172.21.15.139:0/2033022875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6b80c61f0 msgr2=0x7fe6b8155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe6b77fe640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6b80c61f0 0x7fe6b8155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe6b77fe640 1 -- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b80d1670 msgr2=0x7fe6b8151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7f0cde514640 1 -- 172.21.15.139:0/1174065218 >> v2:172.21.15.143:3300/0 conn(0x7f0cd80c7340 msgr2=0x7f0cd80c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7f0cde514640 1 --2- 172.21.15.139:0/1174065218 >> v2:172.21.15.143:3300/0 conn(0x7f0cd80c7340 0x7f0cd80c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7f0cde514640 1 -- 172.21.15.139:0/1174065218 >> v1:172.21.15.143:6789/0 conn(0x7f0cd815a570 legacy=0x7f0cd8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7f0cdd512640 1 -- 172.21.15.139:0/1174065218 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674513647 0 0) 0x7f0cd80c7ea0 con 0x7f0cd815a570 2024-04-26T17:58:32.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7f0cde514640 1 -- 172.21.15.139:0/1174065218 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd806f0e0 con 0x7f0cd815a190 2024-04-26T17:58:32.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe6b77fe640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b80d1670 0x7fe6b8151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe6b77fe640 1 -- 172.21.15.139:0/2033022875 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b81f9c70 con 0x7fe6b815a2b0 2024-04-26T17:58:32.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7f0fe4751640 1 -- 172.21.15.139:0/494465610 shutdown_connections 2024-04-26T17:58:32.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7f0fe4751640 1 -- 172.21.15.139:0/494465610 wait complete. 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe9e5092640 1 -- 172.21.15.139:0/2395916306 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158737696 0 0) 0x7fe9e0070690 con 0x7fe9e0070fd0 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe9e5092640 1 -- 172.21.15.139:0/2395916306 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9cc003520 con 0x7fe9e0070fd0 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe9e5092640 1 -- 172.21.15.139:0/2395916306 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224287788 0 0) 0x7fe9e00b46c0 con 0x7fe9e00c9a20 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe9e5092640 1 -- 172.21.15.139:0/2395916306 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e0070690 con 0x7fe9e00c9a20 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe9e6094640 1 -- 172.21.15.139:0/2395916306 >> v1:172.21.15.143:6789/0 conn(0x7fe9e0070fd0 legacy=0x7fe9e01641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe9e6094640 1 -- 172.21.15.139:0/2395916306 >> v1:172.21.15.139:6789/0 conn(0x7fe9e00c9a20 legacy=0x7fe9e00ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.256+0000 7fe9e6094640 1 -- 172.21.15.139:0/2395916306 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e00b4100 con 0x7fe9e015da50 2024-04-26T17:58:32.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fe6b77fe640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b81f5800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000cb70 tx=0x7fe6b000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f42c2069640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b4045ab0 0x7f42b40e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f42c2069640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4046520 0x7f42b4049cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fe6b4ff9640 1 -- 172.21.15.139:0/2033022875 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0017070 con 0x7fe6b815a2b0 2024-04-26T17:58:32.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fe6b4ff9640 1 -- 172.21.15.139:0/2033022875 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b000ad40 con 0x7fe6b815a2b0 2024-04-26T17:58:32.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f0cde514640 1 --2- 172.21.15.139:0/1174065218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd815a190 0x7f0cd8160010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40097a0 tx=0x7f0cd402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a96856ab5cafdc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f42c2069640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40dd4e0 0x7f42b4047ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f42baffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4046520 0x7f42b4049cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fd605264640 1 Processor -- start 2024-04-26T17:58:32.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f42baffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4046520 0x7f42b4049cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54544/0 (socket says 172.21.15.139:54544) 2024-04-26T17:58:32.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f42baffd640 1 -- 172.21.15.139:0/3607915492 learned_addr learned my addr 172.21.15.139:0/3607915492 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fe6b4ff9640 1 -- 172.21.15.139:0/2033022875 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0012620 con 0x7fe6b815a2b0 2024-04-26T17:58:32.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4046000 con 0x7f42b4045ab0 2024-04-26T17:58:32.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fd605264640 1 -- start start 2024-04-26T17:58:32.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f439499d640 1 Processor -- start 2024-04-26T17:58:32.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b8161970 con 0x7fe6b815a2b0 2024-04-26T17:58:32.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b8162410 con 0x7fe6b815a2b0 2024-04-26T17:58:32.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f42bbfff640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40dd4e0 0x7f42b4047ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7fe9e6094640 1 --2- 172.21.15.139:0/2395916306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e015da50 0x7fe9e00cf150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e80 tx=0x7fe9d8033050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbb6d367710a73de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f0fe4751640 1 Processor -- start 2024-04-26T17:58:32.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f42b40e3d80 con 0x7f42b40dd4e0 2024-04-26T17:58:32.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f0fe4751640 1 -- start start 2024-04-26T17:58:32.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f42b40e3130 con 0x7f42b4046520 2024-04-26T17:58:32.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f0cdd512640 1 -- 172.21.15.139:0/1174065218 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4037070 con 0x7f0cd815a190 2024-04-26T17:58:32.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.257+0000 7f0cdd512640 1 -- 172.21.15.139:0/1174065218 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd402ae40 con 0x7f0cd815a190 2024-04-26T17:58:32.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f0cdd512640 1 -- 172.21.15.139:0/1174065218 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4032660 con 0x7f0cd815a190 2024-04-26T17:58:32.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f42bb7fe640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b4045ab0 0x7f42b40e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f0ce0778640 1 -- 172.21.15.139:0/1174065218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd815a190 msgr2=0x7f0cd8160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0ce0778640 1 --2- 172.21.15.139:0/1174065218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd815a190 0x7f0cd8160010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40097a0 tx=0x7f0cd402a0f0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7f439499d640 1 -- start start 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7fd605264640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7fd605264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd60015ffa0 0x7fd6001f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.258+0000 7fd605264640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd600160ad0 0x7fd600158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd605264640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd60015a5c0 con 0x7fd600160ad0 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd605264640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd600070270 con 0x7fd60015ffa0 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd605264640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd60015a740 con 0x7fd60015a1e0 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd5ff7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd600160ad0 0x7fd600158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd5ff7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd600160ad0 0x7fd600158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36632/0 (socket says 172.21.15.139:36632) 2024-04-26T17:58:32.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd5ff7fe640 1 -- 172.21.15.139:0/1724497250 learned_addr learned my addr 172.21.15.139:0/1724497250 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0ce0778640 1 -- 172.21.15.139:0/1174065218 shutdown_connections 2024-04-26T17:58:32.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0ce0778640 1 --2- 172.21.15.139:0/1174065218 >> v2:172.21.15.143:3300/0 conn(0x7f0cd80c7340 0x7f0cd80c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0ce0778640 1 --2- 172.21.15.139:0/1174065218 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd815a190 0x7f0cd8160010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0ce0778640 1 -- 172.21.15.139:0/1174065218 >> 172.21.15.139:0/1174065218 conn(0x7f0cd80686c0 msgr2=0x7f0cd806fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd5feffd640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f439499d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43900c7ab0 0x7f43900cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b80506c0 con 0x7fe6b815a2b0 2024-04-26T17:58:32.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fd5f7fff640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd60015ffa0 0x7fd6001f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fe9e5092640 1 -- 172.21.15.139:0/2395916306 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8033b90 con 0x7fe9e015da50 2024-04-26T17:58:32.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fe9e5092640 1 -- 172.21.15.139:0/2395916306 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d8033d30 con 0x7fe9e015da50 2024-04-26T17:58:32.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7fe9e5092640 1 -- 172.21.15.139:0/2395916306 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d803b610 con 0x7fe9e015da50 2024-04-26T17:58:32.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0fe4751640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc1f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f439499d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f439015a190 0x7f4390157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f439499d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f439015ffa0 0x7f43901f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f439499d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4390072e00 con 0x7f439015a190 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f439499d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4390072280 con 0x7f439015ffa0 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f439499d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f43900730e0 con 0x7f43900c7ab0 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f438dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f439015a190 0x7f4390157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f438dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f439015a190 0x7f4390157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36638/0 (socket says 172.21.15.139:36638) 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f438dd9b640 1 -- 172.21.15.139:0/3625797102 learned_addr learned my addr 172.21.15.139:0/3625797102 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0fe4751640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fdc0d12e0 0x7f0fdc15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0ce0778640 1 -- 172.21.15.139:0/1174065218 shutdown_connections 2024-04-26T17:58:32.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0fe4751640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f0ce0778640 1 -- 172.21.15.139:0/1174065218 wait complete. 2024-04-26T17:58:32.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.259+0000 7f438ed9d640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f439015ffa0 0x7f43901f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe4751640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc0ce0c0 con 0x7f0fdc155da0 2024-04-26T17:58:32.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe4751640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0fdc0cdde0 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe4751640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fdc156180 con 0x7f0fdc0c63b0 2024-04-26T17:58:32.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f438e59c640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43900c7ab0 0x7f43900cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fe6b4ff9640 1 -- 172.21.15.139:0/2033022875 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6b001a070 con 0x7fe6b815a2b0 2024-04-26T17:58:32.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f42bb7fe640 1 -- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4046520 msgr2=0x7f42b4049cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe2cee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f42bb7fe640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4046520 0x7f42b4049cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f42bb7fe640 1 -- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40dd4e0 msgr2=0x7f42b4047ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fe9e7096640 1 -- 172.21.15.139:0/2395916306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e015da50 msgr2=0x7fe9e00cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f42bb7fe640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40dd4e0 0x7f42b4047ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fe9e7096640 1 --2- 172.21.15.139:0/2395916306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e015da50 0x7fe9e00cf150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e80 tx=0x7fe9d8033050 comp rx=0 tx=0).stop 2024-04-26T17:58:32.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe2cee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36654/0 (socket says 172.21.15.139:36654) 2024-04-26T17:58:32.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe2cee640 1 -- 172.21.15.139:0/1724017752 learned_addr learned my addr 172.21.15.139:0/1724017752 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f42bb7fe640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b4178f30 con 0x7f42b4045ab0 2024-04-26T17:58:32.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fd5ff7fe640 1 -- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 msgr2=0x7fd6000c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fd5ff7fe640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fd5ff7fe640 1 -- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd60015ffa0 msgr2=0x7fd6001f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fd5ff7fe640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd60015ffa0 0x7fd6001f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fd5ff7fe640 1 -- 172.21.15.139:0/1724497250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6001f5e50 con 0x7fd600160ad0 2024-04-26T17:58:32.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fd5f7fff640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd60015ffa0 0x7fd6001f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:32.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f42baffd640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4046520 0x7f42b4049cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:32.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fe9e7096640 1 -- 172.21.15.139:0/2395916306 shutdown_connections 2024-04-26T17:58:32.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe24ed640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc1f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f0fe1cec640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fdc0d12e0 0x7f0fdc15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fe6b4ff9640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe69806c9c0 0x7fe69806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fe9e7096640 1 --2- 172.21.15.139:0/2395916306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e015da50 0x7fe9e00cf150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7fe9e7096640 1 -- 172.21.15.139:0/2395916306 >> 172.21.15.139:0/2395916306 conn(0x7fe9e0068090 msgr2=0x7fe9e00684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f438dd9b640 1 -- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43900c7ab0 msgr2=0x7f43900cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f438dd9b640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43900c7ab0 0x7f43900cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f438dd9b640 1 -- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f439015ffa0 msgr2=0x7f43901f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f438dd9b640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f439015ffa0 0x7f43901f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.260+0000 7f438dd9b640 1 -- 172.21.15.139:0/3625797102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900caf50 con 0x7f439015a190 2024-04-26T17:58:32.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fe9e7096640 1 -- 172.21.15.139:0/2395916306 shutdown_connections 2024-04-26T17:58:32.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fe6b4ff9640 1 -- 172.21.15.139:0/2033022875 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe6b008bcb0 con 0x7fe6b815a2b0 2024-04-26T17:58:32.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fd5ff7fe640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd600160ad0 0x7fd600158f50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800efc0 tx=0x7fd5f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe1cec640 1 -- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 msgr2=0x7f0fdc1f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe1cec640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc1f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe1cec640 1 -- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 msgr2=0x7f0fdc158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe1cec640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0ce0778640 1 Processor -- start 2024-04-26T17:58:32.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe1cec640 1 -- 172.21.15.139:0/1724017752 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fdc1f9180 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fe9e7096640 1 -- 172.21.15.139:0/2395916306 wait complete. 2024-04-26T17:58:32.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f42bb7fe640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b4045ab0 0x7f42b40e26e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b0031000 tx=0x7f42b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fd5f77fe640 1 -- 172.21.15.139:0/1724497250 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8018020 con 0x7fd600160ad0 2024-04-26T17:58:32.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0ce0778640 1 -- start start 2024-04-26T17:58:32.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fe6b6ffd640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe69806c9c0 0x7fe69806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe1cec640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fdc0d12e0 0x7f0fdc15bba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800e850 tx=0x7f0fd800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6001f6110 con 0x7fd600160ad0 2024-04-26T17:58:32.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f438dd9b640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f439015a190 0x7f4390157b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f438402a7e0 tx=0x7f43840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6001f66d0 con 0x7fd600160ad0 2024-04-26T17:58:32.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7fd5f77fe640 1 -- 172.21.15.139:0/1724497250 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f8014480 con 0x7fd600160ad0 2024-04-26T17:58:32.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7fd5f77fe640 1 -- 172.21.15.139:0/1724497250 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8014870 con 0x7fd600160ad0 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0ce0778640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd80c7340 0x7f0cd81f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0ce0778640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd815a190 0x7f0cd81e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0ce0778640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd815a570 0x7f0cd815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0ce0778640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd806f380 con 0x7f0cd815a190 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0ce0778640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd80c7bc0 con 0x7f0cd815a570 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0ce0778640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd8073960 con 0x7f0cd80c7340 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0cded15640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd815a570 0x7f0cd815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0cded15640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd815a570 0x7f0cd815db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:57180/0 (socket says 172.21.15.139:57180) 2024-04-26T17:58:32.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.262+0000 7f0cded15640 1 -- 172.21.15.139:0/3894807952 learned_addr learned my addr 172.21.15.139:0/3894807952 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fd2ffd640 1 -- 172.21.15.139:0/1724017752 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8017070 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fd2ffd640 1 -- 172.21.15.139:0/1724017752 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd800c940 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fd2ffd640 1 -- 172.21.15.139:0/1724017752 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd800cd10 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fdc1f9440 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.261+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fdc1f9a00 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cded15640 1 -- 172.21.15.139:0/3894807952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd80c7340 msgr2=0x7f0cd81f91b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:58:32.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7fe9e7096640 1 Processor -- start 2024-04-26T17:58:32.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cded15640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd80c7340 0x7f0cd81f91b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cded15640 1 -- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd815a190 msgr2=0x7f0cd81e6ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:58:32.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cded15640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd815a190 0x7f0cd81e6ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cded15640 1 -- 172.21.15.139:0/3894807952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81e86c0 con 0x7f0cd815a570 2024-04-26T17:58:32.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7fe9e7096640 1 -- start start 2024-04-26T17:58:32.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7fe6b6ffd640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe69806c9c0 0x7fe69806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8034000 tx=0x7fe6a802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cded15640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd815a570 0x7f0cd815db20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800e7c0 tx=0x7f0cc800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f42a7fff640 1 -- 172.21.15.139:0/3607915492 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0040020 con 0x7f42b4045ab0 2024-04-26T17:58:32.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f42a7fff640 1 -- 172.21.15.139:0/3607915492 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0038040 con 0x7f42b4045ab0 2024-04-26T17:58:32.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f42a7fff640 1 -- 172.21.15.139:0/3607915492 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0037070 con 0x7f42b4045ab0 2024-04-26T17:58:32.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fdc1535c0 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e4005290 con 0x7fd600160ad0 2024-04-26T17:58:32.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b4179210 con 0x7f42b4045ab0 2024-04-26T17:58:32.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f437effd640 1 -- 172.21.15.139:0/3625797102 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384040020 con 0x7f439015a190 2024-04-26T17:58:32.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b41797d0 con 0x7f42b4045ab0 2024-04-26T17:58:32.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cceffd640 1 -- 172.21.15.139:0/3894807952 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8017070 con 0x7f0cd815a570 2024-04-26T17:58:32.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cceffd640 1 -- 172.21.15.139:0/3894807952 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc800c730 con 0x7f0cd815a570 2024-04-26T17:58:32.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.263+0000 7f0cceffd640 1 -- 172.21.15.139:0/3894807952 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800cb20 con 0x7f0cd815a570 2024-04-26T17:58:32.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81f96f0 con 0x7f0cd815a570 2024-04-26T17:58:32.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd81f9c40 con 0x7f0cd815a570 2024-04-26T17:58:32.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7f437effd640 1 -- 172.21.15.139:0/3625797102 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4384038040 con 0x7f439015a190 2024-04-26T17:58:32.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7f437effd640 1 -- 172.21.15.139:0/3625797102 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384037070 con 0x7f439015a190 2024-04-26T17:58:32.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7fe9e7096640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e0070fd0 0x7fe9e014b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7fe9e7096640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e00c9a20 0x7fe9e014b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7fd5f77fe640 1 -- 172.21.15.139:0/1724497250 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5f8005d10 con 0x7fd600160ad0 2024-04-26T17:58:32.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7fe9e6094640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e0070fd0 0x7fe9e014b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.264+0000 7fe9e6094640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e0070fd0 0x7fe9e014b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:54584/0 (socket says 172.21.15.139:54584) 2024-04-26T17:58:32.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fe9e6094640 1 -- 172.21.15.139:0/1699541329 learned_addr learned my addr 172.21.15.139:0/1699541329 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fe9e5893640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e00c9a20 0x7fe9e014b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fe9e7096640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015da50 0x7fe9e00cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e00cbd90 con 0x7fe9e00c9a20 2024-04-26T17:58:32.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e00ca1e0 con 0x7fe9e015da50 2024-04-26T17:58:32.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fd5f77fe640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd5e006c920 0x7fd5e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd8076d20 con 0x7f0cd815a570 2024-04-26T17:58:32.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fd5f77fe640 1 -- 172.21.15.139:0/1724497250 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd5f808cb50 con 0x7fd600160ad0 2024-04-26T17:58:32.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fd5feffd640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd5e006c920 0x7fd5e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7f42a7fff640 1 -- 172.21.15.139:0/3607915492 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42b0043020 con 0x7f42b4045ab0 2024-04-26T17:58:32.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7fe6b4ff9640 1 -- 172.21.15.139:0/2033022875 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe6b0059730 con 0x7fe6b815a2b0 2024-04-26T17:58:32.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43900cb1c0 con 0x7f439015a190 2024-04-26T17:58:32.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43900cb780 con 0x7f439015a190 2024-04-26T17:58:32.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e00c6620 con 0x7fe9e0070fd0 2024-04-26T17:58:32.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.265+0000 7fe9e6895640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015da50 0x7fe9e00cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7fd5feffd640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd5e006c920 0x7fd5e006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0034000 tx=0x7fd5f002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7f42a7fff640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f42a006c940 0x7f42a006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7f42a7fff640 1 -- 172.21.15.139:0/3607915492 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f42b00ac230 con 0x7f42b4045ab0 2024-04-26T17:58:32.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7f0fd2ffd640 1 -- 172.21.15.139:0/1724017752 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0fd801a070 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7f42baffd640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f42a006c940 0x7f42a006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.266+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b40057e0 con 0x7f42b4045ab0 2024-04-26T17:58:32.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7f42baffd640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f42a006c940 0x7f42a006ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42bc06b780 tx=0x7f42bc06a5f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7fe9e6895640 1 -- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e0070fd0 msgr2=0x7fe9e014b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7fe9e6895640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e0070fd0 0x7fe9e014b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7fe9e6895640 1 -- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e00c9a20 msgr2=0x7fe9e014b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7f0fd2ffd640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0fc006c9c0 0x7f0fc006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7fe9e6895640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e00c9a20 0x7fe9e014b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7fe9e6895640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e006d960 con 0x7fe9e015da50 2024-04-26T17:58:32.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390076d20 con 0x7f439015a190 2024-04-26T17:58:32.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7fe9e5893640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e00c9a20 0x7fe9e014b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:32.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7f0fd2ffd640 1 -- 172.21.15.139:0/1724017752 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0fd808c1e0 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7f0fe24ed640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0fc006c9c0 0x7f0fc006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.267+0000 7fe9e6895640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015da50 0x7fe9e00cd850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c3f0 tx=0x7fe9d000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.268+0000 7f0fe24ed640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0fc006c9c0 0x7f0fc006ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4033000 tx=0x7f0fd4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.269+0000 7f0fd2ffd640 1 -- 172.21.15.139:0/1724017752 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0fdc1535c0 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.269+0000 7fe9d6ffd640 1 -- 172.21.15.139:0/1699541329 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0017070 con 0x7fe9e015da50 2024-04-26T17:58:32.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.269+0000 7fe9d6ffd640 1 -- 172.21.15.139:0/1699541329 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d00052d0 con 0x7fe9e015da50 2024-04-26T17:58:32.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.269+0000 7fe9d6ffd640 1 -- 172.21.15.139:0/1699541329 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0003830 con 0x7fe9e015da50 2024-04-26T17:58:32.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.269+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e006dc40 con 0x7fe9e015da50 2024-04-26T17:58:32.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.269+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e00cd050 con 0x7fe9e015da50 2024-04-26T17:58:32.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.271+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e0070db0 con 0x7fe9e015da50 2024-04-26T17:58:32.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.272+0000 7f0cceffd640 1 -- 172.21.15.139:0/3894807952 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0cc801a070 con 0x7f0cd815a570 2024-04-26T17:58:32.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.272+0000 7f0cceffd640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0cbc06c920 0x7f0cbc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.272+0000 7f0cceffd640 1 -- 172.21.15.139:0/3894807952 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0cc808c4f0 con 0x7f0cd815a570 2024-04-26T17:58:32.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.272+0000 7f0cde514640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0cbc06c920 0x7f0cbc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.273+0000 7f0cde514640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0cbc06c920 0x7f0cbc06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4034000 tx=0x7f0cd402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.274+0000 7f0cceffd640 1 -- 172.21.15.139:0/3894807952 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0cc805a5c0 con 0x7f0cd815a570 2024-04-26T17:58:32.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.274+0000 7fd5f77fe640 1 -- 172.21.15.139:0/1724497250 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5f8022030 con 0x7fd600160ad0 2024-04-26T17:58:32.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.277+0000 7f437effd640 1 -- 172.21.15.139:0/3625797102 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4384043020 con 0x7f439015a190 2024-04-26T17:58:32.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.277+0000 7f437effd640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f437006c940 0x7f437006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.277+0000 7fe9d6ffd640 1 -- 172.21.15.139:0/1699541329 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9d001a070 con 0x7fe9e015da50 2024-04-26T17:58:32.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.277+0000 7fe9d6ffd640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9c406c8f0 0x7fe9c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.277+0000 7fe9d6ffd640 1 -- 172.21.15.139:0/1699541329 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe9d008b580 con 0x7fe9e015da50 2024-04-26T17:58:32.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.278+0000 7f438e59c640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f437006c940 0x7f437006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.278+0000 7fe9e6094640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9c406c8f0 0x7fe9c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.278+0000 7fe9e6094640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9c406c8f0 0x7fe9c406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009850 tx=0x7fe9d8037000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.278+0000 7f438e59c640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f437006c940 0x7f437006ee00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4380001780 tx=0x7f4380009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.279+0000 7fe9d6ffd640 1 -- 172.21.15.139:0/1699541329 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe9d0021020 con 0x7fe9e015da50 2024-04-26T17:58:32.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.285+0000 7f42a7fff640 1 -- 172.21.15.139:0/3607915492 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42b004a030 con 0x7f42b4045ab0 2024-04-26T17:58:32.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.287+0000 7f437effd640 1 -- 172.21.15.139:0/3625797102 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4384030de0 con 0x7f439015a190 2024-04-26T17:58:32.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.294+0000 7f437effd640 1 -- 172.21.15.139:0/3625797102 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f438404a020 con 0x7f439015a190 2024-04-26T17:58:32.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.625+0000 7fe90b338640 1 -- 172.21.15.139:0/967494380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe8e4005580 con 0x7fe904164180 2024-04-26T17:58:32.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.626+0000 7fe8f9ffb640 1 -- 172.21.15.139:0/967494380 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8fc059e60 con 0x7fe904164180 2024-04-26T17:58:32.776 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.630+0000 7fe8ef7fe640 1 -- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe8e806ca20 msgr2=0x7fe8e806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.630+0000 7fe8ef7fe640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe8e806ca20 0x7fe8e806eee0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4034000 tx=0x7fe8f402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.630+0000 7fe8ef7fe640 1 -- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe904164180 msgr2=0x7fe9040c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.630+0000 7fe8ef7fe640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe904164180 0x7fe9040c8840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc001630 tx=0x7fe8fc00cf50 comp rx=0 tx=0).stop 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 -- 172.21.15.139:0/967494380 shutdown_connections 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe8e806ca20 0x7fe8e806eee0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe904164180 0x7fe9040c8840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe904159ff0 0x7fe9040ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 --2- 172.21.15.139:0/967494380 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9040d1860 0x7fe9041611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 -- 172.21.15.139:0/967494380 >> 172.21.15.139:0/967494380 conn(0x7fe9040762e0 msgr2=0x7fe9040b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 -- 172.21.15.139:0/967494380 shutdown_connections 2024-04-26T17:58:32.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.631+0000 7fe8ef7fe640 1 -- 172.21.15.139:0/967494380 wait complete. 2024-04-26T17:58:32.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-04-26T17:58:32.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.672+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f43900c7180 con 0x7f439015a190 2024-04-26T17:58:32.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.673+0000 7f437effd640 1 -- 172.21.15.139:0/3625797102 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f438407adf0 con 0x7f439015a190 2024-04-26T17:58:32.780 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.780 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:32.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f437006c940 msgr2=0x7f437006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f437006c940 0x7f437006ee00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4380001780 tx=0x7f4380009040 comp rx=0 tx=0).stop 2024-04-26T17:58:32.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f439015a190 msgr2=0x7f4390157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f439015a190 0x7f4390157b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f438402a7e0 tx=0x7f43840046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 shutdown_connections 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f437006c940 0x7f437006ee00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f439015ffa0 0x7f43901f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f439015a190 0x7f4390157b10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 --2- 172.21.15.139:0/3625797102 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f43900c7ab0 0x7f43900cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 >> 172.21.15.139:0/3625797102 conn(0x7f43900686c0 msgr2=0x7f43900c5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 shutdown_connections 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.675+0000 7f439499d640 1 -- 172.21.15.139:0/3625797102 wait complete. 2024-04-26T17:58:32.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.686+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe6b80ccdf0 con 0x7fe6b815a2b0 2024-04-26T17:58:32.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-26T17:58:32.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.686+0000 7fe6b4ff9640 1 -- 172.21.15.139:0/2033022875 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe6b005da30 con 0x7fe6b815a2b0 2024-04-26T17:58:32.783 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:32.784 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe69806c9c0 msgr2=0x7fe69806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe69806c9c0 0x7fe69806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8034000 tx=0x7fe6a802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 msgr2=0x7fe6b81f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b81f5800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000cb70 tx=0x7fe6b000a430 comp rx=0 tx=0).stop 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 shutdown_connections 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe69806c9c0 0x7fe69806ee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6b815a2b0 0x7fe6b81f5800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6b80d1670 0x7fe6b8151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 --2- 172.21.15.139:0/2033022875 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6b80c61f0 0x7fe6b8155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 >> 172.21.15.139:0/2033022875 conn(0x7fe6b8076520 msgr2=0x7fe6b8160420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 shutdown_connections 2024-04-26T17:58:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.690+0000 7fe6b7fff640 1 -- 172.21.15.139:0/2033022875 wait complete. 2024-04-26T17:58:32.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.696+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe9e015d150 con 0x7fe9e015da50 2024-04-26T17:58:32.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.696+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0fdc076d20 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.697+0000 7fe9d6ffd640 1 -- 172.21.15.139:0/1699541329 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9d0059090 con 0x7fe9e015da50 2024-04-26T17:58:32.786 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:32.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.697+0000 7f0fd2ffd640 1 -- 172.21.15.139:0/1724017752 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0fd8059c60 con 0x7f0fdc0d12e0 2024-04-26T17:58:32.787 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:32.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.698+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd5e4005580 con 0x7fd600160ad0 2024-04-26T17:58:32.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.698+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0cd80c6030 con 0x7f0cd815a570 2024-04-26T17:58:32.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.698+0000 7fd5f77fe640 1 -- 172.21.15.139:0/1724497250 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5f8010040 con 0x7fd600160ad0 2024-04-26T17:58:32.788 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:32.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.698+0000 7f0cceffd640 1 -- 172.21.15.139:0/3894807952 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0cc8059ec0 con 0x7f0cd815a570 2024-04-26T17:58:32.789 INFO:teuthology.orchestra.run.smithi139.stdout:55834574859 2024-04-26T17:58:32.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9c406c8f0 msgr2=0x7fe9c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9c406c8f0 0x7fe9c406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009850 tx=0x7fe9d8037000 comp rx=0 tx=0).stop 2024-04-26T17:58:32.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015da50 msgr2=0x7fe9e00cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015da50 0x7fe9e00cd850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000c3f0 tx=0x7fe9d000c8b0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0fc006c9c0 msgr2=0x7f0fc006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0fc006c9c0 0x7f0fc006ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4033000 tx=0x7f0fd4009000 comp rx=0 tx=0).stop 2024-04-26T17:58:32.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fdc0d12e0 msgr2=0x7f0fdc15bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fdc0d12e0 0x7f0fdc15bba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800e850 tx=0x7f0fd800ed10 comp rx=0 tx=0).stop 2024-04-26T17:58:32.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 shutdown_connections 2024-04-26T17:58:32.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0fc006c9c0 0x7f0fc006ee80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fdc155da0 0x7f0fdc158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fdc0d12e0 0x7f0fdc15bba0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800e850 tx=0x7f0fd800ed10 comp rx=0 tx=0).stop 2024-04-26T17:58:32.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 --2- 172.21.15.139:0/1724017752 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fdc0c63b0 0x7f0fdc1f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 >> 172.21.15.139:0/1724017752 conn(0x7f0fdc068090 msgr2=0x7f0fdc068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 shutdown_connections 2024-04-26T17:58:32.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe9c406c8f0 0x7fe9c406edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9e015da50 0x7fe9e00cd850 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e00c9a20 0x7fe9e014b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 shutdown_connections 2024-04-26T17:58:32.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0fe4751640 1 -- 172.21.15.139:0/1724017752 wait complete. 2024-04-26T17:58:32.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 --2- 172.21.15.139:0/1699541329 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe9e0070fd0 0x7fe9e014b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 >> 172.21.15.139:0/1699541329 conn(0x7fe9e0068090 msgr2=0x7fe9e00c80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 shutdown_connections 2024-04-26T17:58:32.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.700+0000 7fe9e7096640 1 -- 172.21.15.139:0/1699541329 wait complete. 2024-04-26T17:58:32.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0cbc06c920 msgr2=0x7f0cbc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0cbc06c920 0x7f0cbc06ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4034000 tx=0x7f0cd402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:32.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd815a570 msgr2=0x7f0cd815db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd815a570 0x7f0cd815db20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800e7c0 tx=0x7f0cc800ec80 comp rx=0 tx=0).stop 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 shutdown_connections 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0cbc06c920 0x7f0cbc06ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0cd815a570 0x7f0cd815db20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd815a190 0x7f0cd81e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 --2- 172.21.15.139:0/3894807952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0cd80c7340 0x7f0cd81f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.701+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 >> 172.21.15.139:0/3894807952 conn(0x7f0cd80686c0 msgr2=0x7f0cd80c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 shutdown_connections 2024-04-26T17:58:32.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7f0ce0778640 1 -- 172.21.15.139:0/3894807952 wait complete. 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd5e006c920 msgr2=0x7fd5e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd5e006c920 0x7fd5e006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0034000 tx=0x7fd5f002e000 comp rx=0 tx=0).stop 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd600160ad0 msgr2=0x7fd600158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd600160ad0 0x7fd600158f50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800efc0 tx=0x7fd5f800c490 comp rx=0 tx=0).stop 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 shutdown_connections 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd5e006c920 0x7fd5e006ede0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd600160ad0 0x7fd600158f50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd60015ffa0 0x7fd6001f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 --2- 172.21.15.139:0/1724497250 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd60015a1e0 0x7fd6000c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 >> 172.21.15.139:0/1724497250 conn(0x7fd600071d70 msgr2=0x7fd6001ec2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.702+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 shutdown_connections 2024-04-26T17:58:32.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.703+0000 7fd605264640 1 -- 172.21.15.139:0/1724497250 wait complete. 2024-04-26T17:58:32.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-26T17:58:32.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.708+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f42b4033ea0 con 0x7f42b4045ab0 2024-04-26T17:58:32.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.708+0000 7f42a7fff640 1 -- 172.21.15.139:0/3607915492 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42b004a030 con 0x7f42b4045ab0 2024-04-26T17:58:32.797 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.797 INFO:teuthology.orchestra.run.smithi139.stdout:55834574858 2024-04-26T17:58:32.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f42a006c940 msgr2=0x7f42a006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f42a006c940 0x7f42a006ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f42bc06b780 tx=0x7f42bc06a5f0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b4045ab0 msgr2=0x7f42b40e26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b4045ab0 0x7f42b40e26e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b0031000 tx=0x7f42b00046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 shutdown_connections 2024-04-26T17:58:32.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f42a006c940 0x7f42a006ee00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42b40dd4e0 0x7f42b4047ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f42b4046520 0x7f42b4049cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 --2- 172.21.15.139:0/3607915492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42b4045ab0 0x7f42b40e26e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 >> 172.21.15.139:0/3607915492 conn(0x7f42b40505d0 msgr2=0x7f42b404cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 shutdown_connections 2024-04-26T17:58:32.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.712+0000 7f42c2069640 1 -- 172.21.15.139:0/3607915492 wait complete. 2024-04-26T17:58:32.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-04-26T17:58:32.800 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-26T17:58:32.801 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-26T17:58:32.802 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-26T17:58:32.803 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-26T17:58:32.803 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:32.803 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T17:58:32.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:32.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.901+0000 7f6fe7ebd640 1 Processor -- start 2024-04-26T17:58:32.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.901+0000 7f6fe7ebd640 1 -- start start 2024-04-26T17:58:32.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe7ebd640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6fe00cf620 0x7f6fe006c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe7ebd640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe015f490 con 0x7f6fe00cf240 2024-04-26T17:58:32.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe7ebd640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe015f770 con 0x7f6fe006c850 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe7ebd640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe0160010 con 0x7f6fe00cf620 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe5c59640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6fe00cf240 0x7f6fe015c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40474/0 (socket says 172.21.15.139:40474) 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe5c59640 1 -- 172.21.15.139:0/347064947 learned_addr learned my addr 172.21.15.139:0/347064947 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe5458640 1 --2- 172.21.15.139:0/347064947 >> v2:172.21.15.143:3300/0 conn(0x7f6fe00cf620 0x7f6fe006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731386104 0 0) 0x7f6fe015f490 con 0x7f6fe00cf240 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fcc003520 con 0x7f6fe00cf240 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 173279818 0 0) 0x7f6fcc003520 con 0x7f6fe00cf240 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 >> v2:172.21.15.143:3300/0 conn(0x7f6fe00cf620 msgr2=0x7f6fe006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 --2- 172.21.15.139:0/347064947 >> v2:172.21.15.143:3300/0 conn(0x7f6fe00cf620 0x7f6fe006c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 >> v1:172.21.15.143:6789/0 conn(0x7f6fe006c850 legacy=0x7f6fe0166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe015fa50 con 0x7f6fe00cf240 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f6fdc001670 con 0x7f6fe00cf240 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 >> v1:172.21.15.139:6789/0 conn(0x7f6fe00cf240 legacy=0x7f6fe015c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc0039b0 0x7f6fcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fcc004800 0x7f6fcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fcc0051c0 0x7f6fcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe0160010 con 0x7f6fcc004800 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc00c060 con 0x7f6fcc0051c0 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6fcc00c260 con 0x7f6fcc0039b0 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe5458640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fcc004800 0x7f6fcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.902+0000 7f6fe5c59640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc0039b0 0x7f6fcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe645a640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fcc0051c0 0x7f6fcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe5458640 1 -- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc0039b0 msgr2=0x7f6fcc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe5458640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc0039b0 0x7f6fcc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe5458640 1 -- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fcc0051c0 msgr2=0x7f6fcc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe5458640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fcc0051c0 0x7f6fcc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe645a640 1 -- 172.21.15.139:0/347064947 reap_dead start 2024-04-26T17:58:32.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe5458640 1 -- 172.21.15.139:0/347064947 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fcc003520 con 0x7f6fcc004800 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe5458640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fcc004800 0x7f6fcc004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009ac0 tx=0x7f6fcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2763fddd0dd02496 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0036070 con 0x7f6fcc004800 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd0031400 con 0x7f6fcc004800 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.903+0000 7f6fe4c57640 1 -- 172.21.15.139:0/347064947 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0009690 con 0x7f6fcc004800 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.904+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/347064947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fcc004800 msgr2=0x7f6fcc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.904+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fcc004800 0x7f6fcc004c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009ac0 tx=0x7f6fcc005830 comp rx=0 tx=0).stop 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.904+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/347064947 shutdown_connections 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.904+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/347064947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fcc004800 0x7f6fcc004c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.904+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/347064947 >> 172.21.15.139:0/347064947 conn(0x7f6fe0076730 msgr2=0x7f6fe0068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.904+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/347064947 shutdown_connections 2024-04-26T17:58:32.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.904+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/347064947 wait complete. 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.905+0000 7f6fe7ebd640 1 Processor -- start 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.905+0000 7f6fe7ebd640 1 -- start start 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe7ebd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc004800 0x7f6fe01f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe7ebd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe0151f80 0x7f6fe015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe7ebd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe01f19c0 0x7f6fe015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe7ebd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe006cc60 con 0x7f6fe0151f80 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe7ebd640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe015bcb0 con 0x7f6fe01f19c0 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe7ebd640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe006e2a0 con 0x7f6fcc004800 2024-04-26T17:58:32.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe0151f80 0x7f6fe015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe0151f80 0x7f6fe015db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36678/0 (socket says 172.21.15.139:36678) 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 -- 172.21.15.139:0/596287375 learned_addr learned my addr 172.21.15.139:0/596287375 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe645a640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe01f19c0 0x7f6fe015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5c59640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc004800 0x7f6fe01f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 -- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc004800 msgr2=0x7f6fe01f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc004800 0x7f6fe01f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 -- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe01f19c0 msgr2=0x7f6fe015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe01f19c0 0x7f6fe015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 -- 172.21.15.139:0/596287375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe01f5e10 con 0x7f6fe0151f80 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.906+0000 7f6fe5458640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe0151f80 0x7f6fe015db20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009be0 tx=0x7f6fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.907+0000 7f6fd67fc640 1 -- 172.21.15.139:0/596287375 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd003f020 con 0x7f6fe0151f80 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.907+0000 7f6fd67fc640 1 -- 172.21.15.139:0/596287375 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd0037040 con 0x7f6fe0151f80 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.907+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe0152c60 con 0x7f6fe0151f80 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.907+0000 7f6fd67fc640 1 -- 172.21.15.139:0/596287375 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0036070 con 0x7f6fe0151f80 2024-04-26T17:58:32.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.907+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe0153200 con 0x7f6fe0151f80 2024-04-26T17:58:32.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.908+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe0076d20 con 0x7f6fe0151f80 2024-04-26T17:58:32.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.908+0000 7f6fd67fc640 1 -- 172.21.15.139:0/596287375 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fd0042020 con 0x7f6fe0151f80 2024-04-26T17:58:32.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.908+0000 7f6fd67fc640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fc406c8f0 0x7f6fc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:32.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.908+0000 7f6fd67fc640 1 -- 172.21.15.139:0/596287375 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6fd00abdc0 con 0x7f6fe0151f80 2024-04-26T17:58:32.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.909+0000 7f6fe5c59640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fc406c8f0 0x7f6fc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:32.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.909+0000 7f6fe5c59640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fc406c8f0 0x7f6fc406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0011e0 tx=0x7f6fdc001110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:32.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:32.913+0000 7f6fd67fc640 1 -- 172.21.15.139:0/596287375 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6fd0049030 con 0x7f6fe0151f80 2024-04-26T17:58:33.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.087+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6fe01533d0 con 0x7f6fc406c8f0 2024-04-26T17:58:33.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.095+0000 7f6fd67fc640 1 -- 172.21.15.139:0/596287375 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f6fe01533d0 con 0x7f6fc406c8f0 2024-04-26T17:58:33.098 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:33.100 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T17:58:33.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fc406c8f0 msgr2=0x7f6fc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fc406c8f0 0x7f6fc406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0011e0 tx=0x7f6fdc001110 comp rx=0 tx=0).stop 2024-04-26T17:58:33.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe0151f80 msgr2=0x7f6fe015db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe0151f80 0x7f6fe015db20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009be0 tx=0x7f6fd0004730 comp rx=0 tx=0).stop 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 shutdown_connections 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fc406c8f0 0x7f6fc406edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe01f19c0 0x7f6fe015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe0151f80 0x7f6fe015db20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 --2- 172.21.15.139:0/596287375 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fcc004800 0x7f6fe01f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 >> 172.21.15.139:0/596287375 conn(0x7f6fe0076730 msgr2=0x7f6fe00c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 shutdown_connections 2024-04-26T17:58:33.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.098+0000 7f6fe7ebd640 1 -- 172.21.15.139:0/596287375 wait complete. 2024-04-26T17:58:33.109 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-26T17:58:33.032834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867920+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T17:58:09.867920+0000","last_peered":"2024-04-26T17:58:09.867920+0000","last_clean":"2024-04-26T17:58:09.867920+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T17:58:09.867920+0000","last_undegraded":"2024-04-26T17:58:09.867920+0000","last_fullsized":"2024-04-26T17:58:09.867920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866709+0000","last_change":"2024-04-26T17:58:04.721568+0000","last_active":"2024-04-26T17:58:09.866709+0000","last_peered":"2024-04-26T17:58:09.866709+0000","last_clean":"2024-04-26T17:58:09.866709+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T17:58:09.866709+0000","last_undegraded":"2024-04-26T17:58:09.866709+0000","last_fullsized":"2024-04-26T17:58:09.866709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:24.906240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867369+0000","last_change":"2024-04-26T17:58:08.737557+0000","last_active":"2024-04-26T17:58:09.867369+0000","last_peered":"2024-04-26T17:58:09.867369+0000","last_clean":"2024-04-26T17:58:09.867369+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T17:58:09.867369+0000","last_undegraded":"2024-04-26T17:58:09.867369+0000","last_fullsized":"2024-04-26T17:58:09.867369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:29.013280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866886+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T17:58:09.866886+0000","last_peered":"2024-04-26T17:58:09.866886+0000","last_clean":"2024-04-26T17:58:09.866886+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T17:58:09.866886+0000","last_undegraded":"2024-04-26T17:58:09.866886+0000","last_fullsized":"2024-04-26T17:58:09.866886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867706+0000","last_change":"2024-04-26T17:58:04.725200+0000","last_active":"2024-04-26T17:58:09.867706+0000","last_peered":"2024-04-26T17:58:09.867706+0000","last_clean":"2024-04-26T17:58:09.867706+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T17:58:09.867706+0000","last_undegraded":"2024-04-26T17:58:09.867706+0000","last_fullsized":"2024-04-26T17:58:09.867706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:15.882481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866726+0000","last_change":"2024-04-26T17:58:08.747272+0000","last_active":"2024-04-26T17:58:09.866726+0000","last_peered":"2024-04-26T17:58:09.866726+0000","last_clean":"2024-04-26T17:58:09.866726+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T17:58:09.866726+0000","last_undegraded":"2024-04-26T17:58:09.866726+0000","last_fullsized":"2024-04-26T17:58:09.866726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:08.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741319+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T17:58:09.741319+0000","last_peered":"2024-04-26T17:58:09.741319+0000","last_clean":"2024-04-26T17:58:09.741319+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T17:58:09.741319+0000","last_undegraded":"2024-04-26T17:58:09.741319+0000","last_fullsized":"2024-04-26T17:58:09.741319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867042+0000","last_change":"2024-04-26T17:58:04.723700+0000","last_active":"2024-04-26T17:58:09.867042+0000","last_peered":"2024-04-26T17:58:09.867042+0000","last_clean":"2024-04-26T17:58:09.867042+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T17:58:09.867042+0000","last_undegraded":"2024-04-26T17:58:09.867042+0000","last_fullsized":"2024-04-26T17:58:09.867042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:05.637900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866801+0000","last_change":"2024-04-26T17:58:08.746662+0000","last_active":"2024-04-26T17:58:09.866801+0000","last_peered":"2024-04-26T17:58:09.866801+0000","last_clean":"2024-04-26T17:58:09.866801+0000","last_became_active":"2024-04-26T17:58:08.746200+0000","last_became_peered":"2024-04-26T17:58:08.746200+0000","last_unstale":"2024-04-26T17:58:09.866801+0000","last_undegraded":"2024-04-26T17:58:09.866801+0000","last_fullsized":"2024-04-26T17:58:09.866801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:05.431076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740881+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T17:58:09.740881+0000","last_peered":"2024-04-26T17:58:09.740881+0000","last_clean":"2024-04-26T17:58:09.740881+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T17:58:09.740881+0000","last_undegraded":"2024-04-26T17:58:09.740881+0000","last_fullsized":"2024-04-26T17:58:09.740881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867441+0000","last_change":"2024-04-26T17:58:04.723945+0000","last_active":"2024-04-26T17:58:09.867441+0000","last_peered":"2024-04-26T17:58:09.867441+0000","last_clean":"2024-04-26T17:58:09.867441+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T17:58:09.867441+0000","last_undegraded":"2024-04-26T17:58:09.867441+0000","last_fullsized":"2024-04-26T17:58:09.867441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:58.454180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:08.743082+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:56.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742051+0000","last_change":"2024-04-26T17:58:04.715624+0000","last_active":"2024-04-26T17:58:09.742051+0000","last_peered":"2024-04-26T17:58:09.742051+0000","last_clean":"2024-04-26T17:58:09.742051+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T17:58:09.742051+0000","last_undegraded":"2024-04-26T17:58:09.742051+0000","last_fullsized":"2024-04-26T17:58:09.742051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:45.282546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741089+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T17:58:09.741089+0000","last_peered":"2024-04-26T17:58:09.741089+0000","last_clean":"2024-04-26T17:58:09.741089+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T17:58:09.741089+0000","last_undegraded":"2024-04-26T17:58:09.741089+0000","last_fullsized":"2024-04-26T17:58:09.741089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867178+0000","last_change":"2024-04-26T17:58:08.747055+0000","last_active":"2024-04-26T17:58:09.867178+0000","last_peered":"2024-04-26T17:58:09.867178+0000","last_clean":"2024-04-26T17:58:09.867178+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T17:58:09.867178+0000","last_undegraded":"2024-04-26T17:58:09.867178+0000","last_fullsized":"2024-04-26T17:58:09.867178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:38.260141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867917+0000","last_change":"2024-04-26T17:58:04.717982+0000","last_active":"2024-04-26T17:58:09.867917+0000","last_peered":"2024-04-26T17:58:09.867917+0000","last_clean":"2024-04-26T17:58:09.867917+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T17:58:09.867917+0000","last_undegraded":"2024-04-26T17:58:09.867917+0000","last_fullsized":"2024-04-26T17:58:09.867917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:54.094898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868688+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T17:58:09.868688+0000","last_peered":"2024-04-26T17:58:09.868688+0000","last_clean":"2024-04-26T17:58:09.868688+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T17:58:09.868688+0000","last_undegraded":"2024-04-26T17:58:09.868688+0000","last_fullsized":"2024-04-26T17:58:09.868688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867590+0000","last_change":"2024-04-26T17:58:08.747263+0000","last_active":"2024-04-26T17:58:09.867590+0000","last_peered":"2024-04-26T17:58:09.867590+0000","last_clean":"2024-04-26T17:58:09.867590+0000","last_became_active":"2024-04-26T17:58:08.746835+0000","last_became_peered":"2024-04-26T17:58:08.746835+0000","last_unstale":"2024-04-26T17:58:09.867590+0000","last_undegraded":"2024-04-26T17:58:09.867590+0000","last_fullsized":"2024-04-26T17:58:09.867590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:03.581123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867258+0000","last_change":"2024-04-26T17:58:04.717948+0000","last_active":"2024-04-26T17:58:09.867258+0000","last_peered":"2024-04-26T17:58:09.867258+0000","last_clean":"2024-04-26T17:58:09.867258+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T17:58:09.867258+0000","last_undegraded":"2024-04-26T17:58:09.867258+0000","last_fullsized":"2024-04-26T17:58:09.867258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.344820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867168+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T17:58:09.867168+0000","last_peered":"2024-04-26T17:58:09.867168+0000","last_clean":"2024-04-26T17:58:09.867168+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T17:58:09.867168+0000","last_undegraded":"2024-04-26T17:58:09.867168+0000","last_fullsized":"2024-04-26T17:58:09.867168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867165+0000","last_change":"2024-04-26T17:58:08.743822+0000","last_active":"2024-04-26T17:58:09.867165+0000","last_peered":"2024-04-26T17:58:09.867165+0000","last_clean":"2024-04-26T17:58:09.867165+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T17:58:09.867165+0000","last_undegraded":"2024-04-26T17:58:09.867165+0000","last_fullsized":"2024-04-26T17:58:09.867165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:12.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867993+0000","last_change":"2024-04-26T17:58:04.712440+0000","last_active":"2024-04-26T17:58:09.867993+0000","last_peered":"2024-04-26T17:58:09.867993+0000","last_clean":"2024-04-26T17:58:09.867993+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T17:58:09.867993+0000","last_undegraded":"2024-04-26T17:58:09.867993+0000","last_fullsized":"2024-04-26T17:58:09.867993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:30.916890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740538+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T17:58:09.740538+0000","last_peered":"2024-04-26T17:58:09.740538+0000","last_clean":"2024-04-26T17:58:09.740538+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T17:58:09.740538+0000","last_undegraded":"2024-04-26T17:58:09.740538+0000","last_fullsized":"2024-04-26T17:58:09.740538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866990+0000","last_change":"2024-04-26T17:58:08.747104+0000","last_active":"2024-04-26T17:58:09.866990+0000","last_peered":"2024-04-26T17:58:09.866990+0000","last_clean":"2024-04-26T17:58:09.866990+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T17:58:09.866990+0000","last_undegraded":"2024-04-26T17:58:09.866990+0000","last_fullsized":"2024-04-26T17:58:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:19.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867840+0000","last_change":"2024-04-26T17:58:04.715359+0000","last_active":"2024-04-26T17:58:09.867840+0000","last_peered":"2024-04-26T17:58:09.867840+0000","last_clean":"2024-04-26T17:58:09.867840+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T17:58:09.867840+0000","last_undegraded":"2024-04-26T17:58:09.867840+0000","last_fullsized":"2024-04-26T17:58:09.867840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:11.014077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742339+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T17:58:09.742339+0000","last_peered":"2024-04-26T17:58:09.742339+0000","last_clean":"2024-04-26T17:58:09.742339+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T17:58:09.742339+0000","last_undegraded":"2024-04-26T17:58:09.742339+0000","last_fullsized":"2024-04-26T17:58:09.742339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867794+0000","last_change":"2024-04-26T17:58:08.742685+0000","last_active":"2024-04-26T17:58:09.867794+0000","last_peered":"2024-04-26T17:58:09.867794+0000","last_clean":"2024-04-26T17:58:09.867794+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T17:58:09.867794+0000","last_undegraded":"2024-04-26T17:58:09.867794+0000","last_fullsized":"2024-04-26T17:58:09.867794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:49.952963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867465+0000","last_change":"2024-04-26T17:58:04.713980+0000","last_active":"2024-04-26T17:58:09.867465+0000","last_peered":"2024-04-26T17:58:09.867465+0000","last_clean":"2024-04-26T17:58:09.867465+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T17:58:09.867465+0000","last_undegraded":"2024-04-26T17:58:09.867465+0000","last_fullsized":"2024-04-26T17:58:09.867465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:48.678130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867971+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T17:58:09.867971+0000","last_peered":"2024-04-26T17:58:09.867971+0000","last_clean":"2024-04-26T17:58:09.867971+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T17:58:09.867971+0000","last_undegraded":"2024-04-26T17:58:09.867971+0000","last_fullsized":"2024-04-26T17:58:09.867971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867029+0000","last_change":"2024-04-26T17:58:08.746201+0000","last_active":"2024-04-26T17:58:09.867029+0000","last_peered":"2024-04-26T17:58:09.867029+0000","last_clean":"2024-04-26T17:58:09.867029+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T17:58:09.867029+0000","last_undegraded":"2024-04-26T17:58:09.867029+0000","last_fullsized":"2024-04-26T17:58:09.867029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:23.961683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866770+0000","last_change":"2024-04-26T17:58:04.712662+0000","last_active":"2024-04-26T17:58:09.866770+0000","last_peered":"2024-04-26T17:58:09.866770+0000","last_clean":"2024-04-26T17:58:09.866770+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T17:58:09.866770+0000","last_undegraded":"2024-04-26T17:58:09.866770+0000","last_fullsized":"2024-04-26T17:58:09.866770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:37.557975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741512+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T17:58:09.741512+0000","last_peered":"2024-04-26T17:58:09.741512+0000","last_clean":"2024-04-26T17:58:09.741512+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T17:58:09.741512+0000","last_undegraded":"2024-04-26T17:58:09.741512+0000","last_fullsized":"2024-04-26T17:58:09.741512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868118+0000","last_change":"2024-04-26T17:58:08.740345+0000","last_active":"2024-04-26T17:58:09.868118+0000","last_peered":"2024-04-26T17:58:09.868118+0000","last_clean":"2024-04-26T17:58:09.868118+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T17:58:09.868118+0000","last_undegraded":"2024-04-26T17:58:09.868118+0000","last_fullsized":"2024-04-26T17:58:09.868118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:49.324368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867513+0000","last_change":"2024-04-26T17:58:04.726233+0000","last_active":"2024-04-26T17:58:09.867513+0000","last_peered":"2024-04-26T17:58:09.867513+0000","last_clean":"2024-04-26T17:58:09.867513+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T17:58:09.867513+0000","last_undegraded":"2024-04-26T17:58:09.867513+0000","last_fullsized":"2024-04-26T17:58:09.867513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:04.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866859+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T17:58:09.866859+0000","last_peered":"2024-04-26T17:58:09.866859+0000","last_clean":"2024-04-26T17:58:09.866859+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T17:58:09.866859+0000","last_undegraded":"2024-04-26T17:58:09.866859+0000","last_fullsized":"2024-04-26T17:58:09.866859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868258+0000","last_change":"2024-04-26T17:58:08.742909+0000","last_active":"2024-04-26T17:58:09.868258+0000","last_peered":"2024-04-26T17:58:09.868258+0000","last_clean":"2024-04-26T17:58:09.868258+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T17:58:09.868258+0000","last_undegraded":"2024-04-26T17:58:09.868258+0000","last_fullsized":"2024-04-26T17:58:09.868258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:50.554497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867397+0000","last_change":"2024-04-26T17:58:04.708024+0000","last_active":"2024-04-26T17:58:09.867397+0000","last_peered":"2024-04-26T17:58:09.867397+0000","last_clean":"2024-04-26T17:58:09.867397+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T17:58:09.867397+0000","last_undegraded":"2024-04-26T17:58:09.867397+0000","last_fullsized":"2024-04-26T17:58:09.867397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867406+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T17:58:09.867406+0000","last_peered":"2024-04-26T17:58:09.867406+0000","last_clean":"2024-04-26T17:58:09.867406+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T17:58:09.867406+0000","last_undegraded":"2024-04-26T17:58:09.867406+0000","last_fullsized":"2024-04-26T17:58:09.867406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866674+0000","last_change":"2024-04-26T17:58:08.739726+0000","last_active":"2024-04-26T17:58:09.866674+0000","last_peered":"2024-04-26T17:58:09.866674+0000","last_clean":"2024-04-26T17:58:09.866674+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T17:58:09.866674+0000","last_undegraded":"2024-04-26T17:58:09.866674+0000","last_fullsized":"2024-04-26T17:58:09.866674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:08.315753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866446+0000","last_change":"2024-04-26T17:58:04.712446+0000","last_active":"2024-04-26T17:58:09.866446+0000","last_peered":"2024-04-26T17:58:09.866446+0000","last_clean":"2024-04-26T17:58:09.866446+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T17:58:09.866446+0000","last_undegraded":"2024-04-26T17:58:09.866446+0000","last_fullsized":"2024-04-26T17:58:09.866446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:52.484069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739473+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T17:58:09.739473+0000","last_peered":"2024-04-26T17:58:09.739473+0000","last_clean":"2024-04-26T17:58:09.739473+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T17:58:09.739473+0000","last_undegraded":"2024-04-26T17:58:09.739473+0000","last_fullsized":"2024-04-26T17:58:09.739473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867315+0000","last_change":"2024-04-26T17:58:08.742536+0000","last_active":"2024-04-26T17:58:09.867315+0000","last_peered":"2024-04-26T17:58:09.867315+0000","last_clean":"2024-04-26T17:58:09.867315+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T17:58:09.867315+0000","last_undegraded":"2024-04-26T17:58:09.867315+0000","last_fullsized":"2024-04-26T17:58:09.867315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:49.364705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866653+0000","last_change":"2024-04-26T17:58:04.711535+0000","last_active":"2024-04-26T17:58:09.866653+0000","last_peered":"2024-04-26T17:58:09.866653+0000","last_clean":"2024-04-26T17:58:09.866653+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T17:58:09.866653+0000","last_undegraded":"2024-04-26T17:58:09.866653+0000","last_fullsized":"2024-04-26T17:58:09.866653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:11.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740669+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T17:58:09.740669+0000","last_peered":"2024-04-26T17:58:09.740669+0000","last_clean":"2024-04-26T17:58:09.740669+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T17:58:09.740669+0000","last_undegraded":"2024-04-26T17:58:09.740669+0000","last_fullsized":"2024-04-26T17:58:09.740669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867764+0000","last_change":"2024-04-26T17:58:08.734543+0000","last_active":"2024-04-26T17:58:09.867764+0000","last_peered":"2024-04-26T17:58:09.867764+0000","last_clean":"2024-04-26T17:58:09.867764+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T17:58:09.867764+0000","last_undegraded":"2024-04-26T17:58:09.867764+0000","last_fullsized":"2024-04-26T17:58:09.867764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:55.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866271+0000","last_change":"2024-04-26T17:58:04.727199+0000","last_active":"2024-04-26T17:58:09.866271+0000","last_peered":"2024-04-26T17:58:09.866271+0000","last_clean":"2024-04-26T17:58:09.866271+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T17:58:09.866271+0000","last_undegraded":"2024-04-26T17:58:09.866271+0000","last_fullsized":"2024-04-26T17:58:09.866271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:06.483618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867639+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T17:58:09.867639+0000","last_peered":"2024-04-26T17:58:09.867639+0000","last_clean":"2024-04-26T17:58:09.867639+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T17:58:09.867639+0000","last_undegraded":"2024-04-26T17:58:09.867639+0000","last_fullsized":"2024-04-26T17:58:09.867639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740780+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T17:58:09.740780+0000","last_peered":"2024-04-26T17:58:09.740780+0000","last_clean":"2024-04-26T17:58:09.740780+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T17:58:09.740780+0000","last_undegraded":"2024-04-26T17:58:09.740780+0000","last_fullsized":"2024-04-26T17:58:09.740780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741715+0000","last_change":"2024-04-26T17:58:08.737072+0000","last_active":"2024-04-26T17:58:09.741715+0000","last_peered":"2024-04-26T17:58:09.741715+0000","last_clean":"2024-04-26T17:58:09.741715+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T17:58:09.741715+0000","last_undegraded":"2024-04-26T17:58:09.741715+0000","last_fullsized":"2024-04-26T17:58:09.741715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:11.217370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740782+0000","last_change":"2024-04-26T17:58:04.724798+0000","last_active":"2024-04-26T17:58:09.740782+0000","last_peered":"2024-04-26T17:58:09.740782+0000","last_clean":"2024-04-26T17:58:09.740782+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T17:58:09.740782+0000","last_undegraded":"2024-04-26T17:58:09.740782+0000","last_fullsized":"2024-04-26T17:58:09.740782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.707135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739785+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T17:58:09.739785+0000","last_peered":"2024-04-26T17:58:09.739785+0000","last_clean":"2024-04-26T17:58:09.739785+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T17:58:09.739785+0000","last_undegraded":"2024-04-26T17:58:09.739785+0000","last_fullsized":"2024-04-26T17:58:09.739785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741890+0000","last_change":"2024-04-26T17:58:08.735010+0000","last_active":"2024-04-26T17:58:09.741890+0000","last_peered":"2024-04-26T17:58:09.741890+0000","last_clean":"2024-04-26T17:58:09.741890+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T17:58:09.741890+0000","last_undegraded":"2024-04-26T17:58:09.741890+0000","last_fullsized":"2024-04-26T17:58:09.741890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.377179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867215+0000","last_change":"2024-04-26T17:58:04.726744+0000","last_active":"2024-04-26T17:58:09.867215+0000","last_peered":"2024-04-26T17:58:09.867215+0000","last_clean":"2024-04-26T17:58:09.867215+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T17:58:09.867215+0000","last_undegraded":"2024-04-26T17:58:09.867215+0000","last_fullsized":"2024-04-26T17:58:09.867215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:06.654631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868255+0000","last_change":"2024-04-26T17:58:08.748124+0000","last_active":"2024-04-26T17:58:09.868255+0000","last_peered":"2024-04-26T17:58:09.868255+0000","last_clean":"2024-04-26T17:58:09.868255+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T17:58:09.868255+0000","last_undegraded":"2024-04-26T17:58:09.868255+0000","last_fullsized":"2024-04-26T17:58:09.868255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:07.600726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741479+0000","last_change":"2024-04-26T17:58:04.716933+0000","last_active":"2024-04-26T17:58:09.741479+0000","last_peered":"2024-04-26T17:58:09.741479+0000","last_clean":"2024-04-26T17:58:09.741479+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T17:58:09.741479+0000","last_undegraded":"2024-04-26T17:58:09.741479+0000","last_fullsized":"2024-04-26T17:58:09.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:25.360981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739660+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T17:58:09.739660+0000","last_peered":"2024-04-26T17:58:09.739660+0000","last_clean":"2024-04-26T17:58:09.739660+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T17:58:09.739660+0000","last_undegraded":"2024-04-26T17:58:09.739660+0000","last_fullsized":"2024-04-26T17:58:09.739660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866386+0000","last_change":"2024-04-26T17:58:08.737297+0000","last_active":"2024-04-26T17:58:09.866386+0000","last_peered":"2024-04-26T17:58:09.866386+0000","last_clean":"2024-04-26T17:58:09.866386+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T17:58:09.866386+0000","last_undegraded":"2024-04-26T17:58:09.866386+0000","last_fullsized":"2024-04-26T17:58:09.866386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:34.582604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741116+0000","last_change":"2024-04-26T17:58:04.716850+0000","last_active":"2024-04-26T17:58:09.741116+0000","last_peered":"2024-04-26T17:58:09.741116+0000","last_clean":"2024-04-26T17:58:09.741116+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T17:58:09.741116+0000","last_undegraded":"2024-04-26T17:58:09.741116+0000","last_fullsized":"2024-04-26T17:58:09.741116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:35.530627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867994+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T17:58:09.867994+0000","last_peered":"2024-04-26T17:58:09.867994+0000","last_clean":"2024-04-26T17:58:09.867994+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T17:58:09.867994+0000","last_undegraded":"2024-04-26T17:58:09.867994+0000","last_fullsized":"2024-04-26T17:58:09.867994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866728+0000","last_change":"2024-04-26T17:58:08.747644+0000","last_active":"2024-04-26T17:58:09.866728+0000","last_peered":"2024-04-26T17:58:09.866728+0000","last_clean":"2024-04-26T17:58:09.866728+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T17:58:09.866728+0000","last_undegraded":"2024-04-26T17:58:09.866728+0000","last_fullsized":"2024-04-26T17:58:09.866728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.713815+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:08.918386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739376+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T17:58:09.739376+0000","last_peered":"2024-04-26T17:58:09.739376+0000","last_clean":"2024-04-26T17:58:09.739376+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T17:58:09.739376+0000","last_undegraded":"2024-04-26T17:58:09.739376+0000","last_fullsized":"2024-04-26T17:58:09.739376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867630+0000","last_change":"2024-04-26T17:58:08.739259+0000","last_active":"2024-04-26T17:58:09.867630+0000","last_peered":"2024-04-26T17:58:09.867630+0000","last_clean":"2024-04-26T17:58:09.867630+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T17:58:09.867630+0000","last_undegraded":"2024-04-26T17:58:09.867630+0000","last_fullsized":"2024-04-26T17:58:09.867630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:42.110881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740479+0000","last_change":"2024-04-26T17:58:04.717008+0000","last_active":"2024-04-26T17:58:09.740479+0000","last_peered":"2024-04-26T17:58:09.740479+0000","last_clean":"2024-04-26T17:58:09.740479+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T17:58:09.740479+0000","last_undegraded":"2024-04-26T17:58:09.740479+0000","last_fullsized":"2024-04-26T17:58:09.740479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:10.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741681+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T17:58:09.741681+0000","last_peered":"2024-04-26T17:58:09.741681+0000","last_clean":"2024-04-26T17:58:09.741681+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T17:58:09.741681+0000","last_undegraded":"2024-04-26T17:58:09.741681+0000","last_fullsized":"2024-04-26T17:58:09.741681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867276+0000","last_change":"2024-04-26T17:58:08.742774+0000","last_active":"2024-04-26T17:58:09.867276+0000","last_peered":"2024-04-26T17:58:09.867276+0000","last_clean":"2024-04-26T17:58:09.867276+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T17:58:09.867276+0000","last_undegraded":"2024-04-26T17:58:09.867276+0000","last_fullsized":"2024-04-26T17:58:09.867276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:04.231921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741023+0000","last_change":"2024-04-26T17:58:04.712970+0000","last_active":"2024-04-26T17:58:09.741023+0000","last_peered":"2024-04-26T17:58:09.741023+0000","last_clean":"2024-04-26T17:58:09.741023+0000","last_became_active":"2024-04-26T17:58:04.712645+0000","last_became_peered":"2024-04-26T17:58:04.712645+0000","last_unstale":"2024-04-26T17:58:09.741023+0000","last_undegraded":"2024-04-26T17:58:09.741023+0000","last_fullsized":"2024-04-26T17:58:09.741023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:06.746889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867322+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T17:58:09.867322+0000","last_peered":"2024-04-26T17:58:09.867322+0000","last_clean":"2024-04-26T17:58:09.867322+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T17:58:09.867322+0000","last_undegraded":"2024-04-26T17:58:09.867322+0000","last_fullsized":"2024-04-26T17:58:09.867322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868215+0000","last_change":"2024-04-26T17:58:08.741761+0000","last_active":"2024-04-26T17:58:09.868215+0000","last_peered":"2024-04-26T17:58:09.868215+0000","last_clean":"2024-04-26T17:58:09.868215+0000","last_became_active":"2024-04-26T17:58:08.741401+0000","last_became_peered":"2024-04-26T17:58:08.741401+0000","last_unstale":"2024-04-26T17:58:09.868215+0000","last_undegraded":"2024-04-26T17:58:09.868215+0000","last_fullsized":"2024-04-26T17:58:09.868215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:44.837522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867967+0000","last_change":"2024-04-26T17:58:04.705981+0000","last_active":"2024-04-26T17:58:09.867967+0000","last_peered":"2024-04-26T17:58:09.867967+0000","last_clean":"2024-04-26T17:58:09.867967+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T17:58:09.867967+0000","last_undegraded":"2024-04-26T17:58:09.867967+0000","last_fullsized":"2024-04-26T17:58:09.867967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868393+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T17:58:09.868393+0000","last_peered":"2024-04-26T17:58:09.868393+0000","last_clean":"2024-04-26T17:58:09.868393+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T17:58:09.868393+0000","last_undegraded":"2024-04-26T17:58:09.868393+0000","last_fullsized":"2024-04-26T17:58:09.868393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867400+0000","last_change":"2024-04-26T17:58:08.739520+0000","last_active":"2024-04-26T17:58:09.867400+0000","last_peered":"2024-04-26T17:58:09.867400+0000","last_clean":"2024-04-26T17:58:09.867400+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T17:58:09.867400+0000","last_undegraded":"2024-04-26T17:58:09.867400+0000","last_fullsized":"2024-04-26T17:58:09.867400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:10.313792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.719394+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:33.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.307724+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T17:58:17.307724+0000","last_peered":"2024-04-26T17:58:17.307724+0000","last_clean":"2024-04-26T17:58:17.307724+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T17:58:17.307724+0000","last_undegraded":"2024-04-26T17:58:17.307724+0000","last_fullsized":"2024-04-26T17:58:17.307724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868423+0000","last_change":"2024-04-26T17:58:08.736275+0000","last_active":"2024-04-26T17:58:09.868423+0000","last_peered":"2024-04-26T17:58:09.868423+0000","last_clean":"2024-04-26T17:58:09.868423+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T17:58:09.868423+0000","last_undegraded":"2024-04-26T17:58:09.868423+0000","last_fullsized":"2024-04-26T17:58:09.868423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:07.103401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867796+0000","last_change":"2024-04-26T17:58:04.712316+0000","last_active":"2024-04-26T17:58:09.867796+0000","last_peered":"2024-04-26T17:58:09.867796+0000","last_clean":"2024-04-26T17:58:09.867796+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T17:58:09.867796+0000","last_undegraded":"2024-04-26T17:58:09.867796+0000","last_fullsized":"2024-04-26T17:58:09.867796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:49.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866776+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T17:58:09.866776+0000","last_peered":"2024-04-26T17:58:09.866776+0000","last_clean":"2024-04-26T17:58:09.866776+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T17:58:09.866776+0000","last_undegraded":"2024-04-26T17:58:09.866776+0000","last_fullsized":"2024-04-26T17:58:09.866776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867058+0000","last_change":"2024-04-26T17:58:08.742746+0000","last_active":"2024-04-26T17:58:09.867058+0000","last_peered":"2024-04-26T17:58:09.867058+0000","last_clean":"2024-04-26T17:58:09.867058+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T17:58:09.867058+0000","last_undegraded":"2024-04-26T17:58:09.867058+0000","last_fullsized":"2024-04-26T17:58:09.867058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:51.352617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868076+0000","last_change":"2024-04-26T17:58:04.723214+0000","last_active":"2024-04-26T17:58:09.868076+0000","last_peered":"2024-04-26T17:58:09.868076+0000","last_clean":"2024-04-26T17:58:09.868076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T17:58:09.868076+0000","last_undegraded":"2024-04-26T17:58:09.868076+0000","last_fullsized":"2024-04-26T17:58:09.868076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:08.558197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867696+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T17:58:09.867696+0000","last_peered":"2024-04-26T17:58:09.867696+0000","last_clean":"2024-04-26T17:58:09.867696+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T17:58:09.867696+0000","last_undegraded":"2024-04-26T17:58:09.867696+0000","last_fullsized":"2024-04-26T17:58:09.867696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867239+0000","last_change":"2024-04-26T17:58:08.745044+0000","last_active":"2024-04-26T17:58:09.867239+0000","last_peered":"2024-04-26T17:58:09.867239+0000","last_clean":"2024-04-26T17:58:09.867239+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T17:58:09.867239+0000","last_undegraded":"2024-04-26T17:58:09.867239+0000","last_fullsized":"2024-04-26T17:58:09.867239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:53.339198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867490+0000","last_change":"2024-04-26T17:58:04.720903+0000","last_active":"2024-04-26T17:58:09.867490+0000","last_peered":"2024-04-26T17:58:09.867490+0000","last_clean":"2024-04-26T17:58:09.867490+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T17:58:09.867490+0000","last_undegraded":"2024-04-26T17:58:09.867490+0000","last_fullsized":"2024-04-26T17:58:09.867490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:46.583637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742161+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T17:58:09.742161+0000","last_peered":"2024-04-26T17:58:09.742161+0000","last_clean":"2024-04-26T17:58:09.742161+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T17:58:09.742161+0000","last_undegraded":"2024-04-26T17:58:09.742161+0000","last_fullsized":"2024-04-26T17:58:09.742161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867269+0000","last_change":"2024-04-26T17:58:08.743119+0000","last_active":"2024-04-26T17:58:09.867269+0000","last_peered":"2024-04-26T17:58:09.867269+0000","last_clean":"2024-04-26T17:58:09.867269+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T17:58:09.867269+0000","last_undegraded":"2024-04-26T17:58:09.867269+0000","last_fullsized":"2024-04-26T17:58:09.867269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:41.640200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867500+0000","last_change":"2024-04-26T17:58:08.739999+0000","last_active":"2024-04-26T17:58:09.867500+0000","last_peered":"2024-04-26T17:58:09.867500+0000","last_clean":"2024-04-26T17:58:09.867500+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T17:58:09.867500+0000","last_undegraded":"2024-04-26T17:58:09.867500+0000","last_fullsized":"2024-04-26T17:58:09.867500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:30.637006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866996+0000","last_change":"2024-04-26T17:58:04.719069+0000","last_active":"2024-04-26T17:58:09.866996+0000","last_peered":"2024-04-26T17:58:09.866996+0000","last_clean":"2024-04-26T17:58:09.866996+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T17:58:09.866996+0000","last_undegraded":"2024-04-26T17:58:09.866996+0000","last_fullsized":"2024-04-26T17:58:09.866996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:09.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867009+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T17:58:09.867009+0000","last_peered":"2024-04-26T17:58:09.867009+0000","last_clean":"2024-04-26T17:58:09.867009+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T17:58:09.867009+0000","last_undegraded":"2024-04-26T17:58:09.867009+0000","last_fullsized":"2024-04-26T17:58:09.867009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741957+0000","last_change":"2024-04-26T17:58:08.738167+0000","last_active":"2024-04-26T17:58:09.741957+0000","last_peered":"2024-04-26T17:58:09.741957+0000","last_clean":"2024-04-26T17:58:09.741957+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T17:58:09.741957+0000","last_undegraded":"2024-04-26T17:58:09.741957+0000","last_fullsized":"2024-04-26T17:58:09.741957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:42.434088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867177+0000","last_change":"2024-04-26T17:58:04.717580+0000","last_active":"2024-04-26T17:58:09.867177+0000","last_peered":"2024-04-26T17:58:09.867177+0000","last_clean":"2024-04-26T17:58:09.867177+0000","last_became_active":"2024-04-26T17:58:04.717313+0000","last_became_peered":"2024-04-26T17:58:04.717313+0000","last_unstale":"2024-04-26T17:58:09.867177+0000","last_undegraded":"2024-04-26T17:58:09.867177+0000","last_fullsized":"2024-04-26T17:58:09.867177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:54.802557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867508+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T17:58:09.867508+0000","last_peered":"2024-04-26T17:58:09.867508+0000","last_clean":"2024-04-26T17:58:09.867508+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T17:58:09.867508+0000","last_undegraded":"2024-04-26T17:58:09.867508+0000","last_fullsized":"2024-04-26T17:58:09.867508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742229+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T17:58:09.742229+0000","last_peered":"2024-04-26T17:58:09.742229+0000","last_clean":"2024-04-26T17:58:09.742229+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T17:58:09.742229+0000","last_undegraded":"2024-04-26T17:58:09.742229+0000","last_fullsized":"2024-04-26T17:58:09.742229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868345+0000","last_change":"2024-04-26T17:58:04.713025+0000","last_active":"2024-04-26T17:58:09.868345+0000","last_peered":"2024-04-26T17:58:09.868345+0000","last_clean":"2024-04-26T17:58:09.868345+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T17:58:09.868345+0000","last_undegraded":"2024-04-26T17:58:09.868345+0000","last_fullsized":"2024-04-26T17:58:09.868345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:35.294319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739719+0000","last_change":"2024-04-26T17:58:08.739580+0000","last_active":"2024-04-26T17:58:09.739719+0000","last_peered":"2024-04-26T17:58:09.739719+0000","last_clean":"2024-04-26T17:58:09.739719+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T17:58:09.739719+0000","last_undegraded":"2024-04-26T17:58:09.739719+0000","last_fullsized":"2024-04-26T17:58:09.739719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.613945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868520+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T17:58:09.868520+0000","last_peered":"2024-04-26T17:58:09.868520+0000","last_clean":"2024-04-26T17:58:09.868520+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T17:58:09.868520+0000","last_undegraded":"2024-04-26T17:58:09.868520+0000","last_fullsized":"2024-04-26T17:58:09.868520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867109+0000","last_change":"2024-04-26T17:58:04.712809+0000","last_active":"2024-04-26T17:58:09.867109+0000","last_peered":"2024-04-26T17:58:09.867109+0000","last_clean":"2024-04-26T17:58:09.867109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T17:58:09.867109+0000","last_undegraded":"2024-04-26T17:58:09.867109+0000","last_fullsized":"2024-04-26T17:58:09.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:27.667789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866917+0000","last_change":"2024-04-26T17:58:08.738098+0000","last_active":"2024-04-26T17:58:09.866917+0000","last_peered":"2024-04-26T17:58:09.866917+0000","last_clean":"2024-04-26T17:58:09.866917+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T17:58:09.866917+0000","last_undegraded":"2024-04-26T17:58:09.866917+0000","last_fullsized":"2024-04-26T17:58:09.866917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:46.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740387+0000","last_change":"2024-04-26T17:58:04.717040+0000","last_active":"2024-04-26T17:58:09.740387+0000","last_peered":"2024-04-26T17:58:09.740387+0000","last_clean":"2024-04-26T17:58:09.740387+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T17:58:09.740387+0000","last_undegraded":"2024-04-26T17:58:09.740387+0000","last_fullsized":"2024-04-26T17:58:09.740387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739474+0000","last_change":"2024-04-26T17:58:04.717913+0000","last_active":"2024-04-26T17:58:09.739474+0000","last_peered":"2024-04-26T17:58:09.739474+0000","last_clean":"2024-04-26T17:58:09.739474+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T17:58:09.739474+0000","last_undegraded":"2024-04-26T17:58:09.739474+0000","last_fullsized":"2024-04-26T17:58:09.739474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:58.220321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867259+0000","last_change":"2024-04-26T17:58:04.726316+0000","last_active":"2024-04-26T17:58:09.867259+0000","last_peered":"2024-04-26T17:58:09.867259+0000","last_clean":"2024-04-26T17:58:09.867259+0000","last_became_active":"2024-04-26T17:58:04.726079+0000","last_became_peered":"2024-04-26T17:58:04.726079+0000","last_unstale":"2024-04-26T17:58:09.867259+0000","last_undegraded":"2024-04-26T17:58:09.867259+0000","last_fullsized":"2024-04-26T17:58:09.867259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:52.023348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868301+0000","last_change":"2024-04-26T17:58:04.718894+0000","last_active":"2024-04-26T17:58:09.868301+0000","last_peered":"2024-04-26T17:58:09.868301+0000","last_clean":"2024-04-26T17:58:09.868301+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T17:58:09.868301+0000","last_undegraded":"2024-04-26T17:58:09.868301+0000","last_fullsized":"2024-04-26T17:58:09.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:08.169756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868428+0000","last_change":"2024-04-26T17:58:04.717545+0000","last_active":"2024-04-26T17:58:09.868428+0000","last_peered":"2024-04-26T17:58:09.868428+0000","last_clean":"2024-04-26T17:58:09.868428+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T17:58:09.868428+0000","last_undegraded":"2024-04-26T17:58:09.868428+0000","last_fullsized":"2024-04-26T17:58:09.868428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:22.541323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866628+0000","last_change":"2024-04-26T17:58:04.719000+0000","last_active":"2024-04-26T17:58:09.866628+0000","last_peered":"2024-04-26T17:58:09.866628+0000","last_clean":"2024-04-26T17:58:09.866628+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T17:58:09.866628+0000","last_undegraded":"2024-04-26T17:58:09.866628+0000","last_fullsized":"2024-04-26T17:58:09.866628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:39.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741672+0000","last_change":"2024-04-26T17:58:04.719202+0000","last_active":"2024-04-26T17:58:09.741672+0000","last_peered":"2024-04-26T17:58:09.741672+0000","last_clean":"2024-04-26T17:58:09.741672+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T17:58:09.741672+0000","last_undegraded":"2024-04-26T17:58:09.741672+0000","last_fullsized":"2024-04-26T17:58:09.741672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:09.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867378+0000","last_change":"2024-04-26T17:58:04.717329+0000","last_active":"2024-04-26T17:58:09.867378+0000","last_peered":"2024-04-26T17:58:09.867378+0000","last_clean":"2024-04-26T17:58:09.867378+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T17:58:09.867378+0000","last_undegraded":"2024-04-26T17:58:09.867378+0000","last_fullsized":"2024-04-26T17:58:09.867378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:05.365008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866573+0000","last_change":"2024-04-26T17:58:04.727246+0000","last_active":"2024-04-26T17:58:09.866573+0000","last_peered":"2024-04-26T17:58:09.866573+0000","last_clean":"2024-04-26T17:58:09.866573+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T17:58:09.866573+0000","last_undegraded":"2024-04-26T17:58:09.866573+0000","last_fullsized":"2024-04-26T17:58:09.866573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:48.343210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867408+0000","last_change":"2024-04-26T17:58:04.713698+0000","last_active":"2024-04-26T17:58:09.867408+0000","last_peered":"2024-04-26T17:58:09.867408+0000","last_clean":"2024-04-26T17:58:09.867408+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T17:58:09.867408+0000","last_undegraded":"2024-04-26T17:58:09.867408+0000","last_fullsized":"2024-04-26T17:58:09.867408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:46.523995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867161+0000","last_change":"2024-04-26T17:58:04.724480+0000","last_active":"2024-04-26T17:58:09.867161+0000","last_peered":"2024-04-26T17:58:09.867161+0000","last_clean":"2024-04-26T17:58:09.867161+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T17:58:09.867161+0000","last_undegraded":"2024-04-26T17:58:09.867161+0000","last_fullsized":"2024-04-26T17:58:09.867161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:55.314208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868176+0000","last_change":"2024-04-26T17:58:04.708369+0000","last_active":"2024-04-26T17:58:09.868176+0000","last_peered":"2024-04-26T17:58:09.868176+0000","last_clean":"2024-04-26T17:58:09.868176+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T17:58:09.868176+0000","last_undegraded":"2024-04-26T17:58:09.868176+0000","last_fullsized":"2024-04-26T17:58:09.868176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:03.947874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741418+0000","last_change":"2024-04-26T17:58:04.714104+0000","last_active":"2024-04-26T17:58:09.741418+0000","last_peered":"2024-04-26T17:58:09.741418+0000","last_clean":"2024-04-26T17:58:09.741418+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T17:58:09.741418+0000","last_undegraded":"2024-04-26T17:58:09.741418+0000","last_fullsized":"2024-04-26T17:58:09.741418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:00.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741424+0000","last_change":"2024-04-26T17:58:04.714925+0000","last_active":"2024-04-26T17:58:09.741424+0000","last_peered":"2024-04-26T17:58:09.741424+0000","last_clean":"2024-04-26T17:58:09.741424+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T17:58:09.741424+0000","last_undegraded":"2024-04-26T17:58:09.741424+0000","last_fullsized":"2024-04-26T17:58:09.741424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.669034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739622+0000","last_change":"2024-04-26T17:58:04.714674+0000","last_active":"2024-04-26T17:58:09.739622+0000","last_peered":"2024-04-26T17:58:09.739622+0000","last_clean":"2024-04-26T17:58:09.739622+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T17:58:09.739622+0000","last_undegraded":"2024-04-26T17:58:09.739622+0000","last_fullsized":"2024-04-26T17:58:09.739622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:12.918478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867942+0000","last_change":"2024-04-26T17:58:04.722294+0000","last_active":"2024-04-26T17:58:09.867942+0000","last_peered":"2024-04-26T17:58:09.867942+0000","last_clean":"2024-04-26T17:58:09.867942+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T17:58:09.867942+0000","last_undegraded":"2024-04-26T17:58:09.867942+0000","last_fullsized":"2024-04-26T17:58:09.867942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:31.169681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866409+0000","last_change":"2024-04-26T17:58:04.725629+0000","last_active":"2024-04-26T17:58:09.866409+0000","last_peered":"2024-04-26T17:58:09.866409+0000","last_clean":"2024-04-26T17:58:09.866409+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T17:58:09.866409+0000","last_undegraded":"2024-04-26T17:58:09.866409+0000","last_fullsized":"2024-04-26T17:58:09.866409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:06.389060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867083+0000","last_change":"2024-04-26T17:58:04.716814+0000","last_active":"2024-04-26T17:58:09.867083+0000","last_peered":"2024-04-26T17:58:09.867083+0000","last_clean":"2024-04-26T17:58:09.867083+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T17:58:09.867083+0000","last_undegraded":"2024-04-26T17:58:09.867083+0000","last_fullsized":"2024-04-26T17:58:09.867083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:38.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867941+0000","last_change":"2024-04-26T17:58:04.715233+0000","last_active":"2024-04-26T17:58:09.867941+0000","last_peered":"2024-04-26T17:58:09.867941+0000","last_clean":"2024-04-26T17:58:09.867941+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T17:58:09.867941+0000","last_undegraded":"2024-04-26T17:58:09.867941+0000","last_fullsized":"2024-04-26T17:58:09.867941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:24.469756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867686+0000","last_change":"2024-04-26T17:58:04.722576+0000","last_active":"2024-04-26T17:58:09.867686+0000","last_peered":"2024-04-26T17:58:09.867686+0000","last_clean":"2024-04-26T17:58:09.867686+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T17:58:09.867686+0000","last_undegraded":"2024-04-26T17:58:09.867686+0000","last_fullsized":"2024-04-26T17:58:09.867686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:33.150267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867768+0000","last_change":"2024-04-26T17:58:04.712057+0000","last_active":"2024-04-26T17:58:09.867768+0000","last_peered":"2024-04-26T17:58:09.867768+0000","last_clean":"2024-04-26T17:58:09.867768+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T17:58:09.867768+0000","last_undegraded":"2024-04-26T17:58:09.867768+0000","last_fullsized":"2024-04-26T17:58:09.867768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:12.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741771+0000","last_change":"2024-04-26T17:58:04.727743+0000","last_active":"2024-04-26T17:58:09.741771+0000","last_peered":"2024-04-26T17:58:09.741771+0000","last_clean":"2024-04-26T17:58:09.741771+0000","last_became_active":"2024-04-26T17:58:04.727395+0000","last_became_peered":"2024-04-26T17:58:04.727395+0000","last_unstale":"2024-04-26T17:58:09.741771+0000","last_undegraded":"2024-04-26T17:58:09.741771+0000","last_fullsized":"2024-04-26T17:58:09.741771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:07.625978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741634+0000","last_change":"2024-04-26T17:58:04.727074+0000","last_active":"2024-04-26T17:58:09.741634+0000","last_peered":"2024-04-26T17:58:09.741634+0000","last_clean":"2024-04-26T17:58:09.741634+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T17:58:09.741634+0000","last_undegraded":"2024-04-26T17:58:09.741634+0000","last_fullsized":"2024-04-26T17:58:09.741634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:17.157157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741450+0000","last_change":"2024-04-26T17:58:04.723761+0000","last_active":"2024-04-26T17:58:09.741450+0000","last_peered":"2024-04-26T17:58:09.741450+0000","last_clean":"2024-04-26T17:58:09.741450+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T17:58:09.741450+0000","last_undegraded":"2024-04-26T17:58:09.741450+0000","last_fullsized":"2024-04-26T17:58:09.741450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:02.783054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867096+0000","last_change":"2024-04-26T17:58:04.724094+0000","last_active":"2024-04-26T17:58:09.867096+0000","last_peered":"2024-04-26T17:58:09.867096+0000","last_clean":"2024-04-26T17:58:09.867096+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T17:58:09.867096+0000","last_undegraded":"2024-04-26T17:58:09.867096+0000","last_fullsized":"2024-04-26T17:58:09.867096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:26.825638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740858+0000","last_change":"2024-04-26T17:58:04.713653+0000","last_active":"2024-04-26T17:58:09.740858+0000","last_peered":"2024-04-26T17:58:09.740858+0000","last_clean":"2024-04-26T17:58:09.740858+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T17:58:09.740858+0000","last_undegraded":"2024-04-26T17:58:09.740858+0000","last_fullsized":"2024-04-26T17:58:09.740858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:10.715579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867111+0000","last_change":"2024-04-26T17:58:04.725695+0000","last_active":"2024-04-26T17:58:09.867111+0000","last_peered":"2024-04-26T17:58:09.867111+0000","last_clean":"2024-04-26T17:58:09.867111+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T17:58:09.867111+0000","last_undegraded":"2024-04-26T17:58:09.867111+0000","last_fullsized":"2024-04-26T17:58:09.867111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:16.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740772+0000","last_change":"2024-04-26T17:58:04.712059+0000","last_active":"2024-04-26T17:58:09.740772+0000","last_peered":"2024-04-26T17:58:09.740772+0000","last_clean":"2024-04-26T17:58:09.740772+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T17:58:09.740772+0000","last_undegraded":"2024-04-26T17:58:09.740772+0000","last_fullsized":"2024-04-26T17:58:09.740772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:53.798495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867547+0000","last_change":"2024-04-26T17:58:04.726921+0000","last_active":"2024-04-26T17:58:09.867547+0000","last_peered":"2024-04-26T17:58:09.867547+0000","last_clean":"2024-04-26T17:58:09.867547+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T17:58:09.867547+0000","last_undegraded":"2024-04-26T17:58:09.867547+0000","last_fullsized":"2024-04-26T17:58:09.867547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:10.889230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867692+0000","last_change":"2024-04-26T17:58:04.714479+0000","last_active":"2024-04-26T17:58:09.867692+0000","last_peered":"2024-04-26T17:58:09.867692+0000","last_clean":"2024-04-26T17:58:09.867692+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T17:58:09.867692+0000","last_undegraded":"2024-04-26T17:58:09.867692+0000","last_fullsized":"2024-04-26T17:58:09.867692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:11.224793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867830+0000","last_change":"2024-04-26T17:58:04.715128+0000","last_active":"2024-04-26T17:58:09.867830+0000","last_peered":"2024-04-26T17:58:09.867830+0000","last_clean":"2024-04-26T17:58:09.867830+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T17:58:09.867830+0000","last_undegraded":"2024-04-26T17:58:09.867830+0000","last_fullsized":"2024-04-26T17:58:09.867830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:28.531949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741199+0000","last_change":"2024-04-26T17:58:04.719415+0000","last_active":"2024-04-26T17:58:09.741199+0000","last_peered":"2024-04-26T17:58:09.741199+0000","last_clean":"2024-04-26T17:58:09.741199+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T17:58:09.741199+0000","last_undegraded":"2024-04-26T17:58:09.741199+0000","last_fullsized":"2024-04-26T17:58:09.741199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:55.030120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:33.114 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:33.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.246+0000 7f119f7f0640 1 Processor -- start 2024-04-26T17:58:33.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.246+0000 7f119f7f0640 1 -- start start 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119f7f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119f7f0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f119806e240 0x7f11980cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119f7f0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11980c7d30 con 0x7f11980cd9a0 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119f7f0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f119806e8d0 con 0x7f119806e240 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119f7f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1198073910 con 0x7f1198153b10 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119cd8b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f119806e240 0x7f11980cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119cd8b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f119806e240 0x7f11980cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36680/0 (socket says 172.21.15.139:36680) 2024-04-26T17:58:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119cd8b640 1 -- 172.21.15.139:0/3462431040 learned_addr learned my addr 172.21.15.139:0/3462431040 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119d58c640 1 --2- 172.21.15.139:0/3462431040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119cd8b640 1 -- 172.21.15.139:0/3462431040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 msgr2=0x7f11980c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119cd8b640 1 --2- 172.21.15.139:0/3462431040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119cd8b640 1 -- 172.21.15.139:0/3462431040 >> v1:172.21.15.143:6789/0 conn(0x7f11980cd9a0 legacy=0x7f119815ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.247+0000 7f119cd8b640 1 -- 172.21.15.139:0/3462431040 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11980c7ff0 con 0x7f119806e240 2024-04-26T17:58:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f119cd8b640 1 --2- 172.21.15.139:0/3462431040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f11980cd460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1188009870 tx=0x7f118802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68a3e3b62b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f118ffff640 1 -- 172.21.15.139:0/3462431040 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188037070 con 0x7f119806e240 2024-04-26T17:58:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f118ffff640 1 -- 172.21.15.139:0/3462431040 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f118802ae50 con 0x7f119806e240 2024-04-26T17:58:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f118ffff640 1 -- 172.21.15.139:0/3462431040 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188032860 con 0x7f119806e240 2024-04-26T17:58:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f119f7f0640 1 -- 172.21.15.139:0/3462431040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 msgr2=0x7f11980cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f119f7f0640 1 --2- 172.21.15.139:0/3462431040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f11980cd460 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1188009870 tx=0x7f118802a300 comp rx=0 tx=0).stop 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f119f7f0640 1 -- 172.21.15.139:0/3462431040 shutdown_connections 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f119f7f0640 1 --2- 172.21.15.139:0/3462431040 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f11980cd460 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f119f7f0640 1 --2- 172.21.15.139:0/3462431040 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.248+0000 7f119f7f0640 1 -- 172.21.15.139:0/3462431040 >> 172.21.15.139:0/3462431040 conn(0x7f1198068270 msgr2=0x7f1198068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.249+0000 7f119f7f0640 1 -- 172.21.15.139:0/3462431040 shutdown_connections 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.249+0000 7f119f7f0640 1 -- 172.21.15.139:0/3462431040 wait complete. 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 Processor -- start 2024-04-26T17:58:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 -- start start 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f1198149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11980cd9a0 0x7f11980cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f11980735a0 con 0x7f119806e240 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f11980732c0 con 0x7f11980cd9a0 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119f7f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1198153ef0 con 0x7f1198153b10 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119d58c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f1198149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119d58c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f1198149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36694/0 (socket says 172.21.15.139:36694) 2024-04-26T17:58:33.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.250+0000 7f119d58c640 1 -- 172.21.15.139:0/2150126686 learned_addr learned my addr 172.21.15.139:0/2150126686 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119cd8b640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11980cd9a0 0x7f11980cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119dd8d640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119d58c640 1 -- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 msgr2=0x7f11980cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119d58c640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119d58c640 1 -- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11980cd9a0 msgr2=0x7f11980cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119d58c640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11980cd9a0 0x7f11980cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119d58c640 1 -- 172.21.15.139:0/2150126686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11981efa10 con 0x7f119806e240 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119cd8b640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11980cd9a0 0x7f11980cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119d58c640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f1198149770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f119400d5f0 tx=0x7f119400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f118dffb640 1 -- 172.21.15.139:0/2150126686 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940125f0 con 0x7f119806e240 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f118dffb640 1 -- 172.21.15.139:0/2150126686 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1194019070 con 0x7f119806e240 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11981efcf0 con 0x7f119806e240 2024-04-26T17:58:33.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f118dffb640 1 -- 172.21.15.139:0/2150126686 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940129d0 con 0x7f119806e240 2024-04-26T17:58:33.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.251+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11981f02b0 con 0x7f119806e240 2024-04-26T17:58:33.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.252+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1198076d20 con 0x7f119806e240 2024-04-26T17:58:33.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.253+0000 7f118dffb640 1 -- 172.21.15.139:0/2150126686 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1194012b70 con 0x7f119806e240 2024-04-26T17:58:33.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.253+0000 7f118dffb640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117c06c8f0 0x7f117c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.253+0000 7f118dffb640 1 -- 172.21.15.139:0/2150126686 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f119408c250 con 0x7f119806e240 2024-04-26T17:58:33.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.253+0000 7f119cd8b640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117c06c8f0 0x7f117c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.253+0000 7f119cd8b640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117c06c8f0 0x7f117c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1188034000 tx=0x7f118802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.257+0000 7f118dffb640 1 -- 172.21.15.139:0/2150126686 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f119405a340 con 0x7f119806e240 2024-04-26T17:58:33.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.429+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11981509d0 con 0x7f117c06c8f0 2024-04-26T17:58:33.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.436+0000 7f118dffb640 1 -- 172.21.15.139:0/2150126686 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f11981509d0 con 0x7f117c06c8f0 2024-04-26T17:58:33.440 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:33.441 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T17:58:33.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117c06c8f0 msgr2=0x7f117c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117c06c8f0 0x7f117c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1188034000 tx=0x7f118802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:33.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 msgr2=0x7f1198149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f1198149770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f119400d5f0 tx=0x7f119400dab0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 shutdown_connections 2024-04-26T17:58:33.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f117c06c8f0 0x7f117c06edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1198153b10 0x7f11980cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11980cd9a0 0x7f11980cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 --2- 172.21.15.139:0/2150126686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f119806e240 0x7f1198149770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 >> 172.21.15.139:0/2150126686 conn(0x7f1198068270 msgr2=0x7f119814e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 shutdown_connections 2024-04-26T17:58:33.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.440+0000 7f119f7f0640 1 -- 172.21.15.139:0/2150126686 wait complete. 2024-04-26T17:58:33.450 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-26T17:58:33.032834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867920+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T17:58:09.867920+0000","last_peered":"2024-04-26T17:58:09.867920+0000","last_clean":"2024-04-26T17:58:09.867920+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T17:58:09.867920+0000","last_undegraded":"2024-04-26T17:58:09.867920+0000","last_fullsized":"2024-04-26T17:58:09.867920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866709+0000","last_change":"2024-04-26T17:58:04.721568+0000","last_active":"2024-04-26T17:58:09.866709+0000","last_peered":"2024-04-26T17:58:09.866709+0000","last_clean":"2024-04-26T17:58:09.866709+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T17:58:09.866709+0000","last_undegraded":"2024-04-26T17:58:09.866709+0000","last_fullsized":"2024-04-26T17:58:09.866709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:24.906240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867369+0000","last_change":"2024-04-26T17:58:08.737557+0000","last_active":"2024-04-26T17:58:09.867369+0000","last_peered":"2024-04-26T17:58:09.867369+0000","last_clean":"2024-04-26T17:58:09.867369+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T17:58:09.867369+0000","last_undegraded":"2024-04-26T17:58:09.867369+0000","last_fullsized":"2024-04-26T17:58:09.867369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:29.013280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866886+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T17:58:09.866886+0000","last_peered":"2024-04-26T17:58:09.866886+0000","last_clean":"2024-04-26T17:58:09.866886+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T17:58:09.866886+0000","last_undegraded":"2024-04-26T17:58:09.866886+0000","last_fullsized":"2024-04-26T17:58:09.866886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867706+0000","last_change":"2024-04-26T17:58:04.725200+0000","last_active":"2024-04-26T17:58:09.867706+0000","last_peered":"2024-04-26T17:58:09.867706+0000","last_clean":"2024-04-26T17:58:09.867706+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T17:58:09.867706+0000","last_undegraded":"2024-04-26T17:58:09.867706+0000","last_fullsized":"2024-04-26T17:58:09.867706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:15.882481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866726+0000","last_change":"2024-04-26T17:58:08.747272+0000","last_active":"2024-04-26T17:58:09.866726+0000","last_peered":"2024-04-26T17:58:09.866726+0000","last_clean":"2024-04-26T17:58:09.866726+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T17:58:09.866726+0000","last_undegraded":"2024-04-26T17:58:09.866726+0000","last_fullsized":"2024-04-26T17:58:09.866726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:08.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741319+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T17:58:09.741319+0000","last_peered":"2024-04-26T17:58:09.741319+0000","last_clean":"2024-04-26T17:58:09.741319+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T17:58:09.741319+0000","last_undegraded":"2024-04-26T17:58:09.741319+0000","last_fullsized":"2024-04-26T17:58:09.741319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867042+0000","last_change":"2024-04-26T17:58:04.723700+0000","last_active":"2024-04-26T17:58:09.867042+0000","last_peered":"2024-04-26T17:58:09.867042+0000","last_clean":"2024-04-26T17:58:09.867042+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T17:58:09.867042+0000","last_undegraded":"2024-04-26T17:58:09.867042+0000","last_fullsized":"2024-04-26T17:58:09.867042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:05.637900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866801+0000","last_change":"2024-04-26T17:58:08.746662+0000","last_active":"2024-04-26T17:58:09.866801+0000","last_peered":"2024-04-26T17:58:09.866801+0000","last_clean":"2024-04-26T17:58:09.866801+0000","last_became_active":"2024-04-26T17:58:08.746200+0000","last_became_peered":"2024-04-26T17:58:08.746200+0000","last_unstale":"2024-04-26T17:58:09.866801+0000","last_undegraded":"2024-04-26T17:58:09.866801+0000","last_fullsized":"2024-04-26T17:58:09.866801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:05.431076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740881+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T17:58:09.740881+0000","last_peered":"2024-04-26T17:58:09.740881+0000","last_clean":"2024-04-26T17:58:09.740881+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T17:58:09.740881+0000","last_undegraded":"2024-04-26T17:58:09.740881+0000","last_fullsized":"2024-04-26T17:58:09.740881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867441+0000","last_change":"2024-04-26T17:58:04.723945+0000","last_active":"2024-04-26T17:58:09.867441+0000","last_peered":"2024-04-26T17:58:09.867441+0000","last_clean":"2024-04-26T17:58:09.867441+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T17:58:09.867441+0000","last_undegraded":"2024-04-26T17:58:09.867441+0000","last_fullsized":"2024-04-26T17:58:09.867441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:58.454180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:08.743082+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:56.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742051+0000","last_change":"2024-04-26T17:58:04.715624+0000","last_active":"2024-04-26T17:58:09.742051+0000","last_peered":"2024-04-26T17:58:09.742051+0000","last_clean":"2024-04-26T17:58:09.742051+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T17:58:09.742051+0000","last_undegraded":"2024-04-26T17:58:09.742051+0000","last_fullsized":"2024-04-26T17:58:09.742051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:45.282546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741089+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T17:58:09.741089+0000","last_peered":"2024-04-26T17:58:09.741089+0000","last_clean":"2024-04-26T17:58:09.741089+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T17:58:09.741089+0000","last_undegraded":"2024-04-26T17:58:09.741089+0000","last_fullsized":"2024-04-26T17:58:09.741089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867178+0000","last_change":"2024-04-26T17:58:08.747055+0000","last_active":"2024-04-26T17:58:09.867178+0000","last_peered":"2024-04-26T17:58:09.867178+0000","last_clean":"2024-04-26T17:58:09.867178+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T17:58:09.867178+0000","last_undegraded":"2024-04-26T17:58:09.867178+0000","last_fullsized":"2024-04-26T17:58:09.867178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:38.260141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867917+0000","last_change":"2024-04-26T17:58:04.717982+0000","last_active":"2024-04-26T17:58:09.867917+0000","last_peered":"2024-04-26T17:58:09.867917+0000","last_clean":"2024-04-26T17:58:09.867917+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T17:58:09.867917+0000","last_undegraded":"2024-04-26T17:58:09.867917+0000","last_fullsized":"2024-04-26T17:58:09.867917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:54.094898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868688+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T17:58:09.868688+0000","last_peered":"2024-04-26T17:58:09.868688+0000","last_clean":"2024-04-26T17:58:09.868688+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T17:58:09.868688+0000","last_undegraded":"2024-04-26T17:58:09.868688+0000","last_fullsized":"2024-04-26T17:58:09.868688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867590+0000","last_change":"2024-04-26T17:58:08.747263+0000","last_active":"2024-04-26T17:58:09.867590+0000","last_peered":"2024-04-26T17:58:09.867590+0000","last_clean":"2024-04-26T17:58:09.867590+0000","last_became_active":"2024-04-26T17:58:08.746835+0000","last_became_peered":"2024-04-26T17:58:08.746835+0000","last_unstale":"2024-04-26T17:58:09.867590+0000","last_undegraded":"2024-04-26T17:58:09.867590+0000","last_fullsized":"2024-04-26T17:58:09.867590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:03.581123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867258+0000","last_change":"2024-04-26T17:58:04.717948+0000","last_active":"2024-04-26T17:58:09.867258+0000","last_peered":"2024-04-26T17:58:09.867258+0000","last_clean":"2024-04-26T17:58:09.867258+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T17:58:09.867258+0000","last_undegraded":"2024-04-26T17:58:09.867258+0000","last_fullsized":"2024-04-26T17:58:09.867258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.344820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867168+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T17:58:09.867168+0000","last_peered":"2024-04-26T17:58:09.867168+0000","last_clean":"2024-04-26T17:58:09.867168+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T17:58:09.867168+0000","last_undegraded":"2024-04-26T17:58:09.867168+0000","last_fullsized":"2024-04-26T17:58:09.867168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867165+0000","last_change":"2024-04-26T17:58:08.743822+0000","last_active":"2024-04-26T17:58:09.867165+0000","last_peered":"2024-04-26T17:58:09.867165+0000","last_clean":"2024-04-26T17:58:09.867165+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T17:58:09.867165+0000","last_undegraded":"2024-04-26T17:58:09.867165+0000","last_fullsized":"2024-04-26T17:58:09.867165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:12.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867993+0000","last_change":"2024-04-26T17:58:04.712440+0000","last_active":"2024-04-26T17:58:09.867993+0000","last_peered":"2024-04-26T17:58:09.867993+0000","last_clean":"2024-04-26T17:58:09.867993+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T17:58:09.867993+0000","last_undegraded":"2024-04-26T17:58:09.867993+0000","last_fullsized":"2024-04-26T17:58:09.867993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:30.916890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740538+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T17:58:09.740538+0000","last_peered":"2024-04-26T17:58:09.740538+0000","last_clean":"2024-04-26T17:58:09.740538+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T17:58:09.740538+0000","last_undegraded":"2024-04-26T17:58:09.740538+0000","last_fullsized":"2024-04-26T17:58:09.740538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866990+0000","last_change":"2024-04-26T17:58:08.747104+0000","last_active":"2024-04-26T17:58:09.866990+0000","last_peered":"2024-04-26T17:58:09.866990+0000","last_clean":"2024-04-26T17:58:09.866990+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T17:58:09.866990+0000","last_undegraded":"2024-04-26T17:58:09.866990+0000","last_fullsized":"2024-04-26T17:58:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:19.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867840+0000","last_change":"2024-04-26T17:58:04.715359+0000","last_active":"2024-04-26T17:58:09.867840+0000","last_peered":"2024-04-26T17:58:09.867840+0000","last_clean":"2024-04-26T17:58:09.867840+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T17:58:09.867840+0000","last_undegraded":"2024-04-26T17:58:09.867840+0000","last_fullsized":"2024-04-26T17:58:09.867840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:11.014077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742339+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T17:58:09.742339+0000","last_peered":"2024-04-26T17:58:09.742339+0000","last_clean":"2024-04-26T17:58:09.742339+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T17:58:09.742339+0000","last_undegraded":"2024-04-26T17:58:09.742339+0000","last_fullsized":"2024-04-26T17:58:09.742339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867794+0000","last_change":"2024-04-26T17:58:08.742685+0000","last_active":"2024-04-26T17:58:09.867794+0000","last_peered":"2024-04-26T17:58:09.867794+0000","last_clean":"2024-04-26T17:58:09.867794+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T17:58:09.867794+0000","last_undegraded":"2024-04-26T17:58:09.867794+0000","last_fullsized":"2024-04-26T17:58:09.867794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:49.952963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867465+0000","last_change":"2024-04-26T17:58:04.713980+0000","last_active":"2024-04-26T17:58:09.867465+0000","last_peered":"2024-04-26T17:58:09.867465+0000","last_clean":"2024-04-26T17:58:09.867465+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T17:58:09.867465+0000","last_undegraded":"2024-04-26T17:58:09.867465+0000","last_fullsized":"2024-04-26T17:58:09.867465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:48.678130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867971+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T17:58:09.867971+0000","last_peered":"2024-04-26T17:58:09.867971+0000","last_clean":"2024-04-26T17:58:09.867971+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T17:58:09.867971+0000","last_undegraded":"2024-04-26T17:58:09.867971+0000","last_fullsized":"2024-04-26T17:58:09.867971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867029+0000","last_change":"2024-04-26T17:58:08.746201+0000","last_active":"2024-04-26T17:58:09.867029+0000","last_peered":"2024-04-26T17:58:09.867029+0000","last_clean":"2024-04-26T17:58:09.867029+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T17:58:09.867029+0000","last_undegraded":"2024-04-26T17:58:09.867029+0000","last_fullsized":"2024-04-26T17:58:09.867029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:23.961683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866770+0000","last_change":"2024-04-26T17:58:04.712662+0000","last_active":"2024-04-26T17:58:09.866770+0000","last_peered":"2024-04-26T17:58:09.866770+0000","last_clean":"2024-04-26T17:58:09.866770+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T17:58:09.866770+0000","last_undegraded":"2024-04-26T17:58:09.866770+0000","last_fullsized":"2024-04-26T17:58:09.866770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:37.557975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741512+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T17:58:09.741512+0000","last_peered":"2024-04-26T17:58:09.741512+0000","last_clean":"2024-04-26T17:58:09.741512+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T17:58:09.741512+0000","last_undegraded":"2024-04-26T17:58:09.741512+0000","last_fullsized":"2024-04-26T17:58:09.741512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868118+0000","last_change":"2024-04-26T17:58:08.740345+0000","last_active":"2024-04-26T17:58:09.868118+0000","last_peered":"2024-04-26T17:58:09.868118+0000","last_clean":"2024-04-26T17:58:09.868118+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T17:58:09.868118+0000","last_undegraded":"2024-04-26T17:58:09.868118+0000","last_fullsized":"2024-04-26T17:58:09.868118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:49.324368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867513+0000","last_change":"2024-04-26T17:58:04.726233+0000","last_active":"2024-04-26T17:58:09.867513+0000","last_peered":"2024-04-26T17:58:09.867513+0000","last_clean":"2024-04-26T17:58:09.867513+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T17:58:09.867513+0000","last_undegraded":"2024-04-26T17:58:09.867513+0000","last_fullsized":"2024-04-26T17:58:09.867513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:04.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866859+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T17:58:09.866859+0000","last_peered":"2024-04-26T17:58:09.866859+0000","last_clean":"2024-04-26T17:58:09.866859+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T17:58:09.866859+0000","last_undegraded":"2024-04-26T17:58:09.866859+0000","last_fullsized":"2024-04-26T17:58:09.866859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868258+0000","last_change":"2024-04-26T17:58:08.742909+0000","last_active":"2024-04-26T17:58:09.868258+0000","last_peered":"2024-04-26T17:58:09.868258+0000","last_clean":"2024-04-26T17:58:09.868258+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T17:58:09.868258+0000","last_undegraded":"2024-04-26T17:58:09.868258+0000","last_fullsized":"2024-04-26T17:58:09.868258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:50.554497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867397+0000","last_change":"2024-04-26T17:58:04.708024+0000","last_active":"2024-04-26T17:58:09.867397+0000","last_peered":"2024-04-26T17:58:09.867397+0000","last_clean":"2024-04-26T17:58:09.867397+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T17:58:09.867397+0000","last_undegraded":"2024-04-26T17:58:09.867397+0000","last_fullsized":"2024-04-26T17:58:09.867397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867406+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T17:58:09.867406+0000","last_peered":"2024-04-26T17:58:09.867406+0000","last_clean":"2024-04-26T17:58:09.867406+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T17:58:09.867406+0000","last_undegraded":"2024-04-26T17:58:09.867406+0000","last_fullsized":"2024-04-26T17:58:09.867406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866674+0000","last_change":"2024-04-26T17:58:08.739726+0000","last_active":"2024-04-26T17:58:09.866674+0000","last_peered":"2024-04-26T17:58:09.866674+0000","last_clean":"2024-04-26T17:58:09.866674+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T17:58:09.866674+0000","last_undegraded":"2024-04-26T17:58:09.866674+0000","last_fullsized":"2024-04-26T17:58:09.866674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:08.315753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866446+0000","last_change":"2024-04-26T17:58:04.712446+0000","last_active":"2024-04-26T17:58:09.866446+0000","last_peered":"2024-04-26T17:58:09.866446+0000","last_clean":"2024-04-26T17:58:09.866446+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T17:58:09.866446+0000","last_undegraded":"2024-04-26T17:58:09.866446+0000","last_fullsized":"2024-04-26T17:58:09.866446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:52.484069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739473+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T17:58:09.739473+0000","last_peered":"2024-04-26T17:58:09.739473+0000","last_clean":"2024-04-26T17:58:09.739473+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T17:58:09.739473+0000","last_undegraded":"2024-04-26T17:58:09.739473+0000","last_fullsized":"2024-04-26T17:58:09.739473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867315+0000","last_change":"2024-04-26T17:58:08.742536+0000","last_active":"2024-04-26T17:58:09.867315+0000","last_peered":"2024-04-26T17:58:09.867315+0000","last_clean":"2024-04-26T17:58:09.867315+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T17:58:09.867315+0000","last_undegraded":"2024-04-26T17:58:09.867315+0000","last_fullsized":"2024-04-26T17:58:09.867315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:49.364705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866653+0000","last_change":"2024-04-26T17:58:04.711535+0000","last_active":"2024-04-26T17:58:09.866653+0000","last_peered":"2024-04-26T17:58:09.866653+0000","last_clean":"2024-04-26T17:58:09.866653+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T17:58:09.866653+0000","last_undegraded":"2024-04-26T17:58:09.866653+0000","last_fullsized":"2024-04-26T17:58:09.866653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:11.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740669+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T17:58:09.740669+0000","last_peered":"2024-04-26T17:58:09.740669+0000","last_clean":"2024-04-26T17:58:09.740669+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T17:58:09.740669+0000","last_undegraded":"2024-04-26T17:58:09.740669+0000","last_fullsized":"2024-04-26T17:58:09.740669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867764+0000","last_change":"2024-04-26T17:58:08.734543+0000","last_active":"2024-04-26T17:58:09.867764+0000","last_peered":"2024-04-26T17:58:09.867764+0000","last_clean":"2024-04-26T17:58:09.867764+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T17:58:09.867764+0000","last_undegraded":"2024-04-26T17:58:09.867764+0000","last_fullsized":"2024-04-26T17:58:09.867764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:55.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866271+0000","last_change":"2024-04-26T17:58:04.727199+0000","last_active":"2024-04-26T17:58:09.866271+0000","last_peered":"2024-04-26T17:58:09.866271+0000","last_clean":"2024-04-26T17:58:09.866271+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T17:58:09.866271+0000","last_undegraded":"2024-04-26T17:58:09.866271+0000","last_fullsized":"2024-04-26T17:58:09.866271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:06.483618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867639+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T17:58:09.867639+0000","last_peered":"2024-04-26T17:58:09.867639+0000","last_clean":"2024-04-26T17:58:09.867639+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T17:58:09.867639+0000","last_undegraded":"2024-04-26T17:58:09.867639+0000","last_fullsized":"2024-04-26T17:58:09.867639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740780+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T17:58:09.740780+0000","last_peered":"2024-04-26T17:58:09.740780+0000","last_clean":"2024-04-26T17:58:09.740780+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T17:58:09.740780+0000","last_undegraded":"2024-04-26T17:58:09.740780+0000","last_fullsized":"2024-04-26T17:58:09.740780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741715+0000","last_change":"2024-04-26T17:58:08.737072+0000","last_active":"2024-04-26T17:58:09.741715+0000","last_peered":"2024-04-26T17:58:09.741715+0000","last_clean":"2024-04-26T17:58:09.741715+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T17:58:09.741715+0000","last_undegraded":"2024-04-26T17:58:09.741715+0000","last_fullsized":"2024-04-26T17:58:09.741715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:11.217370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740782+0000","last_change":"2024-04-26T17:58:04.724798+0000","last_active":"2024-04-26T17:58:09.740782+0000","last_peered":"2024-04-26T17:58:09.740782+0000","last_clean":"2024-04-26T17:58:09.740782+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T17:58:09.740782+0000","last_undegraded":"2024-04-26T17:58:09.740782+0000","last_fullsized":"2024-04-26T17:58:09.740782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.707135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739785+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T17:58:09.739785+0000","last_peered":"2024-04-26T17:58:09.739785+0000","last_clean":"2024-04-26T17:58:09.739785+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T17:58:09.739785+0000","last_undegraded":"2024-04-26T17:58:09.739785+0000","last_fullsized":"2024-04-26T17:58:09.739785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741890+0000","last_change":"2024-04-26T17:58:08.735010+0000","last_active":"2024-04-26T17:58:09.741890+0000","last_peered":"2024-04-26T17:58:09.741890+0000","last_clean":"2024-04-26T17:58:09.741890+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T17:58:09.741890+0000","last_undegraded":"2024-04-26T17:58:09.741890+0000","last_fullsized":"2024-04-26T17:58:09.741890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.377179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867215+0000","last_change":"2024-04-26T17:58:04.726744+0000","last_active":"2024-04-26T17:58:09.867215+0000","last_peered":"2024-04-26T17:58:09.867215+0000","last_clean":"2024-04-26T17:58:09.867215+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T17:58:09.867215+0000","last_undegraded":"2024-04-26T17:58:09.867215+0000","last_fullsized":"2024-04-26T17:58:09.867215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:06.654631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868255+0000","last_change":"2024-04-26T17:58:08.748124+0000","last_active":"2024-04-26T17:58:09.868255+0000","last_peered":"2024-04-26T17:58:09.868255+0000","last_clean":"2024-04-26T17:58:09.868255+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T17:58:09.868255+0000","last_undegraded":"2024-04-26T17:58:09.868255+0000","last_fullsized":"2024-04-26T17:58:09.868255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:07.600726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741479+0000","last_change":"2024-04-26T17:58:04.716933+0000","last_active":"2024-04-26T17:58:09.741479+0000","last_peered":"2024-04-26T17:58:09.741479+0000","last_clean":"2024-04-26T17:58:09.741479+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T17:58:09.741479+0000","last_undegraded":"2024-04-26T17:58:09.741479+0000","last_fullsized":"2024-04-26T17:58:09.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:25.360981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739660+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T17:58:09.739660+0000","last_peered":"2024-04-26T17:58:09.739660+0000","last_clean":"2024-04-26T17:58:09.739660+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T17:58:09.739660+0000","last_undegraded":"2024-04-26T17:58:09.739660+0000","last_fullsized":"2024-04-26T17:58:09.739660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866386+0000","last_change":"2024-04-26T17:58:08.737297+0000","last_active":"2024-04-26T17:58:09.866386+0000","last_peered":"2024-04-26T17:58:09.866386+0000","last_clean":"2024-04-26T17:58:09.866386+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T17:58:09.866386+0000","last_undegraded":"2024-04-26T17:58:09.866386+0000","last_fullsized":"2024-04-26T17:58:09.866386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:34.582604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741116+0000","last_change":"2024-04-26T17:58:04.716850+0000","last_active":"2024-04-26T17:58:09.741116+0000","last_peered":"2024-04-26T17:58:09.741116+0000","last_clean":"2024-04-26T17:58:09.741116+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T17:58:09.741116+0000","last_undegraded":"2024-04-26T17:58:09.741116+0000","last_fullsized":"2024-04-26T17:58:09.741116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:35.530627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867994+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T17:58:09.867994+0000","last_peered":"2024-04-26T17:58:09.867994+0000","last_clean":"2024-04-26T17:58:09.867994+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T17:58:09.867994+0000","last_undegraded":"2024-04-26T17:58:09.867994+0000","last_fullsized":"2024-04-26T17:58:09.867994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866728+0000","last_change":"2024-04-26T17:58:08.747644+0000","last_active":"2024-04-26T17:58:09.866728+0000","last_peered":"2024-04-26T17:58:09.866728+0000","last_clean":"2024-04-26T17:58:09.866728+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T17:58:09.866728+0000","last_undegraded":"2024-04-26T17:58:09.866728+0000","last_fullsized":"2024-04-26T17:58:09.866728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.713815+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:08.918386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739376+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T17:58:09.739376+0000","last_peered":"2024-04-26T17:58:09.739376+0000","last_clean":"2024-04-26T17:58:09.739376+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T17:58:09.739376+0000","last_undegraded":"2024-04-26T17:58:09.739376+0000","last_fullsized":"2024-04-26T17:58:09.739376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867630+0000","last_change":"2024-04-26T17:58:08.739259+0000","last_active":"2024-04-26T17:58:09.867630+0000","last_peered":"2024-04-26T17:58:09.867630+0000","last_clean":"2024-04-26T17:58:09.867630+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T17:58:09.867630+0000","last_undegraded":"2024-04-26T17:58:09.867630+0000","last_fullsized":"2024-04-26T17:58:09.867630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:42.110881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740479+0000","last_change":"2024-04-26T17:58:04.717008+0000","last_active":"2024-04-26T17:58:09.740479+0000","last_peered":"2024-04-26T17:58:09.740479+0000","last_clean":"2024-04-26T17:58:09.740479+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T17:58:09.740479+0000","last_undegraded":"2024-04-26T17:58:09.740479+0000","last_fullsized":"2024-04-26T17:58:09.740479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:10.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741681+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T17:58:09.741681+0000","last_peered":"2024-04-26T17:58:09.741681+0000","last_clean":"2024-04-26T17:58:09.741681+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T17:58:09.741681+0000","last_undegraded":"2024-04-26T17:58:09.741681+0000","last_fullsized":"2024-04-26T17:58:09.741681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867276+0000","last_change":"2024-04-26T17:58:08.742774+0000","last_active":"2024-04-26T17:58:09.867276+0000","last_peered":"2024-04-26T17:58:09.867276+0000","last_clean":"2024-04-26T17:58:09.867276+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T17:58:09.867276+0000","last_undegraded":"2024-04-26T17:58:09.867276+0000","last_fullsized":"2024-04-26T17:58:09.867276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:04.231921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741023+0000","last_change":"2024-04-26T17:58:04.712970+0000","last_active":"2024-04-26T17:58:09.741023+0000","last_peered":"2024-04-26T17:58:09.741023+0000","last_clean":"2024-04-26T17:58:09.741023+0000","last_became_active":"2024-04-26T17:58:04.712645+0000","last_became_peered":"2024-04-26T17:58:04.712645+0000","last_unstale":"2024-04-26T17:58:09.741023+0000","last_undegraded":"2024-04-26T17:58:09.741023+0000","last_fullsized":"2024-04-26T17:58:09.741023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:06.746889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867322+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T17:58:09.867322+0000","last_peered":"2024-04-26T17:58:09.867322+0000","last_clean":"2024-04-26T17:58:09.867322+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T17:58:09.867322+0000","last_undegraded":"2024-04-26T17:58:09.867322+0000","last_fullsized":"2024-04-26T17:58:09.867322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868215+0000","last_change":"2024-04-26T17:58:08.741761+0000","last_active":"2024-04-26T17:58:09.868215+0000","last_peered":"2024-04-26T17:58:09.868215+0000","last_clean":"2024-04-26T17:58:09.868215+0000","last_became_active":"2024-04-26T17:58:08.741401+0000","last_became_peered":"2024-04-26T17:58:08.741401+0000","last_unstale":"2024-04-26T17:58:09.868215+0000","last_undegraded":"2024-04-26T17:58:09.868215+0000","last_fullsized":"2024-04-26T17:58:09.868215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:44.837522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867967+0000","last_change":"2024-04-26T17:58:04.705981+0000","last_active":"2024-04-26T17:58:09.867967+0000","last_peered":"2024-04-26T17:58:09.867967+0000","last_clean":"2024-04-26T17:58:09.867967+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T17:58:09.867967+0000","last_undegraded":"2024-04-26T17:58:09.867967+0000","last_fullsized":"2024-04-26T17:58:09.867967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868393+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T17:58:09.868393+0000","last_peered":"2024-04-26T17:58:09.868393+0000","last_clean":"2024-04-26T17:58:09.868393+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T17:58:09.868393+0000","last_undegraded":"2024-04-26T17:58:09.868393+0000","last_fullsized":"2024-04-26T17:58:09.868393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867400+0000","last_change":"2024-04-26T17:58:08.739520+0000","last_active":"2024-04-26T17:58:09.867400+0000","last_peered":"2024-04-26T17:58:09.867400+0000","last_clean":"2024-04-26T17:58:09.867400+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T17:58:09.867400+0000","last_undegraded":"2024-04-26T17:58:09.867400+0000","last_fullsized":"2024-04-26T17:58:09.867400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:10.313792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.719394+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:33.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.307724+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T17:58:17.307724+0000","last_peered":"2024-04-26T17:58:17.307724+0000","last_clean":"2024-04-26T17:58:17.307724+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T17:58:17.307724+0000","last_undegraded":"2024-04-26T17:58:17.307724+0000","last_fullsized":"2024-04-26T17:58:17.307724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868423+0000","last_change":"2024-04-26T17:58:08.736275+0000","last_active":"2024-04-26T17:58:09.868423+0000","last_peered":"2024-04-26T17:58:09.868423+0000","last_clean":"2024-04-26T17:58:09.868423+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T17:58:09.868423+0000","last_undegraded":"2024-04-26T17:58:09.868423+0000","last_fullsized":"2024-04-26T17:58:09.868423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:07.103401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867796+0000","last_change":"2024-04-26T17:58:04.712316+0000","last_active":"2024-04-26T17:58:09.867796+0000","last_peered":"2024-04-26T17:58:09.867796+0000","last_clean":"2024-04-26T17:58:09.867796+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T17:58:09.867796+0000","last_undegraded":"2024-04-26T17:58:09.867796+0000","last_fullsized":"2024-04-26T17:58:09.867796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:49.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866776+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T17:58:09.866776+0000","last_peered":"2024-04-26T17:58:09.866776+0000","last_clean":"2024-04-26T17:58:09.866776+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T17:58:09.866776+0000","last_undegraded":"2024-04-26T17:58:09.866776+0000","last_fullsized":"2024-04-26T17:58:09.866776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867058+0000","last_change":"2024-04-26T17:58:08.742746+0000","last_active":"2024-04-26T17:58:09.867058+0000","last_peered":"2024-04-26T17:58:09.867058+0000","last_clean":"2024-04-26T17:58:09.867058+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T17:58:09.867058+0000","last_undegraded":"2024-04-26T17:58:09.867058+0000","last_fullsized":"2024-04-26T17:58:09.867058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:51.352617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868076+0000","last_change":"2024-04-26T17:58:04.723214+0000","last_active":"2024-04-26T17:58:09.868076+0000","last_peered":"2024-04-26T17:58:09.868076+0000","last_clean":"2024-04-26T17:58:09.868076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T17:58:09.868076+0000","last_undegraded":"2024-04-26T17:58:09.868076+0000","last_fullsized":"2024-04-26T17:58:09.868076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:08.558197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867696+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T17:58:09.867696+0000","last_peered":"2024-04-26T17:58:09.867696+0000","last_clean":"2024-04-26T17:58:09.867696+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T17:58:09.867696+0000","last_undegraded":"2024-04-26T17:58:09.867696+0000","last_fullsized":"2024-04-26T17:58:09.867696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867239+0000","last_change":"2024-04-26T17:58:08.745044+0000","last_active":"2024-04-26T17:58:09.867239+0000","last_peered":"2024-04-26T17:58:09.867239+0000","last_clean":"2024-04-26T17:58:09.867239+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T17:58:09.867239+0000","last_undegraded":"2024-04-26T17:58:09.867239+0000","last_fullsized":"2024-04-26T17:58:09.867239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:53.339198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867490+0000","last_change":"2024-04-26T17:58:04.720903+0000","last_active":"2024-04-26T17:58:09.867490+0000","last_peered":"2024-04-26T17:58:09.867490+0000","last_clean":"2024-04-26T17:58:09.867490+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T17:58:09.867490+0000","last_undegraded":"2024-04-26T17:58:09.867490+0000","last_fullsized":"2024-04-26T17:58:09.867490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:46.583637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742161+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T17:58:09.742161+0000","last_peered":"2024-04-26T17:58:09.742161+0000","last_clean":"2024-04-26T17:58:09.742161+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T17:58:09.742161+0000","last_undegraded":"2024-04-26T17:58:09.742161+0000","last_fullsized":"2024-04-26T17:58:09.742161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867269+0000","last_change":"2024-04-26T17:58:08.743119+0000","last_active":"2024-04-26T17:58:09.867269+0000","last_peered":"2024-04-26T17:58:09.867269+0000","last_clean":"2024-04-26T17:58:09.867269+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T17:58:09.867269+0000","last_undegraded":"2024-04-26T17:58:09.867269+0000","last_fullsized":"2024-04-26T17:58:09.867269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:41.640200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867500+0000","last_change":"2024-04-26T17:58:08.739999+0000","last_active":"2024-04-26T17:58:09.867500+0000","last_peered":"2024-04-26T17:58:09.867500+0000","last_clean":"2024-04-26T17:58:09.867500+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T17:58:09.867500+0000","last_undegraded":"2024-04-26T17:58:09.867500+0000","last_fullsized":"2024-04-26T17:58:09.867500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:30.637006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866996+0000","last_change":"2024-04-26T17:58:04.719069+0000","last_active":"2024-04-26T17:58:09.866996+0000","last_peered":"2024-04-26T17:58:09.866996+0000","last_clean":"2024-04-26T17:58:09.866996+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T17:58:09.866996+0000","last_undegraded":"2024-04-26T17:58:09.866996+0000","last_fullsized":"2024-04-26T17:58:09.866996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:09.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867009+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T17:58:09.867009+0000","last_peered":"2024-04-26T17:58:09.867009+0000","last_clean":"2024-04-26T17:58:09.867009+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T17:58:09.867009+0000","last_undegraded":"2024-04-26T17:58:09.867009+0000","last_fullsized":"2024-04-26T17:58:09.867009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741957+0000","last_change":"2024-04-26T17:58:08.738167+0000","last_active":"2024-04-26T17:58:09.741957+0000","last_peered":"2024-04-26T17:58:09.741957+0000","last_clean":"2024-04-26T17:58:09.741957+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T17:58:09.741957+0000","last_undegraded":"2024-04-26T17:58:09.741957+0000","last_fullsized":"2024-04-26T17:58:09.741957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:42.434088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867177+0000","last_change":"2024-04-26T17:58:04.717580+0000","last_active":"2024-04-26T17:58:09.867177+0000","last_peered":"2024-04-26T17:58:09.867177+0000","last_clean":"2024-04-26T17:58:09.867177+0000","last_became_active":"2024-04-26T17:58:04.717313+0000","last_became_peered":"2024-04-26T17:58:04.717313+0000","last_unstale":"2024-04-26T17:58:09.867177+0000","last_undegraded":"2024-04-26T17:58:09.867177+0000","last_fullsized":"2024-04-26T17:58:09.867177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:54.802557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867508+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T17:58:09.867508+0000","last_peered":"2024-04-26T17:58:09.867508+0000","last_clean":"2024-04-26T17:58:09.867508+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T17:58:09.867508+0000","last_undegraded":"2024-04-26T17:58:09.867508+0000","last_fullsized":"2024-04-26T17:58:09.867508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742229+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T17:58:09.742229+0000","last_peered":"2024-04-26T17:58:09.742229+0000","last_clean":"2024-04-26T17:58:09.742229+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T17:58:09.742229+0000","last_undegraded":"2024-04-26T17:58:09.742229+0000","last_fullsized":"2024-04-26T17:58:09.742229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868345+0000","last_change":"2024-04-26T17:58:04.713025+0000","last_active":"2024-04-26T17:58:09.868345+0000","last_peered":"2024-04-26T17:58:09.868345+0000","last_clean":"2024-04-26T17:58:09.868345+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T17:58:09.868345+0000","last_undegraded":"2024-04-26T17:58:09.868345+0000","last_fullsized":"2024-04-26T17:58:09.868345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:35.294319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739719+0000","last_change":"2024-04-26T17:58:08.739580+0000","last_active":"2024-04-26T17:58:09.739719+0000","last_peered":"2024-04-26T17:58:09.739719+0000","last_clean":"2024-04-26T17:58:09.739719+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T17:58:09.739719+0000","last_undegraded":"2024-04-26T17:58:09.739719+0000","last_fullsized":"2024-04-26T17:58:09.739719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.613945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868520+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T17:58:09.868520+0000","last_peered":"2024-04-26T17:58:09.868520+0000","last_clean":"2024-04-26T17:58:09.868520+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T17:58:09.868520+0000","last_undegraded":"2024-04-26T17:58:09.868520+0000","last_fullsized":"2024-04-26T17:58:09.868520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867109+0000","last_change":"2024-04-26T17:58:04.712809+0000","last_active":"2024-04-26T17:58:09.867109+0000","last_peered":"2024-04-26T17:58:09.867109+0000","last_clean":"2024-04-26T17:58:09.867109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T17:58:09.867109+0000","last_undegraded":"2024-04-26T17:58:09.867109+0000","last_fullsized":"2024-04-26T17:58:09.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:27.667789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866917+0000","last_change":"2024-04-26T17:58:08.738098+0000","last_active":"2024-04-26T17:58:09.866917+0000","last_peered":"2024-04-26T17:58:09.866917+0000","last_clean":"2024-04-26T17:58:09.866917+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T17:58:09.866917+0000","last_undegraded":"2024-04-26T17:58:09.866917+0000","last_fullsized":"2024-04-26T17:58:09.866917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:46.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740387+0000","last_change":"2024-04-26T17:58:04.717040+0000","last_active":"2024-04-26T17:58:09.740387+0000","last_peered":"2024-04-26T17:58:09.740387+0000","last_clean":"2024-04-26T17:58:09.740387+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T17:58:09.740387+0000","last_undegraded":"2024-04-26T17:58:09.740387+0000","last_fullsized":"2024-04-26T17:58:09.740387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739474+0000","last_change":"2024-04-26T17:58:04.717913+0000","last_active":"2024-04-26T17:58:09.739474+0000","last_peered":"2024-04-26T17:58:09.739474+0000","last_clean":"2024-04-26T17:58:09.739474+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T17:58:09.739474+0000","last_undegraded":"2024-04-26T17:58:09.739474+0000","last_fullsized":"2024-04-26T17:58:09.739474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:58.220321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867259+0000","last_change":"2024-04-26T17:58:04.726316+0000","last_active":"2024-04-26T17:58:09.867259+0000","last_peered":"2024-04-26T17:58:09.867259+0000","last_clean":"2024-04-26T17:58:09.867259+0000","last_became_active":"2024-04-26T17:58:04.726079+0000","last_became_peered":"2024-04-26T17:58:04.726079+0000","last_unstale":"2024-04-26T17:58:09.867259+0000","last_undegraded":"2024-04-26T17:58:09.867259+0000","last_fullsized":"2024-04-26T17:58:09.867259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:52.023348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868301+0000","last_change":"2024-04-26T17:58:04.718894+0000","last_active":"2024-04-26T17:58:09.868301+0000","last_peered":"2024-04-26T17:58:09.868301+0000","last_clean":"2024-04-26T17:58:09.868301+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T17:58:09.868301+0000","last_undegraded":"2024-04-26T17:58:09.868301+0000","last_fullsized":"2024-04-26T17:58:09.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:08.169756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868428+0000","last_change":"2024-04-26T17:58:04.717545+0000","last_active":"2024-04-26T17:58:09.868428+0000","last_peered":"2024-04-26T17:58:09.868428+0000","last_clean":"2024-04-26T17:58:09.868428+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T17:58:09.868428+0000","last_undegraded":"2024-04-26T17:58:09.868428+0000","last_fullsized":"2024-04-26T17:58:09.868428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:22.541323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866628+0000","last_change":"2024-04-26T17:58:04.719000+0000","last_active":"2024-04-26T17:58:09.866628+0000","last_peered":"2024-04-26T17:58:09.866628+0000","last_clean":"2024-04-26T17:58:09.866628+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T17:58:09.866628+0000","last_undegraded":"2024-04-26T17:58:09.866628+0000","last_fullsized":"2024-04-26T17:58:09.866628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:39.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741672+0000","last_change":"2024-04-26T17:58:04.719202+0000","last_active":"2024-04-26T17:58:09.741672+0000","last_peered":"2024-04-26T17:58:09.741672+0000","last_clean":"2024-04-26T17:58:09.741672+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T17:58:09.741672+0000","last_undegraded":"2024-04-26T17:58:09.741672+0000","last_fullsized":"2024-04-26T17:58:09.741672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:09.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867378+0000","last_change":"2024-04-26T17:58:04.717329+0000","last_active":"2024-04-26T17:58:09.867378+0000","last_peered":"2024-04-26T17:58:09.867378+0000","last_clean":"2024-04-26T17:58:09.867378+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T17:58:09.867378+0000","last_undegraded":"2024-04-26T17:58:09.867378+0000","last_fullsized":"2024-04-26T17:58:09.867378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:05.365008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866573+0000","last_change":"2024-04-26T17:58:04.727246+0000","last_active":"2024-04-26T17:58:09.866573+0000","last_peered":"2024-04-26T17:58:09.866573+0000","last_clean":"2024-04-26T17:58:09.866573+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T17:58:09.866573+0000","last_undegraded":"2024-04-26T17:58:09.866573+0000","last_fullsized":"2024-04-26T17:58:09.866573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:48.343210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867408+0000","last_change":"2024-04-26T17:58:04.713698+0000","last_active":"2024-04-26T17:58:09.867408+0000","last_peered":"2024-04-26T17:58:09.867408+0000","last_clean":"2024-04-26T17:58:09.867408+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T17:58:09.867408+0000","last_undegraded":"2024-04-26T17:58:09.867408+0000","last_fullsized":"2024-04-26T17:58:09.867408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:46.523995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867161+0000","last_change":"2024-04-26T17:58:04.724480+0000","last_active":"2024-04-26T17:58:09.867161+0000","last_peered":"2024-04-26T17:58:09.867161+0000","last_clean":"2024-04-26T17:58:09.867161+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T17:58:09.867161+0000","last_undegraded":"2024-04-26T17:58:09.867161+0000","last_fullsized":"2024-04-26T17:58:09.867161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:55.314208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868176+0000","last_change":"2024-04-26T17:58:04.708369+0000","last_active":"2024-04-26T17:58:09.868176+0000","last_peered":"2024-04-26T17:58:09.868176+0000","last_clean":"2024-04-26T17:58:09.868176+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T17:58:09.868176+0000","last_undegraded":"2024-04-26T17:58:09.868176+0000","last_fullsized":"2024-04-26T17:58:09.868176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:03.947874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741418+0000","last_change":"2024-04-26T17:58:04.714104+0000","last_active":"2024-04-26T17:58:09.741418+0000","last_peered":"2024-04-26T17:58:09.741418+0000","last_clean":"2024-04-26T17:58:09.741418+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T17:58:09.741418+0000","last_undegraded":"2024-04-26T17:58:09.741418+0000","last_fullsized":"2024-04-26T17:58:09.741418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:00.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741424+0000","last_change":"2024-04-26T17:58:04.714925+0000","last_active":"2024-04-26T17:58:09.741424+0000","last_peered":"2024-04-26T17:58:09.741424+0000","last_clean":"2024-04-26T17:58:09.741424+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T17:58:09.741424+0000","last_undegraded":"2024-04-26T17:58:09.741424+0000","last_fullsized":"2024-04-26T17:58:09.741424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.669034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739622+0000","last_change":"2024-04-26T17:58:04.714674+0000","last_active":"2024-04-26T17:58:09.739622+0000","last_peered":"2024-04-26T17:58:09.739622+0000","last_clean":"2024-04-26T17:58:09.739622+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T17:58:09.739622+0000","last_undegraded":"2024-04-26T17:58:09.739622+0000","last_fullsized":"2024-04-26T17:58:09.739622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:12.918478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867942+0000","last_change":"2024-04-26T17:58:04.722294+0000","last_active":"2024-04-26T17:58:09.867942+0000","last_peered":"2024-04-26T17:58:09.867942+0000","last_clean":"2024-04-26T17:58:09.867942+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T17:58:09.867942+0000","last_undegraded":"2024-04-26T17:58:09.867942+0000","last_fullsized":"2024-04-26T17:58:09.867942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:31.169681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866409+0000","last_change":"2024-04-26T17:58:04.725629+0000","last_active":"2024-04-26T17:58:09.866409+0000","last_peered":"2024-04-26T17:58:09.866409+0000","last_clean":"2024-04-26T17:58:09.866409+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T17:58:09.866409+0000","last_undegraded":"2024-04-26T17:58:09.866409+0000","last_fullsized":"2024-04-26T17:58:09.866409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:06.389060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867083+0000","last_change":"2024-04-26T17:58:04.716814+0000","last_active":"2024-04-26T17:58:09.867083+0000","last_peered":"2024-04-26T17:58:09.867083+0000","last_clean":"2024-04-26T17:58:09.867083+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T17:58:09.867083+0000","last_undegraded":"2024-04-26T17:58:09.867083+0000","last_fullsized":"2024-04-26T17:58:09.867083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:38.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867941+0000","last_change":"2024-04-26T17:58:04.715233+0000","last_active":"2024-04-26T17:58:09.867941+0000","last_peered":"2024-04-26T17:58:09.867941+0000","last_clean":"2024-04-26T17:58:09.867941+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T17:58:09.867941+0000","last_undegraded":"2024-04-26T17:58:09.867941+0000","last_fullsized":"2024-04-26T17:58:09.867941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:24.469756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867686+0000","last_change":"2024-04-26T17:58:04.722576+0000","last_active":"2024-04-26T17:58:09.867686+0000","last_peered":"2024-04-26T17:58:09.867686+0000","last_clean":"2024-04-26T17:58:09.867686+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T17:58:09.867686+0000","last_undegraded":"2024-04-26T17:58:09.867686+0000","last_fullsized":"2024-04-26T17:58:09.867686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:33.150267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867768+0000","last_change":"2024-04-26T17:58:04.712057+0000","last_active":"2024-04-26T17:58:09.867768+0000","last_peered":"2024-04-26T17:58:09.867768+0000","last_clean":"2024-04-26T17:58:09.867768+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T17:58:09.867768+0000","last_undegraded":"2024-04-26T17:58:09.867768+0000","last_fullsized":"2024-04-26T17:58:09.867768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:12.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741771+0000","last_change":"2024-04-26T17:58:04.727743+0000","last_active":"2024-04-26T17:58:09.741771+0000","last_peered":"2024-04-26T17:58:09.741771+0000","last_clean":"2024-04-26T17:58:09.741771+0000","last_became_active":"2024-04-26T17:58:04.727395+0000","last_became_peered":"2024-04-26T17:58:04.727395+0000","last_unstale":"2024-04-26T17:58:09.741771+0000","last_undegraded":"2024-04-26T17:58:09.741771+0000","last_fullsized":"2024-04-26T17:58:09.741771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:07.625978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741634+0000","last_change":"2024-04-26T17:58:04.727074+0000","last_active":"2024-04-26T17:58:09.741634+0000","last_peered":"2024-04-26T17:58:09.741634+0000","last_clean":"2024-04-26T17:58:09.741634+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T17:58:09.741634+0000","last_undegraded":"2024-04-26T17:58:09.741634+0000","last_fullsized":"2024-04-26T17:58:09.741634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:17.157157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741450+0000","last_change":"2024-04-26T17:58:04.723761+0000","last_active":"2024-04-26T17:58:09.741450+0000","last_peered":"2024-04-26T17:58:09.741450+0000","last_clean":"2024-04-26T17:58:09.741450+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T17:58:09.741450+0000","last_undegraded":"2024-04-26T17:58:09.741450+0000","last_fullsized":"2024-04-26T17:58:09.741450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:02.783054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867096+0000","last_change":"2024-04-26T17:58:04.724094+0000","last_active":"2024-04-26T17:58:09.867096+0000","last_peered":"2024-04-26T17:58:09.867096+0000","last_clean":"2024-04-26T17:58:09.867096+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T17:58:09.867096+0000","last_undegraded":"2024-04-26T17:58:09.867096+0000","last_fullsized":"2024-04-26T17:58:09.867096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:26.825638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740858+0000","last_change":"2024-04-26T17:58:04.713653+0000","last_active":"2024-04-26T17:58:09.740858+0000","last_peered":"2024-04-26T17:58:09.740858+0000","last_clean":"2024-04-26T17:58:09.740858+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T17:58:09.740858+0000","last_undegraded":"2024-04-26T17:58:09.740858+0000","last_fullsized":"2024-04-26T17:58:09.740858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:10.715579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867111+0000","last_change":"2024-04-26T17:58:04.725695+0000","last_active":"2024-04-26T17:58:09.867111+0000","last_peered":"2024-04-26T17:58:09.867111+0000","last_clean":"2024-04-26T17:58:09.867111+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T17:58:09.867111+0000","last_undegraded":"2024-04-26T17:58:09.867111+0000","last_fullsized":"2024-04-26T17:58:09.867111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:16.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740772+0000","last_change":"2024-04-26T17:58:04.712059+0000","last_active":"2024-04-26T17:58:09.740772+0000","last_peered":"2024-04-26T17:58:09.740772+0000","last_clean":"2024-04-26T17:58:09.740772+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T17:58:09.740772+0000","last_undegraded":"2024-04-26T17:58:09.740772+0000","last_fullsized":"2024-04-26T17:58:09.740772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:53.798495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867547+0000","last_change":"2024-04-26T17:58:04.726921+0000","last_active":"2024-04-26T17:58:09.867547+0000","last_peered":"2024-04-26T17:58:09.867547+0000","last_clean":"2024-04-26T17:58:09.867547+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T17:58:09.867547+0000","last_undegraded":"2024-04-26T17:58:09.867547+0000","last_fullsized":"2024-04-26T17:58:09.867547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:10.889230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867692+0000","last_change":"2024-04-26T17:58:04.714479+0000","last_active":"2024-04-26T17:58:09.867692+0000","last_peered":"2024-04-26T17:58:09.867692+0000","last_clean":"2024-04-26T17:58:09.867692+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T17:58:09.867692+0000","last_undegraded":"2024-04-26T17:58:09.867692+0000","last_fullsized":"2024-04-26T17:58:09.867692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:11.224793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867830+0000","last_change":"2024-04-26T17:58:04.715128+0000","last_active":"2024-04-26T17:58:09.867830+0000","last_peered":"2024-04-26T17:58:09.867830+0000","last_clean":"2024-04-26T17:58:09.867830+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T17:58:09.867830+0000","last_undegraded":"2024-04-26T17:58:09.867830+0000","last_fullsized":"2024-04-26T17:58:09.867830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:28.531949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741199+0000","last_change":"2024-04-26T17:58:04.719415+0000","last_active":"2024-04-26T17:58:09.741199+0000","last_peered":"2024-04-26T17:58:09.741199+0000","last_clean":"2024-04-26T17:58:09.741199+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T17:58:09.741199+0000","last_undegraded":"2024-04-26T17:58:09.741199+0000","last_fullsized":"2024-04-26T17:58:09.741199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:55.030120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:33.456 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T17:58:33.456 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T17:58:33.456 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T17:58:33.456 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T17:58:33.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.586+0000 7f431d6d1640 1 Processor -- start 2024-04-26T17:58:33.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.586+0000 7f431d6d1640 1 -- start start 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f431d6d1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f431815d730 0x7f431815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f431d6d1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4318073a30 con 0x7f43180735c0 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f431d6d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43180c6330 con 0x7f4318155c90 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f431d6d1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f4318156070 con 0x7f431815d730 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f43177fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f431815d730 0x7f431815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f43167fc640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f43180735c0 0x7f431815d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40482/0 (socket says 172.21.15.139:40482) 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f43177fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f431815d730 0x7f431815c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36702/0 (socket says 172.21.15.139:36702) 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f43167fc640 1 -- 172.21.15.139:0/729456737 learned_addr learned my addr 172.21.15.139:0/729456737 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f43177fe640 1 -- 172.21.15.139:0/729456737 >> v1:172.21.15.143:6789/0 conn(0x7f4318155c90 legacy=0x7f43180d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f43177fe640 1 -- 172.21.15.139:0/729456737 >> v1:172.21.15.139:6789/0 conn(0x7f43180735c0 legacy=0x7f431815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f43177fe640 1 -- 172.21.15.139:0/729456737 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43180c6610 con 0x7f431815d730 2024-04-26T17:58:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.587+0000 7f4315ffb640 1 -- 172.21.15.139:0/729456737 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384953941 0 0) 0x7f430c001110 con 0x7f43180735c0 2024-04-26T17:58:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.588+0000 7f43177fe640 1 --2- 172.21.15.139:0/729456737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f431815d730 0x7f431815c5b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f43100097a0 tx=0x7f431002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fefdf619ae0616 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.588+0000 7f4315ffb640 1 -- 172.21.15.139:0/729456737 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310037070 con 0x7f431815d730 2024-04-26T17:58:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.588+0000 7f4315ffb640 1 -- 172.21.15.139:0/729456737 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4310032640 con 0x7f431815d730 2024-04-26T17:58:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.588+0000 7f4315ffb640 1 -- 172.21.15.139:0/729456737 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310032a10 con 0x7f431815d730 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.589+0000 7f431d6d1640 1 -- 172.21.15.139:0/729456737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f431815d730 msgr2=0x7f431815c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.589+0000 7f431d6d1640 1 --2- 172.21.15.139:0/729456737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f431815d730 0x7f431815c5b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f43100097a0 tx=0x7f431002a2c0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.589+0000 7f431d6d1640 1 -- 172.21.15.139:0/729456737 shutdown_connections 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.589+0000 7f431d6d1640 1 --2- 172.21.15.139:0/729456737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f431815d730 0x7f431815c5b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.589+0000 7f431d6d1640 1 -- 172.21.15.139:0/729456737 >> 172.21.15.139:0/729456737 conn(0x7f4318074030 msgr2=0x7f4318074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.589+0000 7f431d6d1640 1 -- 172.21.15.139:0/729456737 shutdown_connections 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.589+0000 7f431d6d1640 1 -- 172.21.15.139:0/729456737 wait complete. 2024-04-26T17:58:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.590+0000 7f431d6d1640 1 Processor -- start 2024-04-26T17:58:33.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.590+0000 7f431d6d1640 1 -- start start 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43180735c0 0x7f431814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4318155c90 0x7f431814c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43180cabe0 0x7f43180cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f43180c6eb0 con 0x7f43180735c0 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f43180c6bd0 con 0x7f43180cabe0 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f43180c7190 con 0x7f4318155c90 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43180735c0 0x7f431814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43180735c0 0x7f431814bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36706/0 (socket says 172.21.15.139:36706) 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 -- 172.21.15.139:0/3170897208 learned_addr learned my addr 172.21.15.139:0/3170897208 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f43167fc640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4318155c90 0x7f431814c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 -- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4318155c90 msgr2=0x7f431814c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4318155c90 0x7f431814c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f43177fe640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43180cabe0 0x7f43180cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 -- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43180cabe0 msgr2=0x7f43180cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43180cabe0 0x7f43180cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 -- 172.21.15.139:0/3170897208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4318152b60 con 0x7f43180735c0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f43177fe640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43180cabe0 0x7f43180cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f4316ffd640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43180735c0 0x7f431814bd30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f430800c870 tx=0x7f430800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f42ff7fe640 1 -- 172.21.15.139:0/3170897208 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308003b70 con 0x7f43180735c0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f42ff7fe640 1 -- 172.21.15.139:0/3170897208 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308003d30 con 0x7f43180735c0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4318152e40 con 0x7f43180735c0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f42ff7fe640 1 -- 172.21.15.139:0/3170897208 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430800aa90 con 0x7f43180735c0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.591+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43180c8980 con 0x7f43180735c0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.592+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4318076d20 con 0x7f43180735c0 2024-04-26T17:58:33.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.593+0000 7f42ff7fe640 1 -- 172.21.15.139:0/3170897208 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f430800ac30 con 0x7f43180735c0 2024-04-26T17:58:33.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.593+0000 7f42ff7fe640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f430406c8f0 0x7f430406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.594+0000 7f43167fc640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f430406c8f0 0x7f430406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.594+0000 7f42ff7fe640 1 -- 172.21.15.139:0/3170897208 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f430808be50 con 0x7f43180735c0 2024-04-26T17:58:33.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.594+0000 7f43167fc640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f430406c8f0 0x7f430406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43180cc170 tx=0x7f430c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.598+0000 7f42ff7fe640 1 -- 172.21.15.139:0/3170897208 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4308059f40 con 0x7f43180735c0 2024-04-26T17:58:33.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.811+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f43180cc300 con 0x7f43180735c0 2024-04-26T17:58:33.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.811+0000 7f42ff7fe640 1 -- 172.21.15.139:0/3170897208 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4308059840 con 0x7f43180735c0 2024-04-26T17:58:33.811 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:33.811 INFO:teuthology.orchestra.run.smithi139.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T17:58:33.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f430406c8f0 msgr2=0x7f430406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f430406c8f0 0x7f430406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43180cc170 tx=0x7f430c009040 comp rx=0 tx=0).stop 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43180735c0 msgr2=0x7f431814bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43180735c0 0x7f431814bd30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f430800c870 tx=0x7f430800cd30 comp rx=0 tx=0).stop 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 shutdown_connections 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f430406c8f0 0x7f430406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f43180cabe0 0x7f43180cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4318155c90 0x7f431814c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 --2- 172.21.15.139:0/3170897208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43180735c0 0x7f431814bd30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.813+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 >> 172.21.15.139:0/3170897208 conn(0x7f4318074030 msgr2=0x7f43180cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.814+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 shutdown_connections 2024-04-26T17:58:33.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.814+0000 7f431d6d1640 1 -- 172.21.15.139:0/3170897208 wait complete. 2024-04-26T17:58:33.824 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T17:58:33.825 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:33.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.921+0000 7f833d187640 1 Processor -- start 2024-04-26T17:58:33.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.921+0000 7f833d187640 1 -- start start 2024-04-26T17:58:33.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833d187640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83380cf620 0x7f833806c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833d187640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833815f490 con 0x7f833806c850 2024-04-26T17:58:33.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833d187640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833815f770 con 0x7f83380cf240 2024-04-26T17:58:33.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833d187640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f833806cca0 con 0x7f83380cf620 2024-04-26T17:58:33.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833759e640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f833806c850 0x7f8338166400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40484/0 (socket says 172.21.15.139:40484) 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833759e640 1 -- 172.21.15.139:0/2203677660 learned_addr learned my addr 172.21.15.139:0/2203677660 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f832ffff640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83380cf620 0x7f833806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007023449 0 0) 0x7f833815f490 con 0x7f833806c850 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8324003520 con 0x7f833806c850 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886939145 0 0) 0x7f833815f770 con 0x7f83380cf240 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f833815f490 con 0x7f83380cf240 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1965580390 0 0) 0x7f8324003520 con 0x7f833806c850 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83380cf620 msgr2=0x7f833806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83380cf620 0x7f833806c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 >> v1:172.21.15.143:6789/0 conn(0x7f83380cf240 legacy=0x7f833815c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833815fa50 con 0x7f833806c850 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f83300019f0 con 0x7f833806c850 2024-04-26T17:58:33.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 >> v1:172.21.15.139:6789/0 conn(0x7f833806c850 legacy=0x7f8338166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8324003b70 0x7f8324003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8324004800 0x7f8324004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83240051c0 0x7f832400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f833806cca0 con 0x7f83240051c0 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f832400bfe0 con 0x7f8324004800 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f832400c1e0 con 0x7f8324003b70 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.922+0000 7f832ffff640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f83380cf620 0x7f833806c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f833759e640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83240051c0 0x7f832400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f8336d9d640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8324003b70 0x7f8324003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f832ffff640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8324004800 0x7f8324004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f833759e640 1 -- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8324003b70 msgr2=0x7f8324003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f833759e640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8324003b70 0x7f8324003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f833759e640 1 -- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8324004800 msgr2=0x7f8324004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:33.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f833759e640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8324004800 0x7f8324004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f833759e640 1 -- 172.21.15.139:0/2203677660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8324003520 con 0x7f83240051c0 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.923+0000 7f832ffff640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8324004800 0x7f8324004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833759e640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83240051c0 0x7f832400b9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f833000a720 tx=0x7f8324005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15e55f68b44bfe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833000a370 con 0x7f83240051c0 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833002f070 con 0x7f83240051c0 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833659c640 1 -- 172.21.15.139:0/2203677660 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833002bbd0 con 0x7f83240051c0 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833d187640 1 -- 172.21.15.139:0/2203677660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83240051c0 msgr2=0x7f832400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833d187640 1 --2- 172.21.15.139:0/2203677660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83240051c0 0x7f832400b9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f833000a720 tx=0x7f8324005830 comp rx=0 tx=0).stop 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833759e640 1 -- 172.21.15.139:0/2203677660 reap_dead start 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833d187640 1 -- 172.21.15.139:0/2203677660 shutdown_connections 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833d187640 1 -- 172.21.15.139:0/2203677660 >> 172.21.15.139:0/2203677660 conn(0x7f8338076730 msgr2=0x7f8338068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833d187640 1 -- 172.21.15.139:0/2203677660 shutdown_connections 2024-04-26T17:58:33.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.924+0000 7f833d187640 1 -- 172.21.15.139:0/2203677660 wait complete. 2024-04-26T17:58:33.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 Processor -- start 2024-04-26T17:58:33.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 -- start start 2024-04-26T17:58:33.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833815dc10 0x7f83381e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f833815dff0 0x7f83381f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83381e5410 0x7f83381f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f833815bcb0 con 0x7f83381e5410 2024-04-26T17:58:33.931 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8338160010 con 0x7f833815dff0 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833d187640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f833806e2a0 con 0x7f833815dc10 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833759e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83381e5410 0x7f83381f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833759e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83381e5410 0x7f83381f2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36722/0 (socket says 172.21.15.139:36722) 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f833759e640 1 -- 172.21.15.139:0/3693290432 learned_addr learned my addr 172.21.15.139:0/3693290432 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f8336d9d640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833815dc10 0x7f83381e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.926+0000 7f832ffff640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f833815dff0 0x7f83381f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833759e640 1 -- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833815dc10 msgr2=0x7f83381e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833759e640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833815dc10 0x7f83381e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833759e640 1 -- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f833815dff0 msgr2=0x7f83381f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833759e640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f833815dff0 0x7f83381f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833759e640 1 -- 172.21.15.139:0/3693290432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833815e700 con 0x7f83381e5410 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833759e640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83381e5410 0x7f83381f2250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f833000a810 tx=0x7f833002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f832f7fe640 1 -- 172.21.15.139:0/3693290432 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833000a350 con 0x7f83381e5410 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f832f7fe640 1 -- 172.21.15.139:0/3693290432 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330001a40 con 0x7f83381e5410 2024-04-26T17:58:33.932 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833815e9e0 con 0x7f83381e5410 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f832f7fe640 1 -- 172.21.15.139:0/3693290432 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330034670 con 0x7f83381e5410 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.927+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833815efa0 con 0x7f83381e5410 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.928+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8338076d20 con 0x7f83381e5410 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.928+0000 7f832f7fe640 1 -- 172.21.15.139:0/3693290432 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8330034810 con 0x7f83381e5410 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.929+0000 7f832f7fe640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.929+0000 7f832f7fe640 1 -- 172.21.15.139:0/3693290432 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f83300abb80 con 0x7f83381e5410 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.929+0000 7f8336d9d640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.929+0000 7f8336d9d640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f831806c920 0x7f831806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8328000c00 tx=0x7f8328009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:33.933+0000 7f832f7fe640 1 -- 172.21.15.139:0/3693290432 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8330079ca0 con 0x7f83381e5410 2024-04-26T17:58:34.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.144+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8338070030 con 0x7f83381e5410 2024-04-26T17:58:34.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.144+0000 7f832f7fe640 1 -- 172.21.15.139:0/3693290432 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f83300795a0 con 0x7f83381e5410 2024-04-26T17:58:34.145 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:34.145 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:34.145 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:34.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f831806c920 msgr2=0x7f831806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f831806c920 0x7f831806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8328000c00 tx=0x7f8328009040 comp rx=0 tx=0).stop 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83381e5410 msgr2=0x7f83381f2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83381e5410 0x7f83381f2250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f833000a810 tx=0x7f833002d070 comp rx=0 tx=0).stop 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 shutdown_connections 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f831806c920 0x7f831806ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83381e5410 0x7f83381f2250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f833815dff0 0x7f83381f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 --2- 172.21.15.139:0/3693290432 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f833815dc10 0x7f83381e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 >> 172.21.15.139:0/3693290432 conn(0x7f8338076730 msgr2=0x7f8338148ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 shutdown_connections 2024-04-26T17:58:34.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.146+0000 7f833d187640 1 -- 172.21.15.139:0/3693290432 wait complete. 2024-04-26T17:58:34.158 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:34.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.254+0000 7ff927a59640 1 Processor -- start 2024-04-26T17:58:34.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff927a59640 1 -- start start 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff927a59640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff920155da0 0x7ff92015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff927a59640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 0x7ff9200c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff927a59640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92015f2a0 con 0x7ff920156180 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff927a59640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff92015cbc0 con 0x7ff920155da0 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff927a59640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff9200cc730 con 0x7ff9200cd840 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff924ff4640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff920156180 0x7ff9200d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40494/0 (socket says 172.21.15.139:40494) 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.255+0000 7ff924ff4640 1 -- 172.21.15.139:0/142161978 learned_addr learned my addr 172.21.15.139:0/142161978 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff9257f5640 1 --2- 172.21.15.139:0/142161978 >> v2:172.21.15.143:3300/0 conn(0x7ff920155da0 0x7ff92015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff925ff6640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 0x7ff9200c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268541776 0 0) 0x7ff92015f2a0 con 0x7ff920156180 2024-04-26T17:58:34.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff90c003520 con 0x7ff920156180 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1078414489 0 0) 0x7ff90c003520 con 0x7ff920156180 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 msgr2=0x7ff9200c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 0x7ff9200c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 >> v2:172.21.15.143:3300/0 conn(0x7ff920155da0 msgr2=0x7ff92015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 --2- 172.21.15.139:0/142161978 >> v2:172.21.15.143:3300/0 conn(0x7ff920155da0 0x7ff92015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92015f580 con 0x7ff920156180 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7ff910001670 con 0x7ff920156180 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 >> v1:172.21.15.139:6789/0 conn(0x7ff920156180 legacy=0x7ff9200d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0039b0 0x7ff90c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff90c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 0x7ff90c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff92015cbc0 con 0x7ff90c004800 2024-04-26T17:58:34.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200cc730 con 0x7ff90c0039b0 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff90c00b9f0 con 0x7ff9200cd840 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff924ff4640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff90c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff9257f5640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0039b0 0x7ff90c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff925ff6640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 0x7ff90c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff924ff4640 1 -- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 msgr2=0x7ff90c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff924ff4640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 0x7ff90c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff924ff4640 1 -- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0039b0 msgr2=0x7ff90c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff924ff4640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff90c0039b0 0x7ff90c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff924ff4640 1 -- 172.21.15.139:0/142161978 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c003520 con 0x7ff90c004800 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.256+0000 7ff925ff6640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff9200cd840 0x7ff90c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.257+0000 7ff924ff4640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff90c004c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff920073b60 tx=0x7ff90c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8a77b03b476074 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.257+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910007d50 con 0x7ff90c004800 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.257+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9100058d0 con 0x7ff90c004800 2024-04-26T17:58:34.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.257+0000 7ff917fff640 1 -- 172.21.15.139:0/142161978 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910005cc0 con 0x7ff90c004800 2024-04-26T17:58:34.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.258+0000 7ff927a59640 1 -- 172.21.15.139:0/142161978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 msgr2=0x7ff90c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.258+0000 7ff927a59640 1 --2- 172.21.15.139:0/142161978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff90c004c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff920073b60 tx=0x7ff90c005830 comp rx=0 tx=0).stop 2024-04-26T17:58:34.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.258+0000 7ff925ff6640 1 -- 172.21.15.139:0/142161978 reap_dead start 2024-04-26T17:58:34.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.258+0000 7ff927a59640 1 -- 172.21.15.139:0/142161978 shutdown_connections 2024-04-26T17:58:34.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.258+0000 7ff927a59640 1 -- 172.21.15.139:0/142161978 >> 172.21.15.139:0/142161978 conn(0x7ff920068090 msgr2=0x7ff9200684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:34.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.258+0000 7ff927a59640 1 -- 172.21.15.139:0/142161978 shutdown_connections 2024-04-26T17:58:34.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.258+0000 7ff927a59640 1 -- 172.21.15.139:0/142161978 wait complete. 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.259+0000 7ff927a59640 1 Processor -- start 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.259+0000 7ff927a59640 1 -- start start 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff927a59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff920156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff927a59640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92015e230 0x7ff9201f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff927a59640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff92015e670 0x7ff9201f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff927a59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200d19d0 con 0x7ff90c004800 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff927a59640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff92015fb40 con 0x7ff92015e670 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff927a59640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff9200d1b50 con 0x7ff92015e230 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff920156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff920156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36746/0 (socket says 172.21.15.139:36746) 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 -- 172.21.15.139:0/4131237268 learned_addr learned my addr 172.21.15.139:0/4131237268 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff925ff6640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff92015e670 0x7ff9201f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff924ff4640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92015e230 0x7ff9201f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 -- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92015e230 msgr2=0x7ff9201f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92015e230 0x7ff9201f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 -- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff92015e670 msgr2=0x7ff9201f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff92015e670 0x7ff9201f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 -- 172.21.15.139:0/4131237268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9201f1b40 con 0x7ff90c004800 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff925ff6640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff92015e670 0x7ff9201f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff924ff4640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92015e230 0x7ff9201f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff9257f5640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff920156570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009f90 tx=0x7ff91c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff915ffb640 1 -- 172.21.15.139:0/4131237268 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c015430 con 0x7ff90c004800 2024-04-26T17:58:34.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff915ffb640 1 -- 172.21.15.139:0/4131237268 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91c0155d0 con 0x7ff90c004800 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9201f1e20 con 0x7ff90c004800 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.260+0000 7ff915ffb640 1 -- 172.21.15.139:0/4131237268 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0159c0 con 0x7ff90c004800 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.261+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9201f23e0 con 0x7ff90c004800 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.262+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff920076d20 con 0x7ff90c004800 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.262+0000 7ff915ffb640 1 -- 172.21.15.139:0/4131237268 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff91c015b60 con 0x7ff90c004800 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.262+0000 7ff915ffb640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff90406c8f0 0x7ff90406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.263+0000 7ff915ffb640 1 -- 172.21.15.139:0/4131237268 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff91c08d100 con 0x7ff90c004800 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.263+0000 7ff924ff4640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff90406c8f0 0x7ff90406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.263+0000 7ff924ff4640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff90406c8f0 0x7ff90406edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff910033000 tx=0x7ff910009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.267+0000 7ff915ffb640 1 -- 172.21.15.139:0/4131237268 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff91c019030 con 0x7ff90c004800 2024-04-26T17:58:34.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.476+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9200c7390 con 0x7ff90c004800 2024-04-26T17:58:34.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.476+0000 7ff915ffb640 1 -- 172.21.15.139:0/4131237268 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7ff91c010040 con 0x7ff90c004800 2024-04-26T17:58:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:34.477 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:34.477 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:34.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff90406c8f0 msgr2=0x7ff90406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff90406c8f0 0x7ff90406edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff910033000 tx=0x7ff910009030 comp rx=0 tx=0).stop 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 msgr2=0x7ff920156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff920156570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009f90 tx=0x7ff91c00f580 comp rx=0 tx=0).stop 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 shutdown_connections 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff90406c8f0 0x7ff90406edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff92015e670 0x7ff9201f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff92015e230 0x7ff9201f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 --2- 172.21.15.139:0/4131237268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff90c004800 0x7ff920156570 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.478+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 >> 172.21.15.139:0/4131237268 conn(0x7ff920068090 msgr2=0x7ff9200cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.479+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 shutdown_connections 2024-04-26T17:58:34.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.479+0000 7ff927a59640 1 -- 172.21.15.139:0/4131237268 wait complete. 2024-04-26T17:58:34.489 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:34.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.587+0000 7f0a29c64640 1 Processor -- start 2024-04-26T17:58:34.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.587+0000 7f0a29c64640 1 -- start start 2024-04-26T17:58:34.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a29c64640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 0x7f0a24073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a29c64640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a240c95b0 con 0x7f0a240cae30 2024-04-26T17:58:34.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a29c64640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a240c9820 con 0x7f0a240cb210 2024-04-26T17:58:34.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a29c64640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0a24071b90 con 0x7f0a240c8a30 2024-04-26T17:58:34.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a237fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0a240cae30 0x7f0a24071480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40498/0 (socket says 172.21.15.139:40498) 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a237fe640 1 -- 172.21.15.139:0/3877672784 learned_addr learned my addr 172.21.15.139:0/3877672784 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a23fff640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 0x7f0a24073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620978245 0 0) 0x7f0a240c95b0 con 0x7f0a240cae30 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a0c003520 con 0x7f0a240cae30 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1757129197 0 0) 0x7f0a0c003520 con 0x7f0a240cae30 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 msgr2=0x7f0a24073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 0x7f0a24073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 >> v1:172.21.15.143:6789/0 conn(0x7f0a240cb210 legacy=0x7f0a24155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a240c9b00 con 0x7f0a240cae30 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f0a14001670 con 0x7f0a240cae30 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 >> v1:172.21.15.139:6789/0 conn(0x7f0a240cae30 legacy=0x7f0a24071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 0x7f0a0c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a0c003f60 0x7f0a0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a0c004d40 0x7f0a0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24071b90 con 0x7f0a0c003f60 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c00baa0 con 0x7f0a0c004d40 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.588+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0a0c00bca0 con 0x7f0a240c8a30 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a22ffd640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a0c003f60 0x7f0a0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a237fe640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 0x7f0a0c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a23fff640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a0c004d40 0x7f0a0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a22ffd640 1 -- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 msgr2=0x7f0a0c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a22ffd640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a240c8a30 0x7f0a0c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a22ffd640 1 -- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a0c004d40 msgr2=0x7f0a0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a22ffd640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a0c004d40 0x7f0a0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a22ffd640 1 -- 172.21.15.139:0/3877672784 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0c003520 con 0x7f0a0c003f60 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.589+0000 7f0a22ffd640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a0c003f60 0x7f0a0c004800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0a18001750 tx=0x7f0a0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c7450f2bf3b0bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18001370 con 0x7f0a0c003f60 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a180052d0 con 0x7f0a0c003f60 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a227fc640 1 -- 172.21.15.139:0/3877672784 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1802abe0 con 0x7f0a0c003f60 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a29c64640 1 -- 172.21.15.139:0/3877672784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a0c003f60 msgr2=0x7f0a0c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a29c64640 1 --2- 172.21.15.139:0/3877672784 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a0c003f60 0x7f0a0c004800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0a18001750 tx=0x7f0a0c005830 comp rx=0 tx=0).stop 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a23fff640 1 -- 172.21.15.139:0/3877672784 reap_dead start 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a29c64640 1 -- 172.21.15.139:0/3877672784 shutdown_connections 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a29c64640 1 -- 172.21.15.139:0/3877672784 >> 172.21.15.139:0/3877672784 conn(0x7f0a24068090 msgr2=0x7f0a24068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a29c64640 1 -- 172.21.15.139:0/3877672784 shutdown_connections 2024-04-26T17:58:34.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.590+0000 7f0a29c64640 1 -- 172.21.15.139:0/3877672784 wait complete. 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.591+0000 7f0a29c64640 1 Processor -- start 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a29c64640 1 -- start start 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a29c64640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a0c003f60 0x7f0a241f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a29c64640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a2415cb20 0x7f0a24156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a29c64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a240c0860 0x7f0a240c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a29c64640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24070f60 con 0x7f0a240c0860 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a29c64640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24070d10 con 0x7f0a2415cb20 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a29c64640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2415f340 con 0x7f0a0c003f60 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a23fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a240c0860 0x7f0a240c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a23fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a240c0860 0x7f0a240c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36754/0 (socket says 172.21.15.139:36754) 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a23fff640 1 -- 172.21.15.139:0/2789173671 learned_addr learned my addr 172.21.15.139:0/2789173671 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a237fe640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a0c003f60 0x7f0a241f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.592+0000 7f0a22ffd640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a2415cb20 0x7f0a24156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a23fff640 1 -- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a0c003f60 msgr2=0x7f0a241f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a23fff640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a0c003f60 0x7f0a241f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a23fff640 1 -- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a2415cb20 msgr2=0x7f0a24156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a23fff640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a2415cb20 0x7f0a24156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a23fff640 1 -- 172.21.15.139:0/2789173671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a240be770 con 0x7f0a240c0860 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a23fff640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a240c0860 0x7f0a240c0cf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a24159a00 tx=0x7f0a1c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a0bfff640 1 -- 172.21.15.139:0/2789173671 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c003da0 con 0x7f0a240c0860 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a0bfff640 1 -- 172.21.15.139:0/2789173671 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c01c070 con 0x7f0a240c0860 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a240bea30 con 0x7f0a240c0860 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a0bfff640 1 -- 172.21.15.139:0/2789173671 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00fb10 con 0x7f0a240c0860 2024-04-26T17:58:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.593+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a240beff0 con 0x7f0a240c0860 2024-04-26T17:58:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.594+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a24076d20 con 0x7f0a240c0860 2024-04-26T17:58:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.594+0000 7f0a0bfff640 1 -- 172.21.15.139:0/2789173671 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a1c00fcb0 con 0x7f0a240c0860 2024-04-26T17:58:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.595+0000 7f0a0bfff640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0a1006c920 0x7f0a1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.595+0000 7f0a0bfff640 1 -- 172.21.15.139:0/2789173671 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0a1c08c640 con 0x7f0a240c0860 2024-04-26T17:58:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.595+0000 7f0a237fe640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0a1006c920 0x7f0a1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.595+0000 7f0a237fe640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0a1006c920 0x7f0a1006ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a140015d0 tx=0x7f0a140078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.599+0000 7f0a0bfff640 1 -- 172.21.15.139:0/2789173671 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a1c010040 con 0x7f0a240c0860 2024-04-26T17:58:34.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.776+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a240bf770 con 0x7f0a240c0860 2024-04-26T17:58:34.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.777+0000 7f0a0bfff640 1 -- 172.21.15.139:0/2789173671 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f0a1c05a050 con 0x7f0a240c0860 2024-04-26T17:58:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:34.778 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0a1006c920 msgr2=0x7f0a1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0a1006c920 0x7f0a1006ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0a140015d0 tx=0x7f0a140078f0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a240c0860 msgr2=0x7f0a240c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a240c0860 0x7f0a240c0cf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a24159a00 tx=0x7f0a1c00f1b0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 shutdown_connections 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0a1006c920 0x7f0a1006ede0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a240c0860 0x7f0a240c0cf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0a2415cb20 0x7f0a24156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 --2- 172.21.15.139:0/2789173671 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0a0c003f60 0x7f0a241f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.779+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 >> 172.21.15.139:0/2789173671 conn(0x7f0a24068090 msgr2=0x7f0a24154220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.780+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 shutdown_connections 2024-04-26T17:58:34.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.780+0000 7f0a29c64640 1 -- 172.21.15.139:0/2789173671 wait complete. 2024-04-26T17:58:34.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:34.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.888+0000 7fb30e319640 1 Processor -- start 2024-04-26T17:58:34.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.888+0000 7fb30e319640 1 -- start start 2024-04-26T17:58:34.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb30e319640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb3080cc4f0 0x7fb3080ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb30e319640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3080738c0 con 0x7fb3080b5970 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb30e319640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3080729d0 con 0x7fb3080ce100 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb30e319640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb308072cb0 con 0x7fb3080cc4f0 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb30c8b6640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb3080b5970 0x7fb3080b5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40514/0 (socket says 172.21.15.139:40514) 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb30c8b6640 1 -- 172.21.15.139:0/2861695657 learned_addr learned my addr 172.21.15.139:0/2861695657 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb3077fe640 1 --2- 172.21.15.139:0/2861695657 >> v2:172.21.15.143:3300/0 conn(0x7fb3080cc4f0 0x7fb3080ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066426128 0 0) 0x7fb3080738c0 con 0x7fb3080b5970 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f0003520 con 0x7fb3080b5970 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 296013329 0 0) 0x7fb2f0003520 con 0x7fb3080b5970 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 >> v2:172.21.15.143:3300/0 conn(0x7fb3080cc4f0 msgr2=0x7fb3080ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 --2- 172.21.15.139:0/2861695657 >> v2:172.21.15.143:3300/0 conn(0x7fb3080cc4f0 0x7fb3080ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 >> v1:172.21.15.143:6789/0 conn(0x7fb3080ce100 legacy=0x7fb30815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb308072f90 con 0x7fb3080b5970 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7fb3000019f0 con 0x7fb3080b5970 2024-04-26T17:58:34.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 >> v1:172.21.15.139:6789/0 conn(0x7fb3080b5970 legacy=0x7fb3080b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00039b0 0x7fb2f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f0004800 0x7fb2f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00051c0 0x7fb2f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb308072cb0 con 0x7fb2f00051c0 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f000c160 con 0x7fb2f00039b0 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f000c360 con 0x7fb2f0004800 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb307fff640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00039b0 0x7fb2f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb30c8b6640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00051c0 0x7fb2f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.889+0000 7fb3077fe640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f0004800 0x7fb2f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb30c8b6640 1 -- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f0004800 msgr2=0x7fb2f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb30c8b6640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb2f0004800 0x7fb2f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb30c8b6640 1 -- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00039b0 msgr2=0x7fb2f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb30c8b6640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00039b0 0x7fb2f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb30c8b6640 1 -- 172.21.15.139:0/2861695657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f0003520 con 0x7fb2f00051c0 2024-04-26T17:58:34.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb307fff640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00039b0 0x7fb2f0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb30c8b6640 1 -- 172.21.15.139:0/2861695657 reap_dead start 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb30c8b6640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00051c0 0x7fb2f000b9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb30000a840 tx=0x7fb2f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bce0b4f197a352 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8001370 con 0x7fb2f00051c0 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30002f070 con 0x7fb2f00051c0 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.890+0000 7fb306ffd640 1 -- 172.21.15.139:0/2861695657 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30000a460 con 0x7fb2f00051c0 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.891+0000 7fb30e319640 1 -- 172.21.15.139:0/2861695657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00051c0 msgr2=0x7fb2f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.891+0000 7fb30e319640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00051c0 0x7fb2f000b9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb30000a840 tx=0x7fb2f0005830 comp rx=0 tx=0).stop 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.891+0000 7fb30e319640 1 -- 172.21.15.139:0/2861695657 shutdown_connections 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.891+0000 7fb30e319640 1 --2- 172.21.15.139:0/2861695657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2f00051c0 0x7fb2f000b9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.891+0000 7fb30e319640 1 -- 172.21.15.139:0/2861695657 >> 172.21.15.139:0/2861695657 conn(0x7fb308068270 msgr2=0x7fb308068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.891+0000 7fb30e319640 1 -- 172.21.15.139:0/2861695657 shutdown_connections 2024-04-26T17:58:34.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.891+0000 7fb30e319640 1 -- 172.21.15.139:0/2861695657 wait complete. 2024-04-26T17:58:34.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.892+0000 7fb30e319640 1 Processor -- start 2024-04-26T17:58:34.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.892+0000 7fb30e319640 1 -- start start 2024-04-26T17:58:34.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30e319640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00051c0 0x7fb308154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30e319640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb30815fc00 0x7fb3080c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30e319640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3081f4d90 0x7fb3080c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30e319640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb308156360 con 0x7fb30815fc00 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30e319640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb308073550 con 0x7fb2f00051c0 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30e319640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb3080cd230 con 0x7fb3081f4d90 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb30815fc00 0x7fb3080c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb30815fc00 0x7fb3080c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36782/0 (socket says 172.21.15.139:36782) 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 -- 172.21.15.139:0/902805672 learned_addr learned my addr 172.21.15.139:0/902805672 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb307fff640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00051c0 0x7fb308154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30c8b6640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3081f4d90 0x7fb3080c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 -- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3081f4d90 msgr2=0x7fb3080c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3081f4d90 0x7fb3080c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 -- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00051c0 msgr2=0x7fb308154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00051c0 0x7fb308154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb3077fe640 1 -- 172.21.15.139:0/902805672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3081f19a0 con 0x7fb30815fc00 2024-04-26T17:58:34.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb307fff640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00051c0 0x7fb308154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.893+0000 7fb30c8b6640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3081f4d90 0x7fb3080c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.894+0000 7fb3077fe640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb30815fc00 0x7fb3080c7500 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0118e0 tx=0x7fb2fc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.894+0000 7fb304ff9640 1 -- 172.21.15.139:0/902805672 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00fa90 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.894+0000 7fb304ff9640 1 -- 172.21.15.139:0/902805672 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc00fc30 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.894+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3080c6e00 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.894+0000 7fb304ff9640 1 -- 172.21.15.139:0/902805672 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc014440 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.894+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3081f1f00 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.895+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30808e2b0 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.895+0000 7fb304ff9640 1 -- 172.21.15.139:0/902805672 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2fc012040 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.896+0000 7fb304ff9640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb2f406c920 0x7fb2f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.896+0000 7fb304ff9640 1 -- 172.21.15.139:0/902805672 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb2fc08c480 con 0x7fb30815fc00 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.896+0000 7fb307fff640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb2f406c920 0x7fb2f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:34.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.896+0000 7fb307fff640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb2f406c920 0x7fb2f406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8000c00 tx=0x7fb2f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:34.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:34.900+0000 7fb304ff9640 1 -- 172.21.15.139:0/902805672 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb30808e2b0 con 0x7fb30815fc00 2024-04-26T17:58:34.968 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:34.971 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.115+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb308076d20 con 0x7fb30815fc00 2024-04-26T17:58:35.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.115+0000 7fb304ff9640 1 -- 172.21.15.139:0/902805672 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fb3081f19a0 con 0x7fb30815fc00 2024-04-26T17:58:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:35.115 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:35.116 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:35.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb2f406c920 msgr2=0x7fb2f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb2f406c920 0x7fb2f406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8000c00 tx=0x7fb2f8009040 comp rx=0 tx=0).stop 2024-04-26T17:58:35.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb30815fc00 msgr2=0x7fb3080c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb30815fc00 0x7fb3080c7500 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0118e0 tx=0x7fb2fc011da0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 shutdown_connections 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb2f406c920 0x7fb2f406ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3081f4d90 0x7fb3080c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb30815fc00 0x7fb3080c7500 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 --2- 172.21.15.139:0/902805672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb2f00051c0 0x7fb308154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 >> 172.21.15.139:0/902805672 conn(0x7fb308068270 msgr2=0x7fb308150600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 shutdown_connections 2024-04-26T17:58:35.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.117+0000 7fb30e319640 1 -- 172.21.15.139:0/902805672 wait complete. 2024-04-26T17:58:35.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T17:58:04.046385+0000', 'modified': '2024-04-26T17:58:27.123495+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.143:6834/19919207', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6832', 'nonce': 19919207}, {'type': 'v1', 'addr': '172.21.15.143:6834', 'nonce': 19919207}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-04-26T17:58:35.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T17:58:35.733 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-26T17:58:35.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.837+0000 7fe92850a640 1 Processor -- start 2024-04-26T17:58:35.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.837+0000 7fe92850a640 1 -- start start 2024-04-26T17:58:35.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe92850a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe920155e50 0x7fe9200c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe92850a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe920071890 con 0x7fe920155a70 2024-04-26T17:58:35.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe92850a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9200cab10 con 0x7fe9200b1ed0 2024-04-26T17:58:35.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe92850a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe9200ca330 con 0x7fe920155e50 2024-04-26T17:58:35.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe926aa7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe920155e50 0x7fe9200c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe9262a6640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe920155a70 0x7fe92006ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40524/0 (socket says 172.21.15.139:40524) 2024-04-26T17:58:35.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe9262a6640 1 -- 172.21.15.139:0/889962744 learned_addr learned my addr 172.21.15.139:0/889962744 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:35.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe926aa7640 1 -- 172.21.15.139:0/889962744 >> v1:172.21.15.143:6789/0 conn(0x7fe9200b1ed0 legacy=0x7fe9200cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe926aa7640 1 -- 172.21.15.139:0/889962744 >> v1:172.21.15.139:6789/0 conn(0x7fe920155a70 legacy=0x7fe92006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.838+0000 7fe926aa7640 1 -- 172.21.15.139:0/889962744 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92015bcc0 con 0x7fe920155e50 2024-04-26T17:58:35.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.839+0000 7fe926aa7640 1 --2- 172.21.15.139:0/889962744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe920155e50 0x7fe9200c9df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe918009d90 tx=0x7fe91802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feaa072f1ed73997 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.839+0000 7fe9252a4640 1 -- 172.21.15.139:0/889962744 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918007740 con 0x7fe920155e50 2024-04-26T17:58:35.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.839+0000 7fe9252a4640 1 -- 172.21.15.139:0/889962744 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9180078e0 con 0x7fe920155e50 2024-04-26T17:58:35.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.839+0000 7fe9252a4640 1 -- 172.21.15.139:0/889962744 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918007cb0 con 0x7fe920155e50 2024-04-26T17:58:35.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.839+0000 7fe92850a640 1 -- 172.21.15.139:0/889962744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe920155e50 msgr2=0x7fe9200c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.839+0000 7fe92850a640 1 --2- 172.21.15.139:0/889962744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe920155e50 0x7fe9200c9df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe918009d90 tx=0x7fe91802a680 comp rx=0 tx=0).stop 2024-04-26T17:58:35.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.839+0000 7fe92850a640 1 -- 172.21.15.139:0/889962744 shutdown_connections 2024-04-26T17:58:35.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.840+0000 7fe92850a640 1 --2- 172.21.15.139:0/889962744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe920155e50 0x7fe9200c9df0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.840+0000 7fe92850a640 1 -- 172.21.15.139:0/889962744 >> 172.21.15.139:0/889962744 conn(0x7fe920071de0 msgr2=0x7fe9200721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.840+0000 7fe92850a640 1 -- 172.21.15.139:0/889962744 shutdown_connections 2024-04-26T17:58:35.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.840+0000 7fe92850a640 1 -- 172.21.15.139:0/889962744 wait complete. 2024-04-26T17:58:35.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 Processor -- start 2024-04-26T17:58:35.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 -- start start 2024-04-26T17:58:35.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9200b1ed0 0x7fe9200afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe920155a70 0x7fe9201f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe920155e50 0x7fe9201531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe92015bf60 con 0x7fe9200b1ed0 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe9200ca830 con 0x7fe920155e50 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe92850a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe92015c240 con 0x7fe920155a70 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe9262a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9200b1ed0 0x7fe9200afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe9262a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9200b1ed0 0x7fe9200afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36786/0 (socket says 172.21.15.139:36786) 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.841+0000 7fe9262a6640 1 -- 172.21.15.139:0/833360973 learned_addr learned my addr 172.21.15.139:0/833360973 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe926aa7640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe920155e50 0x7fe9201531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe925aa5640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe920155a70 0x7fe9201f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe9262a6640 1 -- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe920155a70 msgr2=0x7fe9201f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe9262a6640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe920155a70 0x7fe9201f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe9262a6640 1 -- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe920155e50 msgr2=0x7fe9201531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe9262a6640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe920155e50 0x7fe9201531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe9262a6640 1 -- 172.21.15.139:0/833360973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe920158600 con 0x7fe9200b1ed0 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe9262a6640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9200b1ed0 0x7fe9200afda0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00c780 tx=0x7fe91c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe916ffd640 1 -- 172.21.15.139:0/833360973 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c018070 con 0x7fe9200b1ed0 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe916ffd640 1 -- 172.21.15.139:0/833360973 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c0072d0 con 0x7fe9200b1ed0 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9201588e0 con 0x7fe9200b1ed0 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe916ffd640 1 -- 172.21.15.139:0/833360973 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0047e0 con 0x7fe9200b1ed0 2024-04-26T17:58:35.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.842+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9201f5150 con 0x7fe9200b1ed0 2024-04-26T17:58:35.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.844+0000 7fe916ffd640 1 -- 172.21.15.139:0/833360973 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe91c01b070 con 0x7fe9200b1ed0 2024-04-26T17:58:35.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.844+0000 7fe916ffd640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe90406c8f0 0x7fe90406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.844+0000 7fe916ffd640 1 -- 172.21.15.139:0/833360973 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe91c08b4c0 con 0x7fe9200b1ed0 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.844+0000 7fe925aa5640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe90406c8f0 0x7fe90406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.845+0000 7fe925aa5640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe90406c8f0 0x7fe90406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9201ef5c0 tx=0x7fe910009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.845+0000 7fe92b227740 1 Processor -- start 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.845+0000 7fe92b227740 1 -- start start 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d277830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe92b227740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d22eb20 0x55904d230a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d230f70 0x55904d25c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe92b227740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55904d197740 con 0x55904d22eb20 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55904d1333a0 con 0x55904d25bf90 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55904d193700 con 0x55904d230f70 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe925aa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d22eb20 0x55904d230a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe925aa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d22eb20 0x55904d230a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36802/0 (socket says 172.21.15.139:36802) 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe925aa5640 1 -- 172.21.15.139:0/520385940 learned_addr learned my addr 172.21.15.139:0/520385940 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe9262a6640 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d277830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe926aa7640 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d230f70 0x55904d25c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe925aa5640 1 -- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d230f70 msgr2=0x55904d25c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe925aa5640 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d230f70 0x55904d25c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe925aa5640 1 -- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 msgr2=0x55904d277830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.846+0000 7fe925aa5640 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d277830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.847+0000 7fe925aa5640 1 -- 172.21.15.139:0/520385940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d14f750 con 0x55904d22eb20 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.847+0000 7fe925aa5640 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d22eb20 0x55904d230a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9100147f0 tx=0x7fe910010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b916632bf53af9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.847+0000 7fe903fff640 1 -- 172.21.15.139:0/520385940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910024070 con 0x55904d22eb20 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.847+0000 7fe903fff640 1 -- 172.21.15.139:0/520385940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe910012b50 con 0x55904d22eb20 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.847+0000 7fe903fff640 1 -- 172.21.15.139:0/520385940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91001f400 con 0x55904d22eb20 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.847+0000 7fe92b227740 1 -- 172.21.15.139:0/520385940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d22eb20 msgr2=0x55904d230a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.847+0000 7fe92b227740 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d22eb20 0x55904d230a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe9100147f0 tx=0x7fe910010000 comp rx=0 tx=0).stop 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 -- 172.21.15.139:0/520385940 shutdown_connections 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d230f70 0x55904d25c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d22eb20 0x55904d230a30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 --2- 172.21.15.139:0/520385940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d277830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 -- 172.21.15.139:0/520385940 >> 172.21.15.139:0/520385940 conn(0x55904d22f9b0 msgr2=0x55904d276e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 -- 172.21.15.139:0/520385940 shutdown_connections 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 -- 172.21.15.139:0/520385940 wait complete. 2024-04-26T17:58:35.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 -- start start 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.848+0000 7fe92b227740 1 Processor -- start 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 0x55904d25adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 0x55904d258930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe92b227740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d252f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe92b227740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55904d22efb0 con 0x55904d252af0 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55904d11efe0 con 0x55904d283e80 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55904d235090 con 0x55904d25bf90 2024-04-26T17:58:35.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe92b227740 10 client.0 _ll_register_callbacks cb 0x55904d135150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe926aa7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d252f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe9262a6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 0x55904d25adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe925aa5640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 0x55904d258930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe926aa7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d252f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36812/0 (socket says 172.21.15.139:36812) 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.849+0000 7fe926aa7640 1 -- 172.21.15.139:0/2895354676 learned_addr learned my addr 172.21.15.139:0/2895354676 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe926aa7640 1 -- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 msgr2=0x55904d25adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe926aa7640 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 0x55904d25adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe926aa7640 1 -- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 msgr2=0x55904d258930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe926aa7640 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 0x55904d258930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe926aa7640 1 -- 172.21.15.139:0/2895354676 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904cea92d0 con 0x55904d252af0 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe926aa7640 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d252f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe918009eb0 tx=0x7fe918004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce73cb05ee6025fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe9017fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe9017fa640 1 -- 172.21.15.139:0/2895354676 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918009450 con 0x55904d252af0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe9017fa640 1 -- 172.21.15.139:0/2895354676 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe918004780 con 0x55904d252af0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe910012b50 con 0x55904d252af0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe9017fa640 1 -- 172.21.15.139:0/2895354676 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe91804e050 con 0x55904d252af0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 10 client.4716 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55904cf736b0 con 0x55904d252af0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe9017fa640 1 -- 172.21.15.139:0/2895354676 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe910012b50 con 0x55904d252af0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe9017fa640 1 -- 172.21.15.139:0/2895354676 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fe918051020 con 0x55904d252af0 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 10 client.4716 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 10 client.4716 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T17:58:35.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 20 client.4716 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d290ba0 0x55904d292f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 4 client.4716 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.850+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55904d1a5350 con 0x55904d290ba0 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.851+0000 7fe9262a6640 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d290ba0 0x55904d292f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.851+0000 7fe9017fa640 10 client.4716 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.851+0000 7fe9262a6640 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d290ba0 0x55904d292f90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f37290bfff3c59c server_cookie=bcfca0a6673e72ac in_seq=0 out_seq=0 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe9017fa640 1 -- 172.21.15.139:0/2895354676 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55904d1a5350 con 0x55904d290ba0 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe9017fa640 10 client.4716 handle_command_reply: tid=0 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 client.4716 shutdown 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 msgr2=0x55904d252f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d252f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe918009eb0 tx=0x7fe918004ab0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 shutdown_connections 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d252f70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 0x55904d258930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d290ba0 0x55904d292f90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 --2- 172.21.15.139:0/2895354676 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 0x55904d25adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 >> 172.21.15.139:0/2895354676 conn(0x55904d230f70 msgr2=0x55904d22cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe9017fa640 0 client.4716 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 shutdown_connections 2024-04-26T17:58:35.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 1 -- 172.21.15.139:0/2895354676 wait complete. 2024-04-26T17:58:35.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.852+0000 7fe92b227740 20 client.4716 trim_cache size 0 max 16384 2024-04-26T17:58:35.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.870+0000 7fe92b227740 1 Processor -- start 2024-04-26T17:58:35.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.870+0000 7fe92b227740 1 -- start start 2024-04-26T17:58:35.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.870+0000 7fe92b227740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d25c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 0x55904d25c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 0x55904d232d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe92b227740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe9201fe710 con 0x55904d252af0 2024-04-26T17:58:35.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55904d287f00 con 0x55904d283e80 2024-04-26T17:58:35.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55904d2534b0 con 0x55904d25bf90 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d25c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d25c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36816/0 (socket says 172.21.15.139:36816) 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 -- 172.21.15.139:0/3352350980 learned_addr learned my addr 172.21.15.139:0/3352350980 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 -- 172.21.15.139:0/3352350980 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 msgr2=0x55904d25c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 --2- 172.21.15.139:0/3352350980 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 0x55904d25c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 -- 172.21.15.139:0/3352350980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 msgr2=0x55904d232d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 --2- 172.21.15.139:0/3352350980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 0x55904d232d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 -- 172.21.15.139:0/3352350980 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55904d25b130 con 0x55904d252af0 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9262a6640 1 --2- 172.21.15.139:0/3352350980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d25c370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe91c061560 tx=0x7fe91c06f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab75d16ada521b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9037fe640 1 -- 172.21.15.139:0/3352350980 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0897c0 con 0x55904d252af0 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9037fe640 1 -- 172.21.15.139:0/3352350980 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c056ec0 con 0x55904d252af0 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.871+0000 7fe9037fe640 1 -- 172.21.15.139:0/3352350980 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0892f0 con 0x55904d252af0 2024-04-26T17:58:35.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 -- 172.21.15.139:0/3352350980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 msgr2=0x55904d25c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 --2- 172.21.15.139:0/3352350980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d25c370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe91c061560 tx=0x7fe91c06f040 comp rx=0 tx=0).stop 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 -- 172.21.15.139:0/3352350980 shutdown_connections 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 --2- 172.21.15.139:0/3352350980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d283e80 0x55904d232d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 --2- 172.21.15.139:0/3352350980 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d25bf90 0x55904d25c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 --2- 172.21.15.139:0/3352350980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d25c370 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 -- 172.21.15.139:0/3352350980 >> 172.21.15.139:0/3352350980 conn(0x55904d230f70 msgr2=0x55904d286880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 -- 172.21.15.139:0/3352350980 shutdown_connections 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 -- 172.21.15.139:0/3352350980 wait complete. 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 -- start start 2024-04-26T17:58:35.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.872+0000 7fe92b227740 1 Processor -- start 2024-04-26T17:58:35.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe92b227740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d251090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d2ef570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe92b227740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d283e80 0x55904d2e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe92b227740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55904d2583a0 con 0x55904d252af0 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55904d2842e0 con 0x55904d25bf90 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe92b227740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55904d272830 con 0x55904d283e80 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe92b227740 10 client.0 _ll_register_callbacks cb 0x7fe918009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d251090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d251090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36826/0 (socket says 172.21.15.139:36826) 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 -- 172.21.15.139:0/2858975273 learned_addr learned my addr 172.21.15.139:0/2858975273 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe926aa7640 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d283e80 0x55904d2e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe925aa5640 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d2ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 -- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d283e80 msgr2=0x55904d2e8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d283e80 0x55904d2e8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 -- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 msgr2=0x55904d2ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d2ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.873+0000 7fe9262a6640 1 -- 172.21.15.139:0/2858975273 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904d251930 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe9262a6640 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d251090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe91c089680 tx=0x7fe91c0012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0366b6228e3250 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe9017fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe9017fa640 1 -- 172.21.15.139:0/2858975273 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c075070 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe9017fa640 1 -- 172.21.15.139:0/2858975273 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe91c08b0c0 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe91c056ec0 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe9017fa640 1 -- 172.21.15.139:0/2858975273 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe91c0571f0 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 10 client.4722 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55904d270840 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe9017fa640 1 -- 172.21.15.139:0/2858975273 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c056ec0 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe9017fa640 1 -- 172.21.15.139:0/2858975273 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fe91c071190 con 0x55904d252af0 2024-04-26T17:58:35.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 10 client.4722 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 10 client.4722 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 20 client.4722 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d2f25d0 0x55904d2f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 4 client.4722 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "status"}) -- 0x55904d19f1c0 con 0x55904d2f25d0 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.874+0000 7fe925aa5640 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d2f25d0 0x55904d2f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe9017fa640 10 client.4722 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe925aa5640 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d2f25d0 0x55904d2f29b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d74bd4b20b4832 server_cookie=fe75950f3947dc21 in_seq=0 out_seq=0 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe9017fa640 1 -- 172.21.15.139:0/2858975273 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55904d19f1c0 con 0x55904d2f25d0 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe9017fa640 10 client.4722 handle_command_reply: tid=0 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 client.4722 shutdown 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 msgr2=0x55904d251090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d251090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe91c089680 tx=0x7fe91c0012b0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 shutdown_connections 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55904d2f25d0 0x55904d2f29b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55904d283e80 0x55904d2e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55904d25bf90 0x55904d2ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 --2- 172.21.15.139:0/2858975273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55904d252af0 0x55904d251090 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe9017fa640 0 client.4722 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 >> 172.21.15.139:0/2858975273 conn(0x55904d230f70 msgr2=0x55904d25c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 shutdown_connections 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 1 -- 172.21.15.139:0/2858975273 wait complete. 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.875+0000 7fe92b227740 20 client.4722 trim_cache size 0 max 16384 2024-04-26T17:58:35.882 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "ef741c66-6f9a-4560-84cd-b0800c4824c8", 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4309, 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 31.176738937, 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 9, 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 24, 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 37.186071990999999 2024-04-26T17:58:35.883 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:58:35.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe90406c8f0 msgr2=0x7fe90406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe90406c8f0 0x7fe90406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9201ef5c0 tx=0x7fe910009040 comp rx=0 tx=0).stop 2024-04-26T17:58:35.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9200b1ed0 msgr2=0x7fe9200afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9200b1ed0 0x7fe9200afda0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00c780 tx=0x7fe91c00cc40 comp rx=0 tx=0).stop 2024-04-26T17:58:35.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 shutdown_connections 2024-04-26T17:58:35.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe90406c8f0 0x7fe90406edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe920155e50 0x7fe9201531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe920155a70 0x7fe9201f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 --2- 172.21.15.139:0/833360973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9200b1ed0 0x7fe9200afda0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 >> 172.21.15.139:0/833360973 conn(0x7fe920071de0 msgr2=0x7fe9200cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 shutdown_connections 2024-04-26T17:58:35.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:35.876+0000 7fe92850a640 1 -- 172.21.15.139:0/833360973 wait complete. 2024-04-26T17:58:35.887 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T17:58:35.897 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T17:58:35.897 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T17:58:35.898 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T17:58:35.898 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T17:58:35.921 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T17:58:35.921 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T17:58:35.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:35.922 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-04-26T17:58:35.937 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T17:58:35.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:35.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:36.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:36.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-04-26T17:58:36.104 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-26T17:58:36.105 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T17:58:36.105 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:36.105 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T17:58:36.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.201+0000 7f2b48f9e640 1 Processor -- start 2024-04-26T17:58:36.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.201+0000 7f2b48f9e640 1 -- start start 2024-04-26T17:58:36.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.202+0000 7f2b48f9e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2b44152cb0 0x7f2b4415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.202+0000 7f2b48f9e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b440c89f0 0x7f2b440c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.202+0000 7f2b48f9e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b440736a0 con 0x7f2b440c7c20 2024-04-26T17:58:36.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.202+0000 7f2b48f9e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2b440c62e0 con 0x7f2b440c89f0 2024-04-26T17:58:36.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.202+0000 7f2b48f9e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2b44073940 con 0x7f2b44152cb0 2024-04-26T17:58:36.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b41d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2b440c89f0 0x7f2b440c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b42d9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2b440c7c20 0x7f2b440cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40530/0 (socket says 172.21.15.139:40530) 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b42d9d640 1 -- 172.21.15.139:0/3129018863 learned_addr learned my addr 172.21.15.139:0/3129018863 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b4259c640 1 --2- 172.21.15.139:0/3129018863 >> v2:172.21.15.143:3300/0 conn(0x7f2b44152cb0 0x7f2b4415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b41d9b640 1 -- 172.21.15.139:0/3129018863 >> v2:172.21.15.143:3300/0 conn(0x7f2b44152cb0 msgr2=0x7f2b4415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b41d9b640 1 --2- 172.21.15.139:0/3129018863 >> v2:172.21.15.143:3300/0 conn(0x7f2b44152cb0 0x7f2b4415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b41d9b640 1 -- 172.21.15.139:0/3129018863 >> v1:172.21.15.139:6789/0 conn(0x7f2b440c7c20 legacy=0x7f2b440cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b4159a640 1 -- 172.21.15.139:0/3129018863 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1050754476 0 0) 0x7f2b440736a0 con 0x7f2b440c7c20 2024-04-26T17:58:36.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.203+0000 7f2b41d9b640 1 -- 172.21.15.139:0/3129018863 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b440c48c0 con 0x7f2b440c89f0 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b41d9b640 1 --2- 172.21.15.139:0/3129018863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b440c67c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b440723f0 tx=0x7f2b3802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6227ad40ad21c312 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b4159a640 1 -- 172.21.15.139:0/3129018863 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38007740 con 0x7f2b440c89f0 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b4159a640 1 -- 172.21.15.139:0/3129018863 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b380078e0 con 0x7f2b440c89f0 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b4159a640 1 -- 172.21.15.139:0/3129018863 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38007cb0 con 0x7f2b440c89f0 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 -- 172.21.15.139:0/3129018863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 msgr2=0x7f2b440c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/3129018863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b440c67c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2b440723f0 tx=0x7f2b3802a710 comp rx=0 tx=0).stop 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 -- 172.21.15.139:0/3129018863 shutdown_connections 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/3129018863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b440c67c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/3129018863 >> v2:172.21.15.143:3300/0 conn(0x7f2b44152cb0 0x7f2b4415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 -- 172.21.15.139:0/3129018863 >> 172.21.15.139:0/3129018863 conn(0x7f2b44068270 msgr2=0x7f2b44068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:36.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 -- 172.21.15.139:0/3129018863 shutdown_connections 2024-04-26T17:58:36.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.204+0000 7f2b48f9e640 1 -- 172.21.15.139:0/3129018863 wait complete. 2024-04-26T17:58:36.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 Processor -- start 2024-04-26T17:58:36.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 -- start start 2024-04-26T17:58:36.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b440c7c20 0x7f2b441f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b4414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b44152cb0 0x7f2b44146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440c4d20 con 0x7f2b440c89f0 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2b440c4ba0 con 0x7f2b44152cb0 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b48f9e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2b440cdb70 con 0x7f2b440c7c20 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b41d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b4414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b41d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b4414d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36846/0 (socket says 172.21.15.139:36846) 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.206+0000 7f2b41d9b640 1 -- 172.21.15.139:0/1235658469 learned_addr learned my addr 172.21.15.139:0/1235658469 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b42d9d640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b44152cb0 0x7f2b44146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b4259c640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b440c7c20 0x7f2b441f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b41d9b640 1 -- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b440c7c20 msgr2=0x7f2b441f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b41d9b640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b440c7c20 0x7f2b441f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b41d9b640 1 -- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b44152cb0 msgr2=0x7f2b44146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b41d9b640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b44152cb0 0x7f2b44146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b41d9b640 1 -- 172.21.15.139:0/1235658469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b441f3b50 con 0x7f2b440c89f0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b41d9b640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b4414d9e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009e80 tx=0x7f2b38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b32ffd640 1 -- 172.21.15.139:0/1235658469 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38040070 con 0x7f2b440c89f0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b32ffd640 1 -- 172.21.15.139:0/1235658469 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b38031c40 con 0x7f2b440c89f0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b441e1ef0 con 0x7f2b440c89f0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b32ffd640 1 -- 172.21.15.139:0/1235658469 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38009450 con 0x7f2b440c89f0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.207+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4414aba0 con 0x7f2b440c89f0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.208+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b44076d20 con 0x7f2b440c89f0 2024-04-26T17:58:36.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.209+0000 7f2b32ffd640 1 -- 172.21.15.139:0/1235658469 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b38039040 con 0x7f2b440c89f0 2024-04-26T17:58:36.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.209+0000 7f2b32ffd640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2b2406c920 0x7f2b2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.209+0000 7f2b32ffd640 1 -- 172.21.15.139:0/1235658469 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2b380ad280 con 0x7f2b440c89f0 2024-04-26T17:58:36.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.209+0000 7f2b4259c640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2b2406c920 0x7f2b2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.209+0000 7f2b4259c640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2b2406c920 0x7f2b2406ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009b40 tx=0x7f2b3c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.213+0000 7f2b32ffd640 1 -- 172.21.15.139:0/1235658469 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b3807ad20 con 0x7f2b440c89f0 2024-04-26T17:58:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.426+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2b440c7900 con 0x7f2b440c89f0 2024-04-26T17:58:36.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.426+0000 7f2b32ffd640 1 -- 172.21.15.139:0/1235658469 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f2b38081070 con 0x7f2b440c89f0 2024-04-26T17:58:36.427 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2b2406c920 msgr2=0x7f2b2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2b2406c920 0x7f2b2406ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009b40 tx=0x7f2b3c009190 comp rx=0 tx=0).stop 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 msgr2=0x7f2b4414d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b4414d9e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009e80 tx=0x7f2b38004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 shutdown_connections 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2b2406c920 0x7f2b2406ede0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2b44152cb0 0x7f2b44146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b440c89f0 0x7f2b4414d9e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 --2- 172.21.15.139:0/1235658469 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2b440c7c20 0x7f2b441f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 >> 172.21.15.139:0/1235658469 conn(0x7f2b44068270 msgr2=0x7f2b440cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:36.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 shutdown_connections 2024-04-26T17:58:36.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36.429+0000 7f2b48f9e640 1 -- 172.21.15.139:0/1235658469 wait complete. 2024-04-26T17:58:36.439 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T17:58:36.440 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T17:58:36.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:36.440 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-04-26T17:58:36.455 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T17:58:36.455 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T17:58:36.455 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T17:58:36.455 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T17:58:36.456 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42705sec preferred_lft 42705sec 2024-04-26T17:58:36.457 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::8313:5748:ab6c:453d/64 scope link noprefixroute 2024-04-26T17:58:36.457 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:36.457 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T17:58:36.457 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:36.457 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:36.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2024-04-26T17:58:36.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2024-04-26T17:58:36.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2024-04-26T17:58:36.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T17:58:36.457 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:36.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:36.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:36.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:36.590 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T17:58:36.612 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-04-26T17:58:36.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:36.613 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-04-26T17:58:36.669 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-04-26T17:58:36.669 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T17:58:36.669 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T17:58:36.669 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T17:58:36.669 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T17:58:36.670 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:36.670 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:36.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T17:58:36.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T17:58:36.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T17:58:36.670 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:36.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:36.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:36.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:36.793 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-04-26T17:58:36.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:36.809 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-04-26T17:58:36.864 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:36.864 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:36.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T17:58:36.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T17:58:36.864 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:36.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:36.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:36.978 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T17:58:36.978 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:36.978 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:36.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T17:58:36.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T17:58:36.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T17:58:36.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T17:58:36.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T17:58:36.979 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:37.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:37.087 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:37.087 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-04-26T17:58:37.087 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2024-04-26T17:58:37.087 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T17:58:37.087 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-04-26T17:58:37.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:37.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:37.161 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:37.161 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:37.175 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T17:58:37.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:37.176 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:37.227 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T17:58:37.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:37.227 DEBUG:teuthology.orchestra.run.smithi139:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T17:58:37.308 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T17:58:37.308 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T17:58:37.455 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: resolved to: "172.21.15.139:3300,172.21.15.143:3300,172.21.15.143:3301" 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: trying mount with new device syntax: 0@ef741c66-6f9a-4560-84cd-b0800c4824c8.cephfs=/ 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.139:3300/172.21.15.143:3300/172.21.15.143:3301" will pass to kernel 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: You just mounted a file system that supports labels which does not 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T17:58:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T17:58:37.457 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T17:58:37.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:37.458 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:37.521 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:58:37.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:37.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:37.617 INFO:teuthology.orchestra.run.smithi139.stdout:client4734 2024-04-26T17:58:37.618 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T17:58:37.618 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T17:58:37.636 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:58:37.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:37.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:37.733 INFO:teuthology.orchestra.run.smithi139.stdout:client4734 2024-04-26T17:58:37.733 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:58:37.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:37.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:37.789 INFO:teuthology.orchestra.run.smithi139.stdout:client4734 2024-04-26T17:58:37.789 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ef741c66-6f9a-4560-84cd-b0800c4824c8.client4734/status') 2024-04-26T17:58:37.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:37.846 INFO:teuthology.orchestra.run.smithi139.stdout:instance: client.4734 (3)192.168.0.1:0/3858564357 2024-04-26T17:58:37.846 INFO:teuthology.orchestra.run.smithi139.stdout:blocklisted: false 2024-04-26T17:58:37.847 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records in 2024-04-26T17:58:37.847 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records out 2024-04-26T17:58:37.847 INFO:teuthology.orchestra.run.smithi139.stderr:69 bytes copied, 2.1665e-05 s, 3.2 MB/s 2024-04-26T17:58:37.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:37.853 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-26T17:58:37.882 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T17:58:37.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:37.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.979+0000 7f4b33f0a640 1 Processor -- start 2024-04-26T17:58:37.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.979+0000 7f4b33f0a640 1 -- start start 2024-04-26T17:58:37.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b33f0a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4b2c070400 0x7f4b2c155a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b33f0a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4b2c0cb410 0x7f4b2c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b33f0a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b2c0c9e20 con 0x7f4b2c070020 2024-04-26T17:58:37.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b33f0a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2c15fba0 con 0x7f4b2c070400 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b33f0a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2c15fdd0 con 0x7f4b2c0cb410 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b314a5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4b2c070400 0x7f4b2c155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b314a5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4b2c070400 0x7f4b2c155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36856/0 (socket says 172.21.15.139:36856) 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b314a5640 1 -- 172.21.15.139:0/2570170269 learned_addr learned my addr 172.21.15.139:0/2570170269 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.980+0000 7f4b324a7640 1 --2- 172.21.15.139:0/2570170269 >> v2:172.21.15.143:3300/0 conn(0x7f4b2c0cb410 0x7f4b2c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b314a5640 1 -- 172.21.15.139:0/2570170269 >> v2:172.21.15.143:3300/0 conn(0x7f4b2c0cb410 msgr2=0x7f4b2c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b314a5640 1 --2- 172.21.15.139:0/2570170269 >> v2:172.21.15.143:3300/0 conn(0x7f4b2c0cb410 0x7f4b2c155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b314a5640 1 -- 172.21.15.139:0/2570170269 >> v1:172.21.15.143:6789/0 conn(0x7f4b2c070020 legacy=0x7f4b2c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b314a5640 1 -- 172.21.15.139:0/2570170269 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c0ca090 con 0x7f4b2c070400 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b314a5640 1 --2- 172.21.15.139:0/2570170269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c070400 0x7f4b2c155a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0707e0 tx=0x7f4b2002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46964c0150825bf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b30ca4640 1 -- 172.21.15.139:0/2570170269 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20037070 con 0x7f4b2c070400 2024-04-26T17:58:37.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b30ca4640 1 -- 172.21.15.139:0/2570170269 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b20032440 con 0x7f4b2c070400 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.981+0000 7f4b30ca4640 1 -- 172.21.15.139:0/2570170269 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20032810 con 0x7f4b2c070400 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 -- 172.21.15.139:0/2570170269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c070400 msgr2=0x7f4b2c155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/2570170269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c070400 0x7f4b2c155a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0707e0 tx=0x7f4b2002a2c0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 -- 172.21.15.139:0/2570170269 shutdown_connections 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/2570170269 >> v2:172.21.15.143:3300/0 conn(0x7f4b2c0cb410 0x7f4b2c155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/2570170269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c070400 0x7f4b2c155a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 -- 172.21.15.139:0/2570170269 >> 172.21.15.139:0/2570170269 conn(0x7f4b2c071bf0 msgr2=0x7f4b2c071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 -- 172.21.15.139:0/2570170269 shutdown_connections 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.982+0000 7f4b33f0a640 1 -- 172.21.15.139:0/2570170269 wait complete. 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.983+0000 7f4b33f0a640 1 Processor -- start 2024-04-26T17:58:37.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.983+0000 7f4b33f0a640 1 -- start start 2024-04-26T17:58:37.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b33f0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b2c070020 0x7f4b2c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b33f0a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b2c070400 0x7f4b2c151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b33f0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c0cb410 0x7f4b2c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b33f0a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c0cccb0 con 0x7f4b2c0cb410 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b33f0a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c160070 con 0x7f4b2c070400 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b33f0a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4b2c15c190 con 0x7f4b2c070020 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c0cb410 0x7f4b2c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c0cb410 0x7f4b2c14fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36872/0 (socket says 172.21.15.139:36872) 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 -- 172.21.15.139:0/1915945573 learned_addr learned my addr 172.21.15.139:0/1915945573 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b31ca6640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b2c070020 0x7f4b2c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b314a5640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b2c070400 0x7f4b2c151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 -- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b2c070020 msgr2=0x7f4b2c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b2c070020 0x7f4b2c0b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 -- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b2c070400 msgr2=0x7f4b2c151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b2c070400 0x7f4b2c151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 -- 172.21.15.139:0/1915945573 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c1f1760 con 0x7f4b2c0cb410 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b31ca6640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b2c070020 0x7f4b2c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b314a5640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b2c070400 0x7f4b2c151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.984+0000 7f4b324a7640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c0cb410 0x7f4b2c14fbc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400d600 tx=0x7f4b2400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.985+0000 7f4b2a7fc640 1 -- 172.21.15.139:0/1915945573 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b240125f0 con 0x7f4b2c0cb410 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.985+0000 7f4b2a7fc640 1 -- 172.21.15.139:0/1915945573 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b24019070 con 0x7f4b2c0cb410 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.985+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c1f4aa0 con 0x7f4b2c0cb410 2024-04-26T17:58:37.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.985+0000 7f4b2a7fc640 1 -- 172.21.15.139:0/1915945573 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b240129f0 con 0x7f4b2c0cb410 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.985+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c1f5060 con 0x7f4b2c0cb410 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.986+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2c069ae0 con 0x7f4b2c0cb410 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.986+0000 7f4b2a7fc640 1 -- 172.21.15.139:0/1915945573 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b24012b90 con 0x7f4b2c0cb410 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.986+0000 7f4b2a7fc640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4b1806c8f0 0x7f4b1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.986+0000 7f4b2a7fc640 1 -- 172.21.15.139:0/1915945573 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b2408c270 con 0x7f4b2c0cb410 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.986+0000 7f4b31ca6640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4b1806c8f0 0x7f4b1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.987+0000 7f4b31ca6640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4b1806c8f0 0x7f4b1806edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c004520 tx=0x7f4b1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:37.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:37.991+0000 7f4b2a7fc640 1 -- 172.21.15.139:0/1915945573 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b2405a370 con 0x7f4b2c0cb410 2024-04-26T17:58:38.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.167+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b2c076d20 con 0x7f4b1806c8f0 2024-04-26T17:58:38.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.175+0000 7f4b2a7fc640 1 -- 172.21.15.139:0/1915945573 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f4b2c076d20 con 0x7f4b1806c8f0 2024-04-26T17:58:38.179 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:38.181 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T17:58:38.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.178+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4b1806c8f0 msgr2=0x7f4b1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.178+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4b1806c8f0 0x7f4b1806edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c004520 tx=0x7f4b1c009040 comp rx=0 tx=0).stop 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c0cb410 msgr2=0x7f4b2c14fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c0cb410 0x7f4b2c14fbc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400d600 tx=0x7f4b2400dac0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 shutdown_connections 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4b1806c8f0 0x7f4b1806edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b2c0cb410 0x7f4b2c14fbc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4b2c070400 0x7f4b2c151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 --2- 172.21.15.139:0/1915945573 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4b2c070020 0x7f4b2c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 >> 172.21.15.139:0/1915945573 conn(0x7f4b2c071bf0 msgr2=0x7f4b2c06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 shutdown_connections 2024-04-26T17:58:38.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.179+0000 7f4b33f0a640 1 -- 172.21.15.139:0/1915945573 wait complete. 2024-04-26T17:58:38.189 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-26T17:58:37.033717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867920+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T17:58:09.867920+0000","last_peered":"2024-04-26T17:58:09.867920+0000","last_clean":"2024-04-26T17:58:09.867920+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T17:58:09.867920+0000","last_undegraded":"2024-04-26T17:58:09.867920+0000","last_fullsized":"2024-04-26T17:58:09.867920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866709+0000","last_change":"2024-04-26T17:58:04.721568+0000","last_active":"2024-04-26T17:58:09.866709+0000","last_peered":"2024-04-26T17:58:09.866709+0000","last_clean":"2024-04-26T17:58:09.866709+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T17:58:09.866709+0000","last_undegraded":"2024-04-26T17:58:09.866709+0000","last_fullsized":"2024-04-26T17:58:09.866709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:24.906240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867369+0000","last_change":"2024-04-26T17:58:08.737557+0000","last_active":"2024-04-26T17:58:09.867369+0000","last_peered":"2024-04-26T17:58:09.867369+0000","last_clean":"2024-04-26T17:58:09.867369+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T17:58:09.867369+0000","last_undegraded":"2024-04-26T17:58:09.867369+0000","last_fullsized":"2024-04-26T17:58:09.867369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:29.013280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866886+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T17:58:09.866886+0000","last_peered":"2024-04-26T17:58:09.866886+0000","last_clean":"2024-04-26T17:58:09.866886+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T17:58:09.866886+0000","last_undegraded":"2024-04-26T17:58:09.866886+0000","last_fullsized":"2024-04-26T17:58:09.866886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867706+0000","last_change":"2024-04-26T17:58:04.725200+0000","last_active":"2024-04-26T17:58:09.867706+0000","last_peered":"2024-04-26T17:58:09.867706+0000","last_clean":"2024-04-26T17:58:09.867706+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T17:58:09.867706+0000","last_undegraded":"2024-04-26T17:58:09.867706+0000","last_fullsized":"2024-04-26T17:58:09.867706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:15.882481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866726+0000","last_change":"2024-04-26T17:58:08.747272+0000","last_active":"2024-04-26T17:58:09.866726+0000","last_peered":"2024-04-26T17:58:09.866726+0000","last_clean":"2024-04-26T17:58:09.866726+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T17:58:09.866726+0000","last_undegraded":"2024-04-26T17:58:09.866726+0000","last_fullsized":"2024-04-26T17:58:09.866726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:08.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741319+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T17:58:09.741319+0000","last_peered":"2024-04-26T17:58:09.741319+0000","last_clean":"2024-04-26T17:58:09.741319+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T17:58:09.741319+0000","last_undegraded":"2024-04-26T17:58:09.741319+0000","last_fullsized":"2024-04-26T17:58:09.741319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867042+0000","last_change":"2024-04-26T17:58:04.723700+0000","last_active":"2024-04-26T17:58:09.867042+0000","last_peered":"2024-04-26T17:58:09.867042+0000","last_clean":"2024-04-26T17:58:09.867042+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T17:58:09.867042+0000","last_undegraded":"2024-04-26T17:58:09.867042+0000","last_fullsized":"2024-04-26T17:58:09.867042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:05.637900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866801+0000","last_change":"2024-04-26T17:58:08.746662+0000","last_active":"2024-04-26T17:58:09.866801+0000","last_peered":"2024-04-26T17:58:09.866801+0000","last_clean":"2024-04-26T17:58:09.866801+0000","last_became_active":"2024-04-26T17:58:08.746200+0000","last_became_peered":"2024-04-26T17:58:08.746200+0000","last_unstale":"2024-04-26T17:58:09.866801+0000","last_undegraded":"2024-04-26T17:58:09.866801+0000","last_fullsized":"2024-04-26T17:58:09.866801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:05.431076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740881+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T17:58:09.740881+0000","last_peered":"2024-04-26T17:58:09.740881+0000","last_clean":"2024-04-26T17:58:09.740881+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T17:58:09.740881+0000","last_undegraded":"2024-04-26T17:58:09.740881+0000","last_fullsized":"2024-04-26T17:58:09.740881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867441+0000","last_change":"2024-04-26T17:58:04.723945+0000","last_active":"2024-04-26T17:58:09.867441+0000","last_peered":"2024-04-26T17:58:09.867441+0000","last_clean":"2024-04-26T17:58:09.867441+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T17:58:09.867441+0000","last_undegraded":"2024-04-26T17:58:09.867441+0000","last_fullsized":"2024-04-26T17:58:09.867441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:58.454180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:08.743082+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:56.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742051+0000","last_change":"2024-04-26T17:58:04.715624+0000","last_active":"2024-04-26T17:58:09.742051+0000","last_peered":"2024-04-26T17:58:09.742051+0000","last_clean":"2024-04-26T17:58:09.742051+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T17:58:09.742051+0000","last_undegraded":"2024-04-26T17:58:09.742051+0000","last_fullsized":"2024-04-26T17:58:09.742051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:45.282546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741089+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T17:58:09.741089+0000","last_peered":"2024-04-26T17:58:09.741089+0000","last_clean":"2024-04-26T17:58:09.741089+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T17:58:09.741089+0000","last_undegraded":"2024-04-26T17:58:09.741089+0000","last_fullsized":"2024-04-26T17:58:09.741089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867178+0000","last_change":"2024-04-26T17:58:08.747055+0000","last_active":"2024-04-26T17:58:09.867178+0000","last_peered":"2024-04-26T17:58:09.867178+0000","last_clean":"2024-04-26T17:58:09.867178+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T17:58:09.867178+0000","last_undegraded":"2024-04-26T17:58:09.867178+0000","last_fullsized":"2024-04-26T17:58:09.867178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:38.260141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867917+0000","last_change":"2024-04-26T17:58:04.717982+0000","last_active":"2024-04-26T17:58:09.867917+0000","last_peered":"2024-04-26T17:58:09.867917+0000","last_clean":"2024-04-26T17:58:09.867917+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T17:58:09.867917+0000","last_undegraded":"2024-04-26T17:58:09.867917+0000","last_fullsized":"2024-04-26T17:58:09.867917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:54.094898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868688+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T17:58:09.868688+0000","last_peered":"2024-04-26T17:58:09.868688+0000","last_clean":"2024-04-26T17:58:09.868688+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T17:58:09.868688+0000","last_undegraded":"2024-04-26T17:58:09.868688+0000","last_fullsized":"2024-04-26T17:58:09.868688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867590+0000","last_change":"2024-04-26T17:58:08.747263+0000","last_active":"2024-04-26T17:58:09.867590+0000","last_peered":"2024-04-26T17:58:09.867590+0000","last_clean":"2024-04-26T17:58:09.867590+0000","last_became_active":"2024-04-26T17:58:08.746835+0000","last_became_peered":"2024-04-26T17:58:08.746835+0000","last_unstale":"2024-04-26T17:58:09.867590+0000","last_undegraded":"2024-04-26T17:58:09.867590+0000","last_fullsized":"2024-04-26T17:58:09.867590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:03.581123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867258+0000","last_change":"2024-04-26T17:58:04.717948+0000","last_active":"2024-04-26T17:58:09.867258+0000","last_peered":"2024-04-26T17:58:09.867258+0000","last_clean":"2024-04-26T17:58:09.867258+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T17:58:09.867258+0000","last_undegraded":"2024-04-26T17:58:09.867258+0000","last_fullsized":"2024-04-26T17:58:09.867258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.344820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867168+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T17:58:09.867168+0000","last_peered":"2024-04-26T17:58:09.867168+0000","last_clean":"2024-04-26T17:58:09.867168+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T17:58:09.867168+0000","last_undegraded":"2024-04-26T17:58:09.867168+0000","last_fullsized":"2024-04-26T17:58:09.867168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867165+0000","last_change":"2024-04-26T17:58:08.743822+0000","last_active":"2024-04-26T17:58:09.867165+0000","last_peered":"2024-04-26T17:58:09.867165+0000","last_clean":"2024-04-26T17:58:09.867165+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T17:58:09.867165+0000","last_undegraded":"2024-04-26T17:58:09.867165+0000","last_fullsized":"2024-04-26T17:58:09.867165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:12.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867993+0000","last_change":"2024-04-26T17:58:04.712440+0000","last_active":"2024-04-26T17:58:09.867993+0000","last_peered":"2024-04-26T17:58:09.867993+0000","last_clean":"2024-04-26T17:58:09.867993+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T17:58:09.867993+0000","last_undegraded":"2024-04-26T17:58:09.867993+0000","last_fullsized":"2024-04-26T17:58:09.867993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:30.916890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740538+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T17:58:09.740538+0000","last_peered":"2024-04-26T17:58:09.740538+0000","last_clean":"2024-04-26T17:58:09.740538+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T17:58:09.740538+0000","last_undegraded":"2024-04-26T17:58:09.740538+0000","last_fullsized":"2024-04-26T17:58:09.740538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866990+0000","last_change":"2024-04-26T17:58:08.747104+0000","last_active":"2024-04-26T17:58:09.866990+0000","last_peered":"2024-04-26T17:58:09.866990+0000","last_clean":"2024-04-26T17:58:09.866990+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T17:58:09.866990+0000","last_undegraded":"2024-04-26T17:58:09.866990+0000","last_fullsized":"2024-04-26T17:58:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:19.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867840+0000","last_change":"2024-04-26T17:58:04.715359+0000","last_active":"2024-04-26T17:58:09.867840+0000","last_peered":"2024-04-26T17:58:09.867840+0000","last_clean":"2024-04-26T17:58:09.867840+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T17:58:09.867840+0000","last_undegraded":"2024-04-26T17:58:09.867840+0000","last_fullsized":"2024-04-26T17:58:09.867840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:11.014077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742339+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T17:58:09.742339+0000","last_peered":"2024-04-26T17:58:09.742339+0000","last_clean":"2024-04-26T17:58:09.742339+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T17:58:09.742339+0000","last_undegraded":"2024-04-26T17:58:09.742339+0000","last_fullsized":"2024-04-26T17:58:09.742339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867794+0000","last_change":"2024-04-26T17:58:08.742685+0000","last_active":"2024-04-26T17:58:09.867794+0000","last_peered":"2024-04-26T17:58:09.867794+0000","last_clean":"2024-04-26T17:58:09.867794+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T17:58:09.867794+0000","last_undegraded":"2024-04-26T17:58:09.867794+0000","last_fullsized":"2024-04-26T17:58:09.867794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:49.952963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867465+0000","last_change":"2024-04-26T17:58:04.713980+0000","last_active":"2024-04-26T17:58:09.867465+0000","last_peered":"2024-04-26T17:58:09.867465+0000","last_clean":"2024-04-26T17:58:09.867465+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T17:58:09.867465+0000","last_undegraded":"2024-04-26T17:58:09.867465+0000","last_fullsized":"2024-04-26T17:58:09.867465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:48.678130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867971+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T17:58:09.867971+0000","last_peered":"2024-04-26T17:58:09.867971+0000","last_clean":"2024-04-26T17:58:09.867971+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T17:58:09.867971+0000","last_undegraded":"2024-04-26T17:58:09.867971+0000","last_fullsized":"2024-04-26T17:58:09.867971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867029+0000","last_change":"2024-04-26T17:58:08.746201+0000","last_active":"2024-04-26T17:58:09.867029+0000","last_peered":"2024-04-26T17:58:09.867029+0000","last_clean":"2024-04-26T17:58:09.867029+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T17:58:09.867029+0000","last_undegraded":"2024-04-26T17:58:09.867029+0000","last_fullsized":"2024-04-26T17:58:09.867029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:23.961683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866770+0000","last_change":"2024-04-26T17:58:04.712662+0000","last_active":"2024-04-26T17:58:09.866770+0000","last_peered":"2024-04-26T17:58:09.866770+0000","last_clean":"2024-04-26T17:58:09.866770+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T17:58:09.866770+0000","last_undegraded":"2024-04-26T17:58:09.866770+0000","last_fullsized":"2024-04-26T17:58:09.866770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:37.557975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741512+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T17:58:09.741512+0000","last_peered":"2024-04-26T17:58:09.741512+0000","last_clean":"2024-04-26T17:58:09.741512+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T17:58:09.741512+0000","last_undegraded":"2024-04-26T17:58:09.741512+0000","last_fullsized":"2024-04-26T17:58:09.741512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868118+0000","last_change":"2024-04-26T17:58:08.740345+0000","last_active":"2024-04-26T17:58:09.868118+0000","last_peered":"2024-04-26T17:58:09.868118+0000","last_clean":"2024-04-26T17:58:09.868118+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T17:58:09.868118+0000","last_undegraded":"2024-04-26T17:58:09.868118+0000","last_fullsized":"2024-04-26T17:58:09.868118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:49.324368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867513+0000","last_change":"2024-04-26T17:58:04.726233+0000","last_active":"2024-04-26T17:58:09.867513+0000","last_peered":"2024-04-26T17:58:09.867513+0000","last_clean":"2024-04-26T17:58:09.867513+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T17:58:09.867513+0000","last_undegraded":"2024-04-26T17:58:09.867513+0000","last_fullsized":"2024-04-26T17:58:09.867513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:04.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866859+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T17:58:09.866859+0000","last_peered":"2024-04-26T17:58:09.866859+0000","last_clean":"2024-04-26T17:58:09.866859+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T17:58:09.866859+0000","last_undegraded":"2024-04-26T17:58:09.866859+0000","last_fullsized":"2024-04-26T17:58:09.866859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868258+0000","last_change":"2024-04-26T17:58:08.742909+0000","last_active":"2024-04-26T17:58:09.868258+0000","last_peered":"2024-04-26T17:58:09.868258+0000","last_clean":"2024-04-26T17:58:09.868258+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T17:58:09.868258+0000","last_undegraded":"2024-04-26T17:58:09.868258+0000","last_fullsized":"2024-04-26T17:58:09.868258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:50.554497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867397+0000","last_change":"2024-04-26T17:58:04.708024+0000","last_active":"2024-04-26T17:58:09.867397+0000","last_peered":"2024-04-26T17:58:09.867397+0000","last_clean":"2024-04-26T17:58:09.867397+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T17:58:09.867397+0000","last_undegraded":"2024-04-26T17:58:09.867397+0000","last_fullsized":"2024-04-26T17:58:09.867397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867406+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T17:58:09.867406+0000","last_peered":"2024-04-26T17:58:09.867406+0000","last_clean":"2024-04-26T17:58:09.867406+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T17:58:09.867406+0000","last_undegraded":"2024-04-26T17:58:09.867406+0000","last_fullsized":"2024-04-26T17:58:09.867406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866674+0000","last_change":"2024-04-26T17:58:08.739726+0000","last_active":"2024-04-26T17:58:09.866674+0000","last_peered":"2024-04-26T17:58:09.866674+0000","last_clean":"2024-04-26T17:58:09.866674+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T17:58:09.866674+0000","last_undegraded":"2024-04-26T17:58:09.866674+0000","last_fullsized":"2024-04-26T17:58:09.866674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:08.315753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866446+0000","last_change":"2024-04-26T17:58:04.712446+0000","last_active":"2024-04-26T17:58:09.866446+0000","last_peered":"2024-04-26T17:58:09.866446+0000","last_clean":"2024-04-26T17:58:09.866446+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T17:58:09.866446+0000","last_undegraded":"2024-04-26T17:58:09.866446+0000","last_fullsized":"2024-04-26T17:58:09.866446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:52.484069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739473+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T17:58:09.739473+0000","last_peered":"2024-04-26T17:58:09.739473+0000","last_clean":"2024-04-26T17:58:09.739473+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T17:58:09.739473+0000","last_undegraded":"2024-04-26T17:58:09.739473+0000","last_fullsized":"2024-04-26T17:58:09.739473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867315+0000","last_change":"2024-04-26T17:58:08.742536+0000","last_active":"2024-04-26T17:58:09.867315+0000","last_peered":"2024-04-26T17:58:09.867315+0000","last_clean":"2024-04-26T17:58:09.867315+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T17:58:09.867315+0000","last_undegraded":"2024-04-26T17:58:09.867315+0000","last_fullsized":"2024-04-26T17:58:09.867315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:49.364705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866653+0000","last_change":"2024-04-26T17:58:04.711535+0000","last_active":"2024-04-26T17:58:09.866653+0000","last_peered":"2024-04-26T17:58:09.866653+0000","last_clean":"2024-04-26T17:58:09.866653+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T17:58:09.866653+0000","last_undegraded":"2024-04-26T17:58:09.866653+0000","last_fullsized":"2024-04-26T17:58:09.866653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:11.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740669+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T17:58:09.740669+0000","last_peered":"2024-04-26T17:58:09.740669+0000","last_clean":"2024-04-26T17:58:09.740669+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T17:58:09.740669+0000","last_undegraded":"2024-04-26T17:58:09.740669+0000","last_fullsized":"2024-04-26T17:58:09.740669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867764+0000","last_change":"2024-04-26T17:58:08.734543+0000","last_active":"2024-04-26T17:58:09.867764+0000","last_peered":"2024-04-26T17:58:09.867764+0000","last_clean":"2024-04-26T17:58:09.867764+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T17:58:09.867764+0000","last_undegraded":"2024-04-26T17:58:09.867764+0000","last_fullsized":"2024-04-26T17:58:09.867764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:55.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866271+0000","last_change":"2024-04-26T17:58:04.727199+0000","last_active":"2024-04-26T17:58:09.866271+0000","last_peered":"2024-04-26T17:58:09.866271+0000","last_clean":"2024-04-26T17:58:09.866271+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T17:58:09.866271+0000","last_undegraded":"2024-04-26T17:58:09.866271+0000","last_fullsized":"2024-04-26T17:58:09.866271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:06.483618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867639+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T17:58:09.867639+0000","last_peered":"2024-04-26T17:58:09.867639+0000","last_clean":"2024-04-26T17:58:09.867639+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T17:58:09.867639+0000","last_undegraded":"2024-04-26T17:58:09.867639+0000","last_fullsized":"2024-04-26T17:58:09.867639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740780+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T17:58:09.740780+0000","last_peered":"2024-04-26T17:58:09.740780+0000","last_clean":"2024-04-26T17:58:09.740780+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T17:58:09.740780+0000","last_undegraded":"2024-04-26T17:58:09.740780+0000","last_fullsized":"2024-04-26T17:58:09.740780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741715+0000","last_change":"2024-04-26T17:58:08.737072+0000","last_active":"2024-04-26T17:58:09.741715+0000","last_peered":"2024-04-26T17:58:09.741715+0000","last_clean":"2024-04-26T17:58:09.741715+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T17:58:09.741715+0000","last_undegraded":"2024-04-26T17:58:09.741715+0000","last_fullsized":"2024-04-26T17:58:09.741715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:11.217370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740782+0000","last_change":"2024-04-26T17:58:04.724798+0000","last_active":"2024-04-26T17:58:09.740782+0000","last_peered":"2024-04-26T17:58:09.740782+0000","last_clean":"2024-04-26T17:58:09.740782+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T17:58:09.740782+0000","last_undegraded":"2024-04-26T17:58:09.740782+0000","last_fullsized":"2024-04-26T17:58:09.740782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.707135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739785+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T17:58:09.739785+0000","last_peered":"2024-04-26T17:58:09.739785+0000","last_clean":"2024-04-26T17:58:09.739785+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T17:58:09.739785+0000","last_undegraded":"2024-04-26T17:58:09.739785+0000","last_fullsized":"2024-04-26T17:58:09.739785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741890+0000","last_change":"2024-04-26T17:58:08.735010+0000","last_active":"2024-04-26T17:58:09.741890+0000","last_peered":"2024-04-26T17:58:09.741890+0000","last_clean":"2024-04-26T17:58:09.741890+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T17:58:09.741890+0000","last_undegraded":"2024-04-26T17:58:09.741890+0000","last_fullsized":"2024-04-26T17:58:09.741890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.377179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867215+0000","last_change":"2024-04-26T17:58:04.726744+0000","last_active":"2024-04-26T17:58:09.867215+0000","last_peered":"2024-04-26T17:58:09.867215+0000","last_clean":"2024-04-26T17:58:09.867215+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T17:58:09.867215+0000","last_undegraded":"2024-04-26T17:58:09.867215+0000","last_fullsized":"2024-04-26T17:58:09.867215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:06.654631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868255+0000","last_change":"2024-04-26T17:58:08.748124+0000","last_active":"2024-04-26T17:58:09.868255+0000","last_peered":"2024-04-26T17:58:09.868255+0000","last_clean":"2024-04-26T17:58:09.868255+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T17:58:09.868255+0000","last_undegraded":"2024-04-26T17:58:09.868255+0000","last_fullsized":"2024-04-26T17:58:09.868255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:07.600726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741479+0000","last_change":"2024-04-26T17:58:04.716933+0000","last_active":"2024-04-26T17:58:09.741479+0000","last_peered":"2024-04-26T17:58:09.741479+0000","last_clean":"2024-04-26T17:58:09.741479+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T17:58:09.741479+0000","last_undegraded":"2024-04-26T17:58:09.741479+0000","last_fullsized":"2024-04-26T17:58:09.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:25.360981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739660+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T17:58:09.739660+0000","last_peered":"2024-04-26T17:58:09.739660+0000","last_clean":"2024-04-26T17:58:09.739660+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T17:58:09.739660+0000","last_undegraded":"2024-04-26T17:58:09.739660+0000","last_fullsized":"2024-04-26T17:58:09.739660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866386+0000","last_change":"2024-04-26T17:58:08.737297+0000","last_active":"2024-04-26T17:58:09.866386+0000","last_peered":"2024-04-26T17:58:09.866386+0000","last_clean":"2024-04-26T17:58:09.866386+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T17:58:09.866386+0000","last_undegraded":"2024-04-26T17:58:09.866386+0000","last_fullsized":"2024-04-26T17:58:09.866386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:34.582604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741116+0000","last_change":"2024-04-26T17:58:04.716850+0000","last_active":"2024-04-26T17:58:09.741116+0000","last_peered":"2024-04-26T17:58:09.741116+0000","last_clean":"2024-04-26T17:58:09.741116+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T17:58:09.741116+0000","last_undegraded":"2024-04-26T17:58:09.741116+0000","last_fullsized":"2024-04-26T17:58:09.741116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:35.530627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867994+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T17:58:09.867994+0000","last_peered":"2024-04-26T17:58:09.867994+0000","last_clean":"2024-04-26T17:58:09.867994+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T17:58:09.867994+0000","last_undegraded":"2024-04-26T17:58:09.867994+0000","last_fullsized":"2024-04-26T17:58:09.867994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866728+0000","last_change":"2024-04-26T17:58:08.747644+0000","last_active":"2024-04-26T17:58:09.866728+0000","last_peered":"2024-04-26T17:58:09.866728+0000","last_clean":"2024-04-26T17:58:09.866728+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T17:58:09.866728+0000","last_undegraded":"2024-04-26T17:58:09.866728+0000","last_fullsized":"2024-04-26T17:58:09.866728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.713815+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:08.918386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739376+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T17:58:09.739376+0000","last_peered":"2024-04-26T17:58:09.739376+0000","last_clean":"2024-04-26T17:58:09.739376+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T17:58:09.739376+0000","last_undegraded":"2024-04-26T17:58:09.739376+0000","last_fullsized":"2024-04-26T17:58:09.739376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867630+0000","last_change":"2024-04-26T17:58:08.739259+0000","last_active":"2024-04-26T17:58:09.867630+0000","last_peered":"2024-04-26T17:58:09.867630+0000","last_clean":"2024-04-26T17:58:09.867630+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T17:58:09.867630+0000","last_undegraded":"2024-04-26T17:58:09.867630+0000","last_fullsized":"2024-04-26T17:58:09.867630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:42.110881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740479+0000","last_change":"2024-04-26T17:58:04.717008+0000","last_active":"2024-04-26T17:58:09.740479+0000","last_peered":"2024-04-26T17:58:09.740479+0000","last_clean":"2024-04-26T17:58:09.740479+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T17:58:09.740479+0000","last_undegraded":"2024-04-26T17:58:09.740479+0000","last_fullsized":"2024-04-26T17:58:09.740479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:10.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741681+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T17:58:09.741681+0000","last_peered":"2024-04-26T17:58:09.741681+0000","last_clean":"2024-04-26T17:58:09.741681+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T17:58:09.741681+0000","last_undegraded":"2024-04-26T17:58:09.741681+0000","last_fullsized":"2024-04-26T17:58:09.741681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867276+0000","last_change":"2024-04-26T17:58:08.742774+0000","last_active":"2024-04-26T17:58:09.867276+0000","last_peered":"2024-04-26T17:58:09.867276+0000","last_clean":"2024-04-26T17:58:09.867276+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T17:58:09.867276+0000","last_undegraded":"2024-04-26T17:58:09.867276+0000","last_fullsized":"2024-04-26T17:58:09.867276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:04.231921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741023+0000","last_change":"2024-04-26T17:58:04.712970+0000","last_active":"2024-04-26T17:58:09.741023+0000","last_peered":"2024-04-26T17:58:09.741023+0000","last_clean":"2024-04-26T17:58:09.741023+0000","last_became_active":"2024-04-26T17:58:04.712645+0000","last_became_peered":"2024-04-26T17:58:04.712645+0000","last_unstale":"2024-04-26T17:58:09.741023+0000","last_undegraded":"2024-04-26T17:58:09.741023+0000","last_fullsized":"2024-04-26T17:58:09.741023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:06.746889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867322+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T17:58:09.867322+0000","last_peered":"2024-04-26T17:58:09.867322+0000","last_clean":"2024-04-26T17:58:09.867322+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T17:58:09.867322+0000","last_undegraded":"2024-04-26T17:58:09.867322+0000","last_fullsized":"2024-04-26T17:58:09.867322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868215+0000","last_change":"2024-04-26T17:58:08.741761+0000","last_active":"2024-04-26T17:58:09.868215+0000","last_peered":"2024-04-26T17:58:09.868215+0000","last_clean":"2024-04-26T17:58:09.868215+0000","last_became_active":"2024-04-26T17:58:08.741401+0000","last_became_peered":"2024-04-26T17:58:08.741401+0000","last_unstale":"2024-04-26T17:58:09.868215+0000","last_undegraded":"2024-04-26T17:58:09.868215+0000","last_fullsized":"2024-04-26T17:58:09.868215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:44.837522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867967+0000","last_change":"2024-04-26T17:58:04.705981+0000","last_active":"2024-04-26T17:58:09.867967+0000","last_peered":"2024-04-26T17:58:09.867967+0000","last_clean":"2024-04-26T17:58:09.867967+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T17:58:09.867967+0000","last_undegraded":"2024-04-26T17:58:09.867967+0000","last_fullsized":"2024-04-26T17:58:09.867967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868393+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T17:58:09.868393+0000","last_peered":"2024-04-26T17:58:09.868393+0000","last_clean":"2024-04-26T17:58:09.868393+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T17:58:09.868393+0000","last_undegraded":"2024-04-26T17:58:09.868393+0000","last_fullsized":"2024-04-26T17:58:09.868393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867400+0000","last_change":"2024-04-26T17:58:08.739520+0000","last_active":"2024-04-26T17:58:09.867400+0000","last_peered":"2024-04-26T17:58:09.867400+0000","last_clean":"2024-04-26T17:58:09.867400+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T17:58:09.867400+0000","last_undegraded":"2024-04-26T17:58:09.867400+0000","last_fullsized":"2024-04-26T17:58:09.867400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:10.313792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.719394+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:33.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.307724+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T17:58:17.307724+0000","last_peered":"2024-04-26T17:58:17.307724+0000","last_clean":"2024-04-26T17:58:17.307724+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T17:58:17.307724+0000","last_undegraded":"2024-04-26T17:58:17.307724+0000","last_fullsized":"2024-04-26T17:58:17.307724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868423+0000","last_change":"2024-04-26T17:58:08.736275+0000","last_active":"2024-04-26T17:58:09.868423+0000","last_peered":"2024-04-26T17:58:09.868423+0000","last_clean":"2024-04-26T17:58:09.868423+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T17:58:09.868423+0000","last_undegraded":"2024-04-26T17:58:09.868423+0000","last_fullsized":"2024-04-26T17:58:09.868423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:07.103401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867796+0000","last_change":"2024-04-26T17:58:04.712316+0000","last_active":"2024-04-26T17:58:09.867796+0000","last_peered":"2024-04-26T17:58:09.867796+0000","last_clean":"2024-04-26T17:58:09.867796+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T17:58:09.867796+0000","last_undegraded":"2024-04-26T17:58:09.867796+0000","last_fullsized":"2024-04-26T17:58:09.867796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:49.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866776+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T17:58:09.866776+0000","last_peered":"2024-04-26T17:58:09.866776+0000","last_clean":"2024-04-26T17:58:09.866776+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T17:58:09.866776+0000","last_undegraded":"2024-04-26T17:58:09.866776+0000","last_fullsized":"2024-04-26T17:58:09.866776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867058+0000","last_change":"2024-04-26T17:58:08.742746+0000","last_active":"2024-04-26T17:58:09.867058+0000","last_peered":"2024-04-26T17:58:09.867058+0000","last_clean":"2024-04-26T17:58:09.867058+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T17:58:09.867058+0000","last_undegraded":"2024-04-26T17:58:09.867058+0000","last_fullsized":"2024-04-26T17:58:09.867058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:51.352617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868076+0000","last_change":"2024-04-26T17:58:04.723214+0000","last_active":"2024-04-26T17:58:09.868076+0000","last_peered":"2024-04-26T17:58:09.868076+0000","last_clean":"2024-04-26T17:58:09.868076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T17:58:09.868076+0000","last_undegraded":"2024-04-26T17:58:09.868076+0000","last_fullsized":"2024-04-26T17:58:09.868076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:08.558197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867696+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T17:58:09.867696+0000","last_peered":"2024-04-26T17:58:09.867696+0000","last_clean":"2024-04-26T17:58:09.867696+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T17:58:09.867696+0000","last_undegraded":"2024-04-26T17:58:09.867696+0000","last_fullsized":"2024-04-26T17:58:09.867696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867239+0000","last_change":"2024-04-26T17:58:08.745044+0000","last_active":"2024-04-26T17:58:09.867239+0000","last_peered":"2024-04-26T17:58:09.867239+0000","last_clean":"2024-04-26T17:58:09.867239+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T17:58:09.867239+0000","last_undegraded":"2024-04-26T17:58:09.867239+0000","last_fullsized":"2024-04-26T17:58:09.867239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:53.339198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867490+0000","last_change":"2024-04-26T17:58:04.720903+0000","last_active":"2024-04-26T17:58:09.867490+0000","last_peered":"2024-04-26T17:58:09.867490+0000","last_clean":"2024-04-26T17:58:09.867490+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T17:58:09.867490+0000","last_undegraded":"2024-04-26T17:58:09.867490+0000","last_fullsized":"2024-04-26T17:58:09.867490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:46.583637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742161+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T17:58:09.742161+0000","last_peered":"2024-04-26T17:58:09.742161+0000","last_clean":"2024-04-26T17:58:09.742161+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T17:58:09.742161+0000","last_undegraded":"2024-04-26T17:58:09.742161+0000","last_fullsized":"2024-04-26T17:58:09.742161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867269+0000","last_change":"2024-04-26T17:58:08.743119+0000","last_active":"2024-04-26T17:58:09.867269+0000","last_peered":"2024-04-26T17:58:09.867269+0000","last_clean":"2024-04-26T17:58:09.867269+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T17:58:09.867269+0000","last_undegraded":"2024-04-26T17:58:09.867269+0000","last_fullsized":"2024-04-26T17:58:09.867269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:41.640200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867500+0000","last_change":"2024-04-26T17:58:08.739999+0000","last_active":"2024-04-26T17:58:09.867500+0000","last_peered":"2024-04-26T17:58:09.867500+0000","last_clean":"2024-04-26T17:58:09.867500+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T17:58:09.867500+0000","last_undegraded":"2024-04-26T17:58:09.867500+0000","last_fullsized":"2024-04-26T17:58:09.867500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:30.637006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866996+0000","last_change":"2024-04-26T17:58:04.719069+0000","last_active":"2024-04-26T17:58:09.866996+0000","last_peered":"2024-04-26T17:58:09.866996+0000","last_clean":"2024-04-26T17:58:09.866996+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T17:58:09.866996+0000","last_undegraded":"2024-04-26T17:58:09.866996+0000","last_fullsized":"2024-04-26T17:58:09.866996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:09.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867009+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T17:58:09.867009+0000","last_peered":"2024-04-26T17:58:09.867009+0000","last_clean":"2024-04-26T17:58:09.867009+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T17:58:09.867009+0000","last_undegraded":"2024-04-26T17:58:09.867009+0000","last_fullsized":"2024-04-26T17:58:09.867009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741957+0000","last_change":"2024-04-26T17:58:08.738167+0000","last_active":"2024-04-26T17:58:09.741957+0000","last_peered":"2024-04-26T17:58:09.741957+0000","last_clean":"2024-04-26T17:58:09.741957+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T17:58:09.741957+0000","last_undegraded":"2024-04-26T17:58:09.741957+0000","last_fullsized":"2024-04-26T17:58:09.741957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:42.434088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867177+0000","last_change":"2024-04-26T17:58:04.717580+0000","last_active":"2024-04-26T17:58:09.867177+0000","last_peered":"2024-04-26T17:58:09.867177+0000","last_clean":"2024-04-26T17:58:09.867177+0000","last_became_active":"2024-04-26T17:58:04.717313+0000","last_became_peered":"2024-04-26T17:58:04.717313+0000","last_unstale":"2024-04-26T17:58:09.867177+0000","last_undegraded":"2024-04-26T17:58:09.867177+0000","last_fullsized":"2024-04-26T17:58:09.867177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:54.802557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867508+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T17:58:09.867508+0000","last_peered":"2024-04-26T17:58:09.867508+0000","last_clean":"2024-04-26T17:58:09.867508+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T17:58:09.867508+0000","last_undegraded":"2024-04-26T17:58:09.867508+0000","last_fullsized":"2024-04-26T17:58:09.867508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742229+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T17:58:09.742229+0000","last_peered":"2024-04-26T17:58:09.742229+0000","last_clean":"2024-04-26T17:58:09.742229+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T17:58:09.742229+0000","last_undegraded":"2024-04-26T17:58:09.742229+0000","last_fullsized":"2024-04-26T17:58:09.742229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868345+0000","last_change":"2024-04-26T17:58:04.713025+0000","last_active":"2024-04-26T17:58:09.868345+0000","last_peered":"2024-04-26T17:58:09.868345+0000","last_clean":"2024-04-26T17:58:09.868345+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T17:58:09.868345+0000","last_undegraded":"2024-04-26T17:58:09.868345+0000","last_fullsized":"2024-04-26T17:58:09.868345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:35.294319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739719+0000","last_change":"2024-04-26T17:58:08.739580+0000","last_active":"2024-04-26T17:58:09.739719+0000","last_peered":"2024-04-26T17:58:09.739719+0000","last_clean":"2024-04-26T17:58:09.739719+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T17:58:09.739719+0000","last_undegraded":"2024-04-26T17:58:09.739719+0000","last_fullsized":"2024-04-26T17:58:09.739719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.613945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868520+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T17:58:09.868520+0000","last_peered":"2024-04-26T17:58:09.868520+0000","last_clean":"2024-04-26T17:58:09.868520+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T17:58:09.868520+0000","last_undegraded":"2024-04-26T17:58:09.868520+0000","last_fullsized":"2024-04-26T17:58:09.868520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867109+0000","last_change":"2024-04-26T17:58:04.712809+0000","last_active":"2024-04-26T17:58:09.867109+0000","last_peered":"2024-04-26T17:58:09.867109+0000","last_clean":"2024-04-26T17:58:09.867109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T17:58:09.867109+0000","last_undegraded":"2024-04-26T17:58:09.867109+0000","last_fullsized":"2024-04-26T17:58:09.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:27.667789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866917+0000","last_change":"2024-04-26T17:58:08.738098+0000","last_active":"2024-04-26T17:58:09.866917+0000","last_peered":"2024-04-26T17:58:09.866917+0000","last_clean":"2024-04-26T17:58:09.866917+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T17:58:09.866917+0000","last_undegraded":"2024-04-26T17:58:09.866917+0000","last_fullsized":"2024-04-26T17:58:09.866917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:46.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740387+0000","last_change":"2024-04-26T17:58:04.717040+0000","last_active":"2024-04-26T17:58:09.740387+0000","last_peered":"2024-04-26T17:58:09.740387+0000","last_clean":"2024-04-26T17:58:09.740387+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T17:58:09.740387+0000","last_undegraded":"2024-04-26T17:58:09.740387+0000","last_fullsized":"2024-04-26T17:58:09.740387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739474+0000","last_change":"2024-04-26T17:58:04.717913+0000","last_active":"2024-04-26T17:58:09.739474+0000","last_peered":"2024-04-26T17:58:09.739474+0000","last_clean":"2024-04-26T17:58:09.739474+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T17:58:09.739474+0000","last_undegraded":"2024-04-26T17:58:09.739474+0000","last_fullsized":"2024-04-26T17:58:09.739474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:58.220321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867259+0000","last_change":"2024-04-26T17:58:04.726316+0000","last_active":"2024-04-26T17:58:09.867259+0000","last_peered":"2024-04-26T17:58:09.867259+0000","last_clean":"2024-04-26T17:58:09.867259+0000","last_became_active":"2024-04-26T17:58:04.726079+0000","last_became_peered":"2024-04-26T17:58:04.726079+0000","last_unstale":"2024-04-26T17:58:09.867259+0000","last_undegraded":"2024-04-26T17:58:09.867259+0000","last_fullsized":"2024-04-26T17:58:09.867259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:52.023348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868301+0000","last_change":"2024-04-26T17:58:04.718894+0000","last_active":"2024-04-26T17:58:09.868301+0000","last_peered":"2024-04-26T17:58:09.868301+0000","last_clean":"2024-04-26T17:58:09.868301+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T17:58:09.868301+0000","last_undegraded":"2024-04-26T17:58:09.868301+0000","last_fullsized":"2024-04-26T17:58:09.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:08.169756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868428+0000","last_change":"2024-04-26T17:58:04.717545+0000","last_active":"2024-04-26T17:58:09.868428+0000","last_peered":"2024-04-26T17:58:09.868428+0000","last_clean":"2024-04-26T17:58:09.868428+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T17:58:09.868428+0000","last_undegraded":"2024-04-26T17:58:09.868428+0000","last_fullsized":"2024-04-26T17:58:09.868428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:22.541323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866628+0000","last_change":"2024-04-26T17:58:04.719000+0000","last_active":"2024-04-26T17:58:09.866628+0000","last_peered":"2024-04-26T17:58:09.866628+0000","last_clean":"2024-04-26T17:58:09.866628+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T17:58:09.866628+0000","last_undegraded":"2024-04-26T17:58:09.866628+0000","last_fullsized":"2024-04-26T17:58:09.866628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:39.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741672+0000","last_change":"2024-04-26T17:58:04.719202+0000","last_active":"2024-04-26T17:58:09.741672+0000","last_peered":"2024-04-26T17:58:09.741672+0000","last_clean":"2024-04-26T17:58:09.741672+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T17:58:09.741672+0000","last_undegraded":"2024-04-26T17:58:09.741672+0000","last_fullsized":"2024-04-26T17:58:09.741672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:09.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867378+0000","last_change":"2024-04-26T17:58:04.717329+0000","last_active":"2024-04-26T17:58:09.867378+0000","last_peered":"2024-04-26T17:58:09.867378+0000","last_clean":"2024-04-26T17:58:09.867378+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T17:58:09.867378+0000","last_undegraded":"2024-04-26T17:58:09.867378+0000","last_fullsized":"2024-04-26T17:58:09.867378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:05.365008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866573+0000","last_change":"2024-04-26T17:58:04.727246+0000","last_active":"2024-04-26T17:58:09.866573+0000","last_peered":"2024-04-26T17:58:09.866573+0000","last_clean":"2024-04-26T17:58:09.866573+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T17:58:09.866573+0000","last_undegraded":"2024-04-26T17:58:09.866573+0000","last_fullsized":"2024-04-26T17:58:09.866573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:48.343210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867408+0000","last_change":"2024-04-26T17:58:04.713698+0000","last_active":"2024-04-26T17:58:09.867408+0000","last_peered":"2024-04-26T17:58:09.867408+0000","last_clean":"2024-04-26T17:58:09.867408+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T17:58:09.867408+0000","last_undegraded":"2024-04-26T17:58:09.867408+0000","last_fullsized":"2024-04-26T17:58:09.867408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:46.523995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867161+0000","last_change":"2024-04-26T17:58:04.724480+0000","last_active":"2024-04-26T17:58:09.867161+0000","last_peered":"2024-04-26T17:58:09.867161+0000","last_clean":"2024-04-26T17:58:09.867161+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T17:58:09.867161+0000","last_undegraded":"2024-04-26T17:58:09.867161+0000","last_fullsized":"2024-04-26T17:58:09.867161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:55.314208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868176+0000","last_change":"2024-04-26T17:58:04.708369+0000","last_active":"2024-04-26T17:58:09.868176+0000","last_peered":"2024-04-26T17:58:09.868176+0000","last_clean":"2024-04-26T17:58:09.868176+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T17:58:09.868176+0000","last_undegraded":"2024-04-26T17:58:09.868176+0000","last_fullsized":"2024-04-26T17:58:09.868176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:03.947874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741418+0000","last_change":"2024-04-26T17:58:04.714104+0000","last_active":"2024-04-26T17:58:09.741418+0000","last_peered":"2024-04-26T17:58:09.741418+0000","last_clean":"2024-04-26T17:58:09.741418+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T17:58:09.741418+0000","last_undegraded":"2024-04-26T17:58:09.741418+0000","last_fullsized":"2024-04-26T17:58:09.741418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:00.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741424+0000","last_change":"2024-04-26T17:58:04.714925+0000","last_active":"2024-04-26T17:58:09.741424+0000","last_peered":"2024-04-26T17:58:09.741424+0000","last_clean":"2024-04-26T17:58:09.741424+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T17:58:09.741424+0000","last_undegraded":"2024-04-26T17:58:09.741424+0000","last_fullsized":"2024-04-26T17:58:09.741424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.669034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739622+0000","last_change":"2024-04-26T17:58:04.714674+0000","last_active":"2024-04-26T17:58:09.739622+0000","last_peered":"2024-04-26T17:58:09.739622+0000","last_clean":"2024-04-26T17:58:09.739622+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T17:58:09.739622+0000","last_undegraded":"2024-04-26T17:58:09.739622+0000","last_fullsized":"2024-04-26T17:58:09.739622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:12.918478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867942+0000","last_change":"2024-04-26T17:58:04.722294+0000","last_active":"2024-04-26T17:58:09.867942+0000","last_peered":"2024-04-26T17:58:09.867942+0000","last_clean":"2024-04-26T17:58:09.867942+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T17:58:09.867942+0000","last_undegraded":"2024-04-26T17:58:09.867942+0000","last_fullsized":"2024-04-26T17:58:09.867942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:31.169681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866409+0000","last_change":"2024-04-26T17:58:04.725629+0000","last_active":"2024-04-26T17:58:09.866409+0000","last_peered":"2024-04-26T17:58:09.866409+0000","last_clean":"2024-04-26T17:58:09.866409+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T17:58:09.866409+0000","last_undegraded":"2024-04-26T17:58:09.866409+0000","last_fullsized":"2024-04-26T17:58:09.866409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:06.389060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867083+0000","last_change":"2024-04-26T17:58:04.716814+0000","last_active":"2024-04-26T17:58:09.867083+0000","last_peered":"2024-04-26T17:58:09.867083+0000","last_clean":"2024-04-26T17:58:09.867083+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T17:58:09.867083+0000","last_undegraded":"2024-04-26T17:58:09.867083+0000","last_fullsized":"2024-04-26T17:58:09.867083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:38.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867941+0000","last_change":"2024-04-26T17:58:04.715233+0000","last_active":"2024-04-26T17:58:09.867941+0000","last_peered":"2024-04-26T17:58:09.867941+0000","last_clean":"2024-04-26T17:58:09.867941+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T17:58:09.867941+0000","last_undegraded":"2024-04-26T17:58:09.867941+0000","last_fullsized":"2024-04-26T17:58:09.867941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:24.469756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867686+0000","last_change":"2024-04-26T17:58:04.722576+0000","last_active":"2024-04-26T17:58:09.867686+0000","last_peered":"2024-04-26T17:58:09.867686+0000","last_clean":"2024-04-26T17:58:09.867686+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T17:58:09.867686+0000","last_undegraded":"2024-04-26T17:58:09.867686+0000","last_fullsized":"2024-04-26T17:58:09.867686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:33.150267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867768+0000","last_change":"2024-04-26T17:58:04.712057+0000","last_active":"2024-04-26T17:58:09.867768+0000","last_peered":"2024-04-26T17:58:09.867768+0000","last_clean":"2024-04-26T17:58:09.867768+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T17:58:09.867768+0000","last_undegraded":"2024-04-26T17:58:09.867768+0000","last_fullsized":"2024-04-26T17:58:09.867768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:12.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741771+0000","last_change":"2024-04-26T17:58:04.727743+0000","last_active":"2024-04-26T17:58:09.741771+0000","last_peered":"2024-04-26T17:58:09.741771+0000","last_clean":"2024-04-26T17:58:09.741771+0000","last_became_active":"2024-04-26T17:58:04.727395+0000","last_became_peered":"2024-04-26T17:58:04.727395+0000","last_unstale":"2024-04-26T17:58:09.741771+0000","last_undegraded":"2024-04-26T17:58:09.741771+0000","last_fullsized":"2024-04-26T17:58:09.741771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:07.625978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741634+0000","last_change":"2024-04-26T17:58:04.727074+0000","last_active":"2024-04-26T17:58:09.741634+0000","last_peered":"2024-04-26T17:58:09.741634+0000","last_clean":"2024-04-26T17:58:09.741634+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T17:58:09.741634+0000","last_undegraded":"2024-04-26T17:58:09.741634+0000","last_fullsized":"2024-04-26T17:58:09.741634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:17.157157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741450+0000","last_change":"2024-04-26T17:58:04.723761+0000","last_active":"2024-04-26T17:58:09.741450+0000","last_peered":"2024-04-26T17:58:09.741450+0000","last_clean":"2024-04-26T17:58:09.741450+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T17:58:09.741450+0000","last_undegraded":"2024-04-26T17:58:09.741450+0000","last_fullsized":"2024-04-26T17:58:09.741450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:02.783054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867096+0000","last_change":"2024-04-26T17:58:04.724094+0000","last_active":"2024-04-26T17:58:09.867096+0000","last_peered":"2024-04-26T17:58:09.867096+0000","last_clean":"2024-04-26T17:58:09.867096+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T17:58:09.867096+0000","last_undegraded":"2024-04-26T17:58:09.867096+0000","last_fullsized":"2024-04-26T17:58:09.867096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:26.825638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740858+0000","last_change":"2024-04-26T17:58:04.713653+0000","last_active":"2024-04-26T17:58:09.740858+0000","last_peered":"2024-04-26T17:58:09.740858+0000","last_clean":"2024-04-26T17:58:09.740858+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T17:58:09.740858+0000","last_undegraded":"2024-04-26T17:58:09.740858+0000","last_fullsized":"2024-04-26T17:58:09.740858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:10.715579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867111+0000","last_change":"2024-04-26T17:58:04.725695+0000","last_active":"2024-04-26T17:58:09.867111+0000","last_peered":"2024-04-26T17:58:09.867111+0000","last_clean":"2024-04-26T17:58:09.867111+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T17:58:09.867111+0000","last_undegraded":"2024-04-26T17:58:09.867111+0000","last_fullsized":"2024-04-26T17:58:09.867111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:16.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740772+0000","last_change":"2024-04-26T17:58:04.712059+0000","last_active":"2024-04-26T17:58:09.740772+0000","last_peered":"2024-04-26T17:58:09.740772+0000","last_clean":"2024-04-26T17:58:09.740772+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T17:58:09.740772+0000","last_undegraded":"2024-04-26T17:58:09.740772+0000","last_fullsized":"2024-04-26T17:58:09.740772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:53.798495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867547+0000","last_change":"2024-04-26T17:58:04.726921+0000","last_active":"2024-04-26T17:58:09.867547+0000","last_peered":"2024-04-26T17:58:09.867547+0000","last_clean":"2024-04-26T17:58:09.867547+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T17:58:09.867547+0000","last_undegraded":"2024-04-26T17:58:09.867547+0000","last_fullsized":"2024-04-26T17:58:09.867547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:10.889230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867692+0000","last_change":"2024-04-26T17:58:04.714479+0000","last_active":"2024-04-26T17:58:09.867692+0000","last_peered":"2024-04-26T17:58:09.867692+0000","last_clean":"2024-04-26T17:58:09.867692+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T17:58:09.867692+0000","last_undegraded":"2024-04-26T17:58:09.867692+0000","last_fullsized":"2024-04-26T17:58:09.867692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:11.224793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867830+0000","last_change":"2024-04-26T17:58:04.715128+0000","last_active":"2024-04-26T17:58:09.867830+0000","last_peered":"2024-04-26T17:58:09.867830+0000","last_clean":"2024-04-26T17:58:09.867830+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T17:58:09.867830+0000","last_undegraded":"2024-04-26T17:58:09.867830+0000","last_fullsized":"2024-04-26T17:58:09.867830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:28.531949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741199+0000","last_change":"2024-04-26T17:58:04.719415+0000","last_active":"2024-04-26T17:58:09.741199+0000","last_peered":"2024-04-26T17:58:09.741199+0000","last_clean":"2024-04-26T17:58:09.741199+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T17:58:09.741199+0000","last_undegraded":"2024-04-26T17:58:09.741199+0000","last_fullsized":"2024-04-26T17:58:09.741199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:55.030120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:38.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:38.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.327+0000 7fef8bd91640 1 Processor -- start 2024-04-26T17:58:38.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.327+0000 7fef8bd91640 1 -- start start 2024-04-26T17:58:38.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8bd91640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8406e240 0x7fef840c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8bd91640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fef8415ce60 0x7fef8415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8bd91640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef840c7d30 con 0x7fef84153b10 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8bd91640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fef8406e8d0 con 0x7fef8415ce60 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8bd91640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fef84073910 con 0x7fef8406e240 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8a32e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fef8415ce60 0x7fef8415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8932c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8406e240 0x7fef840c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef89b2d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fef84153b10 0x7fef840cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39950/0 (socket says 172.21.15.139:39950) 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef89b2d640 1 -- 172.21.15.139:0/3815126715 learned_addr learned my addr 172.21.15.139:0/3815126715 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8932c640 1 -- 172.21.15.139:0/3815126715 >> v2:172.21.15.143:3300/0 conn(0x7fef8415ce60 msgr2=0x7fef8415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8932c640 1 --2- 172.21.15.139:0/3815126715 >> v2:172.21.15.143:3300/0 conn(0x7fef8415ce60 0x7fef8415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8932c640 1 -- 172.21.15.139:0/3815126715 >> v1:172.21.15.143:6789/0 conn(0x7fef84153b10 legacy=0x7fef840cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.328+0000 7fef8932c640 1 -- 172.21.15.139:0/3815126715 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef840c7ff0 con 0x7fef8406e240 2024-04-26T17:58:38.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.329+0000 7fef8932c640 1 --2- 172.21.15.139:0/3815126715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8406e240 0x7fef840c96d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef740097a0 tx=0x7fef7402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e78c4485b852b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.329+0000 7fef88b2b640 1 -- 172.21.15.139:0/3815126715 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74037070 con 0x7fef8406e240 2024-04-26T17:58:38.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.329+0000 7fef88b2b640 1 -- 172.21.15.139:0/3815126715 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef74032440 con 0x7fef8406e240 2024-04-26T17:58:38.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.329+0000 7fef88b2b640 1 -- 172.21.15.139:0/3815126715 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74032810 con 0x7fef8406e240 2024-04-26T17:58:38.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 -- 172.21.15.139:0/3815126715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8406e240 msgr2=0x7fef840c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 --2- 172.21.15.139:0/3815126715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8406e240 0x7fef840c96d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef740097a0 tx=0x7fef7402a210 comp rx=0 tx=0).stop 2024-04-26T17:58:38.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 -- 172.21.15.139:0/3815126715 shutdown_connections 2024-04-26T17:58:38.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 --2- 172.21.15.139:0/3815126715 >> v2:172.21.15.143:3300/0 conn(0x7fef8415ce60 0x7fef8415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 --2- 172.21.15.139:0/3815126715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8406e240 0x7fef840c96d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 -- 172.21.15.139:0/3815126715 >> 172.21.15.139:0/3815126715 conn(0x7fef84068270 msgr2=0x7fef84068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 -- 172.21.15.139:0/3815126715 shutdown_connections 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.330+0000 7fef8bd91640 1 -- 172.21.15.139:0/3815126715 wait complete. 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.331+0000 7fef8bd91640 1 Processor -- start 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.331+0000 7fef8bd91640 1 -- start start 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8bd91640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef8406e240 0x7fef841f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8bd91640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef84153b10 0x7fef8415bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8bd91640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8415ce60 0x7fef841efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8bd91640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fef840732c0 con 0x7fef84153b10 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8bd91640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fef8415d850 con 0x7fef8406e240 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8bd91640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fef840735a0 con 0x7fef8415ce60 2024-04-26T17:58:38.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef84153b10 0x7fef8415bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef84153b10 0x7fef8415bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36882/0 (socket says 172.21.15.139:36882) 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 -- 172.21.15.139:0/791076877 learned_addr learned my addr 172.21.15.139:0/791076877 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef89b2d640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef8406e240 0x7fef841f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8a32e640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8415ce60 0x7fef841efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 -- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8415ce60 msgr2=0x7fef841efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8415ce60 0x7fef841efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 -- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef8406e240 msgr2=0x7fef841f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef8406e240 0x7fef841f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 -- 172.21.15.139:0/791076877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef841493b0 con 0x7fef84153b10 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.332+0000 7fef8932c640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef84153b10 0x7fef8415bf00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef74000c00 tx=0x7fef740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.333+0000 7fef7a7fc640 1 -- 172.21.15.139:0/791076877 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74041070 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.333+0000 7fef7a7fc640 1 -- 172.21.15.139:0/791076877 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7403c870 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.333+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef84149690 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.333+0000 7fef7a7fc640 1 -- 172.21.15.139:0/791076877 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74037040 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.333+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef84149c50 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.334+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef84076d20 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.334+0000 7fef7a7fc640 1 -- 172.21.15.139:0/791076877 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef74044070 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.334+0000 7fef7a7fc640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fef6806c8f0 0x7fef6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.335+0000 7fef7a7fc640 1 -- 172.21.15.139:0/791076877 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fef740ac9c0 con 0x7fef84153b10 2024-04-26T17:58:38.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.335+0000 7fef89b2d640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fef6806c8f0 0x7fef6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.335+0000 7fef89b2d640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fef6806c8f0 0x7fef6806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef80007fd0 tx=0x7fef80007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.339+0000 7fef7a7fc640 1 -- 172.21.15.139:0/791076877 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fef740aee20 con 0x7fef84153b10 2024-04-26T17:58:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.512+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef8406eab0 con 0x7fef6806c8f0 2024-04-26T17:58:38.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.520+0000 7fef7a7fc640 1 -- 172.21.15.139:0/791076877 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7fef8406eab0 con 0x7fef6806c8f0 2024-04-26T17:58:38.524 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:38.526 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T17:58:38.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fef6806c8f0 msgr2=0x7fef6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fef6806c8f0 0x7fef6806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fef80007fd0 tx=0x7fef80007e80 comp rx=0 tx=0).stop 2024-04-26T17:58:38.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef84153b10 msgr2=0x7fef8415bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef84153b10 0x7fef8415bf00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef74000c00 tx=0x7fef740046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 shutdown_connections 2024-04-26T17:58:38.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fef6806c8f0 0x7fef6806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fef8415ce60 0x7fef841efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef84153b10 0x7fef8415bf00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 --2- 172.21.15.139:0/791076877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fef8406e240 0x7fef841f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.523+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 >> 172.21.15.139:0/791076877 conn(0x7fef84068270 msgr2=0x7fef84151c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.524+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 shutdown_connections 2024-04-26T17:58:38.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.524+0000 7fef8bd91640 1 -- 172.21.15.139:0/791076877 wait complete. 2024-04-26T17:58:38.534 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-26T17:58:37.033717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867920+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T17:58:09.867920+0000","last_peered":"2024-04-26T17:58:09.867920+0000","last_clean":"2024-04-26T17:58:09.867920+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T17:58:09.867920+0000","last_undegraded":"2024-04-26T17:58:09.867920+0000","last_fullsized":"2024-04-26T17:58:09.867920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866709+0000","last_change":"2024-04-26T17:58:04.721568+0000","last_active":"2024-04-26T17:58:09.866709+0000","last_peered":"2024-04-26T17:58:09.866709+0000","last_clean":"2024-04-26T17:58:09.866709+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T17:58:09.866709+0000","last_undegraded":"2024-04-26T17:58:09.866709+0000","last_fullsized":"2024-04-26T17:58:09.866709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:24.906240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867369+0000","last_change":"2024-04-26T17:58:08.737557+0000","last_active":"2024-04-26T17:58:09.867369+0000","last_peered":"2024-04-26T17:58:09.867369+0000","last_clean":"2024-04-26T17:58:09.867369+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T17:58:09.867369+0000","last_undegraded":"2024-04-26T17:58:09.867369+0000","last_fullsized":"2024-04-26T17:58:09.867369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:29.013280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866886+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T17:58:09.866886+0000","last_peered":"2024-04-26T17:58:09.866886+0000","last_clean":"2024-04-26T17:58:09.866886+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T17:58:09.866886+0000","last_undegraded":"2024-04-26T17:58:09.866886+0000","last_fullsized":"2024-04-26T17:58:09.866886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867706+0000","last_change":"2024-04-26T17:58:04.725200+0000","last_active":"2024-04-26T17:58:09.867706+0000","last_peered":"2024-04-26T17:58:09.867706+0000","last_clean":"2024-04-26T17:58:09.867706+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T17:58:09.867706+0000","last_undegraded":"2024-04-26T17:58:09.867706+0000","last_fullsized":"2024-04-26T17:58:09.867706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:15.882481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866726+0000","last_change":"2024-04-26T17:58:08.747272+0000","last_active":"2024-04-26T17:58:09.866726+0000","last_peered":"2024-04-26T17:58:09.866726+0000","last_clean":"2024-04-26T17:58:09.866726+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T17:58:09.866726+0000","last_undegraded":"2024-04-26T17:58:09.866726+0000","last_fullsized":"2024-04-26T17:58:09.866726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:08.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741319+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T17:58:09.741319+0000","last_peered":"2024-04-26T17:58:09.741319+0000","last_clean":"2024-04-26T17:58:09.741319+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T17:58:09.741319+0000","last_undegraded":"2024-04-26T17:58:09.741319+0000","last_fullsized":"2024-04-26T17:58:09.741319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867042+0000","last_change":"2024-04-26T17:58:04.723700+0000","last_active":"2024-04-26T17:58:09.867042+0000","last_peered":"2024-04-26T17:58:09.867042+0000","last_clean":"2024-04-26T17:58:09.867042+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T17:58:09.867042+0000","last_undegraded":"2024-04-26T17:58:09.867042+0000","last_fullsized":"2024-04-26T17:58:09.867042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:05.637900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866801+0000","last_change":"2024-04-26T17:58:08.746662+0000","last_active":"2024-04-26T17:58:09.866801+0000","last_peered":"2024-04-26T17:58:09.866801+0000","last_clean":"2024-04-26T17:58:09.866801+0000","last_became_active":"2024-04-26T17:58:08.746200+0000","last_became_peered":"2024-04-26T17:58:08.746200+0000","last_unstale":"2024-04-26T17:58:09.866801+0000","last_undegraded":"2024-04-26T17:58:09.866801+0000","last_fullsized":"2024-04-26T17:58:09.866801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:05.431076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740881+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T17:58:09.740881+0000","last_peered":"2024-04-26T17:58:09.740881+0000","last_clean":"2024-04-26T17:58:09.740881+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T17:58:09.740881+0000","last_undegraded":"2024-04-26T17:58:09.740881+0000","last_fullsized":"2024-04-26T17:58:09.740881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867441+0000","last_change":"2024-04-26T17:58:04.723945+0000","last_active":"2024-04-26T17:58:09.867441+0000","last_peered":"2024-04-26T17:58:09.867441+0000","last_clean":"2024-04-26T17:58:09.867441+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T17:58:09.867441+0000","last_undegraded":"2024-04-26T17:58:09.867441+0000","last_fullsized":"2024-04-26T17:58:09.867441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:58.454180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:08.743082+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:56.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742051+0000","last_change":"2024-04-26T17:58:04.715624+0000","last_active":"2024-04-26T17:58:09.742051+0000","last_peered":"2024-04-26T17:58:09.742051+0000","last_clean":"2024-04-26T17:58:09.742051+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T17:58:09.742051+0000","last_undegraded":"2024-04-26T17:58:09.742051+0000","last_fullsized":"2024-04-26T17:58:09.742051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:45.282546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741089+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T17:58:09.741089+0000","last_peered":"2024-04-26T17:58:09.741089+0000","last_clean":"2024-04-26T17:58:09.741089+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T17:58:09.741089+0000","last_undegraded":"2024-04-26T17:58:09.741089+0000","last_fullsized":"2024-04-26T17:58:09.741089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867178+0000","last_change":"2024-04-26T17:58:08.747055+0000","last_active":"2024-04-26T17:58:09.867178+0000","last_peered":"2024-04-26T17:58:09.867178+0000","last_clean":"2024-04-26T17:58:09.867178+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T17:58:09.867178+0000","last_undegraded":"2024-04-26T17:58:09.867178+0000","last_fullsized":"2024-04-26T17:58:09.867178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:38.260141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867917+0000","last_change":"2024-04-26T17:58:04.717982+0000","last_active":"2024-04-26T17:58:09.867917+0000","last_peered":"2024-04-26T17:58:09.867917+0000","last_clean":"2024-04-26T17:58:09.867917+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T17:58:09.867917+0000","last_undegraded":"2024-04-26T17:58:09.867917+0000","last_fullsized":"2024-04-26T17:58:09.867917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:54.094898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868688+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T17:58:09.868688+0000","last_peered":"2024-04-26T17:58:09.868688+0000","last_clean":"2024-04-26T17:58:09.868688+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T17:58:09.868688+0000","last_undegraded":"2024-04-26T17:58:09.868688+0000","last_fullsized":"2024-04-26T17:58:09.868688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867590+0000","last_change":"2024-04-26T17:58:08.747263+0000","last_active":"2024-04-26T17:58:09.867590+0000","last_peered":"2024-04-26T17:58:09.867590+0000","last_clean":"2024-04-26T17:58:09.867590+0000","last_became_active":"2024-04-26T17:58:08.746835+0000","last_became_peered":"2024-04-26T17:58:08.746835+0000","last_unstale":"2024-04-26T17:58:09.867590+0000","last_undegraded":"2024-04-26T17:58:09.867590+0000","last_fullsized":"2024-04-26T17:58:09.867590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:03.581123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867258+0000","last_change":"2024-04-26T17:58:04.717948+0000","last_active":"2024-04-26T17:58:09.867258+0000","last_peered":"2024-04-26T17:58:09.867258+0000","last_clean":"2024-04-26T17:58:09.867258+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T17:58:09.867258+0000","last_undegraded":"2024-04-26T17:58:09.867258+0000","last_fullsized":"2024-04-26T17:58:09.867258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.344820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867168+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T17:58:09.867168+0000","last_peered":"2024-04-26T17:58:09.867168+0000","last_clean":"2024-04-26T17:58:09.867168+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T17:58:09.867168+0000","last_undegraded":"2024-04-26T17:58:09.867168+0000","last_fullsized":"2024-04-26T17:58:09.867168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867165+0000","last_change":"2024-04-26T17:58:08.743822+0000","last_active":"2024-04-26T17:58:09.867165+0000","last_peered":"2024-04-26T17:58:09.867165+0000","last_clean":"2024-04-26T17:58:09.867165+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T17:58:09.867165+0000","last_undegraded":"2024-04-26T17:58:09.867165+0000","last_fullsized":"2024-04-26T17:58:09.867165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:12.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867993+0000","last_change":"2024-04-26T17:58:04.712440+0000","last_active":"2024-04-26T17:58:09.867993+0000","last_peered":"2024-04-26T17:58:09.867993+0000","last_clean":"2024-04-26T17:58:09.867993+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T17:58:09.867993+0000","last_undegraded":"2024-04-26T17:58:09.867993+0000","last_fullsized":"2024-04-26T17:58:09.867993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:30.916890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740538+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T17:58:09.740538+0000","last_peered":"2024-04-26T17:58:09.740538+0000","last_clean":"2024-04-26T17:58:09.740538+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T17:58:09.740538+0000","last_undegraded":"2024-04-26T17:58:09.740538+0000","last_fullsized":"2024-04-26T17:58:09.740538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866990+0000","last_change":"2024-04-26T17:58:08.747104+0000","last_active":"2024-04-26T17:58:09.866990+0000","last_peered":"2024-04-26T17:58:09.866990+0000","last_clean":"2024-04-26T17:58:09.866990+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T17:58:09.866990+0000","last_undegraded":"2024-04-26T17:58:09.866990+0000","last_fullsized":"2024-04-26T17:58:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:19.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867840+0000","last_change":"2024-04-26T17:58:04.715359+0000","last_active":"2024-04-26T17:58:09.867840+0000","last_peered":"2024-04-26T17:58:09.867840+0000","last_clean":"2024-04-26T17:58:09.867840+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T17:58:09.867840+0000","last_undegraded":"2024-04-26T17:58:09.867840+0000","last_fullsized":"2024-04-26T17:58:09.867840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:11.014077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742339+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T17:58:09.742339+0000","last_peered":"2024-04-26T17:58:09.742339+0000","last_clean":"2024-04-26T17:58:09.742339+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T17:58:09.742339+0000","last_undegraded":"2024-04-26T17:58:09.742339+0000","last_fullsized":"2024-04-26T17:58:09.742339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867794+0000","last_change":"2024-04-26T17:58:08.742685+0000","last_active":"2024-04-26T17:58:09.867794+0000","last_peered":"2024-04-26T17:58:09.867794+0000","last_clean":"2024-04-26T17:58:09.867794+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T17:58:09.867794+0000","last_undegraded":"2024-04-26T17:58:09.867794+0000","last_fullsized":"2024-04-26T17:58:09.867794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:49.952963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867465+0000","last_change":"2024-04-26T17:58:04.713980+0000","last_active":"2024-04-26T17:58:09.867465+0000","last_peered":"2024-04-26T17:58:09.867465+0000","last_clean":"2024-04-26T17:58:09.867465+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T17:58:09.867465+0000","last_undegraded":"2024-04-26T17:58:09.867465+0000","last_fullsized":"2024-04-26T17:58:09.867465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:48.678130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867971+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T17:58:09.867971+0000","last_peered":"2024-04-26T17:58:09.867971+0000","last_clean":"2024-04-26T17:58:09.867971+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T17:58:09.867971+0000","last_undegraded":"2024-04-26T17:58:09.867971+0000","last_fullsized":"2024-04-26T17:58:09.867971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867029+0000","last_change":"2024-04-26T17:58:08.746201+0000","last_active":"2024-04-26T17:58:09.867029+0000","last_peered":"2024-04-26T17:58:09.867029+0000","last_clean":"2024-04-26T17:58:09.867029+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T17:58:09.867029+0000","last_undegraded":"2024-04-26T17:58:09.867029+0000","last_fullsized":"2024-04-26T17:58:09.867029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:23.961683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866770+0000","last_change":"2024-04-26T17:58:04.712662+0000","last_active":"2024-04-26T17:58:09.866770+0000","last_peered":"2024-04-26T17:58:09.866770+0000","last_clean":"2024-04-26T17:58:09.866770+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T17:58:09.866770+0000","last_undegraded":"2024-04-26T17:58:09.866770+0000","last_fullsized":"2024-04-26T17:58:09.866770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:37.557975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741512+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T17:58:09.741512+0000","last_peered":"2024-04-26T17:58:09.741512+0000","last_clean":"2024-04-26T17:58:09.741512+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T17:58:09.741512+0000","last_undegraded":"2024-04-26T17:58:09.741512+0000","last_fullsized":"2024-04-26T17:58:09.741512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868118+0000","last_change":"2024-04-26T17:58:08.740345+0000","last_active":"2024-04-26T17:58:09.868118+0000","last_peered":"2024-04-26T17:58:09.868118+0000","last_clean":"2024-04-26T17:58:09.868118+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T17:58:09.868118+0000","last_undegraded":"2024-04-26T17:58:09.868118+0000","last_fullsized":"2024-04-26T17:58:09.868118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:49.324368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867513+0000","last_change":"2024-04-26T17:58:04.726233+0000","last_active":"2024-04-26T17:58:09.867513+0000","last_peered":"2024-04-26T17:58:09.867513+0000","last_clean":"2024-04-26T17:58:09.867513+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T17:58:09.867513+0000","last_undegraded":"2024-04-26T17:58:09.867513+0000","last_fullsized":"2024-04-26T17:58:09.867513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:04.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866859+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T17:58:09.866859+0000","last_peered":"2024-04-26T17:58:09.866859+0000","last_clean":"2024-04-26T17:58:09.866859+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T17:58:09.866859+0000","last_undegraded":"2024-04-26T17:58:09.866859+0000","last_fullsized":"2024-04-26T17:58:09.866859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868258+0000","last_change":"2024-04-26T17:58:08.742909+0000","last_active":"2024-04-26T17:58:09.868258+0000","last_peered":"2024-04-26T17:58:09.868258+0000","last_clean":"2024-04-26T17:58:09.868258+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T17:58:09.868258+0000","last_undegraded":"2024-04-26T17:58:09.868258+0000","last_fullsized":"2024-04-26T17:58:09.868258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:50.554497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867397+0000","last_change":"2024-04-26T17:58:04.708024+0000","last_active":"2024-04-26T17:58:09.867397+0000","last_peered":"2024-04-26T17:58:09.867397+0000","last_clean":"2024-04-26T17:58:09.867397+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T17:58:09.867397+0000","last_undegraded":"2024-04-26T17:58:09.867397+0000","last_fullsized":"2024-04-26T17:58:09.867397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867406+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T17:58:09.867406+0000","last_peered":"2024-04-26T17:58:09.867406+0000","last_clean":"2024-04-26T17:58:09.867406+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T17:58:09.867406+0000","last_undegraded":"2024-04-26T17:58:09.867406+0000","last_fullsized":"2024-04-26T17:58:09.867406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866674+0000","last_change":"2024-04-26T17:58:08.739726+0000","last_active":"2024-04-26T17:58:09.866674+0000","last_peered":"2024-04-26T17:58:09.866674+0000","last_clean":"2024-04-26T17:58:09.866674+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T17:58:09.866674+0000","last_undegraded":"2024-04-26T17:58:09.866674+0000","last_fullsized":"2024-04-26T17:58:09.866674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:08.315753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866446+0000","last_change":"2024-04-26T17:58:04.712446+0000","last_active":"2024-04-26T17:58:09.866446+0000","last_peered":"2024-04-26T17:58:09.866446+0000","last_clean":"2024-04-26T17:58:09.866446+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T17:58:09.866446+0000","last_undegraded":"2024-04-26T17:58:09.866446+0000","last_fullsized":"2024-04-26T17:58:09.866446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:52.484069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739473+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T17:58:09.739473+0000","last_peered":"2024-04-26T17:58:09.739473+0000","last_clean":"2024-04-26T17:58:09.739473+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T17:58:09.739473+0000","last_undegraded":"2024-04-26T17:58:09.739473+0000","last_fullsized":"2024-04-26T17:58:09.739473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867315+0000","last_change":"2024-04-26T17:58:08.742536+0000","last_active":"2024-04-26T17:58:09.867315+0000","last_peered":"2024-04-26T17:58:09.867315+0000","last_clean":"2024-04-26T17:58:09.867315+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T17:58:09.867315+0000","last_undegraded":"2024-04-26T17:58:09.867315+0000","last_fullsized":"2024-04-26T17:58:09.867315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:49.364705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866653+0000","last_change":"2024-04-26T17:58:04.711535+0000","last_active":"2024-04-26T17:58:09.866653+0000","last_peered":"2024-04-26T17:58:09.866653+0000","last_clean":"2024-04-26T17:58:09.866653+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T17:58:09.866653+0000","last_undegraded":"2024-04-26T17:58:09.866653+0000","last_fullsized":"2024-04-26T17:58:09.866653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:11.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740669+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T17:58:09.740669+0000","last_peered":"2024-04-26T17:58:09.740669+0000","last_clean":"2024-04-26T17:58:09.740669+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T17:58:09.740669+0000","last_undegraded":"2024-04-26T17:58:09.740669+0000","last_fullsized":"2024-04-26T17:58:09.740669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867764+0000","last_change":"2024-04-26T17:58:08.734543+0000","last_active":"2024-04-26T17:58:09.867764+0000","last_peered":"2024-04-26T17:58:09.867764+0000","last_clean":"2024-04-26T17:58:09.867764+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T17:58:09.867764+0000","last_undegraded":"2024-04-26T17:58:09.867764+0000","last_fullsized":"2024-04-26T17:58:09.867764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:55.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866271+0000","last_change":"2024-04-26T17:58:04.727199+0000","last_active":"2024-04-26T17:58:09.866271+0000","last_peered":"2024-04-26T17:58:09.866271+0000","last_clean":"2024-04-26T17:58:09.866271+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T17:58:09.866271+0000","last_undegraded":"2024-04-26T17:58:09.866271+0000","last_fullsized":"2024-04-26T17:58:09.866271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:06.483618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867639+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T17:58:09.867639+0000","last_peered":"2024-04-26T17:58:09.867639+0000","last_clean":"2024-04-26T17:58:09.867639+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T17:58:09.867639+0000","last_undegraded":"2024-04-26T17:58:09.867639+0000","last_fullsized":"2024-04-26T17:58:09.867639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740780+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T17:58:09.740780+0000","last_peered":"2024-04-26T17:58:09.740780+0000","last_clean":"2024-04-26T17:58:09.740780+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T17:58:09.740780+0000","last_undegraded":"2024-04-26T17:58:09.740780+0000","last_fullsized":"2024-04-26T17:58:09.740780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741715+0000","last_change":"2024-04-26T17:58:08.737072+0000","last_active":"2024-04-26T17:58:09.741715+0000","last_peered":"2024-04-26T17:58:09.741715+0000","last_clean":"2024-04-26T17:58:09.741715+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T17:58:09.741715+0000","last_undegraded":"2024-04-26T17:58:09.741715+0000","last_fullsized":"2024-04-26T17:58:09.741715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:11.217370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740782+0000","last_change":"2024-04-26T17:58:04.724798+0000","last_active":"2024-04-26T17:58:09.740782+0000","last_peered":"2024-04-26T17:58:09.740782+0000","last_clean":"2024-04-26T17:58:09.740782+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T17:58:09.740782+0000","last_undegraded":"2024-04-26T17:58:09.740782+0000","last_fullsized":"2024-04-26T17:58:09.740782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.707135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739785+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T17:58:09.739785+0000","last_peered":"2024-04-26T17:58:09.739785+0000","last_clean":"2024-04-26T17:58:09.739785+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T17:58:09.739785+0000","last_undegraded":"2024-04-26T17:58:09.739785+0000","last_fullsized":"2024-04-26T17:58:09.739785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741890+0000","last_change":"2024-04-26T17:58:08.735010+0000","last_active":"2024-04-26T17:58:09.741890+0000","last_peered":"2024-04-26T17:58:09.741890+0000","last_clean":"2024-04-26T17:58:09.741890+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T17:58:09.741890+0000","last_undegraded":"2024-04-26T17:58:09.741890+0000","last_fullsized":"2024-04-26T17:58:09.741890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.377179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867215+0000","last_change":"2024-04-26T17:58:04.726744+0000","last_active":"2024-04-26T17:58:09.867215+0000","last_peered":"2024-04-26T17:58:09.867215+0000","last_clean":"2024-04-26T17:58:09.867215+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T17:58:09.867215+0000","last_undegraded":"2024-04-26T17:58:09.867215+0000","last_fullsized":"2024-04-26T17:58:09.867215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:06.654631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868255+0000","last_change":"2024-04-26T17:58:08.748124+0000","last_active":"2024-04-26T17:58:09.868255+0000","last_peered":"2024-04-26T17:58:09.868255+0000","last_clean":"2024-04-26T17:58:09.868255+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T17:58:09.868255+0000","last_undegraded":"2024-04-26T17:58:09.868255+0000","last_fullsized":"2024-04-26T17:58:09.868255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:07.600726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741479+0000","last_change":"2024-04-26T17:58:04.716933+0000","last_active":"2024-04-26T17:58:09.741479+0000","last_peered":"2024-04-26T17:58:09.741479+0000","last_clean":"2024-04-26T17:58:09.741479+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T17:58:09.741479+0000","last_undegraded":"2024-04-26T17:58:09.741479+0000","last_fullsized":"2024-04-26T17:58:09.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:25.360981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739660+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T17:58:09.739660+0000","last_peered":"2024-04-26T17:58:09.739660+0000","last_clean":"2024-04-26T17:58:09.739660+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T17:58:09.739660+0000","last_undegraded":"2024-04-26T17:58:09.739660+0000","last_fullsized":"2024-04-26T17:58:09.739660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866386+0000","last_change":"2024-04-26T17:58:08.737297+0000","last_active":"2024-04-26T17:58:09.866386+0000","last_peered":"2024-04-26T17:58:09.866386+0000","last_clean":"2024-04-26T17:58:09.866386+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T17:58:09.866386+0000","last_undegraded":"2024-04-26T17:58:09.866386+0000","last_fullsized":"2024-04-26T17:58:09.866386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:34.582604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741116+0000","last_change":"2024-04-26T17:58:04.716850+0000","last_active":"2024-04-26T17:58:09.741116+0000","last_peered":"2024-04-26T17:58:09.741116+0000","last_clean":"2024-04-26T17:58:09.741116+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T17:58:09.741116+0000","last_undegraded":"2024-04-26T17:58:09.741116+0000","last_fullsized":"2024-04-26T17:58:09.741116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:35.530627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867994+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T17:58:09.867994+0000","last_peered":"2024-04-26T17:58:09.867994+0000","last_clean":"2024-04-26T17:58:09.867994+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T17:58:09.867994+0000","last_undegraded":"2024-04-26T17:58:09.867994+0000","last_fullsized":"2024-04-26T17:58:09.867994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866728+0000","last_change":"2024-04-26T17:58:08.747644+0000","last_active":"2024-04-26T17:58:09.866728+0000","last_peered":"2024-04-26T17:58:09.866728+0000","last_clean":"2024-04-26T17:58:09.866728+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T17:58:09.866728+0000","last_undegraded":"2024-04-26T17:58:09.866728+0000","last_fullsized":"2024-04-26T17:58:09.866728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.713815+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:08.918386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739376+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T17:58:09.739376+0000","last_peered":"2024-04-26T17:58:09.739376+0000","last_clean":"2024-04-26T17:58:09.739376+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T17:58:09.739376+0000","last_undegraded":"2024-04-26T17:58:09.739376+0000","last_fullsized":"2024-04-26T17:58:09.739376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867630+0000","last_change":"2024-04-26T17:58:08.739259+0000","last_active":"2024-04-26T17:58:09.867630+0000","last_peered":"2024-04-26T17:58:09.867630+0000","last_clean":"2024-04-26T17:58:09.867630+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T17:58:09.867630+0000","last_undegraded":"2024-04-26T17:58:09.867630+0000","last_fullsized":"2024-04-26T17:58:09.867630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:42.110881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740479+0000","last_change":"2024-04-26T17:58:04.717008+0000","last_active":"2024-04-26T17:58:09.740479+0000","last_peered":"2024-04-26T17:58:09.740479+0000","last_clean":"2024-04-26T17:58:09.740479+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T17:58:09.740479+0000","last_undegraded":"2024-04-26T17:58:09.740479+0000","last_fullsized":"2024-04-26T17:58:09.740479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:10.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741681+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T17:58:09.741681+0000","last_peered":"2024-04-26T17:58:09.741681+0000","last_clean":"2024-04-26T17:58:09.741681+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T17:58:09.741681+0000","last_undegraded":"2024-04-26T17:58:09.741681+0000","last_fullsized":"2024-04-26T17:58:09.741681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867276+0000","last_change":"2024-04-26T17:58:08.742774+0000","last_active":"2024-04-26T17:58:09.867276+0000","last_peered":"2024-04-26T17:58:09.867276+0000","last_clean":"2024-04-26T17:58:09.867276+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T17:58:09.867276+0000","last_undegraded":"2024-04-26T17:58:09.867276+0000","last_fullsized":"2024-04-26T17:58:09.867276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:04.231921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741023+0000","last_change":"2024-04-26T17:58:04.712970+0000","last_active":"2024-04-26T17:58:09.741023+0000","last_peered":"2024-04-26T17:58:09.741023+0000","last_clean":"2024-04-26T17:58:09.741023+0000","last_became_active":"2024-04-26T17:58:04.712645+0000","last_became_peered":"2024-04-26T17:58:04.712645+0000","last_unstale":"2024-04-26T17:58:09.741023+0000","last_undegraded":"2024-04-26T17:58:09.741023+0000","last_fullsized":"2024-04-26T17:58:09.741023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:06.746889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867322+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T17:58:09.867322+0000","last_peered":"2024-04-26T17:58:09.867322+0000","last_clean":"2024-04-26T17:58:09.867322+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T17:58:09.867322+0000","last_undegraded":"2024-04-26T17:58:09.867322+0000","last_fullsized":"2024-04-26T17:58:09.867322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868215+0000","last_change":"2024-04-26T17:58:08.741761+0000","last_active":"2024-04-26T17:58:09.868215+0000","last_peered":"2024-04-26T17:58:09.868215+0000","last_clean":"2024-04-26T17:58:09.868215+0000","last_became_active":"2024-04-26T17:58:08.741401+0000","last_became_peered":"2024-04-26T17:58:08.741401+0000","last_unstale":"2024-04-26T17:58:09.868215+0000","last_undegraded":"2024-04-26T17:58:09.868215+0000","last_fullsized":"2024-04-26T17:58:09.868215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:44.837522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867967+0000","last_change":"2024-04-26T17:58:04.705981+0000","last_active":"2024-04-26T17:58:09.867967+0000","last_peered":"2024-04-26T17:58:09.867967+0000","last_clean":"2024-04-26T17:58:09.867967+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T17:58:09.867967+0000","last_undegraded":"2024-04-26T17:58:09.867967+0000","last_fullsized":"2024-04-26T17:58:09.867967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868393+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T17:58:09.868393+0000","last_peered":"2024-04-26T17:58:09.868393+0000","last_clean":"2024-04-26T17:58:09.868393+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T17:58:09.868393+0000","last_undegraded":"2024-04-26T17:58:09.868393+0000","last_fullsized":"2024-04-26T17:58:09.868393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867400+0000","last_change":"2024-04-26T17:58:08.739520+0000","last_active":"2024-04-26T17:58:09.867400+0000","last_peered":"2024-04-26T17:58:09.867400+0000","last_clean":"2024-04-26T17:58:09.867400+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T17:58:09.867400+0000","last_undegraded":"2024-04-26T17:58:09.867400+0000","last_fullsized":"2024-04-26T17:58:09.867400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:10.313792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.719394+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:33.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.307724+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T17:58:17.307724+0000","last_peered":"2024-04-26T17:58:17.307724+0000","last_clean":"2024-04-26T17:58:17.307724+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T17:58:17.307724+0000","last_undegraded":"2024-04-26T17:58:17.307724+0000","last_fullsized":"2024-04-26T17:58:17.307724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868423+0000","last_change":"2024-04-26T17:58:08.736275+0000","last_active":"2024-04-26T17:58:09.868423+0000","last_peered":"2024-04-26T17:58:09.868423+0000","last_clean":"2024-04-26T17:58:09.868423+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T17:58:09.868423+0000","last_undegraded":"2024-04-26T17:58:09.868423+0000","last_fullsized":"2024-04-26T17:58:09.868423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:07.103401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867796+0000","last_change":"2024-04-26T17:58:04.712316+0000","last_active":"2024-04-26T17:58:09.867796+0000","last_peered":"2024-04-26T17:58:09.867796+0000","last_clean":"2024-04-26T17:58:09.867796+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T17:58:09.867796+0000","last_undegraded":"2024-04-26T17:58:09.867796+0000","last_fullsized":"2024-04-26T17:58:09.867796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:49.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866776+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T17:58:09.866776+0000","last_peered":"2024-04-26T17:58:09.866776+0000","last_clean":"2024-04-26T17:58:09.866776+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T17:58:09.866776+0000","last_undegraded":"2024-04-26T17:58:09.866776+0000","last_fullsized":"2024-04-26T17:58:09.866776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867058+0000","last_change":"2024-04-26T17:58:08.742746+0000","last_active":"2024-04-26T17:58:09.867058+0000","last_peered":"2024-04-26T17:58:09.867058+0000","last_clean":"2024-04-26T17:58:09.867058+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T17:58:09.867058+0000","last_undegraded":"2024-04-26T17:58:09.867058+0000","last_fullsized":"2024-04-26T17:58:09.867058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:51.352617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868076+0000","last_change":"2024-04-26T17:58:04.723214+0000","last_active":"2024-04-26T17:58:09.868076+0000","last_peered":"2024-04-26T17:58:09.868076+0000","last_clean":"2024-04-26T17:58:09.868076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T17:58:09.868076+0000","last_undegraded":"2024-04-26T17:58:09.868076+0000","last_fullsized":"2024-04-26T17:58:09.868076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:08.558197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867696+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T17:58:09.867696+0000","last_peered":"2024-04-26T17:58:09.867696+0000","last_clean":"2024-04-26T17:58:09.867696+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T17:58:09.867696+0000","last_undegraded":"2024-04-26T17:58:09.867696+0000","last_fullsized":"2024-04-26T17:58:09.867696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867239+0000","last_change":"2024-04-26T17:58:08.745044+0000","last_active":"2024-04-26T17:58:09.867239+0000","last_peered":"2024-04-26T17:58:09.867239+0000","last_clean":"2024-04-26T17:58:09.867239+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T17:58:09.867239+0000","last_undegraded":"2024-04-26T17:58:09.867239+0000","last_fullsized":"2024-04-26T17:58:09.867239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:53.339198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867490+0000","last_change":"2024-04-26T17:58:04.720903+0000","last_active":"2024-04-26T17:58:09.867490+0000","last_peered":"2024-04-26T17:58:09.867490+0000","last_clean":"2024-04-26T17:58:09.867490+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T17:58:09.867490+0000","last_undegraded":"2024-04-26T17:58:09.867490+0000","last_fullsized":"2024-04-26T17:58:09.867490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:46.583637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742161+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T17:58:09.742161+0000","last_peered":"2024-04-26T17:58:09.742161+0000","last_clean":"2024-04-26T17:58:09.742161+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T17:58:09.742161+0000","last_undegraded":"2024-04-26T17:58:09.742161+0000","last_fullsized":"2024-04-26T17:58:09.742161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867269+0000","last_change":"2024-04-26T17:58:08.743119+0000","last_active":"2024-04-26T17:58:09.867269+0000","last_peered":"2024-04-26T17:58:09.867269+0000","last_clean":"2024-04-26T17:58:09.867269+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T17:58:09.867269+0000","last_undegraded":"2024-04-26T17:58:09.867269+0000","last_fullsized":"2024-04-26T17:58:09.867269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:41.640200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867500+0000","last_change":"2024-04-26T17:58:08.739999+0000","last_active":"2024-04-26T17:58:09.867500+0000","last_peered":"2024-04-26T17:58:09.867500+0000","last_clean":"2024-04-26T17:58:09.867500+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T17:58:09.867500+0000","last_undegraded":"2024-04-26T17:58:09.867500+0000","last_fullsized":"2024-04-26T17:58:09.867500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:30.637006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866996+0000","last_change":"2024-04-26T17:58:04.719069+0000","last_active":"2024-04-26T17:58:09.866996+0000","last_peered":"2024-04-26T17:58:09.866996+0000","last_clean":"2024-04-26T17:58:09.866996+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T17:58:09.866996+0000","last_undegraded":"2024-04-26T17:58:09.866996+0000","last_fullsized":"2024-04-26T17:58:09.866996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:09.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867009+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T17:58:09.867009+0000","last_peered":"2024-04-26T17:58:09.867009+0000","last_clean":"2024-04-26T17:58:09.867009+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T17:58:09.867009+0000","last_undegraded":"2024-04-26T17:58:09.867009+0000","last_fullsized":"2024-04-26T17:58:09.867009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741957+0000","last_change":"2024-04-26T17:58:08.738167+0000","last_active":"2024-04-26T17:58:09.741957+0000","last_peered":"2024-04-26T17:58:09.741957+0000","last_clean":"2024-04-26T17:58:09.741957+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T17:58:09.741957+0000","last_undegraded":"2024-04-26T17:58:09.741957+0000","last_fullsized":"2024-04-26T17:58:09.741957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:42.434088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867177+0000","last_change":"2024-04-26T17:58:04.717580+0000","last_active":"2024-04-26T17:58:09.867177+0000","last_peered":"2024-04-26T17:58:09.867177+0000","last_clean":"2024-04-26T17:58:09.867177+0000","last_became_active":"2024-04-26T17:58:04.717313+0000","last_became_peered":"2024-04-26T17:58:04.717313+0000","last_unstale":"2024-04-26T17:58:09.867177+0000","last_undegraded":"2024-04-26T17:58:09.867177+0000","last_fullsized":"2024-04-26T17:58:09.867177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:54.802557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867508+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T17:58:09.867508+0000","last_peered":"2024-04-26T17:58:09.867508+0000","last_clean":"2024-04-26T17:58:09.867508+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T17:58:09.867508+0000","last_undegraded":"2024-04-26T17:58:09.867508+0000","last_fullsized":"2024-04-26T17:58:09.867508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742229+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T17:58:09.742229+0000","last_peered":"2024-04-26T17:58:09.742229+0000","last_clean":"2024-04-26T17:58:09.742229+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T17:58:09.742229+0000","last_undegraded":"2024-04-26T17:58:09.742229+0000","last_fullsized":"2024-04-26T17:58:09.742229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868345+0000","last_change":"2024-04-26T17:58:04.713025+0000","last_active":"2024-04-26T17:58:09.868345+0000","last_peered":"2024-04-26T17:58:09.868345+0000","last_clean":"2024-04-26T17:58:09.868345+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T17:58:09.868345+0000","last_undegraded":"2024-04-26T17:58:09.868345+0000","last_fullsized":"2024-04-26T17:58:09.868345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:35.294319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739719+0000","last_change":"2024-04-26T17:58:08.739580+0000","last_active":"2024-04-26T17:58:09.739719+0000","last_peered":"2024-04-26T17:58:09.739719+0000","last_clean":"2024-04-26T17:58:09.739719+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T17:58:09.739719+0000","last_undegraded":"2024-04-26T17:58:09.739719+0000","last_fullsized":"2024-04-26T17:58:09.739719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.613945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868520+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T17:58:09.868520+0000","last_peered":"2024-04-26T17:58:09.868520+0000","last_clean":"2024-04-26T17:58:09.868520+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T17:58:09.868520+0000","last_undegraded":"2024-04-26T17:58:09.868520+0000","last_fullsized":"2024-04-26T17:58:09.868520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867109+0000","last_change":"2024-04-26T17:58:04.712809+0000","last_active":"2024-04-26T17:58:09.867109+0000","last_peered":"2024-04-26T17:58:09.867109+0000","last_clean":"2024-04-26T17:58:09.867109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T17:58:09.867109+0000","last_undegraded":"2024-04-26T17:58:09.867109+0000","last_fullsized":"2024-04-26T17:58:09.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:27.667789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866917+0000","last_change":"2024-04-26T17:58:08.738098+0000","last_active":"2024-04-26T17:58:09.866917+0000","last_peered":"2024-04-26T17:58:09.866917+0000","last_clean":"2024-04-26T17:58:09.866917+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T17:58:09.866917+0000","last_undegraded":"2024-04-26T17:58:09.866917+0000","last_fullsized":"2024-04-26T17:58:09.866917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:46.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740387+0000","last_change":"2024-04-26T17:58:04.717040+0000","last_active":"2024-04-26T17:58:09.740387+0000","last_peered":"2024-04-26T17:58:09.740387+0000","last_clean":"2024-04-26T17:58:09.740387+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T17:58:09.740387+0000","last_undegraded":"2024-04-26T17:58:09.740387+0000","last_fullsized":"2024-04-26T17:58:09.740387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739474+0000","last_change":"2024-04-26T17:58:04.717913+0000","last_active":"2024-04-26T17:58:09.739474+0000","last_peered":"2024-04-26T17:58:09.739474+0000","last_clean":"2024-04-26T17:58:09.739474+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T17:58:09.739474+0000","last_undegraded":"2024-04-26T17:58:09.739474+0000","last_fullsized":"2024-04-26T17:58:09.739474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:58.220321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867259+0000","last_change":"2024-04-26T17:58:04.726316+0000","last_active":"2024-04-26T17:58:09.867259+0000","last_peered":"2024-04-26T17:58:09.867259+0000","last_clean":"2024-04-26T17:58:09.867259+0000","last_became_active":"2024-04-26T17:58:04.726079+0000","last_became_peered":"2024-04-26T17:58:04.726079+0000","last_unstale":"2024-04-26T17:58:09.867259+0000","last_undegraded":"2024-04-26T17:58:09.867259+0000","last_fullsized":"2024-04-26T17:58:09.867259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:52.023348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868301+0000","last_change":"2024-04-26T17:58:04.718894+0000","last_active":"2024-04-26T17:58:09.868301+0000","last_peered":"2024-04-26T17:58:09.868301+0000","last_clean":"2024-04-26T17:58:09.868301+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T17:58:09.868301+0000","last_undegraded":"2024-04-26T17:58:09.868301+0000","last_fullsized":"2024-04-26T17:58:09.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:08.169756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868428+0000","last_change":"2024-04-26T17:58:04.717545+0000","last_active":"2024-04-26T17:58:09.868428+0000","last_peered":"2024-04-26T17:58:09.868428+0000","last_clean":"2024-04-26T17:58:09.868428+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T17:58:09.868428+0000","last_undegraded":"2024-04-26T17:58:09.868428+0000","last_fullsized":"2024-04-26T17:58:09.868428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:22.541323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866628+0000","last_change":"2024-04-26T17:58:04.719000+0000","last_active":"2024-04-26T17:58:09.866628+0000","last_peered":"2024-04-26T17:58:09.866628+0000","last_clean":"2024-04-26T17:58:09.866628+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T17:58:09.866628+0000","last_undegraded":"2024-04-26T17:58:09.866628+0000","last_fullsized":"2024-04-26T17:58:09.866628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:39.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741672+0000","last_change":"2024-04-26T17:58:04.719202+0000","last_active":"2024-04-26T17:58:09.741672+0000","last_peered":"2024-04-26T17:58:09.741672+0000","last_clean":"2024-04-26T17:58:09.741672+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T17:58:09.741672+0000","last_undegraded":"2024-04-26T17:58:09.741672+0000","last_fullsized":"2024-04-26T17:58:09.741672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:09.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867378+0000","last_change":"2024-04-26T17:58:04.717329+0000","last_active":"2024-04-26T17:58:09.867378+0000","last_peered":"2024-04-26T17:58:09.867378+0000","last_clean":"2024-04-26T17:58:09.867378+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T17:58:09.867378+0000","last_undegraded":"2024-04-26T17:58:09.867378+0000","last_fullsized":"2024-04-26T17:58:09.867378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:05.365008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866573+0000","last_change":"2024-04-26T17:58:04.727246+0000","last_active":"2024-04-26T17:58:09.866573+0000","last_peered":"2024-04-26T17:58:09.866573+0000","last_clean":"2024-04-26T17:58:09.866573+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T17:58:09.866573+0000","last_undegraded":"2024-04-26T17:58:09.866573+0000","last_fullsized":"2024-04-26T17:58:09.866573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:48.343210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867408+0000","last_change":"2024-04-26T17:58:04.713698+0000","last_active":"2024-04-26T17:58:09.867408+0000","last_peered":"2024-04-26T17:58:09.867408+0000","last_clean":"2024-04-26T17:58:09.867408+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T17:58:09.867408+0000","last_undegraded":"2024-04-26T17:58:09.867408+0000","last_fullsized":"2024-04-26T17:58:09.867408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:46.523995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867161+0000","last_change":"2024-04-26T17:58:04.724480+0000","last_active":"2024-04-26T17:58:09.867161+0000","last_peered":"2024-04-26T17:58:09.867161+0000","last_clean":"2024-04-26T17:58:09.867161+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T17:58:09.867161+0000","last_undegraded":"2024-04-26T17:58:09.867161+0000","last_fullsized":"2024-04-26T17:58:09.867161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:55.314208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868176+0000","last_change":"2024-04-26T17:58:04.708369+0000","last_active":"2024-04-26T17:58:09.868176+0000","last_peered":"2024-04-26T17:58:09.868176+0000","last_clean":"2024-04-26T17:58:09.868176+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T17:58:09.868176+0000","last_undegraded":"2024-04-26T17:58:09.868176+0000","last_fullsized":"2024-04-26T17:58:09.868176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:03.947874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741418+0000","last_change":"2024-04-26T17:58:04.714104+0000","last_active":"2024-04-26T17:58:09.741418+0000","last_peered":"2024-04-26T17:58:09.741418+0000","last_clean":"2024-04-26T17:58:09.741418+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T17:58:09.741418+0000","last_undegraded":"2024-04-26T17:58:09.741418+0000","last_fullsized":"2024-04-26T17:58:09.741418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:00.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741424+0000","last_change":"2024-04-26T17:58:04.714925+0000","last_active":"2024-04-26T17:58:09.741424+0000","last_peered":"2024-04-26T17:58:09.741424+0000","last_clean":"2024-04-26T17:58:09.741424+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T17:58:09.741424+0000","last_undegraded":"2024-04-26T17:58:09.741424+0000","last_fullsized":"2024-04-26T17:58:09.741424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.669034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739622+0000","last_change":"2024-04-26T17:58:04.714674+0000","last_active":"2024-04-26T17:58:09.739622+0000","last_peered":"2024-04-26T17:58:09.739622+0000","last_clean":"2024-04-26T17:58:09.739622+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T17:58:09.739622+0000","last_undegraded":"2024-04-26T17:58:09.739622+0000","last_fullsized":"2024-04-26T17:58:09.739622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:12.918478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867942+0000","last_change":"2024-04-26T17:58:04.722294+0000","last_active":"2024-04-26T17:58:09.867942+0000","last_peered":"2024-04-26T17:58:09.867942+0000","last_clean":"2024-04-26T17:58:09.867942+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T17:58:09.867942+0000","last_undegraded":"2024-04-26T17:58:09.867942+0000","last_fullsized":"2024-04-26T17:58:09.867942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:31.169681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866409+0000","last_change":"2024-04-26T17:58:04.725629+0000","last_active":"2024-04-26T17:58:09.866409+0000","last_peered":"2024-04-26T17:58:09.866409+0000","last_clean":"2024-04-26T17:58:09.866409+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T17:58:09.866409+0000","last_undegraded":"2024-04-26T17:58:09.866409+0000","last_fullsized":"2024-04-26T17:58:09.866409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:06.389060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867083+0000","last_change":"2024-04-26T17:58:04.716814+0000","last_active":"2024-04-26T17:58:09.867083+0000","last_peered":"2024-04-26T17:58:09.867083+0000","last_clean":"2024-04-26T17:58:09.867083+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T17:58:09.867083+0000","last_undegraded":"2024-04-26T17:58:09.867083+0000","last_fullsized":"2024-04-26T17:58:09.867083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:38.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867941+0000","last_change":"2024-04-26T17:58:04.715233+0000","last_active":"2024-04-26T17:58:09.867941+0000","last_peered":"2024-04-26T17:58:09.867941+0000","last_clean":"2024-04-26T17:58:09.867941+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T17:58:09.867941+0000","last_undegraded":"2024-04-26T17:58:09.867941+0000","last_fullsized":"2024-04-26T17:58:09.867941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:24.469756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867686+0000","last_change":"2024-04-26T17:58:04.722576+0000","last_active":"2024-04-26T17:58:09.867686+0000","last_peered":"2024-04-26T17:58:09.867686+0000","last_clean":"2024-04-26T17:58:09.867686+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T17:58:09.867686+0000","last_undegraded":"2024-04-26T17:58:09.867686+0000","last_fullsized":"2024-04-26T17:58:09.867686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:33.150267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867768+0000","last_change":"2024-04-26T17:58:04.712057+0000","last_active":"2024-04-26T17:58:09.867768+0000","last_peered":"2024-04-26T17:58:09.867768+0000","last_clean":"2024-04-26T17:58:09.867768+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T17:58:09.867768+0000","last_undegraded":"2024-04-26T17:58:09.867768+0000","last_fullsized":"2024-04-26T17:58:09.867768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:12.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741771+0000","last_change":"2024-04-26T17:58:04.727743+0000","last_active":"2024-04-26T17:58:09.741771+0000","last_peered":"2024-04-26T17:58:09.741771+0000","last_clean":"2024-04-26T17:58:09.741771+0000","last_became_active":"2024-04-26T17:58:04.727395+0000","last_became_peered":"2024-04-26T17:58:04.727395+0000","last_unstale":"2024-04-26T17:58:09.741771+0000","last_undegraded":"2024-04-26T17:58:09.741771+0000","last_fullsized":"2024-04-26T17:58:09.741771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:07.625978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741634+0000","last_change":"2024-04-26T17:58:04.727074+0000","last_active":"2024-04-26T17:58:09.741634+0000","last_peered":"2024-04-26T17:58:09.741634+0000","last_clean":"2024-04-26T17:58:09.741634+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T17:58:09.741634+0000","last_undegraded":"2024-04-26T17:58:09.741634+0000","last_fullsized":"2024-04-26T17:58:09.741634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:17.157157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741450+0000","last_change":"2024-04-26T17:58:04.723761+0000","last_active":"2024-04-26T17:58:09.741450+0000","last_peered":"2024-04-26T17:58:09.741450+0000","last_clean":"2024-04-26T17:58:09.741450+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T17:58:09.741450+0000","last_undegraded":"2024-04-26T17:58:09.741450+0000","last_fullsized":"2024-04-26T17:58:09.741450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:02.783054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867096+0000","last_change":"2024-04-26T17:58:04.724094+0000","last_active":"2024-04-26T17:58:09.867096+0000","last_peered":"2024-04-26T17:58:09.867096+0000","last_clean":"2024-04-26T17:58:09.867096+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T17:58:09.867096+0000","last_undegraded":"2024-04-26T17:58:09.867096+0000","last_fullsized":"2024-04-26T17:58:09.867096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:26.825638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740858+0000","last_change":"2024-04-26T17:58:04.713653+0000","last_active":"2024-04-26T17:58:09.740858+0000","last_peered":"2024-04-26T17:58:09.740858+0000","last_clean":"2024-04-26T17:58:09.740858+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T17:58:09.740858+0000","last_undegraded":"2024-04-26T17:58:09.740858+0000","last_fullsized":"2024-04-26T17:58:09.740858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:10.715579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867111+0000","last_change":"2024-04-26T17:58:04.725695+0000","last_active":"2024-04-26T17:58:09.867111+0000","last_peered":"2024-04-26T17:58:09.867111+0000","last_clean":"2024-04-26T17:58:09.867111+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T17:58:09.867111+0000","last_undegraded":"2024-04-26T17:58:09.867111+0000","last_fullsized":"2024-04-26T17:58:09.867111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:16.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740772+0000","last_change":"2024-04-26T17:58:04.712059+0000","last_active":"2024-04-26T17:58:09.740772+0000","last_peered":"2024-04-26T17:58:09.740772+0000","last_clean":"2024-04-26T17:58:09.740772+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T17:58:09.740772+0000","last_undegraded":"2024-04-26T17:58:09.740772+0000","last_fullsized":"2024-04-26T17:58:09.740772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:53.798495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867547+0000","last_change":"2024-04-26T17:58:04.726921+0000","last_active":"2024-04-26T17:58:09.867547+0000","last_peered":"2024-04-26T17:58:09.867547+0000","last_clean":"2024-04-26T17:58:09.867547+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T17:58:09.867547+0000","last_undegraded":"2024-04-26T17:58:09.867547+0000","last_fullsized":"2024-04-26T17:58:09.867547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:10.889230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867692+0000","last_change":"2024-04-26T17:58:04.714479+0000","last_active":"2024-04-26T17:58:09.867692+0000","last_peered":"2024-04-26T17:58:09.867692+0000","last_clean":"2024-04-26T17:58:09.867692+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T17:58:09.867692+0000","last_undegraded":"2024-04-26T17:58:09.867692+0000","last_fullsized":"2024-04-26T17:58:09.867692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:11.224793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867830+0000","last_change":"2024-04-26T17:58:04.715128+0000","last_active":"2024-04-26T17:58:09.867830+0000","last_peered":"2024-04-26T17:58:09.867830+0000","last_clean":"2024-04-26T17:58:09.867830+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T17:58:09.867830+0000","last_undegraded":"2024-04-26T17:58:09.867830+0000","last_fullsized":"2024-04-26T17:58:09.867830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:28.531949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741199+0000","last_change":"2024-04-26T17:58:04.719415+0000","last_active":"2024-04-26T17:58:09.741199+0000","last_peered":"2024-04-26T17:58:09.741199+0000","last_clean":"2024-04-26T17:58:09.741199+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T17:58:09.741199+0000","last_undegraded":"2024-04-26T17:58:09.741199+0000","last_fullsized":"2024-04-26T17:58:09.741199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:55.030120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:38.540 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T17:58:38.540 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:38.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.672+0000 7fa2e382a640 1 Processor -- start 2024-04-26T17:58:38.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.672+0000 7fa2e382a640 1 -- start start 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e382a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa2dc06e240 0x7fa2dc0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e382a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc15ce60 0x7fa2dc15d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e382a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2dc0c7d30 con 0x7fa2dc153b10 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e382a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fa2dc06e8d0 con 0x7fa2dc06e240 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e382a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa2dc073910 con 0x7fa2dc15ce60 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e0dc5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa2dc06e240 0x7fa2dc0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e15c6640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa2dc153b10 0x7fa2dc0cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40544/0 (socket says 172.21.15.139:40544) 2024-04-26T17:58:38.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e15c6640 1 -- 172.21.15.139:0/2793361251 learned_addr learned my addr 172.21.15.139:0/2793361251 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e1dc7640 1 --2- 172.21.15.139:0/2793361251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc15ce60 0x7fa2dc15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e0dc5640 1 -- 172.21.15.139:0/2793361251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc15ce60 msgr2=0x7fa2dc15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e0dc5640 1 --2- 172.21.15.139:0/2793361251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc15ce60 0x7fa2dc15d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e0dc5640 1 -- 172.21.15.139:0/2793361251 >> v1:172.21.15.139:6789/0 conn(0x7fa2dc153b10 legacy=0x7fa2dc0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e0dc5640 1 -- 172.21.15.139:0/2793361251 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc0c7ff0 con 0x7fa2dc06e240 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2d3fff640 1 -- 172.21.15.139:0/2793361251 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824843191 0 0) 0x7fa2dc0c7d30 con 0x7fa2dc153b10 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.673+0000 7fa2e1dc7640 1 --2- 172.21.15.139:0/2793361251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc15ce60 0x7fa2dc15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.674+0000 7fa2e0dc5640 1 --2- 172.21.15.139:0/2793361251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc06e240 0x7fa2dc0c96d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0097a0 tx=0x7fa2cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7668d91be5926 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.674+0000 7fa2d3fff640 1 -- 172.21.15.139:0/2793361251 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc037070 con 0x7fa2dc06e240 2024-04-26T17:58:38.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.674+0000 7fa2d3fff640 1 -- 172.21.15.139:0/2793361251 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2cc032440 con 0x7fa2dc06e240 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.674+0000 7fa2d3fff640 1 -- 172.21.15.139:0/2793361251 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc032810 con 0x7fa2dc06e240 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 -- 172.21.15.139:0/2793361251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc06e240 msgr2=0x7fa2dc0c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 --2- 172.21.15.139:0/2793361251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc06e240 0x7fa2dc0c96d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0097a0 tx=0x7fa2cc02a210 comp rx=0 tx=0).stop 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 -- 172.21.15.139:0/2793361251 shutdown_connections 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 --2- 172.21.15.139:0/2793361251 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc15ce60 0x7fa2dc15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 --2- 172.21.15.139:0/2793361251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc06e240 0x7fa2dc0c96d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 -- 172.21.15.139:0/2793361251 >> 172.21.15.139:0/2793361251 conn(0x7fa2dc068270 msgr2=0x7fa2dc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 -- 172.21.15.139:0/2793361251 shutdown_connections 2024-04-26T17:58:38.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.675+0000 7fa2e382a640 1 -- 172.21.15.139:0/2793361251 wait complete. 2024-04-26T17:58:38.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.676+0000 7fa2e382a640 1 Processor -- start 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.676+0000 7fa2e382a640 1 -- start start 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e382a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc06e240 0x7fa2dc149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e382a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2dc153b10 0x7fa2dc1f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e382a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc15ce60 0x7fa2dc1e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e382a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc0732c0 con 0x7fa2dc15ce60 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e382a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc15d850 con 0x7fa2dc153b10 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e382a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa2dc0735a0 con 0x7fa2dc06e240 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc15ce60 0x7fa2dc1e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc15ce60 0x7fa2dc1e4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36902/0 (socket says 172.21.15.139:36902) 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 -- 172.21.15.139:0/3420657122 learned_addr learned my addr 172.21.15.139:0/3420657122 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:38.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e0dc5640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2dc153b10 0x7fa2dc1f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e15c6640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc06e240 0x7fa2dc149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 -- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc06e240 msgr2=0x7fa2dc149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc06e240 0x7fa2dc149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 -- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2dc153b10 msgr2=0x7fa2dc1f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2dc153b10 0x7fa2dc1f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 -- 172.21.15.139:0/3420657122 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc1efd40 con 0x7fa2dc15ce60 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e0dc5640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2dc153b10 0x7fa2dc1f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e1dc7640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc15ce60 0x7fa2dc1e4ba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c7c0 tx=0x7fa2d400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2d1ffb640 1 -- 172.21.15.139:0/3420657122 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4015020 con 0x7fa2dc15ce60 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2d1ffb640 1 -- 172.21.15.139:0/3420657122 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d4004230 con 0x7fa2dc15ce60 2024-04-26T17:58:38.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2dc1f0020 con 0x7fa2dc15ce60 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.677+0000 7fa2d1ffb640 1 -- 172.21.15.139:0/3420657122 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4007620 con 0x7fa2dc15ce60 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.678+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2dc1f05e0 con 0x7fa2dc15ce60 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.679+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2dc076d20 con 0x7fa2dc15ce60 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.679+0000 7fa2d1ffb640 1 -- 172.21.15.139:0/3420657122 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2d4018020 con 0x7fa2dc15ce60 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.679+0000 7fa2d1ffb640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa2c006c8f0 0x7fa2c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.680+0000 7fa2e15c6640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa2c006c8f0 0x7fa2c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.680+0000 7fa2d1ffb640 1 -- 172.21.15.139:0/3420657122 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa2d408bfd0 con 0x7fa2dc15ce60 2024-04-26T17:58:38.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.680+0000 7fa2e15c6640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa2c006c8f0 0x7fa2c006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80012e0 tx=0x7fa2d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.684+0000 7fa2d1ffb640 1 -- 172.21.15.139:0/3420657122 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2d401f020 con 0x7fa2dc15ce60 2024-04-26T17:58:38.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.856+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2dc06f6e0 con 0x7fa2c006c8f0 2024-04-26T17:58:38.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.863+0000 7fa2d1ffb640 1 -- 172.21.15.139:0/3420657122 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7fa2dc06f6e0 con 0x7fa2c006c8f0 2024-04-26T17:58:38.867 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:38.869 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T17:58:38.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa2c006c8f0 msgr2=0x7fa2c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa2c006c8f0 0x7fa2c006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80012e0 tx=0x7fa2d8009040 comp rx=0 tx=0).stop 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc15ce60 msgr2=0x7fa2dc1e4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc15ce60 0x7fa2dc1e4ba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400c7c0 tx=0x7fa2d400cc80 comp rx=0 tx=0).stop 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 shutdown_connections 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa2c006c8f0 0x7fa2c006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2dc15ce60 0x7fa2dc1e4ba0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa2dc153b10 0x7fa2dc1f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 --2- 172.21.15.139:0/3420657122 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa2dc06e240 0x7fa2dc149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 >> 172.21.15.139:0/3420657122 conn(0x7fa2dc068270 msgr2=0x7fa2dc14a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 shutdown_connections 2024-04-26T17:58:38.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:38.867+0000 7fa2e382a640 1 -- 172.21.15.139:0/3420657122 wait complete. 2024-04-26T17:58:38.878 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-26T17:58:37.033717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867920+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T17:58:09.867920+0000","last_peered":"2024-04-26T17:58:09.867920+0000","last_clean":"2024-04-26T17:58:09.867920+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T17:58:09.867920+0000","last_undegraded":"2024-04-26T17:58:09.867920+0000","last_fullsized":"2024-04-26T17:58:09.867920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866709+0000","last_change":"2024-04-26T17:58:04.721568+0000","last_active":"2024-04-26T17:58:09.866709+0000","last_peered":"2024-04-26T17:58:09.866709+0000","last_clean":"2024-04-26T17:58:09.866709+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T17:58:09.866709+0000","last_undegraded":"2024-04-26T17:58:09.866709+0000","last_fullsized":"2024-04-26T17:58:09.866709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:24.906240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867369+0000","last_change":"2024-04-26T17:58:08.737557+0000","last_active":"2024-04-26T17:58:09.867369+0000","last_peered":"2024-04-26T17:58:09.867369+0000","last_clean":"2024-04-26T17:58:09.867369+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T17:58:09.867369+0000","last_undegraded":"2024-04-26T17:58:09.867369+0000","last_fullsized":"2024-04-26T17:58:09.867369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:29.013280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866886+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T17:58:09.866886+0000","last_peered":"2024-04-26T17:58:09.866886+0000","last_clean":"2024-04-26T17:58:09.866886+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T17:58:09.866886+0000","last_undegraded":"2024-04-26T17:58:09.866886+0000","last_fullsized":"2024-04-26T17:58:09.866886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867706+0000","last_change":"2024-04-26T17:58:04.725200+0000","last_active":"2024-04-26T17:58:09.867706+0000","last_peered":"2024-04-26T17:58:09.867706+0000","last_clean":"2024-04-26T17:58:09.867706+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T17:58:09.867706+0000","last_undegraded":"2024-04-26T17:58:09.867706+0000","last_fullsized":"2024-04-26T17:58:09.867706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:15.882481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866726+0000","last_change":"2024-04-26T17:58:08.747272+0000","last_active":"2024-04-26T17:58:09.866726+0000","last_peered":"2024-04-26T17:58:09.866726+0000","last_clean":"2024-04-26T17:58:09.866726+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T17:58:09.866726+0000","last_undegraded":"2024-04-26T17:58:09.866726+0000","last_fullsized":"2024-04-26T17:58:09.866726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:08.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741319+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T17:58:09.741319+0000","last_peered":"2024-04-26T17:58:09.741319+0000","last_clean":"2024-04-26T17:58:09.741319+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T17:58:09.741319+0000","last_undegraded":"2024-04-26T17:58:09.741319+0000","last_fullsized":"2024-04-26T17:58:09.741319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867042+0000","last_change":"2024-04-26T17:58:04.723700+0000","last_active":"2024-04-26T17:58:09.867042+0000","last_peered":"2024-04-26T17:58:09.867042+0000","last_clean":"2024-04-26T17:58:09.867042+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T17:58:09.867042+0000","last_undegraded":"2024-04-26T17:58:09.867042+0000","last_fullsized":"2024-04-26T17:58:09.867042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:05.637900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866801+0000","last_change":"2024-04-26T17:58:08.746662+0000","last_active":"2024-04-26T17:58:09.866801+0000","last_peered":"2024-04-26T17:58:09.866801+0000","last_clean":"2024-04-26T17:58:09.866801+0000","last_became_active":"2024-04-26T17:58:08.746200+0000","last_became_peered":"2024-04-26T17:58:08.746200+0000","last_unstale":"2024-04-26T17:58:09.866801+0000","last_undegraded":"2024-04-26T17:58:09.866801+0000","last_fullsized":"2024-04-26T17:58:09.866801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:05.431076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740881+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T17:58:09.740881+0000","last_peered":"2024-04-26T17:58:09.740881+0000","last_clean":"2024-04-26T17:58:09.740881+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T17:58:09.740881+0000","last_undegraded":"2024-04-26T17:58:09.740881+0000","last_fullsized":"2024-04-26T17:58:09.740881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867441+0000","last_change":"2024-04-26T17:58:04.723945+0000","last_active":"2024-04-26T17:58:09.867441+0000","last_peered":"2024-04-26T17:58:09.867441+0000","last_clean":"2024-04-26T17:58:09.867441+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T17:58:09.867441+0000","last_undegraded":"2024-04-26T17:58:09.867441+0000","last_fullsized":"2024-04-26T17:58:09.867441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:58.454180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:08.743082+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:56.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742051+0000","last_change":"2024-04-26T17:58:04.715624+0000","last_active":"2024-04-26T17:58:09.742051+0000","last_peered":"2024-04-26T17:58:09.742051+0000","last_clean":"2024-04-26T17:58:09.742051+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T17:58:09.742051+0000","last_undegraded":"2024-04-26T17:58:09.742051+0000","last_fullsized":"2024-04-26T17:58:09.742051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:45.282546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741089+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T17:58:09.741089+0000","last_peered":"2024-04-26T17:58:09.741089+0000","last_clean":"2024-04-26T17:58:09.741089+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T17:58:09.741089+0000","last_undegraded":"2024-04-26T17:58:09.741089+0000","last_fullsized":"2024-04-26T17:58:09.741089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867178+0000","last_change":"2024-04-26T17:58:08.747055+0000","last_active":"2024-04-26T17:58:09.867178+0000","last_peered":"2024-04-26T17:58:09.867178+0000","last_clean":"2024-04-26T17:58:09.867178+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T17:58:09.867178+0000","last_undegraded":"2024-04-26T17:58:09.867178+0000","last_fullsized":"2024-04-26T17:58:09.867178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:38.260141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867917+0000","last_change":"2024-04-26T17:58:04.717982+0000","last_active":"2024-04-26T17:58:09.867917+0000","last_peered":"2024-04-26T17:58:09.867917+0000","last_clean":"2024-04-26T17:58:09.867917+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T17:58:09.867917+0000","last_undegraded":"2024-04-26T17:58:09.867917+0000","last_fullsized":"2024-04-26T17:58:09.867917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:54.094898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868688+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T17:58:09.868688+0000","last_peered":"2024-04-26T17:58:09.868688+0000","last_clean":"2024-04-26T17:58:09.868688+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T17:58:09.868688+0000","last_undegraded":"2024-04-26T17:58:09.868688+0000","last_fullsized":"2024-04-26T17:58:09.868688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867590+0000","last_change":"2024-04-26T17:58:08.747263+0000","last_active":"2024-04-26T17:58:09.867590+0000","last_peered":"2024-04-26T17:58:09.867590+0000","last_clean":"2024-04-26T17:58:09.867590+0000","last_became_active":"2024-04-26T17:58:08.746835+0000","last_became_peered":"2024-04-26T17:58:08.746835+0000","last_unstale":"2024-04-26T17:58:09.867590+0000","last_undegraded":"2024-04-26T17:58:09.867590+0000","last_fullsized":"2024-04-26T17:58:09.867590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:03.581123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867258+0000","last_change":"2024-04-26T17:58:04.717948+0000","last_active":"2024-04-26T17:58:09.867258+0000","last_peered":"2024-04-26T17:58:09.867258+0000","last_clean":"2024-04-26T17:58:09.867258+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T17:58:09.867258+0000","last_undegraded":"2024-04-26T17:58:09.867258+0000","last_fullsized":"2024-04-26T17:58:09.867258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:14.344820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867168+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T17:58:09.867168+0000","last_peered":"2024-04-26T17:58:09.867168+0000","last_clean":"2024-04-26T17:58:09.867168+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T17:58:09.867168+0000","last_undegraded":"2024-04-26T17:58:09.867168+0000","last_fullsized":"2024-04-26T17:58:09.867168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867165+0000","last_change":"2024-04-26T17:58:08.743822+0000","last_active":"2024-04-26T17:58:09.867165+0000","last_peered":"2024-04-26T17:58:09.867165+0000","last_clean":"2024-04-26T17:58:09.867165+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T17:58:09.867165+0000","last_undegraded":"2024-04-26T17:58:09.867165+0000","last_fullsized":"2024-04-26T17:58:09.867165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:12.552966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867993+0000","last_change":"2024-04-26T17:58:04.712440+0000","last_active":"2024-04-26T17:58:09.867993+0000","last_peered":"2024-04-26T17:58:09.867993+0000","last_clean":"2024-04-26T17:58:09.867993+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T17:58:09.867993+0000","last_undegraded":"2024-04-26T17:58:09.867993+0000","last_fullsized":"2024-04-26T17:58:09.867993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:30.916890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740538+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T17:58:09.740538+0000","last_peered":"2024-04-26T17:58:09.740538+0000","last_clean":"2024-04-26T17:58:09.740538+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T17:58:09.740538+0000","last_undegraded":"2024-04-26T17:58:09.740538+0000","last_fullsized":"2024-04-26T17:58:09.740538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866990+0000","last_change":"2024-04-26T17:58:08.747104+0000","last_active":"2024-04-26T17:58:09.866990+0000","last_peered":"2024-04-26T17:58:09.866990+0000","last_clean":"2024-04-26T17:58:09.866990+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T17:58:09.866990+0000","last_undegraded":"2024-04-26T17:58:09.866990+0000","last_fullsized":"2024-04-26T17:58:09.866990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:19.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867840+0000","last_change":"2024-04-26T17:58:04.715359+0000","last_active":"2024-04-26T17:58:09.867840+0000","last_peered":"2024-04-26T17:58:09.867840+0000","last_clean":"2024-04-26T17:58:09.867840+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T17:58:09.867840+0000","last_undegraded":"2024-04-26T17:58:09.867840+0000","last_fullsized":"2024-04-26T17:58:09.867840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:11.014077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742339+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T17:58:09.742339+0000","last_peered":"2024-04-26T17:58:09.742339+0000","last_clean":"2024-04-26T17:58:09.742339+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T17:58:09.742339+0000","last_undegraded":"2024-04-26T17:58:09.742339+0000","last_fullsized":"2024-04-26T17:58:09.742339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867794+0000","last_change":"2024-04-26T17:58:08.742685+0000","last_active":"2024-04-26T17:58:09.867794+0000","last_peered":"2024-04-26T17:58:09.867794+0000","last_clean":"2024-04-26T17:58:09.867794+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T17:58:09.867794+0000","last_undegraded":"2024-04-26T17:58:09.867794+0000","last_fullsized":"2024-04-26T17:58:09.867794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:49.952963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867465+0000","last_change":"2024-04-26T17:58:04.713980+0000","last_active":"2024-04-26T17:58:09.867465+0000","last_peered":"2024-04-26T17:58:09.867465+0000","last_clean":"2024-04-26T17:58:09.867465+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T17:58:09.867465+0000","last_undegraded":"2024-04-26T17:58:09.867465+0000","last_fullsized":"2024-04-26T17:58:09.867465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:48.678130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867971+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T17:58:09.867971+0000","last_peered":"2024-04-26T17:58:09.867971+0000","last_clean":"2024-04-26T17:58:09.867971+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T17:58:09.867971+0000","last_undegraded":"2024-04-26T17:58:09.867971+0000","last_fullsized":"2024-04-26T17:58:09.867971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867029+0000","last_change":"2024-04-26T17:58:08.746201+0000","last_active":"2024-04-26T17:58:09.867029+0000","last_peered":"2024-04-26T17:58:09.867029+0000","last_clean":"2024-04-26T17:58:09.867029+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T17:58:09.867029+0000","last_undegraded":"2024-04-26T17:58:09.867029+0000","last_fullsized":"2024-04-26T17:58:09.867029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:09:23.961683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866770+0000","last_change":"2024-04-26T17:58:04.712662+0000","last_active":"2024-04-26T17:58:09.866770+0000","last_peered":"2024-04-26T17:58:09.866770+0000","last_clean":"2024-04-26T17:58:09.866770+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T17:58:09.866770+0000","last_undegraded":"2024-04-26T17:58:09.866770+0000","last_fullsized":"2024-04-26T17:58:09.866770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:37.557975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741512+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T17:58:09.741512+0000","last_peered":"2024-04-26T17:58:09.741512+0000","last_clean":"2024-04-26T17:58:09.741512+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T17:58:09.741512+0000","last_undegraded":"2024-04-26T17:58:09.741512+0000","last_fullsized":"2024-04-26T17:58:09.741512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868118+0000","last_change":"2024-04-26T17:58:08.740345+0000","last_active":"2024-04-26T17:58:09.868118+0000","last_peered":"2024-04-26T17:58:09.868118+0000","last_clean":"2024-04-26T17:58:09.868118+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T17:58:09.868118+0000","last_undegraded":"2024-04-26T17:58:09.868118+0000","last_fullsized":"2024-04-26T17:58:09.868118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:49.324368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867513+0000","last_change":"2024-04-26T17:58:04.726233+0000","last_active":"2024-04-26T17:58:09.867513+0000","last_peered":"2024-04-26T17:58:09.867513+0000","last_clean":"2024-04-26T17:58:09.867513+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T17:58:09.867513+0000","last_undegraded":"2024-04-26T17:58:09.867513+0000","last_fullsized":"2024-04-26T17:58:09.867513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:04.872309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866859+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T17:58:09.866859+0000","last_peered":"2024-04-26T17:58:09.866859+0000","last_clean":"2024-04-26T17:58:09.866859+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T17:58:09.866859+0000","last_undegraded":"2024-04-26T17:58:09.866859+0000","last_fullsized":"2024-04-26T17:58:09.866859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868258+0000","last_change":"2024-04-26T17:58:08.742909+0000","last_active":"2024-04-26T17:58:09.868258+0000","last_peered":"2024-04-26T17:58:09.868258+0000","last_clean":"2024-04-26T17:58:09.868258+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T17:58:09.868258+0000","last_undegraded":"2024-04-26T17:58:09.868258+0000","last_fullsized":"2024-04-26T17:58:09.868258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:50.554497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867397+0000","last_change":"2024-04-26T17:58:04.708024+0000","last_active":"2024-04-26T17:58:09.867397+0000","last_peered":"2024-04-26T17:58:09.867397+0000","last_clean":"2024-04-26T17:58:09.867397+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T17:58:09.867397+0000","last_undegraded":"2024-04-26T17:58:09.867397+0000","last_fullsized":"2024-04-26T17:58:09.867397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:02.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867406+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T17:58:09.867406+0000","last_peered":"2024-04-26T17:58:09.867406+0000","last_clean":"2024-04-26T17:58:09.867406+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T17:58:09.867406+0000","last_undegraded":"2024-04-26T17:58:09.867406+0000","last_fullsized":"2024-04-26T17:58:09.867406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866674+0000","last_change":"2024-04-26T17:58:08.739726+0000","last_active":"2024-04-26T17:58:09.866674+0000","last_peered":"2024-04-26T17:58:09.866674+0000","last_clean":"2024-04-26T17:58:09.866674+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T17:58:09.866674+0000","last_undegraded":"2024-04-26T17:58:09.866674+0000","last_fullsized":"2024-04-26T17:58:09.866674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:08.315753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866446+0000","last_change":"2024-04-26T17:58:04.712446+0000","last_active":"2024-04-26T17:58:09.866446+0000","last_peered":"2024-04-26T17:58:09.866446+0000","last_clean":"2024-04-26T17:58:09.866446+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T17:58:09.866446+0000","last_undegraded":"2024-04-26T17:58:09.866446+0000","last_fullsized":"2024-04-26T17:58:09.866446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:52.484069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739473+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T17:58:09.739473+0000","last_peered":"2024-04-26T17:58:09.739473+0000","last_clean":"2024-04-26T17:58:09.739473+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T17:58:09.739473+0000","last_undegraded":"2024-04-26T17:58:09.739473+0000","last_fullsized":"2024-04-26T17:58:09.739473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867315+0000","last_change":"2024-04-26T17:58:08.742536+0000","last_active":"2024-04-26T17:58:09.867315+0000","last_peered":"2024-04-26T17:58:09.867315+0000","last_clean":"2024-04-26T17:58:09.867315+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T17:58:09.867315+0000","last_undegraded":"2024-04-26T17:58:09.867315+0000","last_fullsized":"2024-04-26T17:58:09.867315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:49.364705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866653+0000","last_change":"2024-04-26T17:58:04.711535+0000","last_active":"2024-04-26T17:58:09.866653+0000","last_peered":"2024-04-26T17:58:09.866653+0000","last_clean":"2024-04-26T17:58:09.866653+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T17:58:09.866653+0000","last_undegraded":"2024-04-26T17:58:09.866653+0000","last_fullsized":"2024-04-26T17:58:09.866653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:11.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740669+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T17:58:09.740669+0000","last_peered":"2024-04-26T17:58:09.740669+0000","last_clean":"2024-04-26T17:58:09.740669+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T17:58:09.740669+0000","last_undegraded":"2024-04-26T17:58:09.740669+0000","last_fullsized":"2024-04-26T17:58:09.740669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867764+0000","last_change":"2024-04-26T17:58:08.734543+0000","last_active":"2024-04-26T17:58:09.867764+0000","last_peered":"2024-04-26T17:58:09.867764+0000","last_clean":"2024-04-26T17:58:09.867764+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T17:58:09.867764+0000","last_undegraded":"2024-04-26T17:58:09.867764+0000","last_fullsized":"2024-04-26T17:58:09.867764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:55.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866271+0000","last_change":"2024-04-26T17:58:04.727199+0000","last_active":"2024-04-26T17:58:09.866271+0000","last_peered":"2024-04-26T17:58:09.866271+0000","last_clean":"2024-04-26T17:58:09.866271+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T17:58:09.866271+0000","last_undegraded":"2024-04-26T17:58:09.866271+0000","last_fullsized":"2024-04-26T17:58:09.866271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:06.483618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867639+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T17:58:09.867639+0000","last_peered":"2024-04-26T17:58:09.867639+0000","last_clean":"2024-04-26T17:58:09.867639+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T17:58:09.867639+0000","last_undegraded":"2024-04-26T17:58:09.867639+0000","last_fullsized":"2024-04-26T17:58:09.867639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740780+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T17:58:09.740780+0000","last_peered":"2024-04-26T17:58:09.740780+0000","last_clean":"2024-04-26T17:58:09.740780+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T17:58:09.740780+0000","last_undegraded":"2024-04-26T17:58:09.740780+0000","last_fullsized":"2024-04-26T17:58:09.740780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741715+0000","last_change":"2024-04-26T17:58:08.737072+0000","last_active":"2024-04-26T17:58:09.741715+0000","last_peered":"2024-04-26T17:58:09.741715+0000","last_clean":"2024-04-26T17:58:09.741715+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T17:58:09.741715+0000","last_undegraded":"2024-04-26T17:58:09.741715+0000","last_fullsized":"2024-04-26T17:58:09.741715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:11.217370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740782+0000","last_change":"2024-04-26T17:58:04.724798+0000","last_active":"2024-04-26T17:58:09.740782+0000","last_peered":"2024-04-26T17:58:09.740782+0000","last_clean":"2024-04-26T17:58:09.740782+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T17:58:09.740782+0000","last_undegraded":"2024-04-26T17:58:09.740782+0000","last_fullsized":"2024-04-26T17:58:09.740782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.707135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739785+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T17:58:09.739785+0000","last_peered":"2024-04-26T17:58:09.739785+0000","last_clean":"2024-04-26T17:58:09.739785+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T17:58:09.739785+0000","last_undegraded":"2024-04-26T17:58:09.739785+0000","last_fullsized":"2024-04-26T17:58:09.739785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741890+0000","last_change":"2024-04-26T17:58:08.735010+0000","last_active":"2024-04-26T17:58:09.741890+0000","last_peered":"2024-04-26T17:58:09.741890+0000","last_clean":"2024-04-26T17:58:09.741890+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T17:58:09.741890+0000","last_undegraded":"2024-04-26T17:58:09.741890+0000","last_fullsized":"2024-04-26T17:58:09.741890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:58.377179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867215+0000","last_change":"2024-04-26T17:58:04.726744+0000","last_active":"2024-04-26T17:58:09.867215+0000","last_peered":"2024-04-26T17:58:09.867215+0000","last_clean":"2024-04-26T17:58:09.867215+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T17:58:09.867215+0000","last_undegraded":"2024-04-26T17:58:09.867215+0000","last_fullsized":"2024-04-26T17:58:09.867215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:06.654631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866828+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T17:58:09.866828+0000","last_peered":"2024-04-26T17:58:09.866828+0000","last_clean":"2024-04-26T17:58:09.866828+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T17:58:09.866828+0000","last_undegraded":"2024-04-26T17:58:09.866828+0000","last_fullsized":"2024-04-26T17:58:09.866828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868255+0000","last_change":"2024-04-26T17:58:08.748124+0000","last_active":"2024-04-26T17:58:09.868255+0000","last_peered":"2024-04-26T17:58:09.868255+0000","last_clean":"2024-04-26T17:58:09.868255+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T17:58:09.868255+0000","last_undegraded":"2024-04-26T17:58:09.868255+0000","last_fullsized":"2024-04-26T17:58:09.868255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:07.600726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741479+0000","last_change":"2024-04-26T17:58:04.716933+0000","last_active":"2024-04-26T17:58:09.741479+0000","last_peered":"2024-04-26T17:58:09.741479+0000","last_clean":"2024-04-26T17:58:09.741479+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T17:58:09.741479+0000","last_undegraded":"2024-04-26T17:58:09.741479+0000","last_fullsized":"2024-04-26T17:58:09.741479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:25.360981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739660+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T17:58:09.739660+0000","last_peered":"2024-04-26T17:58:09.739660+0000","last_clean":"2024-04-26T17:58:09.739660+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T17:58:09.739660+0000","last_undegraded":"2024-04-26T17:58:09.739660+0000","last_fullsized":"2024-04-26T17:58:09.739660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866386+0000","last_change":"2024-04-26T17:58:08.737297+0000","last_active":"2024-04-26T17:58:09.866386+0000","last_peered":"2024-04-26T17:58:09.866386+0000","last_clean":"2024-04-26T17:58:09.866386+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T17:58:09.866386+0000","last_undegraded":"2024-04-26T17:58:09.866386+0000","last_fullsized":"2024-04-26T17:58:09.866386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:23:34.582604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741116+0000","last_change":"2024-04-26T17:58:04.716850+0000","last_active":"2024-04-26T17:58:09.741116+0000","last_peered":"2024-04-26T17:58:09.741116+0000","last_clean":"2024-04-26T17:58:09.741116+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T17:58:09.741116+0000","last_undegraded":"2024-04-26T17:58:09.741116+0000","last_fullsized":"2024-04-26T17:58:09.741116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:35.530627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867994+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T17:58:09.867994+0000","last_peered":"2024-04-26T17:58:09.867994+0000","last_clean":"2024-04-26T17:58:09.867994+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T17:58:09.867994+0000","last_undegraded":"2024-04-26T17:58:09.867994+0000","last_fullsized":"2024-04-26T17:58:09.867994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866728+0000","last_change":"2024-04-26T17:58:08.747644+0000","last_active":"2024-04-26T17:58:09.866728+0000","last_peered":"2024-04-26T17:58:09.866728+0000","last_clean":"2024-04-26T17:58:09.866728+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T17:58:09.866728+0000","last_undegraded":"2024-04-26T17:58:09.866728+0000","last_fullsized":"2024-04-26T17:58:09.866728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:33.036956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.713815+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:08.918386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739376+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T17:58:09.739376+0000","last_peered":"2024-04-26T17:58:09.739376+0000","last_clean":"2024-04-26T17:58:09.739376+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T17:58:09.739376+0000","last_undegraded":"2024-04-26T17:58:09.739376+0000","last_fullsized":"2024-04-26T17:58:09.739376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867630+0000","last_change":"2024-04-26T17:58:08.739259+0000","last_active":"2024-04-26T17:58:09.867630+0000","last_peered":"2024-04-26T17:58:09.867630+0000","last_clean":"2024-04-26T17:58:09.867630+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T17:58:09.867630+0000","last_undegraded":"2024-04-26T17:58:09.867630+0000","last_fullsized":"2024-04-26T17:58:09.867630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:42.110881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740479+0000","last_change":"2024-04-26T17:58:04.717008+0000","last_active":"2024-04-26T17:58:09.740479+0000","last_peered":"2024-04-26T17:58:09.740479+0000","last_clean":"2024-04-26T17:58:09.740479+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T17:58:09.740479+0000","last_undegraded":"2024-04-26T17:58:09.740479+0000","last_fullsized":"2024-04-26T17:58:09.740479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:10.029592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741681+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T17:58:09.741681+0000","last_peered":"2024-04-26T17:58:09.741681+0000","last_clean":"2024-04-26T17:58:09.741681+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T17:58:09.741681+0000","last_undegraded":"2024-04-26T17:58:09.741681+0000","last_fullsized":"2024-04-26T17:58:09.741681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867276+0000","last_change":"2024-04-26T17:58:08.742774+0000","last_active":"2024-04-26T17:58:09.867276+0000","last_peered":"2024-04-26T17:58:09.867276+0000","last_clean":"2024-04-26T17:58:09.867276+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T17:58:09.867276+0000","last_undegraded":"2024-04-26T17:58:09.867276+0000","last_fullsized":"2024-04-26T17:58:09.867276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:04.231921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741023+0000","last_change":"2024-04-26T17:58:04.712970+0000","last_active":"2024-04-26T17:58:09.741023+0000","last_peered":"2024-04-26T17:58:09.741023+0000","last_clean":"2024-04-26T17:58:09.741023+0000","last_became_active":"2024-04-26T17:58:04.712645+0000","last_became_peered":"2024-04-26T17:58:04.712645+0000","last_unstale":"2024-04-26T17:58:09.741023+0000","last_undegraded":"2024-04-26T17:58:09.741023+0000","last_fullsized":"2024-04-26T17:58:09.741023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:06.746889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867322+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T17:58:09.867322+0000","last_peered":"2024-04-26T17:58:09.867322+0000","last_clean":"2024-04-26T17:58:09.867322+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T17:58:09.867322+0000","last_undegraded":"2024-04-26T17:58:09.867322+0000","last_fullsized":"2024-04-26T17:58:09.867322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868215+0000","last_change":"2024-04-26T17:58:08.741761+0000","last_active":"2024-04-26T17:58:09.868215+0000","last_peered":"2024-04-26T17:58:09.868215+0000","last_clean":"2024-04-26T17:58:09.868215+0000","last_became_active":"2024-04-26T17:58:08.741401+0000","last_became_peered":"2024-04-26T17:58:08.741401+0000","last_unstale":"2024-04-26T17:58:09.868215+0000","last_undegraded":"2024-04-26T17:58:09.868215+0000","last_fullsized":"2024-04-26T17:58:09.868215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:44.837522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867967+0000","last_change":"2024-04-26T17:58:04.705981+0000","last_active":"2024-04-26T17:58:09.867967+0000","last_peered":"2024-04-26T17:58:09.867967+0000","last_clean":"2024-04-26T17:58:09.867967+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T17:58:09.867967+0000","last_undegraded":"2024-04-26T17:58:09.867967+0000","last_fullsized":"2024-04-26T17:58:09.867967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:21.755118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868393+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T17:58:09.868393+0000","last_peered":"2024-04-26T17:58:09.868393+0000","last_clean":"2024-04-26T17:58:09.868393+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T17:58:09.868393+0000","last_undegraded":"2024-04-26T17:58:09.868393+0000","last_fullsized":"2024-04-26T17:58:09.868393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867400+0000","last_change":"2024-04-26T17:58:08.739520+0000","last_active":"2024-04-26T17:58:09.867400+0000","last_peered":"2024-04-26T17:58:09.867400+0000","last_clean":"2024-04-26T17:58:09.867400+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T17:58:09.867400+0000","last_undegraded":"2024-04-26T17:58:09.867400+0000","last_fullsized":"2024-04-26T17:58:09.867400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:10.313792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740965+0000","last_change":"2024-04-26T17:58:04.719394+0000","last_active":"2024-04-26T17:58:09.740965+0000","last_peered":"2024-04-26T17:58:09.740965+0000","last_clean":"2024-04-26T17:58:09.740965+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T17:58:09.740965+0000","last_undegraded":"2024-04-26T17:58:09.740965+0000","last_fullsized":"2024-04-26T17:58:09.740965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:33.049370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.307724+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T17:58:17.307724+0000","last_peered":"2024-04-26T17:58:17.307724+0000","last_clean":"2024-04-26T17:58:17.307724+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T17:58:17.307724+0000","last_undegraded":"2024-04-26T17:58:17.307724+0000","last_fullsized":"2024-04-26T17:58:17.307724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868423+0000","last_change":"2024-04-26T17:58:08.736275+0000","last_active":"2024-04-26T17:58:09.868423+0000","last_peered":"2024-04-26T17:58:09.868423+0000","last_clean":"2024-04-26T17:58:09.868423+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T17:58:09.868423+0000","last_undegraded":"2024-04-26T17:58:09.868423+0000","last_fullsized":"2024-04-26T17:58:09.868423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:22:07.103401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867796+0000","last_change":"2024-04-26T17:58:04.712316+0000","last_active":"2024-04-26T17:58:09.867796+0000","last_peered":"2024-04-26T17:58:09.867796+0000","last_clean":"2024-04-26T17:58:09.867796+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T17:58:09.867796+0000","last_undegraded":"2024-04-26T17:58:09.867796+0000","last_fullsized":"2024-04-26T17:58:09.867796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:49.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866776+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T17:58:09.866776+0000","last_peered":"2024-04-26T17:58:09.866776+0000","last_clean":"2024-04-26T17:58:09.866776+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T17:58:09.866776+0000","last_undegraded":"2024-04-26T17:58:09.866776+0000","last_fullsized":"2024-04-26T17:58:09.866776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867058+0000","last_change":"2024-04-26T17:58:08.742746+0000","last_active":"2024-04-26T17:58:09.867058+0000","last_peered":"2024-04-26T17:58:09.867058+0000","last_clean":"2024-04-26T17:58:09.867058+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T17:58:09.867058+0000","last_undegraded":"2024-04-26T17:58:09.867058+0000","last_fullsized":"2024-04-26T17:58:09.867058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:51.352617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868076+0000","last_change":"2024-04-26T17:58:04.723214+0000","last_active":"2024-04-26T17:58:09.868076+0000","last_peered":"2024-04-26T17:58:09.868076+0000","last_clean":"2024-04-26T17:58:09.868076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T17:58:09.868076+0000","last_undegraded":"2024-04-26T17:58:09.868076+0000","last_fullsized":"2024-04-26T17:58:09.868076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:08.558197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867696+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T17:58:09.867696+0000","last_peered":"2024-04-26T17:58:09.867696+0000","last_clean":"2024-04-26T17:58:09.867696+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T17:58:09.867696+0000","last_undegraded":"2024-04-26T17:58:09.867696+0000","last_fullsized":"2024-04-26T17:58:09.867696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867239+0000","last_change":"2024-04-26T17:58:08.745044+0000","last_active":"2024-04-26T17:58:09.867239+0000","last_peered":"2024-04-26T17:58:09.867239+0000","last_clean":"2024-04-26T17:58:09.867239+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T17:58:09.867239+0000","last_undegraded":"2024-04-26T17:58:09.867239+0000","last_fullsized":"2024-04-26T17:58:09.867239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:53.339198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867490+0000","last_change":"2024-04-26T17:58:04.720903+0000","last_active":"2024-04-26T17:58:09.867490+0000","last_peered":"2024-04-26T17:58:09.867490+0000","last_clean":"2024-04-26T17:58:09.867490+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T17:58:09.867490+0000","last_undegraded":"2024-04-26T17:58:09.867490+0000","last_fullsized":"2024-04-26T17:58:09.867490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:46.583637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742161+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T17:58:09.742161+0000","last_peered":"2024-04-26T17:58:09.742161+0000","last_clean":"2024-04-26T17:58:09.742161+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T17:58:09.742161+0000","last_undegraded":"2024-04-26T17:58:09.742161+0000","last_fullsized":"2024-04-26T17:58:09.742161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867269+0000","last_change":"2024-04-26T17:58:08.743119+0000","last_active":"2024-04-26T17:58:09.867269+0000","last_peered":"2024-04-26T17:58:09.867269+0000","last_clean":"2024-04-26T17:58:09.867269+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T17:58:09.867269+0000","last_undegraded":"2024-04-26T17:58:09.867269+0000","last_fullsized":"2024-04-26T17:58:09.867269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:41.640200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867500+0000","last_change":"2024-04-26T17:58:08.739999+0000","last_active":"2024-04-26T17:58:09.867500+0000","last_peered":"2024-04-26T17:58:09.867500+0000","last_clean":"2024-04-26T17:58:09.867500+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T17:58:09.867500+0000","last_undegraded":"2024-04-26T17:58:09.867500+0000","last_fullsized":"2024-04-26T17:58:09.867500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:30.637006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866996+0000","last_change":"2024-04-26T17:58:04.719069+0000","last_active":"2024-04-26T17:58:09.866996+0000","last_peered":"2024-04-26T17:58:09.866996+0000","last_clean":"2024-04-26T17:58:09.866996+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T17:58:09.866996+0000","last_undegraded":"2024-04-26T17:58:09.866996+0000","last_fullsized":"2024-04-26T17:58:09.866996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:09.311370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867009+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T17:58:09.867009+0000","last_peered":"2024-04-26T17:58:09.867009+0000","last_clean":"2024-04-26T17:58:09.867009+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T17:58:09.867009+0000","last_undegraded":"2024-04-26T17:58:09.867009+0000","last_fullsized":"2024-04-26T17:58:09.867009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741957+0000","last_change":"2024-04-26T17:58:08.738167+0000","last_active":"2024-04-26T17:58:09.741957+0000","last_peered":"2024-04-26T17:58:09.741957+0000","last_clean":"2024-04-26T17:58:09.741957+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T17:58:09.741957+0000","last_undegraded":"2024-04-26T17:58:09.741957+0000","last_fullsized":"2024-04-26T17:58:09.741957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:42.434088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867177+0000","last_change":"2024-04-26T17:58:04.717580+0000","last_active":"2024-04-26T17:58:09.867177+0000","last_peered":"2024-04-26T17:58:09.867177+0000","last_clean":"2024-04-26T17:58:09.867177+0000","last_became_active":"2024-04-26T17:58:04.717313+0000","last_became_peered":"2024-04-26T17:58:04.717313+0000","last_unstale":"2024-04-26T17:58:09.867177+0000","last_undegraded":"2024-04-26T17:58:09.867177+0000","last_fullsized":"2024-04-26T17:58:09.867177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:54.802557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867508+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T17:58:09.867508+0000","last_peered":"2024-04-26T17:58:09.867508+0000","last_clean":"2024-04-26T17:58:09.867508+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T17:58:09.867508+0000","last_undegraded":"2024-04-26T17:58:09.867508+0000","last_fullsized":"2024-04-26T17:58:09.867508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.742229+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T17:58:09.742229+0000","last_peered":"2024-04-26T17:58:09.742229+0000","last_clean":"2024-04-26T17:58:09.742229+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T17:58:09.742229+0000","last_undegraded":"2024-04-26T17:58:09.742229+0000","last_fullsized":"2024-04-26T17:58:09.742229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868345+0000","last_change":"2024-04-26T17:58:04.713025+0000","last_active":"2024-04-26T17:58:09.868345+0000","last_peered":"2024-04-26T17:58:09.868345+0000","last_clean":"2024-04-26T17:58:09.868345+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T17:58:09.868345+0000","last_undegraded":"2024-04-26T17:58:09.868345+0000","last_fullsized":"2024-04-26T17:58:09.868345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:35.294319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739719+0000","last_change":"2024-04-26T17:58:08.739580+0000","last_active":"2024-04-26T17:58:09.739719+0000","last_peered":"2024-04-26T17:58:09.739719+0000","last_clean":"2024-04-26T17:58:09.739719+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T17:58:09.739719+0000","last_undegraded":"2024-04-26T17:58:09.739719+0000","last_fullsized":"2024-04-26T17:58:09.739719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:59.613945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868520+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T17:58:09.868520+0000","last_peered":"2024-04-26T17:58:09.868520+0000","last_clean":"2024-04-26T17:58:09.868520+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T17:58:09.868520+0000","last_undegraded":"2024-04-26T17:58:09.868520+0000","last_fullsized":"2024-04-26T17:58:09.868520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867109+0000","last_change":"2024-04-26T17:58:04.712809+0000","last_active":"2024-04-26T17:58:09.867109+0000","last_peered":"2024-04-26T17:58:09.867109+0000","last_clean":"2024-04-26T17:58:09.867109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T17:58:09.867109+0000","last_undegraded":"2024-04-26T17:58:09.867109+0000","last_fullsized":"2024-04-26T17:58:09.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:27.667789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866917+0000","last_change":"2024-04-26T17:58:08.738098+0000","last_active":"2024-04-26T17:58:09.866917+0000","last_peered":"2024-04-26T17:58:09.866917+0000","last_clean":"2024-04-26T17:58:09.866917+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T17:58:09.866917+0000","last_undegraded":"2024-04-26T17:58:09.866917+0000","last_fullsized":"2024-04-26T17:58:09.866917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:46.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740387+0000","last_change":"2024-04-26T17:58:04.717040+0000","last_active":"2024-04-26T17:58:09.740387+0000","last_peered":"2024-04-26T17:58:09.740387+0000","last_clean":"2024-04-26T17:58:09.740387+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T17:58:09.740387+0000","last_undegraded":"2024-04-26T17:58:09.740387+0000","last_fullsized":"2024-04-26T17:58:09.740387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.754980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739474+0000","last_change":"2024-04-26T17:58:04.717913+0000","last_active":"2024-04-26T17:58:09.739474+0000","last_peered":"2024-04-26T17:58:09.739474+0000","last_clean":"2024-04-26T17:58:09.739474+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T17:58:09.739474+0000","last_undegraded":"2024-04-26T17:58:09.739474+0000","last_fullsized":"2024-04-26T17:58:09.739474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:58.220321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867259+0000","last_change":"2024-04-26T17:58:04.726316+0000","last_active":"2024-04-26T17:58:09.867259+0000","last_peered":"2024-04-26T17:58:09.867259+0000","last_clean":"2024-04-26T17:58:09.867259+0000","last_became_active":"2024-04-26T17:58:04.726079+0000","last_became_peered":"2024-04-26T17:58:04.726079+0000","last_unstale":"2024-04-26T17:58:09.867259+0000","last_undegraded":"2024-04-26T17:58:09.867259+0000","last_fullsized":"2024-04-26T17:58:09.867259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:52.023348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868301+0000","last_change":"2024-04-26T17:58:04.718894+0000","last_active":"2024-04-26T17:58:09.868301+0000","last_peered":"2024-04-26T17:58:09.868301+0000","last_clean":"2024-04-26T17:58:09.868301+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T17:58:09.868301+0000","last_undegraded":"2024-04-26T17:58:09.868301+0000","last_fullsized":"2024-04-26T17:58:09.868301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:08.169756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868428+0000","last_change":"2024-04-26T17:58:04.717545+0000","last_active":"2024-04-26T17:58:09.868428+0000","last_peered":"2024-04-26T17:58:09.868428+0000","last_clean":"2024-04-26T17:58:09.868428+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T17:58:09.868428+0000","last_undegraded":"2024-04-26T17:58:09.868428+0000","last_fullsized":"2024-04-26T17:58:09.868428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:22.541323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866628+0000","last_change":"2024-04-26T17:58:04.719000+0000","last_active":"2024-04-26T17:58:09.866628+0000","last_peered":"2024-04-26T17:58:09.866628+0000","last_clean":"2024-04-26T17:58:09.866628+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T17:58:09.866628+0000","last_undegraded":"2024-04-26T17:58:09.866628+0000","last_fullsized":"2024-04-26T17:58:09.866628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:39.142823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741672+0000","last_change":"2024-04-26T17:58:04.719202+0000","last_active":"2024-04-26T17:58:09.741672+0000","last_peered":"2024-04-26T17:58:09.741672+0000","last_clean":"2024-04-26T17:58:09.741672+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T17:58:09.741672+0000","last_undegraded":"2024-04-26T17:58:09.741672+0000","last_fullsized":"2024-04-26T17:58:09.741672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:28:09.727598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867378+0000","last_change":"2024-04-26T17:58:04.717329+0000","last_active":"2024-04-26T17:58:09.867378+0000","last_peered":"2024-04-26T17:58:09.867378+0000","last_clean":"2024-04-26T17:58:09.867378+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T17:58:09.867378+0000","last_undegraded":"2024-04-26T17:58:09.867378+0000","last_fullsized":"2024-04-26T17:58:09.867378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:05.365008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866573+0000","last_change":"2024-04-26T17:58:04.727246+0000","last_active":"2024-04-26T17:58:09.866573+0000","last_peered":"2024-04-26T17:58:09.866573+0000","last_clean":"2024-04-26T17:58:09.866573+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T17:58:09.866573+0000","last_undegraded":"2024-04-26T17:58:09.866573+0000","last_fullsized":"2024-04-26T17:58:09.866573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:48.343210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867408+0000","last_change":"2024-04-26T17:58:04.713698+0000","last_active":"2024-04-26T17:58:09.867408+0000","last_peered":"2024-04-26T17:58:09.867408+0000","last_clean":"2024-04-26T17:58:09.867408+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T17:58:09.867408+0000","last_undegraded":"2024-04-26T17:58:09.867408+0000","last_fullsized":"2024-04-26T17:58:09.867408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:12:46.523995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867161+0000","last_change":"2024-04-26T17:58:04.724480+0000","last_active":"2024-04-26T17:58:09.867161+0000","last_peered":"2024-04-26T17:58:09.867161+0000","last_clean":"2024-04-26T17:58:09.867161+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T17:58:09.867161+0000","last_undegraded":"2024-04-26T17:58:09.867161+0000","last_fullsized":"2024-04-26T17:58:09.867161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:55.314208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.868176+0000","last_change":"2024-04-26T17:58:04.708369+0000","last_active":"2024-04-26T17:58:09.868176+0000","last_peered":"2024-04-26T17:58:09.868176+0000","last_clean":"2024-04-26T17:58:09.868176+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T17:58:09.868176+0000","last_undegraded":"2024-04-26T17:58:09.868176+0000","last_fullsized":"2024-04-26T17:58:09.868176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:03.947874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741418+0000","last_change":"2024-04-26T17:58:04.714104+0000","last_active":"2024-04-26T17:58:09.741418+0000","last_peered":"2024-04-26T17:58:09.741418+0000","last_clean":"2024-04-26T17:58:09.741418+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T17:58:09.741418+0000","last_undegraded":"2024-04-26T17:58:09.741418+0000","last_fullsized":"2024-04-26T17:58:09.741418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:00.569848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741424+0000","last_change":"2024-04-26T17:58:04.714925+0000","last_active":"2024-04-26T17:58:09.741424+0000","last_peered":"2024-04-26T17:58:09.741424+0000","last_clean":"2024-04-26T17:58:09.741424+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T17:58:09.741424+0000","last_undegraded":"2024-04-26T17:58:09.741424+0000","last_fullsized":"2024-04-26T17:58:09.741424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.669034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.739622+0000","last_change":"2024-04-26T17:58:04.714674+0000","last_active":"2024-04-26T17:58:09.739622+0000","last_peered":"2024-04-26T17:58:09.739622+0000","last_clean":"2024-04-26T17:58:09.739622+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T17:58:09.739622+0000","last_undegraded":"2024-04-26T17:58:09.739622+0000","last_fullsized":"2024-04-26T17:58:09.739622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:13:12.918478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867942+0000","last_change":"2024-04-26T17:58:04.722294+0000","last_active":"2024-04-26T17:58:09.867942+0000","last_peered":"2024-04-26T17:58:09.867942+0000","last_clean":"2024-04-26T17:58:09.867942+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T17:58:09.867942+0000","last_undegraded":"2024-04-26T17:58:09.867942+0000","last_fullsized":"2024-04-26T17:58:09.867942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:31.169681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.866409+0000","last_change":"2024-04-26T17:58:04.725629+0000","last_active":"2024-04-26T17:58:09.866409+0000","last_peered":"2024-04-26T17:58:09.866409+0000","last_clean":"2024-04-26T17:58:09.866409+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T17:58:09.866409+0000","last_undegraded":"2024-04-26T17:58:09.866409+0000","last_fullsized":"2024-04-26T17:58:09.866409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:06.389060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867083+0000","last_change":"2024-04-26T17:58:04.716814+0000","last_active":"2024-04-26T17:58:09.867083+0000","last_peered":"2024-04-26T17:58:09.867083+0000","last_clean":"2024-04-26T17:58:09.867083+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T17:58:09.867083+0000","last_undegraded":"2024-04-26T17:58:09.867083+0000","last_fullsized":"2024-04-26T17:58:09.867083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:38.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867941+0000","last_change":"2024-04-26T17:58:04.715233+0000","last_active":"2024-04-26T17:58:09.867941+0000","last_peered":"2024-04-26T17:58:09.867941+0000","last_clean":"2024-04-26T17:58:09.867941+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T17:58:09.867941+0000","last_undegraded":"2024-04-26T17:58:09.867941+0000","last_fullsized":"2024-04-26T17:58:09.867941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:24.469756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867686+0000","last_change":"2024-04-26T17:58:04.722576+0000","last_active":"2024-04-26T17:58:09.867686+0000","last_peered":"2024-04-26T17:58:09.867686+0000","last_clean":"2024-04-26T17:58:09.867686+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T17:58:09.867686+0000","last_undegraded":"2024-04-26T17:58:09.867686+0000","last_fullsized":"2024-04-26T17:58:09.867686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:33.150267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867768+0000","last_change":"2024-04-26T17:58:04.712057+0000","last_active":"2024-04-26T17:58:09.867768+0000","last_peered":"2024-04-26T17:58:09.867768+0000","last_clean":"2024-04-26T17:58:09.867768+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T17:58:09.867768+0000","last_undegraded":"2024-04-26T17:58:09.867768+0000","last_fullsized":"2024-04-26T17:58:09.867768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:12.314998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741771+0000","last_change":"2024-04-26T17:58:04.727743+0000","last_active":"2024-04-26T17:58:09.741771+0000","last_peered":"2024-04-26T17:58:09.741771+0000","last_clean":"2024-04-26T17:58:09.741771+0000","last_became_active":"2024-04-26T17:58:04.727395+0000","last_became_peered":"2024-04-26T17:58:04.727395+0000","last_unstale":"2024-04-26T17:58:09.741771+0000","last_undegraded":"2024-04-26T17:58:09.741771+0000","last_fullsized":"2024-04-26T17:58:09.741771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:23:07.625978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741634+0000","last_change":"2024-04-26T17:58:04.727074+0000","last_active":"2024-04-26T17:58:09.741634+0000","last_peered":"2024-04-26T17:58:09.741634+0000","last_clean":"2024-04-26T17:58:09.741634+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T17:58:09.741634+0000","last_undegraded":"2024-04-26T17:58:09.741634+0000","last_fullsized":"2024-04-26T17:58:09.741634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:17.157157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741450+0000","last_change":"2024-04-26T17:58:04.723761+0000","last_active":"2024-04-26T17:58:09.741450+0000","last_peered":"2024-04-26T17:58:09.741450+0000","last_clean":"2024-04-26T17:58:09.741450+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T17:58:09.741450+0000","last_undegraded":"2024-04-26T17:58:09.741450+0000","last_fullsized":"2024-04-26T17:58:09.741450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:02.783054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867096+0000","last_change":"2024-04-26T17:58:04.724094+0000","last_active":"2024-04-26T17:58:09.867096+0000","last_peered":"2024-04-26T17:58:09.867096+0000","last_clean":"2024-04-26T17:58:09.867096+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T17:58:09.867096+0000","last_undegraded":"2024-04-26T17:58:09.867096+0000","last_fullsized":"2024-04-26T17:58:09.867096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:26.825638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740858+0000","last_change":"2024-04-26T17:58:04.713653+0000","last_active":"2024-04-26T17:58:09.740858+0000","last_peered":"2024-04-26T17:58:09.740858+0000","last_clean":"2024-04-26T17:58:09.740858+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T17:58:09.740858+0000","last_undegraded":"2024-04-26T17:58:09.740858+0000","last_fullsized":"2024-04-26T17:58:09.740858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:35:10.715579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867111+0000","last_change":"2024-04-26T17:58:04.725695+0000","last_active":"2024-04-26T17:58:09.867111+0000","last_peered":"2024-04-26T17:58:09.867111+0000","last_clean":"2024-04-26T17:58:09.867111+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T17:58:09.867111+0000","last_undegraded":"2024-04-26T17:58:09.867111+0000","last_fullsized":"2024-04-26T17:58:09.867111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:16.883645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.740772+0000","last_change":"2024-04-26T17:58:04.712059+0000","last_active":"2024-04-26T17:58:09.740772+0000","last_peered":"2024-04-26T17:58:09.740772+0000","last_clean":"2024-04-26T17:58:09.740772+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T17:58:09.740772+0000","last_undegraded":"2024-04-26T17:58:09.740772+0000","last_fullsized":"2024-04-26T17:58:09.740772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:53.798495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867547+0000","last_change":"2024-04-26T17:58:04.726921+0000","last_active":"2024-04-26T17:58:09.867547+0000","last_peered":"2024-04-26T17:58:09.867547+0000","last_clean":"2024-04-26T17:58:09.867547+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T17:58:09.867547+0000","last_undegraded":"2024-04-26T17:58:09.867547+0000","last_fullsized":"2024-04-26T17:58:09.867547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:10.889230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867692+0000","last_change":"2024-04-26T17:58:04.714479+0000","last_active":"2024-04-26T17:58:09.867692+0000","last_peered":"2024-04-26T17:58:09.867692+0000","last_clean":"2024-04-26T17:58:09.867692+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T17:58:09.867692+0000","last_undegraded":"2024-04-26T17:58:09.867692+0000","last_fullsized":"2024-04-26T17:58:09.867692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:11.224793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.867830+0000","last_change":"2024-04-26T17:58:04.715128+0000","last_active":"2024-04-26T17:58:09.867830+0000","last_peered":"2024-04-26T17:58:09.867830+0000","last_clean":"2024-04-26T17:58:09.867830+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T17:58:09.867830+0000","last_undegraded":"2024-04-26T17:58:09.867830+0000","last_fullsized":"2024-04-26T17:58:09.867830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:28.531949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:09.741199+0000","last_change":"2024-04-26T17:58:04.719415+0000","last_active":"2024-04-26T17:58:09.741199+0000","last_peered":"2024-04-26T17:58:09.741199+0000","last_clean":"2024-04-26T17:58:09.741199+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T17:58:09.741199+0000","last_undegraded":"2024-04-26T17:58:09.741199+0000","last_fullsized":"2024-04-26T17:58:09.741199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:55.030120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:38.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:39.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.016+0000 7ff49c922640 1 Processor -- start 2024-04-26T17:58:39.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.016+0000 7ff49c922640 1 -- start start 2024-04-26T17:58:39.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.016+0000 7ff49c922640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff4980ce070 0x7ff49815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.016+0000 7ff49c922640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980b4370 0x7ff49815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.016+0000 7ff49c922640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49815fa00 con 0x7ff4980ce450 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff49c922640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ff4980cc090 con 0x7ff4980ce070 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff49c922640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff49815fce0 con 0x7ff4980b4370 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff49659c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff4980ce070 0x7ff49815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff496d9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff4980ce450 0x7ff4980ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40546/0 (socket says 172.21.15.139:40546) 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff496d9d640 1 -- 172.21.15.139:0/3178914545 learned_addr learned my addr 172.21.15.139:0/3178914545 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff48dd9b640 1 --2- 172.21.15.139:0/3178914545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980b4370 0x7ff49815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff495d9b640 1 -- 172.21.15.139:0/3178914545 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186618318 0 0) 0x7ff49815fa00 con 0x7ff4980ce450 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff495d9b640 1 -- 172.21.15.139:0/3178914545 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff484003520 con 0x7ff4980ce450 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff49659c640 1 -- 172.21.15.139:0/3178914545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980b4370 msgr2=0x7ff49815f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff49659c640 1 --2- 172.21.15.139:0/3178914545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980b4370 0x7ff49815f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff49659c640 1 -- 172.21.15.139:0/3178914545 >> v1:172.21.15.139:6789/0 conn(0x7ff4980ce450 legacy=0x7ff4980ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.017+0000 7ff49659c640 1 -- 172.21.15.139:0/3178914545 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49815ffc0 con 0x7ff4980ce070 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49659c640 1 --2- 172.21.15.139:0/3178914545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff49815bbd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097a0 tx=0x7ff48802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e42d711539b6b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff495d9b640 1 -- 172.21.15.139:0/3178914545 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488037070 con 0x7ff4980ce070 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff495d9b640 1 -- 172.21.15.139:0/3178914545 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488032440 con 0x7ff4980ce070 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff495d9b640 1 -- 172.21.15.139:0/3178914545 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488032810 con 0x7ff4980ce070 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 -- 172.21.15.139:0/3178914545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 msgr2=0x7ff49815bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 --2- 172.21.15.139:0/3178914545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff49815bbd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097a0 tx=0x7ff48802a180 comp rx=0 tx=0).stop 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 -- 172.21.15.139:0/3178914545 shutdown_connections 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 --2- 172.21.15.139:0/3178914545 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980b4370 0x7ff49815f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 --2- 172.21.15.139:0/3178914545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff49815bbd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 -- 172.21.15.139:0/3178914545 >> 172.21.15.139:0/3178914545 conn(0x7ff4980743c0 msgr2=0x7ff498068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 -- 172.21.15.139:0/3178914545 shutdown_connections 2024-04-26T17:58:39.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.018+0000 7ff49c922640 1 -- 172.21.15.139:0/3178914545 wait complete. 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 Processor -- start 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 -- start start 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4980b4370 0x7ff4980c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff4980d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980ce450 0x7ff4981f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff49815f700 con 0x7ff4980ce070 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff4980cc5c0 con 0x7ff4980b4370 2024-04-26T17:58:39.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.020+0000 7ff49c922640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff4980cd1f0 con 0x7ff4980ce450 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff4980d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff4980d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36924/0 (socket says 172.21.15.139:36924) 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 -- 172.21.15.139:0/4257990136 learned_addr learned my addr 172.21.15.139:0/4257990136 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff496d9d640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980ce450 0x7ff4981f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff49659c640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4980b4370 0x7ff4980c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 -- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980ce450 msgr2=0x7ff4981f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980ce450 0x7ff4981f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 -- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4980b4370 msgr2=0x7ff4980c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4980b4370 0x7ff4980c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 -- 172.21.15.139:0/4257990136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4980c9470 con 0x7ff4980ce070 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48dd9b640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff4980d1d70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff48000e9e0 tx=0x7ff48000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48f7fe640 1 -- 172.21.15.139:0/4257990136 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff480017070 con 0x7ff4980ce070 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48f7fe640 1 -- 172.21.15.139:0/4257990136 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48000c970 con 0x7ff4980ce070 2024-04-26T17:58:39.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4980c9750 con 0x7ff4980ce070 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff48f7fe640 1 -- 172.21.15.139:0/4257990136 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48000cd60 con 0x7ff4980ce070 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.021+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4981f4fd0 con 0x7ff4980ce070 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.022+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff498076d20 con 0x7ff4980ce070 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.023+0000 7ff48f7fe640 1 -- 172.21.15.139:0/4257990136 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff48001a070 con 0x7ff4980ce070 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.023+0000 7ff48f7fe640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.023+0000 7ff48f7fe640 1 -- 172.21.15.139:0/4257990136 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff48008c270 con 0x7ff4980ce070 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.023+0000 7ff49659c640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.023+0000 7ff49659c640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff47806c8f0 0x7ff47806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff488034000 tx=0x7ff48802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.027+0000 7ff48f7fe640 1 -- 172.21.15.139:0/4257990136 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff48005a2d0 con 0x7ff4980ce070 2024-04-26T17:58:39.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.239+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff498153db0 con 0x7ff4980ce070 2024-04-26T17:58:39.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.240+0000 7ff48f7fe640 1 -- 172.21.15.139:0/4257990136 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7ff480059bd0 con 0x7ff4980ce070 2024-04-26T17:58:39.240 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:39.240 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:39.240 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:39.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff47806c8f0 msgr2=0x7ff47806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff47806c8f0 0x7ff47806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff488034000 tx=0x7ff48802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:39.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 msgr2=0x7ff4980d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff4980d1d70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff48000e9e0 tx=0x7ff48000eea0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 shutdown_connections 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff4980ce450 0x7ff4981f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4980ce070 0x7ff4980d1d70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 --2- 172.21.15.139:0/4257990136 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff4980b4370 0x7ff4980c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 >> 172.21.15.139:0/4257990136 conn(0x7ff4980743c0 msgr2=0x7ff498068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 shutdown_connections 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.242+0000 7ff49c922640 1 -- 172.21.15.139:0/4257990136 wait complete. 2024-04-26T17:58:39.253 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:39.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.350+0000 7f2c847e4640 1 Processor -- start 2024-04-26T17:58:39.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.350+0000 7f2c847e4640 1 -- start start 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c847e4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c7c0ce100 0x7f2c7c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c847e4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0b5970 0x7f2c7c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c847e4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c7c0738c0 con 0x7f2c7c0cc4f0 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c847e4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2c7c0b6310 con 0x7f2c7c0ce100 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c847e4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2c7c0729d0 con 0x7f2c7c0b5970 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c82580640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c7c0ce100 0x7f2c7c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c81d7f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2c7c0cc4f0 0x7f2c7c15fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40556/0 (socket says 172.21.15.139:40556) 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c81d7f640 1 -- 172.21.15.139:0/4239268345 learned_addr learned my addr 172.21.15.139:0/4239268345 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c82d81640 1 --2- 172.21.15.139:0/4239268345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0b5970 0x7f2c7c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c82580640 1 -- 172.21.15.139:0/4239268345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0b5970 msgr2=0x7f2c7c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:39.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c82580640 1 --2- 172.21.15.139:0/4239268345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0b5970 0x7f2c7c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c82580640 1 -- 172.21.15.139:0/4239268345 >> v1:172.21.15.139:6789/0 conn(0x7f2c7c0cc4f0 legacy=0x7f2c7c15fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c82580640 1 -- 172.21.15.139:0/4239268345 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7c072cb0 con 0x7f2c7c0ce100 2024-04-26T17:58:39.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.351+0000 7f2c8157e640 1 -- 172.21.15.139:0/4239268345 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217514724 0 0) 0x7f2c7c0738c0 con 0x7f2c7c0cc4f0 2024-04-26T17:58:39.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.352+0000 7f2c82580640 1 --2- 172.21.15.139:0/4239268345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0ce100 0x7f2c7c0ce4e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097a0 tx=0x7f2c7802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d5c375c6d03c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.352+0000 7f2c8157e640 1 -- 172.21.15.139:0/4239268345 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78037070 con 0x7f2c7c0ce100 2024-04-26T17:58:39.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.352+0000 7f2c8157e640 1 -- 172.21.15.139:0/4239268345 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7802ae50 con 0x7f2c7c0ce100 2024-04-26T17:58:39.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.352+0000 7f2c8157e640 1 -- 172.21.15.139:0/4239268345 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78032660 con 0x7f2c7c0ce100 2024-04-26T17:58:39.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.352+0000 7f2c847e4640 1 -- 172.21.15.139:0/4239268345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0ce100 msgr2=0x7f2c7c0ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.352+0000 7f2c847e4640 1 --2- 172.21.15.139:0/4239268345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0ce100 0x7f2c7c0ce4e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097a0 tx=0x7f2c7802a100 comp rx=0 tx=0).stop 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.353+0000 7f2c847e4640 1 -- 172.21.15.139:0/4239268345 shutdown_connections 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.353+0000 7f2c847e4640 1 --2- 172.21.15.139:0/4239268345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0b5970 0x7f2c7c0b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.353+0000 7f2c847e4640 1 --2- 172.21.15.139:0/4239268345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0ce100 0x7f2c7c0ce4e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.353+0000 7f2c847e4640 1 -- 172.21.15.139:0/4239268345 >> 172.21.15.139:0/4239268345 conn(0x7f2c7c068270 msgr2=0x7f2c7c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.353+0000 7f2c847e4640 1 -- 172.21.15.139:0/4239268345 shutdown_connections 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.353+0000 7f2c847e4640 1 -- 172.21.15.139:0/4239268345 wait complete. 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 Processor -- start 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 -- start start 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0b5970 0x7f2c7c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c7c0cc4f0 0x7f2c7c14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0ce100 0x7f2c7c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c073550 con 0x7f2c7c0b5970 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c073270 con 0x7f2c7c0cc4f0 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c847e4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2c7c156360 con 0x7f2c7c0ce100 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c82580640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0b5970 0x7f2c7c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.354+0000 7f2c82580640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0b5970 0x7f2c7c14bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36934/0 (socket says 172.21.15.139:36934) 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82580640 1 -- 172.21.15.139:0/3591685712 learned_addr learned my addr 172.21.15.139:0/3591685712 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82d81640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0ce100 0x7f2c7c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c81d7f640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c7c0cc4f0 0x7f2c7c14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82580640 1 -- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0ce100 msgr2=0x7f2c7c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82580640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0ce100 0x7f2c7c0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82580640 1 -- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c7c0cc4f0 msgr2=0x7f2c7c14c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82580640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c7c0cc4f0 0x7f2c7c14c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82580640 1 -- 172.21.15.139:0/3591685712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7c0c8ab0 con 0x7f2c7c0b5970 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82d81640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0ce100 0x7f2c7c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c81d7f640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c7c0cc4f0 0x7f2c7c14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c82580640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0b5970 0x7f2c7c14bcb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c780098c0 tx=0x7f2c780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c72ffd640 1 -- 172.21.15.139:0/3591685712 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78041030 con 0x7f2c7c0b5970 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c72ffd640 1 -- 172.21.15.139:0/3591685712 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7802ac50 con 0x7f2c7c0b5970 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7c0cf450 con 0x7f2c7c0b5970 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c72ffd640 1 -- 172.21.15.139:0/3591685712 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78037040 con 0x7f2c7c0b5970 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.355+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c7c0cfa10 con 0x7f2c7c0b5970 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.356+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7c08e2b0 con 0x7f2c7c0b5970 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.357+0000 7f2c72ffd640 1 -- 172.21.15.139:0/3591685712 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c78044070 con 0x7f2c7c0b5970 2024-04-26T17:58:39.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.357+0000 7f2c72ffd640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.357+0000 7f2c81d7f640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.357+0000 7f2c72ffd640 1 -- 172.21.15.139:0/3591685712 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2c780ac4f0 con 0x7f2c7c0b5970 2024-04-26T17:58:39.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.357+0000 7f2c81d7f640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2c6006c8f0 0x7f2c6006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c151310 tx=0x7f2c6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.361+0000 7f2c72ffd640 1 -- 172.21.15.139:0/3591685712 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c7c08e2b0 con 0x7f2c7c0b5970 2024-04-26T17:58:39.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.573+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c7c0cfd20 con 0x7f2c7c0b5970 2024-04-26T17:58:39.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.574+0000 7f2c72ffd640 1 -- 172.21.15.139:0/3591685712 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f2c7802ae20 con 0x7f2c7c0b5970 2024-04-26T17:58:39.574 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:39.574 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:39.574 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2c6006c8f0 msgr2=0x7f2c6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2c6006c8f0 0x7f2c6006edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c151310 tx=0x7f2c6c009040 comp rx=0 tx=0).stop 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0b5970 msgr2=0x7f2c7c14bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0b5970 0x7f2c7c14bcb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2c780098c0 tx=0x7f2c780046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 shutdown_connections 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2c6006c8f0 0x7f2c6006edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c7c0ce100 0x7f2c7c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c7c0cc4f0 0x7f2c7c14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 --2- 172.21.15.139:0/3591685712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c7c0b5970 0x7f2c7c14bcb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 >> 172.21.15.139:0/3591685712 conn(0x7f2c7c068270 msgr2=0x7f2c7c0c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 shutdown_connections 2024-04-26T17:58:39.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.576+0000 7f2c847e4640 1 -- 172.21.15.139:0/3591685712 wait complete. 2024-04-26T17:58:39.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:39.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaeec83640 1 Processor -- start 2024-04-26T17:58:39.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaeec83640 1 -- start start 2024-04-26T17:58:39.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaeec83640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae80caab0 0x7feae806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaeec83640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feae80cb950 0x7feae80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaeec83640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae8159d70 con 0x7feae8153c50 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaeec83640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7feae80c43a0 con 0x7feae80cb950 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaeec83640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7feae815a8d0 con 0x7feae80caab0 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.684+0000 7feaed220640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feae80cb950 0x7feae80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feaeca1f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7feae8153c50 0x7feae80cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45748/0 (socket says 172.21.15.139:45748) 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feaed220640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feae80cb950 0x7feae80702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38906/0 (socket says 172.21.15.139:38906) 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feaeca1f640 1 -- 172.21.15.139:0/2494467549 learned_addr learned my addr 172.21.15.139:0/2494467549 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feae7fff640 1 --2- 172.21.15.139:0/2494467549 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae80caab0 0x7feae806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feaed220640 1 -- 172.21.15.139:0/2494467549 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae80caab0 msgr2=0x7feae806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feaed220640 1 --2- 172.21.15.139:0/2494467549 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae80caab0 0x7feae806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feaed220640 1 -- 172.21.15.139:0/2494467549 >> v1:172.21.15.139:6789/0 conn(0x7feae8153c50 legacy=0x7feae80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feaed220640 1 -- 172.21.15.139:0/2494467549 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae8154030 con 0x7feae80cb950 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feae7fff640 1 --2- 172.21.15.139:0/2494467549 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae80caab0 0x7feae806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:39.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.685+0000 7feae77fe640 1 -- 172.21.15.139:0/2494467549 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487010990 0 0) 0x7feae8159d70 con 0x7feae8153c50 2024-04-26T17:58:39.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaed220640 1 --2- 172.21.15.139:0/2494467549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80cb950 0x7feae80702f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25b179cab6db378 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feae77fe640 1 -- 172.21.15.139:0/2494467549 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0007740 con 0x7feae80cb950 2024-04-26T17:58:39.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feae77fe640 1 -- 172.21.15.139:0/2494467549 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae00078e0 con 0x7feae80cb950 2024-04-26T17:58:39.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feae77fe640 1 -- 172.21.15.139:0/2494467549 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0007cb0 con 0x7feae80cb950 2024-04-26T17:58:39.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 -- 172.21.15.139:0/2494467549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80cb950 msgr2=0x7feae80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 --2- 172.21.15.139:0/2494467549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80cb950 0x7feae80702f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae002a6f0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 -- 172.21.15.139:0/2494467549 shutdown_connections 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 --2- 172.21.15.139:0/2494467549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80cb950 0x7feae80702f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 --2- 172.21.15.139:0/2494467549 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae80caab0 0x7feae806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 -- 172.21.15.139:0/2494467549 >> 172.21.15.139:0/2494467549 conn(0x7feae8071bf0 msgr2=0x7feae8071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 -- 172.21.15.139:0/2494467549 shutdown_connections 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.686+0000 7feaeec83640 1 -- 172.21.15.139:0/2494467549 wait complete. 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.687+0000 7feaeec83640 1 Processor -- start 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.687+0000 7feaeec83640 1 -- start start 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeec83640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80caab0 0x7feae80b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeec83640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feae80cb950 0x7feae806ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeec83640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae8153c50 0x7feae81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeec83640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feae815a310 con 0x7feae80caab0 2024-04-26T17:58:39.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeec83640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7feae80cf4c0 con 0x7feae80cb950 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeec83640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7feae815a5f0 con 0x7feae8153c50 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeca1f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80caab0 0x7feae80b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeca1f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80caab0 0x7feae80b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38922/0 (socket says 172.21.15.139:38922) 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaeca1f640 1 -- 172.21.15.139:0/2243644856 learned_addr learned my addr 172.21.15.139:0/2243644856 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feaed220640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae8153c50 0x7feae81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.688+0000 7feae7fff640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feae80cb950 0x7feae806ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeca1f640 1 -- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae8153c50 msgr2=0x7feae81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeca1f640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae8153c50 0x7feae81591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeca1f640 1 -- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feae80cb950 msgr2=0x7feae806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeca1f640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feae80cb950 0x7feae806ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeca1f640 1 -- 172.21.15.139:0/2243644856 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae81f4a20 con 0x7feae80caab0 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeca1f640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80caab0 0x7feae80b0ef0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c460 tx=0x7feadc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feae57fa640 1 -- 172.21.15.139:0/2243644856 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0074e0 con 0x7feae80caab0 2024-04-26T17:58:39.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feae57fa640 1 -- 172.21.15.139:0/2243644856 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feadc0047e0 con 0x7feae80caab0 2024-04-26T17:58:39.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae81f4d00 con 0x7feae80caab0 2024-04-26T17:58:39.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feae57fa640 1 -- 172.21.15.139:0/2243644856 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc004bd0 con 0x7feae80caab0 2024-04-26T17:58:39.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.689+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae81f52c0 con 0x7feae80caab0 2024-04-26T17:58:39.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.690+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae8069ae0 con 0x7feae80caab0 2024-04-26T17:58:39.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.690+0000 7feae57fa640 1 -- 172.21.15.139:0/2243644856 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feadc011070 con 0x7feae80caab0 2024-04-26T17:58:39.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.691+0000 7feae57fa640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feacc06c8f0 0x7feacc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.691+0000 7feae57fa640 1 -- 172.21.15.139:0/2243644856 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feadc08b8d0 con 0x7feae80caab0 2024-04-26T17:58:39.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.691+0000 7feae7fff640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feacc06c8f0 0x7feacc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.691+0000 7feae7fff640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feacc06c8f0 0x7feacc06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feae80c61b0 tx=0x7fead4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.695+0000 7feae57fa640 1 -- 172.21.15.139:0/2243644856 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feadc059400 con 0x7feae80caab0 2024-04-26T17:58:39.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.871+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feae8076d20 con 0x7feae80caab0 2024-04-26T17:58:39.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.872+0000 7feae57fa640 1 -- 172.21.15.139:0/2243644856 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7feadc05d700 con 0x7feae80caab0 2024-04-26T17:58:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:39.872 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T17:58:09.076715+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feacc06c8f0 msgr2=0x7feacc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feacc06c8f0 0x7feacc06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feae80c61b0 tx=0x7fead4008040 comp rx=0 tx=0).stop 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80caab0 msgr2=0x7feae80b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80caab0 0x7feae80b0ef0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c460 tx=0x7feadc00c920 comp rx=0 tx=0).stop 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 shutdown_connections 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feacc06c8f0 0x7feacc06edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feae8153c50 0x7feae81591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feae80cb950 0x7feae806ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 --2- 172.21.15.139:0/2243644856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feae80caab0 0x7feae80b0ef0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 >> 172.21.15.139:0/2243644856 conn(0x7feae8071bf0 msgr2=0x7feae8152420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 shutdown_connections 2024-04-26T17:58:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:39.874+0000 7feaeec83640 1 -- 172.21.15.139:0/2243644856 wait complete. 2024-04-26T17:58:39.885 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-04-26T17:58:39.989 INFO:teuthology.orchestra.run.smithi139.stdout:{"run_dir":"/var/run/ceph"} 2024-04-26T17:58:39.989 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-04-26T17:58:39.989 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 9496 2024-04-26T17:58:39.989 DEBUG:tasks.quiescer:Yielding 2024-04-26T17:58:39.990 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T17:58:40.001 INFO:tasks.workunit:Pulling workunits from ref bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:58:40.002 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T17:58:40.002 INFO:tasks.workunit:timeout=6h 2024-04-26T17:58:40.002 INFO:tasks.workunit:cleanup=True 2024-04-26T17:58:40.002 DEBUG:teuthology.orchestra.run.smithi139:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:40.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:40.016 INFO:teuthology.orchestra.run.smithi139.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-26 17:58:09.700741653 +0000 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-26 17:58:17.305779393 +0000 2024-04-26T17:58:40.017 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-26 17:58:09.700741653 +0000 2024-04-26T17:58:40.017 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:40.017 DEBUG:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T17:58:40.085 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:58:40.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.102+0000 7f1fe4e47640 1 Processor -- start 2024-04-26T17:58:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.102+0000 7f1fe4e47640 1 -- start start 2024-04-26T17:58:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.102+0000 7f1fe4e47640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1fe00cc4f0 0x7f1fe00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.102+0000 7f1fe4e47640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe00738c0 con 0x7f1fe00ce100 2024-04-26T17:58:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.102+0000 7f1fe4e47640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe00729d0 con 0x7f1fe00b5970 2024-04-26T17:58:40.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.102+0000 7f1fe4e47640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe0072cb0 con 0x7f1fe00cc4f0 2024-04-26T17:58:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.103+0000 7f1fde59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1fe00ce100 0x7f1fe015fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45760/0 (socket says 172.21.15.139:45760) 2024-04-26T17:58:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.103+0000 7f1fde59c640 1 -- 172.21.15.139:0/3261989974 learned_addr learned my addr 172.21.15.139:0/3261989974 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:40.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.103+0000 7f1fddd9b640 1 --2- 172.21.15.139:0/3261989974 >> v2:172.21.15.139:3300/0 conn(0x7f1fe00cc4f0 0x7f1fe00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.103+0000 7f1fddd9b640 1 -- 172.21.15.139:0/3261989974 >> v1:172.21.15.143:6789/0 conn(0x7f1fe00b5970 legacy=0x7f1fe00b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.103+0000 7f1fddd9b640 1 -- 172.21.15.139:0/3261989974 >> v1:172.21.15.139:6789/0 conn(0x7f1fe00ce100 legacy=0x7f1fe015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.103+0000 7f1fdd59a640 1 -- 172.21.15.139:0/3261989974 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133617399 0 0) 0x7f1fe00738c0 con 0x7f1fe00ce100 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.103+0000 7f1fddd9b640 1 -- 172.21.15.139:0/3261989974 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe0072f90 con 0x7f1fe00cc4f0 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.104+0000 7f1fddd9b640 1 --2- 172.21.15.139:0/3261989974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00cc4f0 0x7f1fe00ce4e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40097a0 tx=0x7f1fd402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f887aa9d46d151 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.104+0000 7f1fdd59a640 1 -- 172.21.15.139:0/3261989974 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4037070 con 0x7f1fe00cc4f0 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.104+0000 7f1fdd59a640 1 -- 172.21.15.139:0/3261989974 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd402ae50 con 0x7f1fe00cc4f0 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.104+0000 7f1fdd59a640 1 -- 172.21.15.139:0/3261989974 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4032660 con 0x7f1fe00cc4f0 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.105+0000 7f1fe4e47640 1 -- 172.21.15.139:0/3261989974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00cc4f0 msgr2=0x7f1fe00ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.105+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/3261989974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00cc4f0 0x7f1fe00ce4e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40097a0 tx=0x7f1fd402a140 comp rx=0 tx=0).stop 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.105+0000 7f1fe4e47640 1 -- 172.21.15.139:0/3261989974 shutdown_connections 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.105+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/3261989974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00cc4f0 0x7f1fe00ce4e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.105+0000 7f1fe4e47640 1 -- 172.21.15.139:0/3261989974 >> 172.21.15.139:0/3261989974 conn(0x7f1fe0068270 msgr2=0x7f1fe0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.105+0000 7f1fe4e47640 1 -- 172.21.15.139:0/3261989974 shutdown_connections 2024-04-26T17:58:40.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.105+0000 7f1fe4e47640 1 -- 172.21.15.139:0/3261989974 wait complete. 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.106+0000 7f1fe4e47640 1 Processor -- start 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.106+0000 7f1fe4e47640 1 -- start start 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fe4e47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fe00b5970 0x7f1fe014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fe4e47640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fe00cc4f0 0x7f1fe00c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fe4e47640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00ce100 0x7f1fe0149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fe4e47640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe0156360 con 0x7f1fe00ce100 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fe4e47640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe0073550 con 0x7f1fe00b5970 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fe4e47640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe00cd230 con 0x7f1fe00cc4f0 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fded9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00ce100 0x7f1fe0149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fded9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00ce100 0x7f1fe0149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38946/0 (socket says 172.21.15.139:38946) 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fded9d640 1 -- 172.21.15.139:0/4272589486 learned_addr learned my addr 172.21.15.139:0/4272589486 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fde59c640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fe00b5970 0x7f1fe014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fddd9b640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fe00cc4f0 0x7f1fe00c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fded9d640 1 -- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fe00cc4f0 msgr2=0x7f1fe00c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fded9d640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fe00cc4f0 0x7f1fe00c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.107+0000 7f1fded9d640 1 -- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fe00b5970 msgr2=0x7f1fe014b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fded9d640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fe00b5970 0x7f1fe014b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fded9d640 1 -- 172.21.15.139:0/4272589486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe00d1b60 con 0x7f1fe00ce100 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fded9d640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00ce100 0x7f1fe0149c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000c3c0 tx=0x7f1fd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fceffd640 1 -- 172.21.15.139:0/4272589486 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0017070 con 0x7f1fe00ce100 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fceffd640 1 -- 172.21.15.139:0/4272589486 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd00035f0 con 0x7f1fe00ce100 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fceffd640 1 -- 172.21.15.139:0/4272589486 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd00039e0 con 0x7f1fe00ce100 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe01f22b0 con 0x7f1fe00ce100 2024-04-26T17:58:40.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.108+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe01f4f40 con 0x7f1fe00ce100 2024-04-26T17:58:40.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.109+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe008e2b0 con 0x7f1fe00ce100 2024-04-26T17:58:40.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.110+0000 7f1fceffd640 1 -- 172.21.15.139:0/4272589486 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fd001a070 con 0x7f1fe00ce100 2024-04-26T17:58:40.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.110+0000 7f1fceffd640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc006c8f0 0x7f1fc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.110+0000 7f1fceffd640 1 -- 172.21.15.139:0/4272589486 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1fd008b250 con 0x7f1fe00ce100 2024-04-26T17:58:40.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.110+0000 7f1fde59c640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc006c8f0 0x7f1fc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.110+0000 7f1fde59c640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc006c8f0 0x7f1fc006edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80012e0 tx=0x7f1fd8001630 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.114+0000 7f1fceffd640 1 -- 172.21.15.139:0/4272589486 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fe008e2b0 con 0x7f1fe00ce100 2024-04-26T17:58:40.117 INFO:tasks.workunit.client.0.smithi139.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T17:58:40.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.338+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fe0076d20 con 0x7f1fe00ce100 2024-04-26T17:58:40.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.338+0000 7f1fceffd640 1 -- 172.21.15.139:0/4272589486 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f1fd0058c50 con 0x7f1fe00ce100 2024-04-26T17:58:40.339 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:40.339 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:40.339 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.340+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc006c8f0 msgr2=0x7f1fc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.340+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc006c8f0 0x7f1fc006edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80012e0 tx=0x7f1fd8001630 comp rx=0 tx=0).stop 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.340+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00ce100 msgr2=0x7f1fe0149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.340+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00ce100 0x7f1fe0149c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000c3c0 tx=0x7f1fd000c880 comp rx=0 tx=0).stop 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.340+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 shutdown_connections 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.340+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc006c8f0 0x7f1fc006edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.341+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fe00ce100 0x7f1fe0149c90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.341+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fe00cc4f0 0x7f1fe00c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.341+0000 7f1fe4e47640 1 --2- 172.21.15.139:0/4272589486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fe00b5970 0x7f1fe014b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.341+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 >> 172.21.15.139:0/4272589486 conn(0x7f1fe0068270 msgr2=0x7f1fe0151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.341+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 shutdown_connections 2024-04-26T17:58:40.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:40.341+0000 7f1fe4e47640 1 -- 172.21.15.139:0/4272589486 wait complete. 2024-04-26T17:58:40.956 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T17:58:04.046385+0000', 'modified': '2024-04-26T17:58:27.123495+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4309': {'gid': 4309, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.143:6834/19919207', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6832', 'nonce': 19919207}, {'type': 'v1', 'addr': '172.21.15.143:6834', 'nonce': 19919207}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4309, 'qdb_cluster': [4309]} 2024-04-26T17:58:40.956 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T17:58:40.956 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-26T17:58:41.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.057+0000 7fdbf8959640 1 Processor -- start 2024-04-26T17:58:41.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.057+0000 7fdbf8959640 1 -- start start 2024-04-26T17:58:41.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.058+0000 7fdbf8959640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdbf4156000 0x7fdbf40c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.058+0000 7fdbf8959640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf4070a70 con 0x7fdbf4070630 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.058+0000 7fdbf8959640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf40ca1a0 con 0x7fdbf40c9d50 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.058+0000 7fdbf8959640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf40ca660 con 0x7fdbf4156000 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.058+0000 7fdbf259c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdbf4156000 0x7fdbf40c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.058+0000 7fdbf1d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fdbf4070630 0x7fdbf415bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45770/0 (socket says 172.21.15.139:45770) 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.058+0000 7fdbf1d9b640 1 -- 172.21.15.139:0/2302180590 learned_addr learned my addr 172.21.15.139:0/2302180590 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf259c640 1 -- 172.21.15.139:0/2302180590 >> v1:172.21.15.143:6789/0 conn(0x7fdbf40c9d50 legacy=0x7fdbf415c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf259c640 1 -- 172.21.15.139:0/2302180590 >> v1:172.21.15.139:6789/0 conn(0x7fdbf4070630 legacy=0x7fdbf415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf259c640 1 -- 172.21.15.139:0/2302180590 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf40ca920 con 0x7fdbf4156000 2024-04-26T17:58:41.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf159a640 1 -- 172.21.15.139:0/2302180590 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815411779 0 0) 0x7fdbf4070a70 con 0x7fdbf4070630 2024-04-26T17:58:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf259c640 1 --2- 172.21.15.139:0/2302180590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40c4ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009d90 tx=0x7fdbe402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6372de1586dae0f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf159a640 1 -- 172.21.15.139:0/2302180590 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4031600 con 0x7fdbf4156000 2024-04-26T17:58:41.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf159a640 1 -- 172.21.15.139:0/2302180590 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe40317a0 con 0x7fdbf4156000 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.059+0000 7fdbf159a640 1 -- 172.21.15.139:0/2302180590 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4031b70 con 0x7fdbf4156000 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.060+0000 7fdbf8959640 1 -- 172.21.15.139:0/2302180590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 msgr2=0x7fdbf40c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.060+0000 7fdbf8959640 1 --2- 172.21.15.139:0/2302180590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40c4ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009d90 tx=0x7fdbe402a610 comp rx=0 tx=0).stop 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.060+0000 7fdbf8959640 1 -- 172.21.15.139:0/2302180590 shutdown_connections 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.060+0000 7fdbf8959640 1 --2- 172.21.15.139:0/2302180590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40c4ac0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.060+0000 7fdbf8959640 1 -- 172.21.15.139:0/2302180590 >> 172.21.15.139:0/2302180590 conn(0x7fdbf4071d70 msgr2=0x7fdbf4072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.060+0000 7fdbf8959640 1 -- 172.21.15.139:0/2302180590 shutdown_connections 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.060+0000 7fdbf8959640 1 -- 172.21.15.139:0/2302180590 wait complete. 2024-04-26T17:58:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.061+0000 7fdbf8959640 1 Processor -- start 2024-04-26T17:58:41.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf8959640 1 -- start start 2024-04-26T17:58:41.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf8959640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbf4070630 0x7fdbf414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf8959640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbf40c9d50 0x7fdbf41564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf8959640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf8959640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf415c980 con 0x7fdbf4156000 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf8959640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf406d190 con 0x7fdbf4070630 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf8959640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf406c4d0 con 0x7fdbf40c9d50 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38960/0 (socket says 172.21.15.139:38960) 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/314484263 learned_addr learned my addr 172.21.15.139:0/314484263 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf259c640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbf4070630 0x7fdbf414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.062+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbf40c9d50 0x7fdbf41564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbf40c9d50 msgr2=0x7fdbf41564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbf40c9d50 0x7fdbf41564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbf4070630 msgr2=0x7fdbf414fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbf4070630 0x7fdbf414fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/314484263 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf41569e0 con 0x7fdbf4156000 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf259c640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbf4070630 0x7fdbf414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbf40c9d50 0x7fdbf41564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40cf7c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00b440 tx=0x7fdbec00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbe2ffd640 1 -- 172.21.15.139:0/314484263 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec015020 con 0x7fdbf4156000 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbe2ffd640 1 -- 172.21.15.139:0/314484263 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec011830 con 0x7fdbf4156000 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf40b52e0 con 0x7fdbf4156000 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbe2ffd640 1 -- 172.21.15.139:0/314484263 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec011c20 con 0x7fdbf4156000 2024-04-26T17:58:41.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.063+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf40cddb0 con 0x7fdbf4156000 2024-04-26T17:58:41.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.064+0000 7fdbe2ffd640 1 -- 172.21.15.139:0/314484263 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbec018020 con 0x7fdbf4156000 2024-04-26T17:58:41.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.065+0000 7fdbe2ffd640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdbd406c920 0x7fdbd406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.065+0000 7fdbe2ffd640 1 -- 172.21.15.139:0/314484263 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbec08bd90 con 0x7fdbf4156000 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.065+0000 7fdbf259c640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdbd406c920 0x7fdbd406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.065+0000 7fdbf259c640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdbd406c920 0x7fdbd406ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4034000 tx=0x7fdbe402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.066+0000 7fdbfb670740 1 Processor -- start 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.066+0000 7fdbfb670740 1 -- start start 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc8b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc86fb20 0x561cfc871a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc871f70 0x561cfc89d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbfb670740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561cfc7d8740 con 0x561cfc871f70 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561cfc7743a0 con 0x561cfc89cf90 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561cfc7d4700 con 0x561cfc86fb20 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc871f70 0x561cfc89d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc871f70 0x561cfc89d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38972/0 (socket says 172.21.15.139:38972) 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/1763328630 learned_addr learned my addr 172.21.15.139:0/1763328630 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:41.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf259c640 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc8b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc86fb20 0x561cfc871a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc86fb20 msgr2=0x561cfc871a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc86fb20 0x561cfc871a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 msgr2=0x561cfc8b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc8b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/1763328630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cfc790750 con 0x561cfc871f70 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf259c640 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc8b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc86fb20 0x561cfc871a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc871f70 0x561cfc89d370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdbec061e30 tx=0x7fdbec059fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a94e18b3e75acdf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbd3fff640 1 -- 172.21.15.139:0/1763328630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec062360 con 0x561cfc871f70 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbd3fff640 1 -- 172.21.15.139:0/1763328630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec011dc0 con 0x561cfc871f70 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.067+0000 7fdbd3fff640 1 -- 172.21.15.139:0/1763328630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec055df0 con 0x561cfc871f70 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 -- 172.21.15.139:0/1763328630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc871f70 msgr2=0x561cfc89d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc871f70 0x561cfc89d370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdbec061e30 tx=0x7fdbec059fc0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 -- 172.21.15.139:0/1763328630 shutdown_connections 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc871f70 0x561cfc89d370 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc86fb20 0x561cfc871a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 --2- 172.21.15.139:0/1763328630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc8b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 -- 172.21.15.139:0/1763328630 >> 172.21.15.139:0/1763328630 conn(0x561cfc8709b0 msgr2=0x561cfc8b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 -- 172.21.15.139:0/1763328630 shutdown_connections 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.068+0000 7fdbfb670740 1 -- 172.21.15.139:0/1763328630 wait complete. 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.069+0000 7fdbfb670740 1 -- start start 2024-04-26T17:58:41.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.069+0000 7fdbfb670740 1 Processor -- start 2024-04-26T17:58:41.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc8adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc874170 0x561cfc8c5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc8b5a50 0x561cfc89a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561cfc86ffb0 con 0x561cfc874170 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561cfc75ffe0 con 0x561cfc8b5a50 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561cfc876090 con 0x561cfc89cf90 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 10 client.0 _ll_register_callbacks cb 0x561cfc776150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc874170 0x561cfc8c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc874170 0x561cfc8c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38974/0 (socket says 172.21.15.139:38974) 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 -- 172.21.15.139:0/205440946 learned_addr learned my addr 172.21.15.139:0/205440946 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf259c640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc8adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc8b5a50 0x561cfc89a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 -- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 msgr2=0x561cfc8adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc8adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 -- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc8b5a50 msgr2=0x561cfc89a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc8b5a50 0x561cfc89a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 -- 172.21.15.139:0/205440946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cfc4ea2d0 con 0x561cfc874170 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc8b5a50 0x561cfc89a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:41.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf259c640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc8adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc874170 0x561cfc8c5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8000f60 tx=0x7fdbe8001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d926b14391f33e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbd17fa640 1 -- 172.21.15.139:0/205440946 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8019060 con 0x561cfc874170 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbd17fa640 1 -- 172.21.15.139:0/205440946 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbe80143f0 con 0x561cfc874170 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbec011dc0 con 0x561cfc874170 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbd17fa640 1 -- 172.21.15.139:0/205440946 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdbe801f050 con 0x561cfc874170 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 10 client.4803 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561cfc5b46b0 con 0x561cfc874170 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.070+0000 7fdbd17fa640 1 -- 172.21.15.139:0/205440946 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec011dc0 con 0x561cfc874170 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbd17fa640 1 -- 172.21.15.139:0/205440946 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fdbe8022020 con 0x561cfc874170 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbfb670740 10 client.4803 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbfb670740 10 client.4803 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbfb670740 20 client.4803 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:41.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbfb670740 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8d1df0 0x561cfc8d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbfb670740 4 client.4803 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cfc7e6350 con 0x561cfc8d1df0 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbf259c640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8d1df0 0x561cfc8d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbf259c640 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8d1df0 0x561cfc8d41e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e33d6a901f9737 server_cookie=f18eedc7f701ddba in_seq=0 out_seq=0 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.071+0000 7fdbd17fa640 10 client.4803 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbd17fa640 1 -- 172.21.15.139:0/205440946 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561cfc7e6350 con 0x561cfc8d1df0 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbd17fa640 10 client.4803 handle_command_reply: tid=0 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 client.4803 shutdown 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc874170 msgr2=0x561cfc8c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc874170 0x561cfc8c5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8000f60 tx=0x7fdbe8001520 comp rx=0 tx=0).stop 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 shutdown_connections 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc8b5a50 0x561cfc89a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc874170 0x561cfc8c5870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8d1df0 0x561cfc8d41e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 --2- 172.21.15.139:0/205440946 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc8adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 >> 172.21.15.139:0/205440946 conn(0x561cfc871f70 msgr2=0x561cfc86d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbd17fa640 0 client.4803 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:41.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 shutdown_connections 2024-04-26T17:58:41.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 1 -- 172.21.15.139:0/205440946 wait complete. 2024-04-26T17:58:41.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.072+0000 7fdbfb670740 20 client.4803 trim_cache size 0 max 16384 2024-04-26T17:58:41.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.090+0000 7fdbfb670740 1 Processor -- start 2024-04-26T17:58:41.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.090+0000 7fdbfb670740 1 -- start start 2024-04-26T17:58:41.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc874170 0x561cfc8bee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc86d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc86dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbfb670740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf41fe530 con 0x561cfc8b5a50 2024-04-26T17:58:41.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561cfc8b7c70 con 0x561cfc874170 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561cfc89b3c0 con 0x561cfc89cf90 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc86dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc86dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38986/0 (socket says 172.21.15.139:38986) 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/3850483952 learned_addr learned my addr 172.21.15.139:0/3850483952 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/3850483952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 msgr2=0x561cfc86d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc86d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/3850483952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc874170 msgr2=0x561cfc8bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf259c640 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc874170 0x561cfc8bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc874170 0x561cfc8bee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/3850483952 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cfc86a700 con 0x561cfc8b5a50 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc86dbb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbec059940 tx=0x7fdbec01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a00ef295edbfac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbd37fe640 1 -- 172.21.15.139:0/3850483952 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec062360 con 0x561cfc8b5a50 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbd37fe640 1 -- 172.21.15.139:0/3850483952 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec077070 con 0x561cfc8b5a50 2024-04-26T17:58:41.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.091+0000 7fdbd37fe640 1 -- 172.21.15.139:0/3850483952 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec057a80 con 0x561cfc8b5a50 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 -- 172.21.15.139:0/3850483952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 msgr2=0x561cfc86dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc86dbb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbec059940 tx=0x7fdbec01c000 comp rx=0 tx=0).stop 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 -- 172.21.15.139:0/3850483952 shutdown_connections 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc86dbb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc89cf90 0x561cfc86d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 --2- 172.21.15.139:0/3850483952 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc874170 0x561cfc8bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 -- 172.21.15.139:0/3850483952 >> 172.21.15.139:0/3850483952 conn(0x561cfc871f70 msgr2=0x561cfc86eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 -- 172.21.15.139:0/3850483952 shutdown_connections 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 -- 172.21.15.139:0/3850483952 wait complete. 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.092+0000 7fdbfb670740 1 -- start start 2024-04-26T17:58:41.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 1 Processor -- start 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc874170 0x561cfc89a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc929300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc929840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561cfc8c8430 con 0x561cfc8b5a50 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x561cfc8b5ed0 con 0x561cfc89cf90 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561cfc8c8ae0 con 0x561cfc874170 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbfb670740 10 client.0 _ll_register_callbacks cb 0x7fdbe8007e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:41.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc929840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbf2d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc929840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39000/0 (socket says 172.21.15.139:39000) 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.093+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/2438131745 learned_addr learned my addr 172.21.15.139:0/2438131745 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf259c640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc874170 0x561cfc89a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc929300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc874170 msgr2=0x561cfc89a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc874170 0x561cfc89a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 msgr2=0x561cfc929300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc929300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf2d9d640 1 -- 172.21.15.139:0/2438131745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cfc930510 con 0x561cfc8b5a50 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf1d9b640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc929300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbf2d9d640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc929840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdbec059430 tx=0x7fdbec004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7f447e28d9a69f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbd17fa640 1 -- 172.21.15.139:0/2438131745 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec055df0 con 0x561cfc8b5a50 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbd17fa640 1 -- 172.21.15.139:0/2438131745 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbec061ed0 con 0x561cfc8b5a50 2024-04-26T17:58:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbec077070 con 0x561cfc8b5a50 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbd17fa640 1 -- 172.21.15.139:0/2438131745 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fdbec055f90 con 0x561cfc8b5a50 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 10 client.4809 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561cfc86d950 con 0x561cfc8b5a50 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbd17fa640 1 -- 172.21.15.139:0/2438131745 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec077070 con 0x561cfc8b5a50 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbd17fa640 1 -- 172.21.15.139:0/2438131745 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fdbec058bd0 con 0x561cfc8b5a50 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 10 client.4809 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 10 client.4809 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 20 client.4809 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8acd40 0x561cfc8ad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 4 client.4809 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.094+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "status"}) -- 0x561cfc7e01c0 con 0x561cfc8acd40 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbf259c640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8acd40 0x561cfc8ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbf259c640 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8acd40 0x561cfc8ad120 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1445a5917fdba701 server_cookie=e59f8162ff548bb in_seq=0 out_seq=0 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbd17fa640 10 client.4809 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbd17fa640 1 -- 172.21.15.139:0/2438131745 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x561cfc7e01c0 con 0x561cfc8acd40 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbd17fa640 10 client.4809 handle_command_reply: tid=0 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 client.4809 shutdown 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 msgr2=0x561cfc929840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc929840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdbec059430 tx=0x7fdbec004660 comp rx=0 tx=0).stop 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 shutdown_connections 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561cfc8b5a50 0x561cfc929840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x561cfc89cf90 0x561cfc929300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561cfc8acd40 0x561cfc8ad120 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 --2- 172.21.15.139:0/2438131745 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x561cfc874170 0x561cfc89a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbd17fa640 0 client.4809 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 >> 172.21.15.139:0/2438131745 conn(0x561cfc871f70 msgr2=0x561cfc8bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 shutdown_connections 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 1 -- 172.21.15.139:0/2438131745 wait complete. 2024-04-26T17:58:41.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.095+0000 7fdbfb670740 20 client.4809 trim_cache size 0 max 16384 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "ef741c66-6f9a-4560-84cd-b0800c4824c8", 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4309, 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 36.396921720000002, 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 9, 2024-04-26T17:58:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 24, 2024-04-26T17:58:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T17:58:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 42.406253046000003 2024-04-26T17:58:41.103 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:58:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdbd406c920 msgr2=0x7fdbd406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdbd406c920 0x7fdbd406ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4034000 tx=0x7fdbe402f000 comp rx=0 tx=0).stop 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 msgr2=0x7fdbf40cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40cf7c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00b440 tx=0x7fdbec00b900 comp rx=0 tx=0).stop 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 shutdown_connections 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdbd406c920 0x7fdbd406ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdbf4156000 0x7fdbf40cf7c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdbf40c9d50 0x7fdbf41564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 --2- 172.21.15.139:0/314484263 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdbf4070630 0x7fdbf414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 >> 172.21.15.139:0/314484263 conn(0x7fdbf4071d70 msgr2=0x7fdbf415b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 shutdown_connections 2024-04-26T17:58:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:41.096+0000 7fdbf8959640 1 -- 172.21.15.139:0/314484263 wait complete. 2024-04-26T17:58:41.106 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-26T17:58:56.107 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T17:58:56.108 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T17:58:56.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:56.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.220+0000 7f80cc6fc640 1 Processor -- start 2024-04-26T17:58:56.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.220+0000 7f80cc6fc640 1 -- start start 2024-04-26T17:58:56.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cc6fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f80c406e240 0x7f80c40c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cc6fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f80c415ce60 0x7f80c415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cc6fc640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c415d830 con 0x7f80c4153b10 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cc6fc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f80c406e8d0 con 0x7f80c415ce60 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cc6fc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f80c4073910 con 0x7f80c406e240 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cac99640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f80c415ce60 0x7f80c415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80ca498640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f80c4153b10 0x7f80c40cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45968/0 (socket says 172.21.15.139:45968) 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80ca498640 1 -- 172.21.15.139:0/3110593466 learned_addr learned my addr 172.21.15.139:0/3110593466 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80c9c97640 1 --2- 172.21.15.139:0/3110593466 >> v2:172.21.15.143:3300/0 conn(0x7f80c406e240 0x7f80c40c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cac99640 1 -- 172.21.15.139:0/3110593466 >> v2:172.21.15.143:3300/0 conn(0x7f80c406e240 msgr2=0x7f80c40c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80c9496640 1 -- 172.21.15.139:0/3110593466 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323388035 0 0) 0x7f80c415d830 con 0x7f80c4153b10 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cac99640 1 --2- 172.21.15.139:0/3110593466 >> v2:172.21.15.143:3300/0 conn(0x7f80c406e240 0x7f80c40c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cac99640 1 -- 172.21.15.139:0/3110593466 >> v1:172.21.15.139:6789/0 conn(0x7f80c4153b10 legacy=0x7f80c40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80cac99640 1 -- 172.21.15.139:0/3110593466 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c40c7d30 con 0x7f80c415ce60 2024-04-26T17:58:56.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.221+0000 7f80c9c97640 1 --2- 172.21.15.139:0/3110593466 >> v2:172.21.15.143:3300/0 conn(0x7f80c406e240 0x7f80c40c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.222+0000 7f80cac99640 1 --2- 172.21.15.139:0/3110593466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c415d2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f80c40ce040 tx=0x7f80bc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b30447a2f38dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.222+0000 7f80c9496640 1 -- 172.21.15.139:0/3110593466 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc007740 con 0x7f80c415ce60 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.222+0000 7f80c9496640 1 -- 172.21.15.139:0/3110593466 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc0078e0 con 0x7f80c415ce60 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.222+0000 7f80c9496640 1 -- 172.21.15.139:0/3110593466 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc007cb0 con 0x7f80c415ce60 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 -- 172.21.15.139:0/3110593466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 msgr2=0x7f80c415d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/3110593466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c415d2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f80c40ce040 tx=0x7f80bc02a710 comp rx=0 tx=0).stop 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 -- 172.21.15.139:0/3110593466 shutdown_connections 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/3110593466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c415d2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/3110593466 >> v2:172.21.15.143:3300/0 conn(0x7f80c406e240 0x7f80c40c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 -- 172.21.15.139:0/3110593466 >> 172.21.15.139:0/3110593466 conn(0x7f80c4068270 msgr2=0x7f80c4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 -- 172.21.15.139:0/3110593466 shutdown_connections 2024-04-26T17:58:56.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.223+0000 7f80cc6fc640 1 -- 172.21.15.139:0/3110593466 wait complete. 2024-04-26T17:58:56.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.224+0000 7f80cc6fc640 1 Processor -- start 2024-04-26T17:58:56.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.224+0000 7f80cc6fc640 1 -- start start 2024-04-26T17:58:56.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80c406e240 0x7f80c4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80c4153b10 0x7f80c415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c40cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f80c40732c0 con 0x7f80c415ce60 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4072fe0 con 0x7f80c406e240 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f80c40735a0 con 0x7f80c4153b10 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c40cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c40cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33686/0 (socket says 172.21.15.139:33686) 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 -- 172.21.15.139:0/107057551 learned_addr learned my addr 172.21.15.139:0/107057551 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80ca498640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80c406e240 0x7f80c4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80c9c97640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80c4153b10 0x7f80c415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 -- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80c4153b10 msgr2=0x7f80c415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80c4153b10 0x7f80c415b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 -- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80c406e240 msgr2=0x7f80c4151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80c406e240 0x7f80c4151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 -- 172.21.15.139:0/107057551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c415c1b0 con 0x7f80c415ce60 2024-04-26T17:58:56.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cac99640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c40cb1d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009e50 tx=0x7f80bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80baffd640 1 -- 172.21.15.139:0/107057551 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc03f070 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80baffd640 1 -- 172.21.15.139:0/107057551 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc031cc0 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80baffd640 1 -- 172.21.15.139:0/107057551 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc044680 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c4152360 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.225+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c415c730 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.226+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c4076d20 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.227+0000 7f80baffd640 1 -- 172.21.15.139:0/107057551 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80bc03b410 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.227+0000 7f80baffd640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f80a806c8f0 0x7f80a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.227+0000 7f80baffd640 1 -- 172.21.15.139:0/107057551 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f80bc0ad890 con 0x7f80c415ce60 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.227+0000 7f80ca498640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f80a806c8f0 0x7f80a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.228+0000 7f80ca498640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f80a806c8f0 0x7f80a806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f80c0000f60 tx=0x7f80c0007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.232+0000 7f80baffd640 1 -- 172.21.15.139:0/107057551 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f80bc07b980 con 0x7f80c415ce60 2024-04-26T17:58:56.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.440+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80c406eab0 con 0x7f80c415ce60 2024-04-26T17:58:56.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.441+0000 7f80baffd640 1 -- 172.21.15.139:0/107057551 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f80bc07b280 con 0x7f80c415ce60 2024-04-26T17:58:56.441 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:58:56.441 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:58:56.441 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:58:56.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f80a806c8f0 msgr2=0x7f80a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f80a806c8f0 0x7f80a806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f80c0000f60 tx=0x7f80c0007b50 comp rx=0 tx=0).stop 2024-04-26T17:58:56.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 msgr2=0x7f80c40cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c40cb1d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009e50 tx=0x7f80bc004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:56.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 shutdown_connections 2024-04-26T17:58:56.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f80a806c8f0 0x7f80a806edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c415ce60 0x7f80c40cb1d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f80c4153b10 0x7f80c415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 --2- 172.21.15.139:0/107057551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f80c406e240 0x7f80c4151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 >> 172.21.15.139:0/107057551 conn(0x7f80c4068270 msgr2=0x7f80c413ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 shutdown_connections 2024-04-26T17:58:56.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.443+0000 7f80cc6fc640 1 -- 172.21.15.139:0/107057551 wait complete. 2024-04-26T17:58:56.454 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T17:58:56.454 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T17:58:56.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.561+0000 7fc50ed24640 1 Processor -- start 2024-04-26T17:58:56.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.561+0000 7fc50ed24640 1 -- start start 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50ed24640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc508155e70 0x7fc5080c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50ed24640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc5080c4740 0x7fc508166440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50ed24640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc508156250 con 0x7fc5080c9be0 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50ed24640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc50815c670 con 0x7fc508155e70 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50ed24640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc50815bac0 con 0x7fc5080c4740 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50cac0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc508155e70 0x7fc5080c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc507fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc5080c9be0 0x7fc5080cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45982/0 (socket says 172.21.15.139:45982) 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50cac0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc508155e70 0x7fc5080c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33690/0 (socket says 172.21.15.139:33690) 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc507fff640 1 -- 172.21.15.139:0/1925427415 learned_addr learned my addr 172.21.15.139:0/1925427415 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/1925427415 >> v2:172.21.15.143:3300/0 conn(0x7fc5080c4740 0x7fc508166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50cac0640 1 -- 172.21.15.139:0/1925427415 >> v2:172.21.15.143:3300/0 conn(0x7fc5080c4740 msgr2=0x7fc508166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1925427415 >> v2:172.21.15.143:3300/0 conn(0x7fc5080c4740 0x7fc508166440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50cac0640 1 -- 172.21.15.139:0/1925427415 >> v1:172.21.15.139:6789/0 conn(0x7fc5080c9be0 legacy=0x7fc5080cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc50cac0640 1 -- 172.21.15.139:0/1925427415 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc508070ac0 con 0x7fc508155e70 2024-04-26T17:58:56.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.562+0000 7fc5077fe640 1 -- 172.21.15.139:0/1925427415 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707866310 0 0) 0x7fc4f4001110 con 0x7fc5080c9be0 2024-04-26T17:58:56.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1925427415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc5080c4200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc5080cfc90 tx=0x7fc4fc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f90020170a80d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc5077fe640 1 -- 172.21.15.139:0/1925427415 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc037070 con 0x7fc508155e70 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc5077fe640 1 -- 172.21.15.139:0/1925427415 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc032440 con 0x7fc508155e70 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc5077fe640 1 -- 172.21.15.139:0/1925427415 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc032810 con 0x7fc508155e70 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 -- 172.21.15.139:0/1925427415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 msgr2=0x7fc5080c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1925427415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc5080c4200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc5080cfc90 tx=0x7fc4fc02a230 comp rx=0 tx=0).stop 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 -- 172.21.15.139:0/1925427415 shutdown_connections 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1925427415 >> v2:172.21.15.143:3300/0 conn(0x7fc5080c4740 0x7fc508166440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1925427415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc5080c4200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 -- 172.21.15.139:0/1925427415 >> 172.21.15.139:0/1925427415 conn(0x7fc508068090 msgr2=0x7fc508068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 -- 172.21.15.139:0/1925427415 shutdown_connections 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.563+0000 7fc50ed24640 1 -- 172.21.15.139:0/1925427415 wait complete. 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.564+0000 7fc50ed24640 1 Processor -- start 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50ed24640 1 -- start start 2024-04-26T17:58:56.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50ed24640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5080c4740 0x7fc5081f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50ed24640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080c9be0 0x7fc50815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50ed24640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc50815e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50ed24640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc50815c300 con 0x7fc508155e70 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50ed24640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc50815c020 con 0x7fc5080c4740 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50ed24640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc508070e90 con 0x7fc5080c9be0 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.565+0000 7fc50d2c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc50815e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc50815e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33706/0 (socket says 172.21.15.139:33706) 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 -- 172.21.15.139:0/1494112698 learned_addr learned my addr 172.21.15.139:0/1494112698 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc507fff640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080c9be0 0x7fc50815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5080c4740 0x7fc5081f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 -- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080c9be0 msgr2=0x7fc50815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080c9be0 0x7fc50815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 -- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5080c4740 msgr2=0x7fc5081f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5080c4740 0x7fc5081f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 -- 172.21.15.139:0/1494112698 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5081e6980 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc50815e400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc500007e90 tx=0x7fc50000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc5057fa640 1 -- 172.21.15.139:0/1494112698 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500014420 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc5057fa640 1 -- 172.21.15.139:0/1494112698 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc500019070 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5081e6c40 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc5057fa640 1 -- 172.21.15.139:0/1494112698 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500014800 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.566+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5081e7200 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.567+0000 7fc5057fa640 1 -- 172.21.15.139:0/1494112698 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5000149a0 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.568+0000 7fc5057fa640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4ec06c8f0 0x7fc4ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.568+0000 7fc5057fa640 1 -- 172.21.15.139:0/1494112698 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc50008c790 con 0x7fc508155e70 2024-04-26T17:58:56.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.568+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4ec06c8f0 0x7fc4ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.568+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4ec06c8f0 0x7fc4ec06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc034000 tx=0x7fc4fc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.569+0000 7fc511a3f740 1 Processor -- start 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.569+0000 7fc511a3f740 1 -- start start 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 0x55ed7c2a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc511a3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ed7c203d80 con 0x55ed7c2a1b40 2024-04-26T17:58:56.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ed7c19fc20 con 0x55ed7c2a05e0 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ed7c1ffd40 con 0x55ed7c2dfae0 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33722/0 (socket says 172.21.15.139:33722) 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 -- 172.21.15.139:0/833468528 learned_addr learned my addr 172.21.15.139:0/833468528 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50cac0640 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc507fff640 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 0x55ed7c2a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 -- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 msgr2=0x55ed7c2a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 0x55ed7c2a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 -- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 msgr2=0x55ed7c2df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 -- 172.21.15.139:0/833468528 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed7bfe1d80 con 0x55ed7c2a1b40 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50cac0640 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:56.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2a0f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc500062770 tx=0x7fc50005a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b358df2e542f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc4f27fc640 1 -- 172.21.15.139:0/833468528 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500062ca0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc4f27fc640 1 -- 172.21.15.139:0/833468528 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5000583c0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.570+0000 7fc4f27fc640 1 -- 172.21.15.139:0/833468528 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500012dc0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 -- 172.21.15.139:0/833468528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 msgr2=0x55ed7c2a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2a0f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc500062770 tx=0x7fc50005a0c0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 -- 172.21.15.139:0/833468528 shutdown_connections 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2a0f00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 0x55ed7c2a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 --2- 172.21.15.139:0/833468528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 -- 172.21.15.139:0/833468528 >> 172.21.15.139:0/833468528 conn(0x55ed7c267740 msgr2=0x55ed7c2e4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 -- 172.21.15.139:0/833468528 shutdown_connections 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 -- 172.21.15.139:0/833468528 wait complete. 2024-04-26T17:58:56.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.571+0000 7fc511a3f740 1 -- start start 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 1 Processor -- start 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a05e0 0x55ed7c2da2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2dfae0 0x55ed7c2c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ed7c29ec20 con 0x55ed7c2a1b40 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ed7c19d840 con 0x55ed7c2dfae0 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ed7c2a2170 con 0x55ed7c2a05e0 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc511a3f740 10 client.0 _ll_register_callbacks cb 0x55ed7c1a15b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc507fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc507fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2f14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33728/0 (socket says 172.21.15.139:33728) 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc507fff640 1 -- 172.21.15.139:0/1800476433 learned_addr learned my addr 172.21.15.139:0/1800476433 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.572+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2dfae0 0x55ed7c2c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a05e0 0x55ed7c2da2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc507fff640 1 -- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a05e0 msgr2=0x55ed7c2da2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc507fff640 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a05e0 0x55ed7c2da2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc507fff640 1 -- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2dfae0 msgr2=0x55ed7c2c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc507fff640 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2dfae0 0x55ed7c2c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc507fff640 1 -- 172.21.15.139:0/1800476433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed7c042510 con 0x55ed7c2a1b40 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc507fff640 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2f14b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc508070910 tx=0x7fc4f4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c4c42f9d455922 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc4e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc4e77fe640 1 -- 172.21.15.139:0/1800476433 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f40133f0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc4e77fe640 1 -- 172.21.15.139:0/1800476433 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc4f4013590 con 0x55ed7c2a1b40 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5000583c0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc4e77fe640 1 -- 172.21.15.139:0/1800476433 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc4f4020050 con 0x55ed7c2a1b40 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 10 client.4833 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ed7bed5670 con 0x55ed7c2a1b40 2024-04-26T17:58:56.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc4e77fe640 1 -- 172.21.15.139:0/1800476433 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5000583c0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc4e77fe640 1 -- 172.21.15.139:0/1800476433 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc4f4023020 con 0x55ed7c2a1b40 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 10 client.4833 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 20 client.4833 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c2c8710 0x55ed7c2c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 4 client.4833 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.573+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed7c211990 con 0x55ed7c2c8710 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.574+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c2c8710 0x55ed7c2c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.574+0000 7fc4e77fe640 10 client.4833 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.574+0000 7fc50cac0640 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c2c8710 0x55ed7c2c8090 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=847a71aa73916e38 server_cookie=efdffb1df442b8dc in_seq=0 out_seq=0 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc4e77fe640 1 -- 172.21.15.139:0/1800476433 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ed7c211990 con 0x55ed7c2c8710 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc4e77fe640 10 client.4833 handle_command_reply: tid=0 2024-04-26T17:58:56.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 client.4833 shutdown 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 msgr2=0x55ed7c2f14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2f14b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc508070910 tx=0x7fc4f4007f90 comp rx=0 tx=0).stop 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 shutdown_connections 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2dfae0 0x55ed7c2c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2f14b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c2c8710 0x55ed7c2c8090 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1800476433 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a05e0 0x55ed7c2da2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 >> 172.21.15.139:0/1800476433 conn(0x55ed7c267740 msgr2=0x55ed7c2a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc4e77fe640 0 client.4833 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 shutdown_connections 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 1 -- 172.21.15.139:0/1800476433 wait complete. 2024-04-26T17:58:56.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.575+0000 7fc511a3f740 20 client.4833 trim_cache size 0 max 16384 2024-04-26T17:58:56.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.592+0000 7fc511a3f740 1 Processor -- start 2024-04-26T17:58:56.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.592+0000 7fc511a3f740 1 -- start start 2024-04-26T17:58:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2d8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2d8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 0x55ed7c303c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc511a3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc5082005e0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc5081ff4c0 con 0x55ed7c2a05e0 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc5081f5c20 con 0x55ed7c2dfae0 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2d8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33738/0 (socket says 172.21.15.139:33738) 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 -- 172.21.15.139:0/1502428345 learned_addr learned my addr 172.21.15.139:0/1502428345 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 -- 172.21.15.139:0/1502428345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 msgr2=0x55ed7c303c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 --2- 172.21.15.139:0/1502428345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 0x55ed7c303c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 -- 172.21.15.139:0/1502428345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 msgr2=0x55ed7c2d8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 --2- 172.21.15.139:0/1502428345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 -- 172.21.15.139:0/1502428345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed7c2f1820 con 0x55ed7c2a1b40 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc507fff640 1 --2- 172.21.15.139:0/1502428345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2d8560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4007ac0 tx=0x7fc4f400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160631b7893b9dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc4f1ffb640 1 -- 172.21.15.139:0/1502428345 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f40133f0 con 0x55ed7c2a1b40 2024-04-26T17:58:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc4f1ffb640 1 -- 172.21.15.139:0/1502428345 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f4018070 con 0x55ed7c2a1b40 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.593+0000 7fc4f1ffb640 1 -- 172.21.15.139:0/1502428345 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4013b40 con 0x55ed7c2a1b40 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 -- 172.21.15.139:0/1502428345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 msgr2=0x55ed7c2d8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1502428345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2d8560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4007ac0 tx=0x7fc4f400d000 comp rx=0 tx=0).stop 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 -- 172.21.15.139:0/1502428345 shutdown_connections 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1502428345 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2dfae0 0x55ed7c303c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1502428345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2a1b40 0x55ed7c2d8560 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 --2- 172.21.15.139:0/1502428345 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2d8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 -- 172.21.15.139:0/1502428345 >> 172.21.15.139:0/1502428345 conn(0x55ed7c267740 msgr2=0x55ed7c2962c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 -- 172.21.15.139:0/1502428345 shutdown_connections 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 -- 172.21.15.139:0/1502428345 wait complete. 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.594+0000 7fc511a3f740 1 -- start start 2024-04-26T17:58:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 1 Processor -- start 2024-04-26T17:58:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a1b40 0x55ed7c2e0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2dfae0 0x55ed7c354eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc5081fe050 con 0x55ed7c2dfae0 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc5081fedf0 con 0x55ed7c2a05e0 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc5081fe720 con 0x55ed7c2a1b40 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc511a3f740 10 client.0 _ll_register_callbacks cb 0x7fc4f4007af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc50d2c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2dfae0 0x55ed7c354eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc50d2c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2dfae0 0x55ed7c354eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33740/0 (socket says 172.21.15.139:33740) 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.595+0000 7fc50d2c1640 1 -- 172.21.15.139:0/782963330 learned_addr learned my addr 172.21.15.139:0/782963330 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50cac0640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc507fff640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a1b40 0x55ed7c2e0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50d2c1640 1 -- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a1b40 msgr2=0x55ed7c2e0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a1b40 0x55ed7c2e0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50d2c1640 1 -- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 msgr2=0x55ed7c2a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50d2c1640 1 -- 172.21.15.139:0/782963330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed7c296a60 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50cac0640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc50d2c1640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2dfae0 0x55ed7c354eb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc50008a8c0 tx=0x7fc50008a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be88f22b279be67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc4e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc4e77fe640 1 -- 172.21.15.139:0/782963330 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50005e170 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc4e77fe640 1 -- 172.21.15.139:0/782963330 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc500012dc0 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4f4018070 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc4e77fe640 1 -- 172.21.15.139:0/782963330 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc500056730 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 10 client.4839 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ed7c2e17e0 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc4e77fe640 1 -- 172.21.15.139:0/782963330 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f4018070 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc4e77fe640 1 -- 172.21.15.139:0/782963330 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc50008ace0 con 0x55ed7c2dfae0 2024-04-26T17:58:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 10 client.4839 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 10 client.4839 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 20 client.4839 populate_metadata read hostname 'smithi139' 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c3553f0 0x55ed7c35e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 4 client.4839 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.596+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55ed7c20b800 con 0x55ed7c3553f0 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.597+0000 7fc50cac0640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c3553f0 0x55ed7c35e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.597+0000 7fc50cac0640 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c3553f0 0x55ed7c35e720 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a733ad25ca88d2 server_cookie=5d386d95526493ef in_seq=0 out_seq=0 2024-04-26T17:58:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.597+0000 7fc4e77fe640 10 client.4839 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.601+0000 7fc4e77fe640 1 -- 172.21.15.139:0/782963330 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55ed7c20b800 con 0x55ed7c3553f0 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.601+0000 7fc4e77fe640 10 client.4839 handle_command_reply: tid=0 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 client.4839 shutdown 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2dfae0 msgr2=0x55ed7c354eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2dfae0 0x55ed7c354eb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc50008a8c0 tx=0x7fc50008a790 comp rx=0 tx=0).stop 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 shutdown_connections 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ed7c2dfae0 0x55ed7c354eb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ed7c3553f0 0x55ed7c35e720 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ed7c2a1b40 0x55ed7c2e0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 --2- 172.21.15.139:0/782963330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ed7c2a05e0 0x55ed7c2a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc4e77fe640 0 client.4839 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 >> 172.21.15.139:0/782963330 conn(0x55ed7c267740 msgr2=0x55ed7c2962c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 shutdown_connections 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 1 -- 172.21.15.139:0/782963330 wait complete. 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc511a3f740 20 client.4839 trim_cache size 0 max 16384 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 2, 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stdout: "6637f9f2": { 2024-04-26T17:58:56.605 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 2, 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T17:58:56.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:58:56.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:58:56.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:58:56.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:58:56.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:58:56.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:58:56.607 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4ec06c8f0 msgr2=0x7fc4ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4ec06c8f0 0x7fc4ec06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc034000 tx=0x7fc4fc02e000 comp rx=0 tx=0).stop 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 msgr2=0x7fc50815e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc50815e400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc500007e90 tx=0x7fc50000e4b0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 shutdown_connections 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4ec06c8f0 0x7fc4ec06edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508155e70 0x7fc50815e400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc5080c9be0 0x7fc50815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 --2- 172.21.15.139:0/1494112698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5080c4740 0x7fc5081f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.602+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 >> 172.21.15.139:0/1494112698 conn(0x7fc508068090 msgr2=0x7fc5081547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.603+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 shutdown_connections 2024-04-26T17:58:56.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:58:56.603+0000 7fc50ed24640 1 -- 172.21.15.139:0/1494112698 wait complete. 2024-04-26T17:58:56.613 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6637f9f2', quiesce took 0.5 seconds. Will release after: 30.0 2024-04-26T17:59:05.115 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:59:05.118 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:59:26.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:59:26.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.717+0000 7f1025c15640 1 Processor -- start 2024-04-26T17:59:26.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.717+0000 7f1025c15640 1 -- start start 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f1025c15640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1020155da0 0x7f102015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f1025c15640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1020156180 0x7f10200d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f1025c15640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10200cd840 0x7f10200d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f1025c15640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f102015cbc0 con 0x7f1020155da0 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f1025c15640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f10200cc730 con 0x7f1020156180 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f1025c15640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f102015f2a0 con 0x7f10200cd840 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1020155da0 0x7f102015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1020155da0 0x7f102015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52432/0 (socket says 172.21.15.139:52432) 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 -- 172.21.15.139:0/2537932517 learned_addr learned my addr 172.21.15.139:0/2537932517 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101effd640 1 --2- 172.21.15.139:0/2537932517 >> v2:172.21.15.143:3300/0 conn(0x7f1020156180 0x7f10200d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 -- 172.21.15.139:0/2537932517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10200cd840 msgr2=0x7f10200d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:26.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101ffff640 1 --2- 172.21.15.139:0/2537932517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10200cd840 0x7f10200d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 --2- 172.21.15.139:0/2537932517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10200cd840 0x7f10200d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 -- 172.21.15.139:0/2537932517 >> v2:172.21.15.143:3300/0 conn(0x7f1020156180 msgr2=0x7f10200d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 --2- 172.21.15.139:0/2537932517 >> v2:172.21.15.143:3300/0 conn(0x7f1020156180 0x7f10200d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101f7fe640 1 -- 172.21.15.139:0/2537932517 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102015f580 con 0x7f1020155da0 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.718+0000 7f101effd640 1 --2- 172.21.15.139:0/2537932517 >> v2:172.21.15.143:3300/0 conn(0x7f1020156180 0x7f10200d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.719+0000 7f101f7fe640 1 --2- 172.21.15.139:0/2537932517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1020155da0 0x7f102015c680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10200cbe80 tx=0x7f101002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1f4a40900bdb2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.719+0000 7f101e7fc640 1 -- 172.21.15.139:0/2537932517 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010037070 con 0x7f1020155da0 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.719+0000 7f101e7fc640 1 -- 172.21.15.139:0/2537932517 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1010032440 con 0x7f1020155da0 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.719+0000 7f101e7fc640 1 -- 172.21.15.139:0/2537932517 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010032810 con 0x7f1020155da0 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 -- 172.21.15.139:0/2537932517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1020155da0 msgr2=0x7f102015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 --2- 172.21.15.139:0/2537932517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1020155da0 0x7f102015c680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10200cbe80 tx=0x7f101002a140 comp rx=0 tx=0).stop 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 -- 172.21.15.139:0/2537932517 shutdown_connections 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 --2- 172.21.15.139:0/2537932517 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10200cd840 0x7f10200d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 --2- 172.21.15.139:0/2537932517 >> v2:172.21.15.143:3300/0 conn(0x7f1020156180 0x7f10200d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 --2- 172.21.15.139:0/2537932517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1020155da0 0x7f102015c680 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 -- 172.21.15.139:0/2537932517 >> 172.21.15.139:0/2537932517 conn(0x7f1020068090 msgr2=0x7f10200684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:26.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 -- 172.21.15.139:0/2537932517 shutdown_connections 2024-04-26T17:59:26.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.720+0000 7f1025c15640 1 -- 172.21.15.139:0/2537932517 wait complete. 2024-04-26T17:59:26.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.721+0000 7f1025c15640 1 Processor -- start 2024-04-26T17:59:26.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.721+0000 7f1025c15640 1 -- start start 2024-04-26T17:59:26.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f1025c15640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10200cd840 0x7f10200d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f1025c15640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1020155da0 0x7f10201f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f1025c15640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10201e79b0 0x7f10201f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f1025c15640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10200cc160 con 0x7f10200cd840 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f1025c15640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f102015fb40 con 0x7f1020155da0 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f1025c15640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10200cc2e0 con 0x7f10201e79b0 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10200cd840 0x7f10200d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10200cd840 0x7f10200d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52446/0 (socket says 172.21.15.139:52446) 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 -- 172.21.15.139:0/3615084098 learned_addr learned my addr 172.21.15.139:0/3615084098 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101effd640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1020155da0 0x7f10201f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101ffff640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10201e79b0 0x7f10201f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 -- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10201e79b0 msgr2=0x7f10201f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10201e79b0 0x7f10201f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 -- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1020155da0 msgr2=0x7f10201f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:26.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1020155da0 0x7f10201f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 -- 172.21.15.139:0/3615084098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10201f58e0 con 0x7f10200cd840 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101effd640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1020155da0 0x7f10201f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.722+0000 7f101f7fe640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10200cd840 0x7f10200d0530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f101002a180 tx=0x7f10100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.723+0000 7f1007fff640 1 -- 172.21.15.139:0/3615084098 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010037040 con 0x7f10200cd840 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.723+0000 7f1007fff640 1 -- 172.21.15.139:0/3615084098 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1010042070 con 0x7f10200cd840 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.723+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10201f5b80 con 0x7f10200cd840 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.723+0000 7f1007fff640 1 -- 172.21.15.139:0/3615084098 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010030bb0 con 0x7f10200cd840 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.723+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1020150570 con 0x7f10200cd840 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.724+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1020076d20 con 0x7f10200cd840 2024-04-26T17:59:26.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.724+0000 7f1007fff640 1 -- 172.21.15.139:0/3615084098 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1010047460 con 0x7f10200cd840 2024-04-26T17:59:26.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.725+0000 7f1007fff640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f100c06c8f0 0x7f100c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:26.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.725+0000 7f1007fff640 1 -- 172.21.15.139:0/3615084098 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f10100acc30 con 0x7f10200cd840 2024-04-26T17:59:26.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.725+0000 7f101effd640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f100c06c8f0 0x7f100c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:26.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.725+0000 7f101effd640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f100c06c8f0 0x7f100c06edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10201537c0 tx=0x7f1014008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:26.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.729+0000 7f1007fff640 1 -- 172.21.15.139:0/3615084098 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1010045360 con 0x7f10200cd840 2024-04-26T17:59:26.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.962+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10200cd330 con 0x7f10200cd840 2024-04-26T17:59:26.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.962+0000 7f1007fff640 1 -- 172.21.15.139:0/3615084098 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f101007abd0 con 0x7f10200cd840 2024-04-26T17:59:26.963 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:59:26.963 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:59:26.963 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f100c06c8f0 msgr2=0x7f100c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f100c06c8f0 0x7f100c06edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10201537c0 tx=0x7f1014008040 comp rx=0 tx=0).stop 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10200cd840 msgr2=0x7f10200d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10200cd840 0x7f10200d0530 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f101002a180 tx=0x7f10100046c0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 shutdown_connections 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f100c06c8f0 0x7f100c06edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10201e79b0 0x7f10201f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1020155da0 0x7f10201f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 --2- 172.21.15.139:0/3615084098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10200cd840 0x7f10200d0530 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:26.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 >> 172.21.15.139:0/3615084098 conn(0x7f1020068090 msgr2=0x7f10200c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:26.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 shutdown_connections 2024-04-26T17:59:26.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:26.965+0000 7f1025c15640 1 -- 172.21.15.139:0/3615084098 wait complete. 2024-04-26T17:59:26.976 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 6637f9f2 --release --await' 2024-04-26T17:59:26.977 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 6637f9f2 --release --await 2024-04-26T17:59:27.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.084+0000 7f3a2b540640 1 Processor -- start 2024-04-26T17:59:27.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.084+0000 7f3a2b540640 1 -- start start 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a2b540640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a24152bc0 0x7f3a240c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a2b540640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a240ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a2b540640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a240c4770 con 0x7f3a24072f20 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a2b540640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f3a240733f0 con 0x7f3a24152bc0 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a2b540640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2406d2f0 con 0x7f3a240c4ec0 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a292dc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a24152bc0 0x7f3a240c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a28adb640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3a24072f20 0x7f3a240c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49460/0 (socket says 172.21.15.139:49460) 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a292dc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a24152bc0 0x7f3a240c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52452/0 (socket says 172.21.15.139:52452) 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.085+0000 7f3a292dc640 1 -- 172.21.15.139:0/111322899 learned_addr learned my addr 172.21.15.139:0/111322899 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.086+0000 7f3a29add640 1 --2- 172.21.15.139:0/111322899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a240ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.086+0000 7f3a292dc640 1 -- 172.21.15.139:0/111322899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 msgr2=0x7f3a240ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.086+0000 7f3a292dc640 1 --2- 172.21.15.139:0/111322899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a240ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.086+0000 7f3a292dc640 1 -- 172.21.15.139:0/111322899 >> v1:172.21.15.139:6789/0 conn(0x7f3a24072f20 legacy=0x7f3a240c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.086+0000 7f3a1bfff640 1 -- 172.21.15.139:0/111322899 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494593138 0 0) 0x7f3a240c4770 con 0x7f3a24072f20 2024-04-26T17:59:27.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.086+0000 7f3a292dc640 1 -- 172.21.15.139:0/111322899 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a24074470 con 0x7f3a24152bc0 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.087+0000 7f3a292dc640 1 --2- 172.21.15.139:0/111322899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a240c8a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000bb10 tx=0x7f3a2002c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a262367b324e0f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.087+0000 7f3a1bfff640 1 -- 172.21.15.139:0/111322899 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20035070 con 0x7f3a24152bc0 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.087+0000 7f3a1bfff640 1 -- 172.21.15.139:0/111322899 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a20031610 con 0x7f3a24152bc0 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.087+0000 7f3a1bfff640 1 -- 172.21.15.139:0/111322899 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a200319e0 con 0x7f3a24152bc0 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 -- 172.21.15.139:0/111322899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 msgr2=0x7f3a240c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 --2- 172.21.15.139:0/111322899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a240c8a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000bb10 tx=0x7f3a2002c9b0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 -- 172.21.15.139:0/111322899 shutdown_connections 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 --2- 172.21.15.139:0/111322899 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a240ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 --2- 172.21.15.139:0/111322899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a240c8a30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 -- 172.21.15.139:0/111322899 >> 172.21.15.139:0/111322899 conn(0x7f3a2406ed70 msgr2=0x7f3a2406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 -- 172.21.15.139:0/111322899 shutdown_connections 2024-04-26T17:59:27.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.088+0000 7f3a2b540640 1 -- 172.21.15.139:0/111322899 wait complete. 2024-04-26T17:59:27.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.089+0000 7f3a2b540640 1 Processor -- start 2024-04-26T17:59:27.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.089+0000 7f3a2b540640 1 -- start start 2024-04-26T17:59:27.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a2b540640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a24072f20 0x7f3a241f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a2b540640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a241df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a2b540640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a241df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a2b540640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240c4250 con 0x7f3a24152bc0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a2b540640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240c3f70 con 0x7f3a24072f20 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a2b540640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a24152fa0 con 0x7f3a240c4ec0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a241df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a241df5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52456/0 (socket says 172.21.15.139:52456) 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 -- 172.21.15.139:0/308616932 learned_addr learned my addr 172.21.15.139:0/308616932 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a292dc640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a24072f20 0x7f3a241f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a28adb640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a241df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 -- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 msgr2=0x7f3a241df0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a241df0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 -- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a24072f20 msgr2=0x7f3a241f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a24072f20 0x7f3a241f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 -- 172.21.15.139:0/308616932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a241f1b00 con 0x7f3a24152bc0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.090+0000 7f3a29add640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a241df5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c007e70 tx=0x7f3a1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.091+0000 7f3a19ffb640 1 -- 172.21.15.139:0/308616932 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c014620 con 0x7f3a24152bc0 2024-04-26T17:59:27.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.091+0000 7f3a19ffb640 1 -- 172.21.15.139:0/308616932 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c019070 con 0x7f3a24152bc0 2024-04-26T17:59:27.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.091+0000 7f3a19ffb640 1 -- 172.21.15.139:0/308616932 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c014a20 con 0x7f3a24152bc0 2024-04-26T17:59:27.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.091+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a241f1820 con 0x7f3a24152bc0 2024-04-26T17:59:27.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.091+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241507b0 con 0x7f3a24152bc0 2024-04-26T17:59:27.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.092+0000 7f3a19ffb640 1 -- 172.21.15.139:0/308616932 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a1c014bc0 con 0x7f3a24152bc0 2024-04-26T17:59:27.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.093+0000 7f3a19ffb640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a08070d00 0x7f3a080731c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.093+0000 7f3a19ffb640 1 -- 172.21.15.139:0/308616932 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3a1c08c810 con 0x7f3a24152bc0 2024-04-26T17:59:27.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.093+0000 7f3a292dc640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a08070d00 0x7f3a080731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.094+0000 7f3a292dc640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a08070d00 0x7f3a080731c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a20037000 tx=0x7f3a2003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.094+0000 7f3a2e25b740 1 Processor -- start 2024-04-26T17:59:27.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.094+0000 7f3a2e25b740 1 -- start start 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65b4b0 0x5641df69a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df69a9b0 0x5641df65b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65ca10 0x5641df65bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5641df5c0040 con 0x5641df69a9b0 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5641df55bb60 con 0x5641df65b4b0 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5641df5bc000 con 0x5641df65ca10 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df69a9b0 0x5641df65b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df69a9b0 0x5641df65b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52468/0 (socket says 172.21.15.139:52468) 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 -- 172.21.15.139:0/4236185564 learned_addr learned my addr 172.21.15.139:0/4236185564 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a292dc640 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65b4b0 0x5641df69a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a29add640 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65ca10 0x5641df65bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 -- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65ca10 msgr2=0x5641df65bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65ca10 0x5641df65bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 -- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65b4b0 msgr2=0x5641df69a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65b4b0 0x5641df69a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 -- 172.21.15.139:0/4236185564 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641df5509c0 con 0x5641df69a9b0 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a29add640 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65ca10 0x5641df65bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:27.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a28adb640 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df69a9b0 0x5641df65b890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a140011e0 tx=0x7f3a14005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c007732352158694 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a06ffd640 1 -- 172.21.15.139:0/4236185564 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14019070 con 0x5641df69a9b0 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a06ffd640 1 -- 172.21.15.139:0/4236185564 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a140074c0 con 0x5641df69a9b0 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.095+0000 7f3a06ffd640 1 -- 172.21.15.139:0/4236185564 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007670 con 0x5641df69a9b0 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4236185564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df69a9b0 msgr2=0x5641df65b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df69a9b0 0x5641df65b890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a140011e0 tx=0x7f3a14005bc0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4236185564 shutdown_connections 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65ca10 0x5641df65bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df69a9b0 0x5641df65b890 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4236185564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65b4b0 0x5641df69a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4236185564 >> 172.21.15.139:0/4236185564 conn(0x5641df622930 msgr2=0x5641df69f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4236185564 shutdown_connections 2024-04-26T17:59:27.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.096+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4236185564 wait complete. 2024-04-26T17:59:27.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.097+0000 7f3a2e25b740 1 -- start start 2024-04-26T17:59:27.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.097+0000 7f3a2e25b740 1 Processor -- start 2024-04-26T17:59:27.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df698900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6af130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df682870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5641df659af0 con 0x5641df65b4b0 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5641df5594f0 con 0x5641df65ca10 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5641df65d040 con 0x5641df69a9b0 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df698900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a2e25b740 10 client.0 _ll_register_callbacks cb 0x5641df5b6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df698900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52470/0 (socket says 172.21.15.139:52470) 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 -- 172.21.15.139:0/4073571802 learned_addr learned my addr 172.21.15.139:0/4073571802 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a28adb640 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a29add640 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df682870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 -- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 msgr2=0x5641df682870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df682870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 -- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 msgr2=0x5641df6af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 -- 172.21.15.139:0/4073571802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641df2d1920 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f3a292dc640 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df698900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000b2c0 tx=0x7f3a20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c78d2c38ec79784 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.098+0000 7f39fffff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f39fffff640 1 -- 172.21.15.139:0/4073571802 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20035040 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f39fffff640 1 -- 172.21.15.139:0/4073571802 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3a200318e0 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a140074c0 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f39fffff640 1 -- 172.21.15.139:0/4073571802 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3a2005c050 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 10 client.4860 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5641df39dd30 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f39fffff640 1 -- 172.21.15.139:0/4073571802 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a140074c0 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f39fffff640 1 -- 172.21.15.139:0/4073571802 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3a2005f020 con 0x5641df65b4b0 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 10 client.4860 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 10 client.4860 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:59:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 20 client.4860 populate_metadata read hostname 'smithi139' 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df686240 0x5641df682db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 4 client.4860 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641df593a00 con 0x5641df686240 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.099+0000 7f3a28adb640 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df686240 0x5641df682db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.100+0000 7f39fffff640 10 client.4860 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.100+0000 7f3a28adb640 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df686240 0x5641df682db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daddf0fc567c4f7b server_cookie=dc33462563bae9b3 in_seq=0 out_seq=0 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f39fffff640 1 -- 172.21.15.139:0/4073571802 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5641df593a00 con 0x5641df686240 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f39fffff640 10 client.4860 handle_command_reply: tid=0 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 client.4860 shutdown 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 msgr2=0x5641df698900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df698900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000b2c0 tx=0x7f3a20004730 comp rx=0 tx=0).stop 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 shutdown_connections 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df686240 0x5641df682db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df682870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f39fffff640 0 client.4860 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/4073571802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df698900 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 >> 172.21.15.139:0/4073571802 conn(0x5641df622930 msgr2=0x5641df684060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 shutdown_connections 2024-04-26T17:59:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 1 -- 172.21.15.139:0/4073571802 wait complete. 2024-04-26T17:59:27.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.101+0000 7f3a2e25b740 20 client.4860 trim_cache size 0 max 16384 2024-04-26T17:59:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.119+0000 7f3a2e25b740 1 Processor -- start 2024-04-26T17:59:27.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.119+0000 7f3a2e25b740 1 -- start start 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df659110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df6979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241fc050 con 0x5641df65b4b0 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241faf30 con 0x5641df65ca10 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a241ee000 con 0x5641df69a9b0 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df659110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df659110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52474/0 (socket says 172.21.15.139:52474) 2024-04-26T17:59:27.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 -- 172.21.15.139:0/1290062723 learned_addr learned my addr 172.21.15.139:0/1290062723 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a28adb640 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a29add640 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df6979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 -- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 msgr2=0x5641df6979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df6979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 -- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 msgr2=0x5641df6974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 -- 172.21.15.139:0/1290062723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641df6938c0 con 0x5641df65b4b0 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a28adb640 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.120+0000 7f3a292dc640 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df659110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000b7f0 tx=0x7f3a20047070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b6f2ec2f34aa99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.121+0000 7f3a067fc640 1 -- 172.21.15.139:0/1290062723 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20035070 con 0x5641df65b4b0 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.121+0000 7f3a067fc640 1 -- 172.21.15.139:0/1290062723 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a20054070 con 0x5641df65b4b0 2024-04-26T17:59:27.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.121+0000 7f3a067fc640 1 -- 172.21.15.139:0/1290062723 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a200318e0 con 0x5641df65b4b0 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1290062723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 msgr2=0x5641df659110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df659110 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000b7f0 tx=0x7f3a20047070 comp rx=0 tx=0).stop 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1290062723 shutdown_connections 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df69a9b0 0x5641df6979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df65ca10 0x5641df6974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1290062723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65b4b0 0x5641df659110 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1290062723 >> 172.21.15.139:0/1290062723 conn(0x5641df622930 msgr2=0x5641df656af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1290062723 shutdown_connections 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1290062723 wait complete. 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 -- start start 2024-04-26T17:59:27.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.122+0000 7f3a2e25b740 1 Processor -- start 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65b4b0 0x5641df656ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65ca10 0x5641df70f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a2e25b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df69a9b0 0x5641df70fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241f9cc0 con 0x5641df65ca10 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241fa860 con 0x5641df69a9b0 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a2e25b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a241fa190 con 0x5641df65b4b0 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a2e25b740 10 client.0 _ll_register_callbacks cb 0x7f3a2000b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.123+0000 7f3a28adb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65ca10 0x5641df70f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65ca10 0x5641df70f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52478/0 (socket says 172.21.15.139:52478) 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 -- 172.21.15.139:0/1998416013 learned_addr learned my addr 172.21.15.139:0/1998416013 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a292dc640 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65b4b0 0x5641df656ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a29add640 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df69a9b0 0x5641df70fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 -- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65b4b0 msgr2=0x5641df656ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65b4b0 0x5641df656ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 -- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df69a9b0 msgr2=0x5641df70fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df69a9b0 0x5641df70fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 -- 172.21.15.139:0/1998416013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641df655150 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a28adb640 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65ca10 0x5641df70f520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5641df69ba50 tx=0x7f3a14011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619a6d0f3c73dfb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f39fffff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f39fffff640 1 -- 172.21.15.139:0/1998416013 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14019040 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f39fffff640 1 -- 172.21.15.139:0/1998416013 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3a14001c20 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.124+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a20054070 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f39fffff640 1 -- 172.21.15.139:0/1998416013 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3a1402d200 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 10 client.4866 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5641df6abc00 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f39fffff640 1 -- 172.21.15.139:0/1998416013 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a20054070 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f39fffff640 1 -- 172.21.15.139:0/1998416013 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3a14035020 con 0x5641df65ca10 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 10 client.4866 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 10 client.4866 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:59:27.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 20 client.4866 populate_metadata read hostname 'smithi139' 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df683aa0 0x5641df6ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 4 client.4866 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6637f9f2", "release": true, "await": true}] 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6637f9f2", "release": true, "await": true}) -- 0x5641df5cdc50 con 0x5641df683aa0 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.125+0000 7f3a292dc640 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df683aa0 0x5641df6ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a292dc640 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df683aa0 0x5641df6ac8d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47bf85cdbf0cc54 server_cookie=595ef74d6e01872c in_seq=0 out_seq=0 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f39fffff640 10 client.4866 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f39fffff640 1 -- 172.21.15.139:0/1998416013 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x5641df5cdc50 con 0x5641df683aa0 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f39fffff640 10 client.4866 handle_command_reply: tid=0 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 client.4866 shutdown 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65ca10 msgr2=0x5641df70f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65ca10 0x5641df70f520 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x5641df69ba50 tx=0x7f3a14011000 comp rx=0 tx=0).stop 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 shutdown_connections 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5641df69a9b0 0x5641df70fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5641df65ca10 0x5641df70f520 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5641df683aa0 0x5641df6ac8d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 --2- 172.21.15.139:0/1998416013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5641df65b4b0 0x5641df656ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 >> 172.21.15.139:0/1998416013 conn(0x5641df622930 msgr2=0x5641df6558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f39fffff640 0 client.4866 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 shutdown_connections 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 1 -- 172.21.15.139:0/1998416013 wait complete. 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.126+0000 7f3a2e25b740 20 client.4866 trim_cache size 0 max 16384 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T17:59:27.131 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T17:59:27.132 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 4, 2024-04-26T17:59:27.132 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T17:59:27.132 INFO:teuthology.orchestra.run.smithi139.stdout: "6637f9f2": { 2024-04-26T17:59:27.132 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 4, 2024-04-26T17:59:27.132 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T17:59:27.132 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:59:27.133 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T17:59:27.133 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:59:27.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:59:27.133 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T17:59:27.133 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T17:59:27.133 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T17:59:27.134 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T17:59:27.134 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T17:59:27.134 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:59:27.134 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T17:59:27.134 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:59:27.134 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.135 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:59:27.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a08070d00 msgr2=0x7f3a080731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a08070d00 0x7f3a080731c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a20037000 tx=0x7f3a2003c040 comp rx=0 tx=0).stop 2024-04-26T17:59:27.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 msgr2=0x7f3a241df5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a241df5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c007e70 tx=0x7f3a1c00e4b0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 shutdown_connections 2024-04-26T17:59:27.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a08070d00 0x7f3a080731c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a24152bc0 0x7f3a241df5f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a240c4ec0 0x7f3a241df0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 --2- 172.21.15.139:0/308616932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a24072f20 0x7f3a241f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 >> 172.21.15.139:0/308616932 conn(0x7f3a2406ed70 msgr2=0x7f3a24073790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 shutdown_connections 2024-04-26T17:59:27.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.127+0000 7f3a2b540640 1 -- 172.21.15.139:0/308616932 wait complete. 2024-04-26T17:59:27.140 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6637f9f2', seconds elapsed: 31.0 2024-04-26T17:59:27.140 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T17:59:27.141 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:59:27.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.245+0000 7f1a836fc640 1 Processor -- start 2024-04-26T17:59:27.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a836fc640 1 -- start start 2024-04-26T17:59:27.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a836fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1a7c155da0 0x7f1a7c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a836fc640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7c15f2a0 con 0x7f1a7c0cd840 2024-04-26T17:59:27.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a836fc640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7c15f580 con 0x7f1a7c156180 2024-04-26T17:59:27.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a836fc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7c15cbc0 con 0x7f1a7c155da0 2024-04-26T17:59:27.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a81498640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1a7c155da0 0x7f1a7c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a81c99640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1a7c0cd840 0x7f1a7c0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49468/0 (socket says 172.21.15.139:49468) 2024-04-26T17:59:27.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.246+0000 7f1a81c99640 1 -- 172.21.15.139:0/1518788999 learned_addr learned my addr 172.21.15.139:0/1518788999 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:59:27.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.247+0000 7f1a81498640 1 -- 172.21.15.139:0/1518788999 >> v1:172.21.15.143:6789/0 conn(0x7f1a7c156180 legacy=0x7f1a7c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.247+0000 7f1a81498640 1 -- 172.21.15.139:0/1518788999 >> v1:172.21.15.139:6789/0 conn(0x7f1a7c0cd840 legacy=0x7f1a7c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.247+0000 7f1a81498640 1 -- 172.21.15.139:0/1518788999 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c15f860 con 0x7f1a7c155da0 2024-04-26T17:59:27.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.248+0000 7f1a81498640 1 --2- 172.21.15.139:0/1518788999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15c680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a780097a0 tx=0x7f1a7802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77805ad539cea92 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.248+0000 7f1a73fff640 1 -- 172.21.15.139:0/1518788999 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78037070 con 0x7f1a7c155da0 2024-04-26T17:59:27.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.248+0000 7f1a73fff640 1 -- 172.21.15.139:0/1518788999 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a78032440 con 0x7f1a7c155da0 2024-04-26T17:59:27.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.248+0000 7f1a73fff640 1 -- 172.21.15.139:0/1518788999 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78032810 con 0x7f1a7c155da0 2024-04-26T17:59:27.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.249+0000 7f1a836fc640 1 -- 172.21.15.139:0/1518788999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 msgr2=0x7f1a7c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.249+0000 7f1a836fc640 1 --2- 172.21.15.139:0/1518788999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15c680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1a780097a0 tx=0x7f1a7802a1a0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.249+0000 7f1a836fc640 1 -- 172.21.15.139:0/1518788999 shutdown_connections 2024-04-26T17:59:27.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.249+0000 7f1a836fc640 1 --2- 172.21.15.139:0/1518788999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15c680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.249+0000 7f1a836fc640 1 -- 172.21.15.139:0/1518788999 >> 172.21.15.139:0/1518788999 conn(0x7f1a7c068090 msgr2=0x7f1a7c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.249+0000 7f1a836fc640 1 -- 172.21.15.139:0/1518788999 shutdown_connections 2024-04-26T17:59:27.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.249+0000 7f1a836fc640 1 -- 172.21.15.139:0/1518788999 wait complete. 2024-04-26T17:59:27.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.250+0000 7f1a836fc640 1 Processor -- start 2024-04-26T17:59:27.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.250+0000 7f1a836fc640 1 -- start start 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a836fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a7c0cd840 0x7f1a7c1e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a836fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a836fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a7c0d14d0 0x7f1a7c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a836fc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c0d19d0 con 0x7f1a7c155da0 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a836fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c0cc730 con 0x7f1a7c0cd840 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a836fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7c0d1b50 con 0x7f1a7c0d14d0 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52500/0 (socket says 172.21.15.139:52500) 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 -- 172.21.15.139:0/2962698033 learned_addr learned my addr 172.21.15.139:0/2962698033 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a81498640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a7c0cd840 0x7f1a7c1e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a81c99640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a7c0d14d0 0x7f1a7c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 -- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a7c0d14d0 msgr2=0x7f1a7c14bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a7c0d14d0 0x7f1a7c14bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 -- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a7c0cd840 msgr2=0x7f1a7c1e62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a7c0cd840 0x7f1a7c1e62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 -- 172.21.15.139:0/2962698033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c1e5590 con 0x7f1a7c155da0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a81c99640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a7c0d14d0 0x7f1a7c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.251+0000 7f1a80c97640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15e230 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00c470 tx=0x7f1a6c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.252+0000 7f1a71ffb640 1 -- 172.21.15.139:0/2962698033 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0052d0 con 0x7f1a7c155da0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.252+0000 7f1a71ffb640 1 -- 172.21.15.139:0/2962698033 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6c005470 con 0x7f1a7c155da0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.252+0000 7f1a71ffb640 1 -- 172.21.15.139:0/2962698033 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c007260 con 0x7f1a7c155da0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.252+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7c1e5870 con 0x7f1a7c155da0 2024-04-26T17:59:27.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.252+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7c1f5240 con 0x7f1a7c155da0 2024-04-26T17:59:27.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.253+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7c155900 con 0x7f1a7c155da0 2024-04-26T17:59:27.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.253+0000 7f1a71ffb640 1 -- 172.21.15.139:0/2962698033 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a6c007400 con 0x7f1a7c155da0 2024-04-26T17:59:27.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.254+0000 7f1a71ffb640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a6006c8f0 0x7f1a6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.254+0000 7f1a71ffb640 1 -- 172.21.15.139:0/2962698033 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f1a6c08b410 con 0x7f1a7c155da0 2024-04-26T17:59:27.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.254+0000 7f1a81498640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a6006c8f0 0x7f1a6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.254+0000 7f1a81498640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a6006c8f0 0x7f1a6006edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a78034000 tx=0x7f1a7802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.259+0000 7f1a71ffb640 1 -- 172.21.15.139:0/2962698033 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a7c155900 con 0x7f1a7c155da0 2024-04-26T17:59:27.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.499+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a7c076d20 con 0x7f1a7c155da0 2024-04-26T17:59:27.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.500+0000 7f1a71ffb640 1 -- 172.21.15.139:0/2962698033 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f1a6c059440 con 0x7f1a7c155da0 2024-04-26T17:59:27.500 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:59:27.500 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:59:27.500 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:59:27.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a6006c8f0 msgr2=0x7f1a6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a6006c8f0 0x7f1a6006edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1a78034000 tx=0x7f1a7802e000 comp rx=0 tx=0).stop 2024-04-26T17:59:27.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 msgr2=0x7f1a7c15e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15e230 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00c470 tx=0x7f1a6c001e70 comp rx=0 tx=0).stop 2024-04-26T17:59:27.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 shutdown_connections 2024-04-26T17:59:27.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a6006c8f0 0x7f1a6006edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a7c0d14d0 0x7f1a7c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a7c155da0 0x7f1a7c15e230 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 --2- 172.21.15.139:0/2962698033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a7c0cd840 0x7f1a7c1e62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 >> 172.21.15.139:0/2962698033 conn(0x7f1a7c068090 msgr2=0x7f1a7c15c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 shutdown_connections 2024-04-26T17:59:27.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.502+0000 7f1a836fc640 1 -- 172.21.15.139:0/2962698033 wait complete. 2024-04-26T17:59:27.514 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T17:59:27.514 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T17:59:27.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.624+0000 7fb366997640 1 Processor -- start 2024-04-26T17:59:27.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.624+0000 7fb366997640 1 -- start start 2024-04-26T17:59:27.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb366997640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb360155e20 0x7fb36015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb366997640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c6900 0x7fb3600cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb366997640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb360156200 con 0x7fb3600c64b0 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb366997640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb3600cd550 con 0x7fb360155e20 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb366997640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb36015c330 con 0x7fb3600c6900 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb3600c64b0 0x7fb3600c77f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49472/0 (socket says 172.21.15.139:49472) 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35f7fe640 1 -- 172.21.15.139:0/1145458542 learned_addr learned my addr 172.21.15.139:0/1145458542 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb364f34640 1 --2- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c6900 0x7fb3600cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35ffff640 1 --2- 172.21.15.139:0/1145458542 >> v2:172.21.15.143:3300/0 conn(0x7fb360155e20 0x7fb36015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35effd640 1 -- 172.21.15.139:0/1145458542 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137473869 0 0) 0x7fb360156200 con 0x7fb3600c64b0 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35effd640 1 -- 172.21.15.139:0/1145458542 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb348003520 con 0x7fb3600c64b0 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35ffff640 1 -- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c6900 msgr2=0x7fb3600cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35ffff640 1 --2- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c6900 0x7fb3600cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35ffff640 1 -- 172.21.15.139:0/1145458542 >> v1:172.21.15.139:6789/0 conn(0x7fb3600c64b0 legacy=0x7fb3600c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb35ffff640 1 -- 172.21.15.139:0/1145458542 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36015c610 con 0x7fb360155e20 2024-04-26T17:59:27.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.625+0000 7fb364f34640 1 --2- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c6900 0x7fb3600cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:27.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.626+0000 7fb35ffff640 1 --2- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 0x7fb36015bb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3500097a0 tx=0x7fb35002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afece89e1586d951 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.626+0000 7fb35effd640 1 -- 172.21.15.139:0/1145458542 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350037070 con 0x7fb360155e20 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.626+0000 7fb35effd640 1 -- 172.21.15.139:0/1145458542 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb350032440 con 0x7fb360155e20 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.626+0000 7fb35effd640 1 -- 172.21.15.139:0/1145458542 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350032810 con 0x7fb360155e20 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 -- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 msgr2=0x7fb36015bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 --2- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 0x7fb36015bb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3500097a0 tx=0x7fb35002a180 comp rx=0 tx=0).stop 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 -- 172.21.15.139:0/1145458542 shutdown_connections 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 --2- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c6900 0x7fb3600cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 --2- 172.21.15.139:0/1145458542 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 0x7fb36015bb10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 -- 172.21.15.139:0/1145458542 >> 172.21.15.139:0/1145458542 conn(0x7fb360072930 msgr2=0x7fb360072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 -- 172.21.15.139:0/1145458542 shutdown_connections 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.627+0000 7fb366997640 1 -- 172.21.15.139:0/1145458542 wait complete. 2024-04-26T17:59:27.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.628+0000 7fb366997640 1 Processor -- start 2024-04-26T17:59:27.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.628+0000 7fb366997640 1 -- start start 2024-04-26T17:59:27.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb366997640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c64b0 0x7fb36014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb366997640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3600c6900 0x7fb360148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb366997640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 0x7fb360148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb366997640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3600c72d0 con 0x7fb3600c6900 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb366997640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb3600c6ff0 con 0x7fb360155e20 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb366997640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb36015c050 con 0x7fb3600c64b0 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3600c6900 0x7fb360148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3600c6900 0x7fb360148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52516/0 (socket says 172.21.15.139:52516) 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb35f7fe640 1 -- 172.21.15.139:0/2432905224 learned_addr learned my addr 172.21.15.139:0/2432905224 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c64b0 0x7fb36014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.629+0000 7fb364f34640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 0x7fb360148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35f7fe640 1 -- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c64b0 msgr2=0x7fb36014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c64b0 0x7fb36014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35f7fe640 1 -- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 msgr2=0x7fb360148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 0x7fb360148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35f7fe640 1 -- 172.21.15.139:0/2432905224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600d1bc0 con 0x7fb3600c6900 2024-04-26T17:59:27.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3600c6900 0x7fb360148350 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb3540010e0 tx=0x7fb35400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35cff9640 1 -- 172.21.15.139:0/2432905224 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354017070 con 0x7fb3600c6900 2024-04-26T17:59:27.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35cff9640 1 -- 172.21.15.139:0/2432905224 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb354005d00 con 0x7fb3600c6900 2024-04-26T17:59:27.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3600d1600 con 0x7fb3600c6900 2024-04-26T17:59:27.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb35cff9640 1 -- 172.21.15.139:0/2432905224 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354007310 con 0x7fb3600c6900 2024-04-26T17:59:27.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.630+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb360152e00 con 0x7fb3600c6900 2024-04-26T17:59:27.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.632+0000 7fb35cff9640 1 -- 172.21.15.139:0/2432905224 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb35401a070 con 0x7fb3600c6900 2024-04-26T17:59:27.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.632+0000 7fb35cff9640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb34c06c8f0 0x7fb34c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.632+0000 7fb35cff9640 1 -- 172.21.15.139:0/2432905224 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb35408b1a0 con 0x7fb3600c6900 2024-04-26T17:59:27.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.632+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb34c06c8f0 0x7fb34c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.633+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb34c06c8f0 0x7fb34c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb350034000 tx=0x7fb35002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.633+0000 7fb369784740 1 Processor -- start 2024-04-26T17:59:27.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.633+0000 7fb369784740 1 -- start start 2024-04-26T17:59:27.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd351dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb369784740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd351ddae0 0x55dd3519e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd3519ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb369784740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dd35101d80 con 0x55dd351ddae0 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55dd3509dc20 con 0x55dd3519fb40 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55dd350fdd40 con 0x55dd3519e5e0 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd351ddae0 0x55dd3519e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd351ddae0 0x55dd3519e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52524/0 (socket says 172.21.15.139:52524) 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 -- 172.21.15.139:0/3468878972 learned_addr learned my addr 172.21.15.139:0/3468878972 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb364f34640 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd3519ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35ffff640 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd351dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 -- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 msgr2=0x55dd351dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd351dd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 -- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 msgr2=0x55dd3519ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd3519ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 -- 172.21.15.139:0/3468878972 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd34edfd80 con 0x55dd351ddae0 2024-04-26T17:59:27.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb364f34640 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd3519ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:27.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd351ddae0 0x55dd3519e9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb354089270 tx=0x7fb354058c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc1771e2de48053 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb345ffb640 1 -- 172.21.15.139:0/3468878972 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354056c20 con 0x55dd351ddae0 2024-04-26T17:59:27.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb345ffb640 1 -- 172.21.15.139:0/3468878972 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb354056e80 con 0x55dd351ddae0 2024-04-26T17:59:27.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.635+0000 7fb345ffb640 1 -- 172.21.15.139:0/3468878972 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3540074b0 con 0x55dd351ddae0 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 -- 172.21.15.139:0/3468878972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd351ddae0 msgr2=0x55dd3519e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd351ddae0 0x55dd3519e9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb354089270 tx=0x7fb354058c40 comp rx=0 tx=0).stop 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 -- 172.21.15.139:0/3468878972 shutdown_connections 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd3519ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd351ddae0 0x55dd3519e9c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 --2- 172.21.15.139:0/3468878972 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd351dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 -- 172.21.15.139:0/3468878972 >> 172.21.15.139:0/3468878972 conn(0x55dd35165740 msgr2=0x55dd351e2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 -- 172.21.15.139:0/3468878972 shutdown_connections 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.636+0000 7fb369784740 1 -- 172.21.15.139:0/3468878972 wait complete. 2024-04-26T17:59:27.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.637+0000 7fb369784740 1 -- start start 2024-04-26T17:59:27.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.637+0000 7fb369784740 1 Processor -- start 2024-04-26T17:59:27.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.638+0000 7fb369784740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351d65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd351d47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd351ddae0 0x55dd351d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb369784740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dd3519cc20 con 0x55dd3519e5e0 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55dd3509b840 con 0x55dd3519fb40 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55dd351a0170 con 0x55dd351ddae0 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb369784740 10 client.0 _ll_register_callbacks cb 0x55dd3509f5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351d65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351d65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52532/0 (socket says 172.21.15.139:52532) 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 -- 172.21.15.139:0/2108779772 learned_addr learned my addr 172.21.15.139:0/2108779772 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd351d47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 -- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd351ddae0 msgr2=0x55dd351d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd351ddae0 0x55dd351d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 -- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 msgr2=0x55dd351d47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd351d47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 -- 172.21.15.139:0/2108779772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd34f40510 con 0x55dd3519e5e0 2024-04-26T17:59:27.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd351d47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351d65b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb3500098c0 tx=0x7fb35002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c2906bd8288276 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb33effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb33effd640 1 -- 172.21.15.139:0/2108779772 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350037040 con 0x55dd3519e5e0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb33effd640 1 -- 172.21.15.139:0/2108779772 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb35003c640 con 0x55dd3519e5e0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.639+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb354056e80 con 0x55dd3519e5e0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb33effd640 1 -- 172.21.15.139:0/2108779772 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb35003c840 con 0x55dd3519e5e0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 10 client.4887 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55dd34dd3670 con 0x55dd3519e5e0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb33effd640 1 -- 172.21.15.139:0/2108779772 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb354056e80 con 0x55dd3519e5e0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb33effd640 1 -- 172.21.15.139:0/2108779772 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb35003c9e0 con 0x55dd3519e5e0 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 10 client.4887 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 20 client.4887 populate_metadata read hostname 'smithi139' 2024-04-26T17:59:27.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd351d8880 0x55dd351f3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 4 client.4887 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd3510f990 con 0x55dd351d8880 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.640+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd351d8880 0x55dd351f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb33effd640 10 client.4887 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd351d8880 0x55dd351f3330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7c852cc027a48d server_cookie=ed05044d14aa6a84 in_seq=0 out_seq=0 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb33effd640 1 -- 172.21.15.139:0/2108779772 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dd3510f990 con 0x55dd351d8880 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb33effd640 10 client.4887 handle_command_reply: tid=0 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 client.4887 shutdown 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 msgr2=0x55dd351d65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351d65b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb3500098c0 tx=0x7fb35002c070 comp rx=0 tx=0).stop 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 shutdown_connections 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd351d8880 0x55dd351f3330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb33effd640 0 client.4887 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd351ddae0 0x55dd351d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd3519fb40 0x55dd351d47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 --2- 172.21.15.139:0/2108779772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351d65b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.641+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 >> 172.21.15.139:0/2108779772 conn(0x55dd35165740 msgr2=0x55dd3519f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.642+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 shutdown_connections 2024-04-26T17:59:27.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.642+0000 7fb369784740 1 -- 172.21.15.139:0/2108779772 wait complete. 2024-04-26T17:59:27.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.642+0000 7fb369784740 20 client.4887 trim_cache size 0 max 16384 2024-04-26T17:59:27.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.660+0000 7fb369784740 1 Processor -- start 2024-04-26T17:59:27.660 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.660+0000 7fb369784740 1 -- start start 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd35197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb369784740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519fb40 0x55dd351980e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd351c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb369784740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3602004b0 con 0x55dd3519fb40 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb3601ff390 con 0x55dd351ddae0 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb3601f5a50 con 0x55dd3519e5e0 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519fb40 0x55dd351980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519fb40 0x55dd351980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52546/0 (socket says 172.21.15.139:52546) 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 -- 172.21.15.139:0/1656121041 learned_addr learned my addr 172.21.15.139:0/1656121041 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb364f34640 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd351c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35ffff640 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd35197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 -- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 msgr2=0x55dd35197ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd35197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 -- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 msgr2=0x55dd351c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd351c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb35f7fe640 1 -- 172.21.15.139:0/1656121041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd351d7b80 con 0x55dd3519fb40 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.661+0000 7fb364f34640 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd351c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519fb40 0x55dd351980e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb35400ccd0 tx=0x7fb354014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0334ab6ae12c4c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb3457fa640 1 -- 172.21.15.139:0/1656121041 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354088070 con 0x55dd3519fb40 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb3457fa640 1 -- 172.21.15.139:0/1656121041 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb354056c20 con 0x55dd3519fb40 2024-04-26T17:59:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb3457fa640 1 -- 172.21.15.139:0/1656121041 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354071040 con 0x55dd3519fb40 2024-04-26T17:59:27.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb369784740 1 -- 172.21.15.139:0/1656121041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519fb40 msgr2=0x55dd351980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb369784740 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519fb40 0x55dd351980e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb35400ccd0 tx=0x7fb354014000 comp rx=0 tx=0).stop 2024-04-26T17:59:27.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb369784740 1 -- 172.21.15.139:0/1656121041 shutdown_connections 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb369784740 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd351c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.662+0000 7fb369784740 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519fb40 0x55dd351980e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.663+0000 7fb369784740 1 --2- 172.21.15.139:0/1656121041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519e5e0 0x55dd35197ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.663+0000 7fb369784740 1 -- 172.21.15.139:0/1656121041 >> 172.21.15.139:0/1656121041 conn(0x55dd35165740 msgr2=0x55dd3519bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.663+0000 7fb369784740 1 -- 172.21.15.139:0/1656121041 shutdown_connections 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.663+0000 7fb369784740 1 -- 172.21.15.139:0/1656121041 wait complete. 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.663+0000 7fb369784740 1 -- start start 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.663+0000 7fb369784740 1 Processor -- start 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb369784740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519fb40 0x55dd3519f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb369784740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd3525cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb369784740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3601fdf20 con 0x55dd3519e5e0 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb3601fecc0 con 0x55dd351ddae0 2024-04-26T17:59:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb369784740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb3601fe5f0 con 0x55dd3519fb40 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb369784740 10 client.0 _ll_register_callbacks cb 0x7fb3480036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb35ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52548/0 (socket says 172.21.15.139:52548) 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb35ffff640 1 -- 172.21.15.139:0/2371606165 learned_addr learned my addr 172.21.15.139:0/2371606165 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519fb40 0x55dd3519f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.664+0000 7fb364f34640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd3525cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb35f7fe640 1 -- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 msgr2=0x55dd3525cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd3525cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb35f7fe640 1 -- 172.21.15.139:0/2371606165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 msgr2=0x55dd351e95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351e95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb35f7fe640 1 -- 172.21.15.139:0/2371606165 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55dd351c85d0 con 0x55dd3519fb40 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351e95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb35f7fe640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519fb40 0x55dd3519f360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb354089320 tx=0x7fb354000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab6902aa48e17ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb33effd640 10 client.0 ms_handle_connect on v2:172.21.15.143:3301/0 2024-04-26T17:59:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb33effd640 1 -- 172.21.15.139:0/2371606165 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354088070 con 0x55dd3519fb40 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb33effd640 1 -- 172.21.15.139:0/2371606165 <== mon.2 v2:172.21.15.143:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb3540074b0 con 0x55dd3519fb40 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb354056c20 con 0x55dd3519fb40 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb33effd640 1 -- 172.21.15.139:0/2371606165 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb354071040 con 0x55dd3519fb40 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb369784740 10 client.4574 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55dd35199f60 con 0x55dd3519fb40 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb33effd640 1 -- 172.21.15.139:0/2371606165 <== mon.2 v2:172.21.15.143:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb354056c20 con 0x55dd3519fb40 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb33effd640 1 -- 172.21.15.139:0/2371606165 <== mon.2 v2:172.21.15.143:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb354057fd0 con 0x55dd3519fb40 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb369784740 10 client.4574 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb369784740 10 client.4574 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb369784740 20 client.4574 populate_metadata read hostname 'smithi139' 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.665+0000 7fb369784740 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd3525d4a0 0x55dd3525d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.666+0000 7fb369784740 4 client.4574 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.666+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55dd35109800 con 0x55dd3525d4a0 2024-04-26T17:59:27.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.666+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd3525d4a0 0x55dd3525d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:27.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.666+0000 7fb33effd640 10 client.4574 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.666+0000 7fb35ffff640 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd3525d4a0 0x55dd3525d8b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f89e18cf44692ba3 server_cookie=c23978640d3b509f in_seq=0 out_seq=0 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.667+0000 7fb33effd640 1 -- 172.21.15.139:0/2371606165 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55dd35109800 con 0x55dd3525d4a0 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.667+0000 7fb33effd640 10 client.4574 handle_command_reply: tid=0 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.667+0000 7fb369784740 1 client.4574 shutdown 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519fb40 msgr2=0x55dd3519f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519fb40 0x55dd3519f360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb354089320 tx=0x7fb354000bc0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 shutdown_connections 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55dd351ddae0 0x55dd3525cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55dd3525d4a0 0x55dd3525d8b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55dd3519fb40 0x55dd3519f360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 --2- 172.21.15.139:0/2371606165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dd3519e5e0 0x55dd351e95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 >> 172.21.15.139:0/2371606165 conn(0x55dd35165740 msgr2=0x55dd3519bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb33effd640 0 client.4574 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 shutdown_connections 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 1 -- 172.21.15.139:0/2371606165 wait complete. 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb369784740 20 client.4574 trim_cache size 0 max 16384 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 6, 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T17:59:27.672 INFO:teuthology.orchestra.run.smithi139.stdout: "cf6ff086": { 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 6, 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:59:27.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.674 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.674 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.674 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.674 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:27.674 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.668+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb34c06c8f0 msgr2=0x7fb34c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb34c06c8f0 0x7fb34c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb350034000 tx=0x7fb35002e000 comp rx=0 tx=0).stop 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3600c6900 msgr2=0x7fb360148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3600c6900 0x7fb360148350 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb3540010e0 tx=0x7fb35400c7d0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 shutdown_connections 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb34c06c8f0 0x7fb34c06edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb360155e20 0x7fb360148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3600c6900 0x7fb360148350 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 --2- 172.21.15.139:0/2432905224 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb3600c64b0 0x7fb36014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 >> 172.21.15.139:0/2432905224 conn(0x7fb360072930 msgr2=0x7fb3601512a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 shutdown_connections 2024-04-26T17:59:27.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:27.669+0000 7fb366997640 1 -- 172.21.15.139:0/2432905224 wait complete. 2024-04-26T17:59:27.681 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cf6ff086', quiesce took 0.5 seconds. Will release after: 30.0 2024-04-26T17:59:35.261 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:59:35.264 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:59:57.682 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:59:57.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.783+0000 7fdab4245640 1 Processor -- start 2024-04-26T17:59:57.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.784+0000 7fdab4245640 1 -- start start 2024-04-26T17:59:57.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab4245640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdaac156180 0x7fdaac15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab4245640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaac15f2a0 con 0x7fdaac155da0 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab4245640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaac15f580 con 0x7fdaac0cd840 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab4245640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fdaac15cbc0 con 0x7fdaac156180 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab17e0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdaac156180 0x7fdaac15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab1fe1640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fdaac155da0 0x7fdaac0d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:38412/0 (socket says 172.21.15.139:38412) 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab1fe1640 1 -- 172.21.15.139:0/3520904278 learned_addr learned my addr 172.21.15.139:0/3520904278 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab17e0640 1 -- 172.21.15.139:0/3520904278 >> v1:172.21.15.143:6789/0 conn(0x7fdaac0cd840 legacy=0x7fdaac0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab17e0640 1 -- 172.21.15.139:0/3520904278 >> v1:172.21.15.139:6789/0 conn(0x7fdaac155da0 legacy=0x7fdaac0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.786+0000 7fdab17e0640 1 -- 172.21.15.139:0/3520904278 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac15f860 con 0x7fdaac156180 2024-04-26T17:59:57.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.785+0000 7fdab0fdf640 1 -- 172.21.15.139:0/3520904278 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825457265 0 0) 0x7fdaac15f2a0 con 0x7fdaac155da0 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.786+0000 7fdab17e0640 1 --2- 172.21.15.139:0/3520904278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac156180 0x7fdaac15c680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0097a0 tx=0x7fda9c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cc995b9d9f2628 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.786+0000 7fdab0fdf640 1 -- 172.21.15.139:0/3520904278 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c037070 con 0x7fdaac156180 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.786+0000 7fdab0fdf640 1 -- 172.21.15.139:0/3520904278 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c02ae50 con 0x7fdaac156180 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.786+0000 7fdab0fdf640 1 -- 172.21.15.139:0/3520904278 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c032660 con 0x7fdaac156180 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.787+0000 7fdab4245640 1 -- 172.21.15.139:0/3520904278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac156180 msgr2=0x7fdaac15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.787+0000 7fdab4245640 1 --2- 172.21.15.139:0/3520904278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac156180 0x7fdaac15c680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0097a0 tx=0x7fda9c02a140 comp rx=0 tx=0).stop 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.787+0000 7fdab4245640 1 -- 172.21.15.139:0/3520904278 shutdown_connections 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.787+0000 7fdab4245640 1 --2- 172.21.15.139:0/3520904278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac156180 0x7fdaac15c680 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.787+0000 7fdab4245640 1 -- 172.21.15.139:0/3520904278 >> 172.21.15.139:0/3520904278 conn(0x7fdaac068090 msgr2=0x7fdaac0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.787+0000 7fdab4245640 1 -- 172.21.15.139:0/3520904278 shutdown_connections 2024-04-26T17:59:57.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.787+0000 7fdab4245640 1 -- 172.21.15.139:0/3520904278 wait complete. 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 Processor -- start 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 -- start start 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac0cd840 0x7fdaac0d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaac155da0 0x7fdaac154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaac15cd60 0x7fdaac1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac0d19d0 con 0x7fdaac0cd840 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac0cc730 con 0x7fdaac15cd60 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.789+0000 7fdab4245640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdaac0d1b50 con 0x7fdaac155da0 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac0cd840 0x7fdaac0d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac0cd840 0x7fdaac0d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46616/0 (socket says 172.21.15.139:46616) 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 -- 172.21.15.139:0/2376885555 learned_addr learned my addr 172.21.15.139:0/2376885555 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:57.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab17e0640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaac155da0 0x7fdaac154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab27e2640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaac15cd60 0x7fdaac1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 -- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaac155da0 msgr2=0x7fdaac154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaac155da0 0x7fdaac154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 -- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaac15cd60 msgr2=0x7fdaac1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaac15cd60 0x7fdaac1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 -- 172.21.15.139:0/2376885555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac0d0a20 con 0x7fdaac0cd840 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab1fe1640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac0cd840 0x7fdaac0d04e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c500 tx=0x7fdaa800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdaa27fc640 1 -- 172.21.15.139:0/2376885555 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8018070 con 0x7fdaac0cd840 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdaa27fc640 1 -- 172.21.15.139:0/2376885555 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa8007560 con 0x7fdaac0cd840 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.790+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaac0cf440 con 0x7fdaac0cd840 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.791+0000 7fdaa27fc640 1 -- 172.21.15.139:0/2376885555 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8004a20 con 0x7fdaac0cd840 2024-04-26T17:59:57.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.791+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaac0cfa00 con 0x7fdaac0cd840 2024-04-26T17:59:57.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.792+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaac076d20 con 0x7fdaac0cd840 2024-04-26T17:59:57.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.792+0000 7fdaa27fc640 1 -- 172.21.15.139:0/2376885555 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdaa801b070 con 0x7fdaac0cd840 2024-04-26T17:59:57.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.793+0000 7fdaa27fc640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fda9006c970 0x7fda9006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:57.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.793+0000 7fdaa27fc640 1 -- 172.21.15.139:0/2376885555 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fdaa808b1e0 con 0x7fdaac0cd840 2024-04-26T17:59:57.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.793+0000 7fdab17e0640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fda9006c970 0x7fda9006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:57.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.794+0000 7fdab17e0640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fda9006c970 0x7fda9006ee30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda9c034000 tx=0x7fda9c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:57.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:57.801+0000 7fdaa27fc640 1 -- 172.21.15.139:0/2376885555 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdaa804fb80 con 0x7fdaac0cd840 2024-04-26T17:59:58.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.111+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdaac0ccd30 con 0x7fdaac0cd840 2024-04-26T17:59:58.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.112+0000 7fdaa27fc640 1 -- 172.21.15.139:0/2376885555 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fdaa8058ca0 con 0x7fdaac0cd840 2024-04-26T17:59:58.112 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T17:59:58.112 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T17:59:58.112 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fda9006c970 msgr2=0x7fda9006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fda9006c970 0x7fda9006ee30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda9c034000 tx=0x7fda9c02e000 comp rx=0 tx=0).stop 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac0cd840 msgr2=0x7fdaac0d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac0cd840 0x7fdaac0d04e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800c500 tx=0x7fdaa800c9c0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 shutdown_connections 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fda9006c970 0x7fda9006ee30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdaac15cd60 0x7fdaac1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdaac155da0 0x7fdaac154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 --2- 172.21.15.139:0/2376885555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaac0cd840 0x7fdaac0d04e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 >> 172.21.15.139:0/2376885555 conn(0x7fdaac068090 msgr2=0x7fdaac15c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:58.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 shutdown_connections 2024-04-26T17:59:58.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.115+0000 7fdab4245640 1 -- 172.21.15.139:0/2376885555 wait complete. 2024-04-26T17:59:58.129 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id cf6ff086 --release --await' 2024-04-26T17:59:58.129 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id cf6ff086 --release --await 2024-04-26T17:59:58.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.233+0000 7fb71da3f640 1 Processor -- start 2024-04-26T17:59:58.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.233+0000 7fb71da3f640 1 -- start start 2024-04-26T17:59:58.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb71da3f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7181527f0 0x7fb71815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb71da3f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb71815fdf0 0x7fb7180d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb71da3f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb7180d1860 0x7fb7180cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb71da3f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb7180c6780 con 0x7fb7180d1860 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb71da3f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb71815cbc0 con 0x7fb71815fdf0 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb71da3f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb71815c040 con 0x7fb7181527f0 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb7180d1860 0x7fb7180cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb7180d1860 0x7fb7180cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46622/0 (socket says 172.21.15.139:46622) 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 -- 172.21.15.139:0/1548866191 learned_addr learned my addr 172.21.15.139:0/1548866191 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb70ffff640 1 --2- 172.21.15.139:0/1548866191 >> v2:172.21.15.143:3300/0 conn(0x7fb71815fdf0 0x7fb7180d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb716ffd640 1 --2- 172.21.15.139:0/1548866191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7181527f0 0x7fb71815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 -- 172.21.15.139:0/1548866191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7181527f0 msgr2=0x7fb71815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 --2- 172.21.15.139:0/1548866191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7181527f0 0x7fb71815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 -- 172.21.15.139:0/1548866191 >> v2:172.21.15.143:3300/0 conn(0x7fb71815fdf0 msgr2=0x7fb7180d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 --2- 172.21.15.139:0/1548866191 >> v2:172.21.15.143:3300/0 conn(0x7fb71815fdf0 0x7fb7180d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.234+0000 7fb7177fe640 1 -- 172.21.15.139:0/1548866191 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71815c320 con 0x7fb7180d1860 2024-04-26T17:59:58.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.235+0000 7fb7177fe640 1 --2- 172.21.15.139:0/1548866191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7180d1860 0x7fb7180cc0e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb718074af0 tx=0x7fb71002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24b952ff7341813 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:58.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.235+0000 7fb7167fc640 1 -- 172.21.15.139:0/1548866191 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710036070 con 0x7fb7180d1860 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb7167fc640 1 -- 172.21.15.139:0/1548866191 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb710031600 con 0x7fb7180d1860 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb7167fc640 1 -- 172.21.15.139:0/1548866191 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7100319d0 con 0x7fb7180d1860 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 -- 172.21.15.139:0/1548866191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7180d1860 msgr2=0x7fb7180cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1548866191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7180d1860 0x7fb7180cc0e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb718074af0 tx=0x7fb71002a6a0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 -- 172.21.15.139:0/1548866191 shutdown_connections 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1548866191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7180d1860 0x7fb7180cc0e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1548866191 >> v2:172.21.15.143:3300/0 conn(0x7fb71815fdf0 0x7fb7180d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1548866191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb7181527f0 0x7fb71815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 -- 172.21.15.139:0/1548866191 >> 172.21.15.139:0/1548866191 conn(0x7fb718076100 msgr2=0x7fb718073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 -- 172.21.15.139:0/1548866191 shutdown_connections 2024-04-26T17:59:58.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.236+0000 7fb71da3f640 1 -- 172.21.15.139:0/1548866191 wait complete. 2024-04-26T17:59:58.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.237+0000 7fb71da3f640 1 Processor -- start 2024-04-26T17:59:58.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.237+0000 7fb71da3f640 1 -- start start 2024-04-26T17:59:58.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb71da3f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7180d1860 0x7fb7180d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb71da3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7181527f0 0x7fb7181f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb71da3f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb71815fdf0 0x7fb7181f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb71da3f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb7180cdb00 con 0x7fb7181527f0 2024-04-26T17:59:58.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb71da3f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb71815c8e0 con 0x7fb7180d1860 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb71da3f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb71815bc70 con 0x7fb71815fdf0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7181527f0 0x7fb7181f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7181527f0 0x7fb7181f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46626/0 (socket says 172.21.15.139:46626) 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb70ffff640 1 -- 172.21.15.139:0/1046041389 learned_addr learned my addr 172.21.15.139:0/1046041389 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.238+0000 7fb716ffd640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7180d1860 0x7fb7180d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb7177fe640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb71815fdf0 0x7fb7181f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb70ffff640 1 -- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb71815fdf0 msgr2=0x7fb7181f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb70ffff640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb71815fdf0 0x7fb7181f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb70ffff640 1 -- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7180d1860 msgr2=0x7fb7180d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb70ffff640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7180d1860 0x7fb7180d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb70ffff640 1 -- 172.21.15.139:0/1046041389 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7180cfbc0 con 0x7fb7181527f0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb70ffff640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7181527f0 0x7fb7181f2850 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb70000e870 tx=0x7fb70000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb714ff9640 1 -- 172.21.15.139:0/1046041389 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700017070 con 0x7fb7181527f0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb714ff9640 1 -- 172.21.15.139:0/1046041389 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70000c8e0 con 0x7fb7181527f0 2024-04-26T17:59:58.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb714ff9640 1 -- 172.21.15.139:0/1046041389 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70000cc90 con 0x7fb7181527f0 2024-04-26T17:59:58.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7180cfe60 con 0x7fb7181527f0 2024-04-26T17:59:58.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.239+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7180d0420 con 0x7fb7181527f0 2024-04-26T17:59:58.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.241+0000 7fb714ff9640 1 -- 172.21.15.139:0/1046041389 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb70001a070 con 0x7fb7181527f0 2024-04-26T17:59:58.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.242+0000 7fb714ff9640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb6f806c920 0x7fb6f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.242+0000 7fb716ffd640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb6f806c920 0x7fb6f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.242+0000 7fb714ff9640 1 -- 172.21.15.139:0/1046041389 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb70008c1e0 con 0x7fb7181527f0 2024-04-26T17:59:58.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.242+0000 7fb716ffd640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb6f806c920 0x7fb6f806ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb708009a50 tx=0x7fb708008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:58.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.243+0000 7fb720830740 1 Processor -- start 2024-04-26T17:59:58.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.243+0000 7fb720830740 1 -- start start 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.243+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e6c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.243+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e6c9b0 0x557a61e2d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb720830740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e2ea10 0x557a61e2ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb720830740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557a61d92040 con 0x557a61e2ea10 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e6c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e6c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:55222/0 (socket says 172.21.15.139:55222) 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 -- 172.21.15.139:0/16764730 learned_addr learned my addr 172.21.15.139:0/16764730 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb70ffff640 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e6c9b0 0x557a61e2d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb7177fe640 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e2ea10 0x557a61e2ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb720830740 1 -- 172.21.15.139:0/16764730 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x557a61d2db60 con 0x557a61e2d4b0 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb720830740 1 -- 172.21.15.139:0/16764730 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x557a61d8e000 con 0x557a61e6c9b0 2024-04-26T17:59:58.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 -- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e6c9b0 msgr2=0x557a61e2d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e6c9b0 0x557a61e2d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 -- 172.21.15.139:0/16764730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e2ea10 msgr2=0x557a61e2ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e2ea10 0x557a61e2ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb716ffd640 1 -- 172.21.15.139:0/16764730 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a61d229c0 con 0x557a61e2d4b0 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.244+0000 7fb7177fe640 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e2ea10 0x557a61e2ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.245+0000 7fb716ffd640 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e6c470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb708011d20 tx=0x7fb708014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff2d9348158e8458 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.245+0000 7fb70d7fa640 1 -- 172.21.15.139:0/16764730 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb708011d50 con 0x557a61e2d4b0 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.245+0000 7fb70d7fa640 1 -- 172.21.15.139:0/16764730 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb708026070 con 0x557a61e2d4b0 2024-04-26T17:59:58.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.245+0000 7fb70d7fa640 1 -- 172.21.15.139:0/16764730 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb708021640 con 0x557a61e2d4b0 2024-04-26T17:59:58.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 -- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 msgr2=0x557a61e6c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e6c470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb708011d20 tx=0x7fb708014000 comp rx=0 tx=0).stop 2024-04-26T17:59:58.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 -- 172.21.15.139:0/16764730 shutdown_connections 2024-04-26T17:59:58.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e2ea10 0x557a61e2ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e6c9b0 0x557a61e2d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 --2- 172.21.15.139:0/16764730 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e6c470 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 -- 172.21.15.139:0/16764730 >> 172.21.15.139:0/16764730 conn(0x557a61df4930 msgr2=0x557a61e71450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 -- 172.21.15.139:0/16764730 shutdown_connections 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.246+0000 7fb720830740 1 -- 172.21.15.139:0/16764730 wait complete. 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.247+0000 7fb720830740 1 -- start start 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.247+0000 7fb720830740 1 Processor -- start 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e56c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61e6b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb720830740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e812c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e812c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e812c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46642/0 (socket says 172.21.15.139:46642) 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 -- 172.21.15.139:0/762987378 learned_addr learned my addr 172.21.15.139:0/762987378 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb720830740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557a61e2baf0 con 0x557a61e6c9b0 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x557a61d2b4f0 con 0x557a61e2ea10 2024-04-26T17:59:58.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x557a61e2f040 con 0x557a61e2d4b0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb716ffd640 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e56c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb70ffff640 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61e6b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb720830740 10 client.0 _ll_register_callbacks cb 0x557a61d88c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 -- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 msgr2=0x557a61e56c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e56c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 -- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 msgr2=0x557a61e6b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61e6b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.248+0000 7fb7177fe640 1 -- 172.21.15.139:0/762987378 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a61aa3920 con 0x557a61e6c9b0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.249+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb708026070 con 0x557a61e6c9b0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.249+0000 7fb7177fe640 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e812c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb71002ac90 tx=0x7fb710004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ac1e41b73f9eaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.249+0000 7fb6f67fc640 10 client.4914 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.249+0000 7fb6f67fc640 1 -- 172.21.15.139:0/762987378 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710043070 con 0x557a61e6c9b0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.249+0000 7fb6f67fc640 1 -- 172.21.15.139:0/762987378 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb71003d870 con 0x557a61e6c9b0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.249+0000 7fb6f67fc640 1 -- 172.21.15.139:0/762987378 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb710036040 con 0x557a61e6c9b0 2024-04-26T17:59:58.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 10 client.4914 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:58.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({fsmap=9}) -- 0x557a61b6fd30 con 0x557a61e6c9b0 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb6f67fc640 1 -- 172.21.15.139:0/762987378 <== mon.0 v2:172.21.15.139:3300/0 4 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb71004f060 con 0x557a61e6c9b0 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 10 client.4914 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 10 client.4914 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 20 client.4914 populate_metadata read hostname 'smithi139' 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e7d9d0 0x557a61e7ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 4 client.4914 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a61d65a00 con 0x557a61e7d9d0 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.250+0000 7fb716ffd640 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e7d9d0 0x557a61e7ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb6f67fc640 10 client.4914 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb716ffd640 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e7d9d0 0x557a61e7ddb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2c9f50a670532b server_cookie=ef05b36e827b30c1 in_seq=0 out_seq=0 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb6f67fc640 1 -- 172.21.15.139:0/762987378 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557a61d65a00 con 0x557a61e7d9d0 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb6f67fc640 10 client.4914 handle_command_reply: tid=0 2024-04-26T17:59:58.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb720830740 1 client.4914 shutdown 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 msgr2=0x557a61e812c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb720830740 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e812c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb71002ac90 tx=0x7fb710004ab0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.251+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 shutdown_connections 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e812c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61e6b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e7d9d0 0x557a61e7ddb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 1 --2- 172.21.15.139:0/762987378 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e56c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb6f67fc640 0 client.4914 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 >> 172.21.15.139:0/762987378 conn(0x557a61df4930 msgr2=0x557a61e718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 shutdown_connections 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 1 -- 172.21.15.139:0/762987378 wait complete. 2024-04-26T17:59:58.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.252+0000 7fb720830740 20 client.4914 trim_cache size 0 max 16384 2024-04-26T17:59:58.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.283+0000 7fb720830740 1 Processor -- start 2024-04-26T17:59:58.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.283+0000 7fb720830740 1 -- start start 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e2b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2ea10 0x557a61e6fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb720830740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e70000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb720830740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb718200390 con 0x557a61e6c9b0 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb720830740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb7181ff270 con 0x557a61e2d4b0 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb720830740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb7181fd7b0 con 0x557a61e2ea10 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e70000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e70000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46646/0 (socket says 172.21.15.139:46646) 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 -- 172.21.15.139:0/12797063 learned_addr learned my addr 172.21.15.139:0/12797063 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb70ffff640 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2ea10 0x557a61e6fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb716ffd640 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 -- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2ea10 msgr2=0x557a61e6fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2ea10 0x557a61e6fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 -- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 msgr2=0x557a61e2b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e2b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 -- 172.21.15.139:0/12797063 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a61e2ac70 con 0x557a61e6c9b0 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb70ffff640 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2ea10 0x557a61e6fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb716ffd640 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e2b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.285+0000 7fb7177fe640 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e70000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb71003d930 tx=0x7fb71003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972eec9e36a7e7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.286+0000 7fb70cff9640 1 -- 172.21.15.139:0/12797063 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710043070 con 0x557a61e6c9b0 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.286+0000 7fb70cff9640 1 -- 172.21.15.139:0/12797063 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb708026070 con 0x557a61e6c9b0 2024-04-26T17:59:58.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.286+0000 7fb70cff9640 1 -- 172.21.15.139:0/12797063 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710004030 con 0x557a61e6c9b0 2024-04-26T17:59:58.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 -- 172.21.15.139:0/12797063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 msgr2=0x557a61e70000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e70000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb71003d930 tx=0x7fb71003d000 comp rx=0 tx=0).stop 2024-04-26T17:59:58.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 -- 172.21.15.139:0/12797063 shutdown_connections 2024-04-26T17:59:58.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61e70000 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2ea10 0x557a61e6fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 --2- 172.21.15.139:0/12797063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2d4b0 0x557a61e2b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 -- 172.21.15.139:0/12797063 >> 172.21.15.139:0/12797063 conn(0x557a61df4930 msgr2=0x557a61e6a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:58.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 -- 172.21.15.139:0/12797063 shutdown_connections 2024-04-26T17:59:58.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.287+0000 7fb720830740 1 -- 172.21.15.139:0/12797063 wait complete. 2024-04-26T17:59:58.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.288+0000 7fb720830740 1 -- start start 2024-04-26T17:59:58.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.288+0000 7fb720830740 1 Processor -- start 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e62b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb720830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61ee0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb720830740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61ee0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb720830740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb7181fde00 con 0x557a61e6c9b0 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb720830740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb7181feba0 con 0x557a61e2ea10 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb720830740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb7181fe4d0 con 0x557a61e2d4b0 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb720830740 10 client.0 _ll_register_callbacks cb 0x7fb700006f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61ee0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61ee0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46654/0 (socket says 172.21.15.139:46654) 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 -- 172.21.15.139:0/859110490 learned_addr learned my addr 172.21.15.139:0/859110490 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb716ffd640 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e62b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb70ffff640 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61ee0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 -- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 msgr2=0x557a61e62b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e62b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 -- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 msgr2=0x557a61ee0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61ee0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.289+0000 7fb7177fe640 1 -- 172.21.15.139:0/859110490 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a61e29160 con 0x557a61e6c9b0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb7177fe640 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61ee0e60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb710049040 tx=0x7fb710009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266c877924b2beb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb6f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb6f67fc640 1 -- 172.21.15.139:0/859110490 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71005b070 con 0x557a61e6c9b0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb708026070 con 0x557a61e6c9b0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb6f67fc640 1 -- 172.21.15.139:0/859110490 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fb710031b20 con 0x557a61e6c9b0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb6f67fc640 1 -- 172.21.15.139:0/859110490 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb710066050 con 0x557a61e6c9b0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 10 client.4920 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557a61e63070 con 0x557a61e6c9b0 2024-04-26T17:59:58.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb6f67fc640 1 -- 172.21.15.139:0/859110490 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb710031d20 con 0x557a61e6c9b0 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb6f67fc640 1 -- 172.21.15.139:0/859110490 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb710069020 con 0x557a61e6c9b0 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 10 client.4920 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 10 client.4920 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 20 client.4920 populate_metadata read hostname 'smithi139' 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e23720 0x557a61e55050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 4 client.4920 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cf6ff086", "release": true, "await": true}] 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.290+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cf6ff086", "release": true, "await": true}) -- 0x7fb708026070 con 0x557a61e23720 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.291+0000 7fb716ffd640 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e23720 0x557a61e55050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.291+0000 7fb6f67fc640 10 client.4920 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.291+0000 7fb716ffd640 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e23720 0x557a61e55050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ebf236fb264fcc1 server_cookie=ecee50d07041d2f0 in_seq=0 out_seq=0 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.291+0000 7fb6f67fc640 1 -- 172.21.15.139:0/859110490 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x7fb708026070 con 0x557a61e23720 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.291+0000 7fb6f67fc640 10 client.4920 handle_command_reply: tid=0 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.291+0000 7fb720830740 1 client.4920 shutdown 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 msgr2=0x557a61ee0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61ee0e60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb710049040 tx=0x7fb710009810 comp rx=0 tx=0).stop 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 shutdown_connections 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a61e6c9b0 0x557a61ee0e60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557a61e2ea10 0x557a61ee0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557a61e23720 0x557a61e55050 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 --2- 172.21.15.139:0/859110490 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557a61e2d4b0 0x557a61e62b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 >> 172.21.15.139:0/859110490 conn(0x557a61df4930 msgr2=0x557a61e26e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb6f67fc640 0 client.4920 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 shutdown_connections 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 1 -- 172.21.15.139:0/859110490 wait complete. 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb720830740 20 client.4920 trim_cache size 0 max 16384 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T17:59:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 8, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "cf6ff086": { 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 8, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T17:59:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T17:59:58.298 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb6f806c920 msgr2=0x7fb6f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb6f806c920 0x7fb6f806ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb708009a50 tx=0x7fb708008040 comp rx=0 tx=0).stop 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7181527f0 msgr2=0x7fb7181f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.292+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7181527f0 0x7fb7181f2850 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb70000e870 tx=0x7fb70000ed30 comp rx=0 tx=0).stop 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 shutdown_connections 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb6f806c920 0x7fb6f806ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb71815fdf0 0x7fb7181f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7181527f0 0x7fb7181f2850 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 --2- 172.21.15.139:0/1046041389 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb7180d1860 0x7fb7180d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 >> 172.21.15.139:0/1046041389 conn(0x7fb718076100 msgr2=0x7fb7180cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:58.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 shutdown_connections 2024-04-26T17:59:58.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T17:59:58.293+0000 7fb71da3f640 1 -- 172.21.15.139:0/1046041389 wait complete. 2024-04-26T17:59:58.306 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cf6ff086', seconds elapsed: 31.2 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr:Note: switching to 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'. 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr: 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr: 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T18:00:02.258 INFO:tasks.workunit.client.0.smithi139.stderr: 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr: git switch -c 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr: 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr:Or undo this operation with: 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr: 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr: git switch - 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr: 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr: 2024-04-26T18:00:02.259 INFO:tasks.workunit.client.0.smithi139.stderr:HEAD is now at bc94a2a924f Merge commit 'refs/pull/57099/head' of github.com:ceph/ceph into quiescer 2024-04-26T18:00:02.264 DEBUG:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T18:00:02.321 INFO:tasks.workunit.client.0.smithi139.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T18:00:02.323 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T18:00:02.323 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T18:00:02.831 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T18:00:02.886 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T18:00:02.925 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T18:00:02.926 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T18:00:02.926 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T18:00:02.965 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T18:00:02.968 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T18:00:02.968 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T18:00:02.983 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2024-04-26T18:00:02.985 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2024-04-26T18:00:02.985 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-04-26T18:00:03.044 INFO:tasks.workunit.client.0.smithi139.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-04-26T18:00:05.378 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:05.381 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:05.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir foo 2024-04-26T18:00:05.587 INFO:tasks.workunit.client.0.smithi139.stderr:+ cp linux-2.6.33.tar.bz2 foo 2024-04-26T18:00:05.624 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir foo/.snap/barsnap 2024-04-26T18:00:05.631 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm foo/linux-2.6.33.tar.bz2 2024-04-26T18:00:05.640 INFO:tasks.workunit.client.0.smithi139.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2024-04-26T18:00:05.884 INFO:tasks.workunit.client.0.smithi139.stdout:passed: files are identical 2024-04-26T18:00:05.884 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 'passed: files are identical' 2024-04-26T18:00:05.884 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir foo/.snap/barsnap 2024-04-26T18:00:05.893 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:00:05.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo OK 2024-04-26T18:00:05.894 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:00:05.894 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:00:05.966 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2024-04-26T18:00:05.966 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-04-26T18:00:06.027 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 1 2024-04-26T18:00:06.028 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 2 2024-04-26T18:00:06.028 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 3 2024-04-26T18:00:06.029 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' -e file4 ']' 2024-04-26T18:00:06.029 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/snap1 2024-04-26T18:00:06.038 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 4 2024-04-26T18:00:06.045 INFO:tasks.workunit.client.0.smithi139.stderr:++ ls 2024-04-26T18:00:06.054 INFO:tasks.workunit.client.0.smithi139.stderr:+ now='file1 2024-04-26T18:00:06.054 INFO:tasks.workunit.client.0.smithi139.stderr:file2 2024-04-26T18:00:06.054 INFO:tasks.workunit.client.0.smithi139.stderr:file3 2024-04-26T18:00:06.054 INFO:tasks.workunit.client.0.smithi139.stderr:file4' 2024-04-26T18:00:06.054 INFO:tasks.workunit.client.0.smithi139.stderr:++ ls .snap/snap1 2024-04-26T18:00:06.056 INFO:tasks.workunit.client.0.smithi139.stderr:+ then='file1 2024-04-26T18:00:06.056 INFO:tasks.workunit.client.0.smithi139.stderr:file2 2024-04-26T18:00:06.056 INFO:tasks.workunit.client.0.smithi139.stderr:file3' 2024-04-26T18:00:06.056 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir .snap/snap1 2024-04-26T18:00:06.060 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 'file1 2024-04-26T18:00:06.061 INFO:tasks.workunit.client.0.smithi139.stderr:file2 2024-04-26T18:00:06.061 INFO:tasks.workunit.client.0.smithi139.stderr:file3 2024-04-26T18:00:06.061 INFO:tasks.workunit.client.0.smithi139.stderr:file4' = 'file1 2024-04-26T18:00:06.061 INFO:tasks.workunit.client.0.smithi139.stderr:file2 2024-04-26T18:00:06.061 INFO:tasks.workunit.client.0.smithi139.stderr:file3' ']' 2024-04-26T18:00:06.061 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 1 2024-04-26T18:00:06.065 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 2 2024-04-26T18:00:06.070 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 3 2024-04-26T18:00:06.077 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/snap1 2024-04-26T18:00:06.086 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 4 2024-04-26T18:00:06.092 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir .snap/snap1 2024-04-26T18:00:06.096 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm file1 file2 file3 file4 2024-04-26T18:00:06.102 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:00:06.103 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo OK 2024-04-26T18:00:06.103 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:00:06.103 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:00:06.169 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2024-04-26T18:00:06.169 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-04-26T18:00:06.229 INFO:tasks.workunit.client.0.smithi139.stdout:Create dir 100 to 199 ... 2024-04-26T18:00:06.247 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 100 2024-04-26T18:00:06.258 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 101 2024-04-26T18:00:06.269 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 102 2024-04-26T18:00:06.279 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 103 2024-04-26T18:00:06.289 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 104 2024-04-26T18:00:06.300 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 105 2024-04-26T18:00:06.310 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 106 2024-04-26T18:00:06.321 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 107 2024-04-26T18:00:06.332 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 108 2024-04-26T18:00:06.341 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 109 2024-04-26T18:00:06.351 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 110 2024-04-26T18:00:06.361 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 111 2024-04-26T18:00:06.371 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 112 2024-04-26T18:00:06.382 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 113 2024-04-26T18:00:06.393 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 114 2024-04-26T18:00:06.404 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 115 2024-04-26T18:00:06.415 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 116 2024-04-26T18:00:06.813 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 117 2024-04-26T18:00:06.824 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 118 2024-04-26T18:00:06.836 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 119 2024-04-26T18:00:06.847 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 120 2024-04-26T18:00:07.110 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 121 2024-04-26T18:00:07.121 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 122 2024-04-26T18:00:07.134 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 123 2024-04-26T18:00:07.146 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 124 2024-04-26T18:00:07.157 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 125 2024-04-26T18:00:07.168 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 126 2024-04-26T18:00:07.179 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 127 2024-04-26T18:00:07.190 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 128 2024-04-26T18:00:07.486 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 129 2024-04-26T18:00:07.727 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 130 2024-04-26T18:00:07.740 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 131 2024-04-26T18:00:07.752 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 132 2024-04-26T18:00:07.764 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 133 2024-04-26T18:00:07.775 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 134 2024-04-26T18:00:07.787 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 135 2024-04-26T18:00:07.799 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 136 2024-04-26T18:00:07.811 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 137 2024-04-26T18:00:07.824 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 138 2024-04-26T18:00:07.837 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 139 2024-04-26T18:00:07.848 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 140 2024-04-26T18:00:07.860 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 141 2024-04-26T18:00:07.872 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 142 2024-04-26T18:00:07.885 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 143 2024-04-26T18:00:07.902 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 144 2024-04-26T18:00:07.914 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 145 2024-04-26T18:00:07.926 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 146 2024-04-26T18:00:07.938 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 147 2024-04-26T18:00:07.949 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 148 2024-04-26T18:00:07.961 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 149 2024-04-26T18:00:07.972 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 150 2024-04-26T18:00:07.983 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 151 2024-04-26T18:00:07.995 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 152 2024-04-26T18:00:08.007 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 153 2024-04-26T18:00:08.020 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 154 2024-04-26T18:00:08.033 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 155 2024-04-26T18:00:08.045 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 156 2024-04-26T18:00:08.059 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 157 2024-04-26T18:00:08.074 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 158 2024-04-26T18:00:08.087 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 159 2024-04-26T18:00:08.098 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 160 2024-04-26T18:00:08.109 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 161 2024-04-26T18:00:08.120 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 162 2024-04-26T18:00:08.132 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 163 2024-04-26T18:00:08.143 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 164 2024-04-26T18:00:08.155 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 165 2024-04-26T18:00:08.165 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 166 2024-04-26T18:00:08.176 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 167 2024-04-26T18:00:08.187 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 168 2024-04-26T18:00:08.199 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 169 2024-04-26T18:00:08.442 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 170 2024-04-26T18:00:08.455 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 171 2024-04-26T18:00:09.223 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 172 2024-04-26T18:00:09.237 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 173 2024-04-26T18:00:09.249 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 174 2024-04-26T18:00:09.261 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 175 2024-04-26T18:00:09.274 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 176 2024-04-26T18:00:09.286 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 177 2024-04-26T18:00:09.299 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 178 2024-04-26T18:00:09.312 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 179 2024-04-26T18:00:09.324 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 180 2024-04-26T18:00:09.335 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 181 2024-04-26T18:00:09.347 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 182 2024-04-26T18:00:10.754 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 183 2024-04-26T18:00:10.767 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 184 2024-04-26T18:00:10.780 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 185 2024-04-26T18:00:10.793 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 186 2024-04-26T18:00:10.806 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 187 2024-04-26T18:00:10.820 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 188 2024-04-26T18:00:10.830 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 189 2024-04-26T18:00:10.843 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 190 2024-04-26T18:00:10.855 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 191 2024-04-26T18:00:10.867 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 192 2024-04-26T18:00:10.879 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 193 2024-04-26T18:00:10.890 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 194 2024-04-26T18:00:10.902 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 195 2024-04-26T18:00:10.913 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 196 2024-04-26T18:00:10.924 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 197 2024-04-26T18:00:10.936 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 198 2024-04-26T18:00:10.948 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 199 2024-04-26T18:00:10.958 INFO:tasks.workunit.client.0.smithi139.stdout:Take first snapshot .snap/test1 2024-04-26T18:00:11.020 INFO:tasks.workunit.client.0.smithi139.stdout:Create dir 200 to 299 ... 2024-04-26T18:00:11.021 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 200 2024-04-26T18:00:11.037 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 201 2024-04-26T18:00:11.048 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 202 2024-04-26T18:00:11.058 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 203 2024-04-26T18:00:11.068 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 204 2024-04-26T18:00:11.079 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 205 2024-04-26T18:00:11.089 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 206 2024-04-26T18:00:11.101 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 207 2024-04-26T18:00:11.112 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 208 2024-04-26T18:00:11.123 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 209 2024-04-26T18:00:11.133 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 210 2024-04-26T18:00:11.393 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 211 2024-04-26T18:00:11.961 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 212 2024-04-26T18:00:11.974 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 213 2024-04-26T18:00:11.988 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 214 2024-04-26T18:00:11.999 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 215 2024-04-26T18:00:12.011 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 216 2024-04-26T18:00:12.279 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 217 2024-04-26T18:00:12.291 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 218 2024-04-26T18:00:12.560 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 219 2024-04-26T18:00:12.571 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 220 2024-04-26T18:00:12.583 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 221 2024-04-26T18:00:12.595 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 222 2024-04-26T18:00:12.606 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 223 2024-04-26T18:00:12.618 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 224 2024-04-26T18:00:12.630 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 225 2024-04-26T18:00:12.642 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 226 2024-04-26T18:00:12.654 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 227 2024-04-26T18:00:12.666 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 228 2024-04-26T18:00:12.677 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 229 2024-04-26T18:00:12.689 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 230 2024-04-26T18:00:12.701 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 231 2024-04-26T18:00:12.712 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 232 2024-04-26T18:00:12.722 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 233 2024-04-26T18:00:12.733 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 234 2024-04-26T18:00:12.744 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 235 2024-04-26T18:00:12.755 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 236 2024-04-26T18:00:12.765 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 237 2024-04-26T18:00:12.775 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 238 2024-04-26T18:00:12.786 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 239 2024-04-26T18:00:12.797 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 240 2024-04-26T18:00:12.807 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 241 2024-04-26T18:00:12.818 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 242 2024-04-26T18:00:12.828 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 243 2024-04-26T18:00:12.839 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 244 2024-04-26T18:00:12.849 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 245 2024-04-26T18:00:12.859 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 246 2024-04-26T18:00:12.871 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 247 2024-04-26T18:00:12.882 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 248 2024-04-26T18:00:12.894 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 249 2024-04-26T18:00:12.905 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 250 2024-04-26T18:00:12.918 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 251 2024-04-26T18:00:15.773 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 252 2024-04-26T18:00:15.786 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 253 2024-04-26T18:00:15.799 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 254 2024-04-26T18:00:15.812 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 255 2024-04-26T18:00:15.825 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 256 2024-04-26T18:00:15.837 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 257 2024-04-26T18:00:15.849 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 258 2024-04-26T18:00:15.861 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 259 2024-04-26T18:00:15.873 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 260 2024-04-26T18:00:15.885 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 261 2024-04-26T18:00:15.898 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 262 2024-04-26T18:00:15.910 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 263 2024-04-26T18:00:15.922 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 264 2024-04-26T18:00:15.934 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 265 2024-04-26T18:00:15.946 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 266 2024-04-26T18:00:15.957 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 267 2024-04-26T18:00:15.990 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 268 2024-04-26T18:00:16.001 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 269 2024-04-26T18:00:16.011 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 270 2024-04-26T18:00:16.022 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 271 2024-04-26T18:00:16.034 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 272 2024-04-26T18:00:16.044 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 273 2024-04-26T18:00:16.055 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 274 2024-04-26T18:00:16.067 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 275 2024-04-26T18:00:16.079 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 276 2024-04-26T18:00:16.089 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 277 2024-04-26T18:00:16.099 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 278 2024-04-26T18:00:16.109 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 279 2024-04-26T18:00:16.121 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 280 2024-04-26T18:00:16.132 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 281 2024-04-26T18:00:16.141 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 282 2024-04-26T18:00:16.152 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 283 2024-04-26T18:00:16.161 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 284 2024-04-26T18:00:16.173 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 285 2024-04-26T18:00:16.184 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 286 2024-04-26T18:00:16.194 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 287 2024-04-26T18:00:16.205 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 288 2024-04-26T18:00:16.216 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 289 2024-04-26T18:00:16.879 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 290 2024-04-26T18:00:16.892 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 291 2024-04-26T18:00:16.905 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 292 2024-04-26T18:00:16.916 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 293 2024-04-26T18:00:16.928 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 294 2024-04-26T18:00:16.940 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 295 2024-04-26T18:00:16.951 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 296 2024-04-26T18:00:16.962 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 297 2024-04-26T18:00:16.972 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 298 2024-04-26T18:00:16.984 INFO:tasks.workunit.client.0.smithi139.stdout: create dir 299 2024-04-26T18:00:16.995 INFO:tasks.workunit.client.0.smithi139.stdout:Create a snapshot in every first level dir ... 2024-04-26T18:00:17.642 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/.snap/snap-subdir-test 2024-04-26T18:00:17.653 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/30 file after the snapshot 2024-04-26T18:00:17.654 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/31 file after the snapshot 2024-04-26T18:00:17.657 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/32 file after the snapshot 2024-04-26T18:00:17.670 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/33 file after the snapshot 2024-04-26T18:00:17.672 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/34 file after the snapshot 2024-04-26T18:00:17.674 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/35 file after the snapshot 2024-04-26T18:00:17.675 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/36 file after the snapshot 2024-04-26T18:00:17.676 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/37 file after the snapshot 2024-04-26T18:00:17.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/38 file after the snapshot 2024-04-26T18:00:17.679 INFO:tasks.workunit.client.0.smithi139.stdout: create 100/39 file after the snapshot 2024-04-26T18:00:17.681 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/.snap/snap-subdir-test 2024-04-26T18:00:17.700 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/30 file after the snapshot 2024-04-26T18:00:17.701 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/31 file after the snapshot 2024-04-26T18:00:17.704 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/32 file after the snapshot 2024-04-26T18:00:17.714 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/33 file after the snapshot 2024-04-26T18:00:17.715 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/34 file after the snapshot 2024-04-26T18:00:17.716 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/35 file after the snapshot 2024-04-26T18:00:17.717 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/36 file after the snapshot 2024-04-26T18:00:17.718 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/37 file after the snapshot 2024-04-26T18:00:17.719 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/38 file after the snapshot 2024-04-26T18:00:17.719 INFO:tasks.workunit.client.0.smithi139.stdout: create 101/39 file after the snapshot 2024-04-26T18:00:17.720 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/.snap/snap-subdir-test 2024-04-26T18:00:17.738 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/30 file after the snapshot 2024-04-26T18:00:17.740 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/31 file after the snapshot 2024-04-26T18:00:17.741 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/32 file after the snapshot 2024-04-26T18:00:17.742 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/33 file after the snapshot 2024-04-26T18:00:17.746 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/34 file after the snapshot 2024-04-26T18:00:17.758 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/35 file after the snapshot 2024-04-26T18:00:17.759 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/36 file after the snapshot 2024-04-26T18:00:17.760 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/37 file after the snapshot 2024-04-26T18:00:17.761 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/38 file after the snapshot 2024-04-26T18:00:17.763 INFO:tasks.workunit.client.0.smithi139.stdout: create 102/39 file after the snapshot 2024-04-26T18:00:17.764 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/.snap/snap-subdir-test 2024-04-26T18:00:17.785 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/30 file after the snapshot 2024-04-26T18:00:17.787 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/31 file after the snapshot 2024-04-26T18:00:17.789 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/32 file after the snapshot 2024-04-26T18:00:17.792 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/33 file after the snapshot 2024-04-26T18:00:17.796 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/34 file after the snapshot 2024-04-26T18:00:17.797 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/35 file after the snapshot 2024-04-26T18:00:17.798 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/36 file after the snapshot 2024-04-26T18:00:17.799 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/37 file after the snapshot 2024-04-26T18:00:17.800 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/38 file after the snapshot 2024-04-26T18:00:17.800 INFO:tasks.workunit.client.0.smithi139.stdout: create 103/39 file after the snapshot 2024-04-26T18:00:17.801 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/.snap/snap-subdir-test 2024-04-26T18:00:17.820 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/30 file after the snapshot 2024-04-26T18:00:17.822 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/31 file after the snapshot 2024-04-26T18:00:18.077 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/32 file after the snapshot 2024-04-26T18:00:18.334 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/33 file after the snapshot 2024-04-26T18:00:18.335 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/34 file after the snapshot 2024-04-26T18:00:18.336 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/35 file after the snapshot 2024-04-26T18:00:18.337 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/36 file after the snapshot 2024-04-26T18:00:18.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/37 file after the snapshot 2024-04-26T18:00:18.339 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/38 file after the snapshot 2024-04-26T18:00:18.340 INFO:tasks.workunit.client.0.smithi139.stdout: create 104/39 file after the snapshot 2024-04-26T18:00:18.341 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/.snap/snap-subdir-test 2024-04-26T18:00:18.408 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/30 file after the snapshot 2024-04-26T18:00:18.410 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/31 file after the snapshot 2024-04-26T18:00:18.415 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/32 file after the snapshot 2024-04-26T18:00:18.422 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/33 file after the snapshot 2024-04-26T18:00:18.423 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/34 file after the snapshot 2024-04-26T18:00:18.424 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/35 file after the snapshot 2024-04-26T18:00:18.425 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/36 file after the snapshot 2024-04-26T18:00:18.425 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/37 file after the snapshot 2024-04-26T18:00:18.426 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/38 file after the snapshot 2024-04-26T18:00:18.427 INFO:tasks.workunit.client.0.smithi139.stdout: create 105/39 file after the snapshot 2024-04-26T18:00:18.428 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/.snap/snap-subdir-test 2024-04-26T18:00:18.444 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/30 file after the snapshot 2024-04-26T18:00:18.446 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/31 file after the snapshot 2024-04-26T18:00:18.449 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/32 file after the snapshot 2024-04-26T18:00:18.458 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/33 file after the snapshot 2024-04-26T18:00:18.459 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/34 file after the snapshot 2024-04-26T18:00:18.460 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/35 file after the snapshot 2024-04-26T18:00:18.461 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/36 file after the snapshot 2024-04-26T18:00:18.462 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/37 file after the snapshot 2024-04-26T18:00:18.463 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/38 file after the snapshot 2024-04-26T18:00:18.463 INFO:tasks.workunit.client.0.smithi139.stdout: create 106/39 file after the snapshot 2024-04-26T18:00:18.464 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/.snap/snap-subdir-test 2024-04-26T18:00:18.480 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/30 file after the snapshot 2024-04-26T18:00:18.481 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/31 file after the snapshot 2024-04-26T18:00:18.482 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/32 file after the snapshot 2024-04-26T18:00:18.486 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/33 file after the snapshot 2024-04-26T18:00:18.499 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/34 file after the snapshot 2024-04-26T18:00:18.501 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/35 file after the snapshot 2024-04-26T18:00:18.502 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/36 file after the snapshot 2024-04-26T18:00:18.503 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/37 file after the snapshot 2024-04-26T18:00:18.505 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/38 file after the snapshot 2024-04-26T18:00:18.506 INFO:tasks.workunit.client.0.smithi139.stdout: create 107/39 file after the snapshot 2024-04-26T18:00:18.508 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/.snap/snap-subdir-test 2024-04-26T18:00:18.525 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/30 file after the snapshot 2024-04-26T18:00:18.530 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/31 file after the snapshot 2024-04-26T18:00:18.533 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/32 file after the snapshot 2024-04-26T18:00:18.534 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/33 file after the snapshot 2024-04-26T18:00:18.535 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/34 file after the snapshot 2024-04-26T18:00:18.536 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/35 file after the snapshot 2024-04-26T18:00:18.537 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/36 file after the snapshot 2024-04-26T18:00:18.537 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/37 file after the snapshot 2024-04-26T18:00:18.538 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/38 file after the snapshot 2024-04-26T18:00:18.539 INFO:tasks.workunit.client.0.smithi139.stdout: create 108/39 file after the snapshot 2024-04-26T18:00:18.728 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/.snap/snap-subdir-test 2024-04-26T18:00:18.945 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/30 file after the snapshot 2024-04-26T18:00:18.946 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/31 file after the snapshot 2024-04-26T18:00:18.947 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/32 file after the snapshot 2024-04-26T18:00:18.951 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/33 file after the snapshot 2024-04-26T18:00:18.960 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/34 file after the snapshot 2024-04-26T18:00:18.967 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/35 file after the snapshot 2024-04-26T18:00:18.968 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/36 file after the snapshot 2024-04-26T18:00:18.969 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/37 file after the snapshot 2024-04-26T18:00:18.971 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/38 file after the snapshot 2024-04-26T18:00:18.972 INFO:tasks.workunit.client.0.smithi139.stdout: create 109/39 file after the snapshot 2024-04-26T18:00:18.974 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/.snap/snap-subdir-test 2024-04-26T18:00:18.992 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/30 file after the snapshot 2024-04-26T18:00:18.999 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/31 file after the snapshot 2024-04-26T18:00:19.003 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/32 file after the snapshot 2024-04-26T18:00:19.008 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/33 file after the snapshot 2024-04-26T18:00:19.009 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/34 file after the snapshot 2024-04-26T18:00:19.011 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/35 file after the snapshot 2024-04-26T18:00:19.012 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/36 file after the snapshot 2024-04-26T18:00:19.013 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/37 file after the snapshot 2024-04-26T18:00:19.013 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/38 file after the snapshot 2024-04-26T18:00:19.014 INFO:tasks.workunit.client.0.smithi139.stdout: create 110/39 file after the snapshot 2024-04-26T18:00:19.015 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/.snap/snap-subdir-test 2024-04-26T18:00:19.031 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/30 file after the snapshot 2024-04-26T18:00:19.032 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/31 file after the snapshot 2024-04-26T18:00:19.034 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/32 file after the snapshot 2024-04-26T18:00:19.037 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/33 file after the snapshot 2024-04-26T18:00:19.037 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/34 file after the snapshot 2024-04-26T18:00:19.038 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/35 file after the snapshot 2024-04-26T18:00:19.040 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/36 file after the snapshot 2024-04-26T18:00:19.048 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/37 file after the snapshot 2024-04-26T18:00:19.048 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/38 file after the snapshot 2024-04-26T18:00:19.049 INFO:tasks.workunit.client.0.smithi139.stdout: create 111/39 file after the snapshot 2024-04-26T18:00:19.050 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/.snap/snap-subdir-test 2024-04-26T18:00:19.519 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/30 file after the snapshot 2024-04-26T18:00:19.521 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/31 file after the snapshot 2024-04-26T18:00:19.522 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/32 file after the snapshot 2024-04-26T18:00:19.524 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/33 file after the snapshot 2024-04-26T18:00:19.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/34 file after the snapshot 2024-04-26T18:00:19.536 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/35 file after the snapshot 2024-04-26T18:00:19.537 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/36 file after the snapshot 2024-04-26T18:00:19.538 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/37 file after the snapshot 2024-04-26T18:00:19.539 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/38 file after the snapshot 2024-04-26T18:00:19.540 INFO:tasks.workunit.client.0.smithi139.stdout: create 112/39 file after the snapshot 2024-04-26T18:00:19.541 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/.snap/snap-subdir-test 2024-04-26T18:00:19.563 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/30 file after the snapshot 2024-04-26T18:00:19.567 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/31 file after the snapshot 2024-04-26T18:00:19.575 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/32 file after the snapshot 2024-04-26T18:00:19.579 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/33 file after the snapshot 2024-04-26T18:00:19.580 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/34 file after the snapshot 2024-04-26T18:00:19.581 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/35 file after the snapshot 2024-04-26T18:00:19.582 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/36 file after the snapshot 2024-04-26T18:00:19.582 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/37 file after the snapshot 2024-04-26T18:00:19.583 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/38 file after the snapshot 2024-04-26T18:00:19.584 INFO:tasks.workunit.client.0.smithi139.stdout: create 113/39 file after the snapshot 2024-04-26T18:00:19.585 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/.snap/snap-subdir-test 2024-04-26T18:00:19.601 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/30 file after the snapshot 2024-04-26T18:00:19.602 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/31 file after the snapshot 2024-04-26T18:00:19.603 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/32 file after the snapshot 2024-04-26T18:00:19.608 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/33 file after the snapshot 2024-04-26T18:00:19.608 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/34 file after the snapshot 2024-04-26T18:00:19.611 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/35 file after the snapshot 2024-04-26T18:00:19.616 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/36 file after the snapshot 2024-04-26T18:00:19.617 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/37 file after the snapshot 2024-04-26T18:00:19.618 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/38 file after the snapshot 2024-04-26T18:00:19.619 INFO:tasks.workunit.client.0.smithi139.stdout: create 114/39 file after the snapshot 2024-04-26T18:00:19.620 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/.snap/snap-subdir-test 2024-04-26T18:00:19.635 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/30 file after the snapshot 2024-04-26T18:00:19.637 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/31 file after the snapshot 2024-04-26T18:00:19.640 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/32 file after the snapshot 2024-04-26T18:00:19.642 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/33 file after the snapshot 2024-04-26T18:00:19.642 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/34 file after the snapshot 2024-04-26T18:00:19.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/35 file after the snapshot 2024-04-26T18:00:19.644 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/36 file after the snapshot 2024-04-26T18:00:19.652 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/37 file after the snapshot 2024-04-26T18:00:19.653 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/38 file after the snapshot 2024-04-26T18:00:19.654 INFO:tasks.workunit.client.0.smithi139.stdout: create 115/39 file after the snapshot 2024-04-26T18:00:19.655 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/.snap/snap-subdir-test 2024-04-26T18:00:19.672 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/30 file after the snapshot 2024-04-26T18:00:19.673 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/31 file after the snapshot 2024-04-26T18:00:19.674 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/32 file after the snapshot 2024-04-26T18:00:19.675 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/33 file after the snapshot 2024-04-26T18:00:19.680 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/34 file after the snapshot 2024-04-26T18:00:19.686 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/35 file after the snapshot 2024-04-26T18:00:19.689 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/36 file after the snapshot 2024-04-26T18:00:19.690 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/37 file after the snapshot 2024-04-26T18:00:19.691 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/38 file after the snapshot 2024-04-26T18:00:19.692 INFO:tasks.workunit.client.0.smithi139.stdout: create 116/39 file after the snapshot 2024-04-26T18:00:19.692 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/.snap/snap-subdir-test 2024-04-26T18:00:19.709 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/30 file after the snapshot 2024-04-26T18:00:19.710 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/31 file after the snapshot 2024-04-26T18:00:19.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/32 file after the snapshot 2024-04-26T18:00:19.715 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/33 file after the snapshot 2024-04-26T18:00:19.718 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/34 file after the snapshot 2024-04-26T18:00:19.720 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/35 file after the snapshot 2024-04-26T18:00:19.724 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/36 file after the snapshot 2024-04-26T18:00:19.727 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/37 file after the snapshot 2024-04-26T18:00:19.728 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/38 file after the snapshot 2024-04-26T18:00:19.728 INFO:tasks.workunit.client.0.smithi139.stdout: create 117/39 file after the snapshot 2024-04-26T18:00:19.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/.snap/snap-subdir-test 2024-04-26T18:00:19.745 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/30 file after the snapshot 2024-04-26T18:00:19.747 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/31 file after the snapshot 2024-04-26T18:00:19.748 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/32 file after the snapshot 2024-04-26T18:00:19.750 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/33 file after the snapshot 2024-04-26T18:00:19.759 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/34 file after the snapshot 2024-04-26T18:00:19.765 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/35 file after the snapshot 2024-04-26T18:00:19.766 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/36 file after the snapshot 2024-04-26T18:00:19.767 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/37 file after the snapshot 2024-04-26T18:00:19.768 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/38 file after the snapshot 2024-04-26T18:00:19.769 INFO:tasks.workunit.client.0.smithi139.stdout: create 118/39 file after the snapshot 2024-04-26T18:00:19.769 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/.snap/snap-subdir-test 2024-04-26T18:00:19.789 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/30 file after the snapshot 2024-04-26T18:00:19.791 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/31 file after the snapshot 2024-04-26T18:00:19.792 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/32 file after the snapshot 2024-04-26T18:00:19.793 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/33 file after the snapshot 2024-04-26T18:00:19.799 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/34 file after the snapshot 2024-04-26T18:00:19.853 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/35 file after the snapshot 2024-04-26T18:00:19.853 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/36 file after the snapshot 2024-04-26T18:00:19.854 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/37 file after the snapshot 2024-04-26T18:00:19.855 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/38 file after the snapshot 2024-04-26T18:00:19.856 INFO:tasks.workunit.client.0.smithi139.stdout: create 119/39 file after the snapshot 2024-04-26T18:00:19.857 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/.snap/snap-subdir-test 2024-04-26T18:00:19.872 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/30 file after the snapshot 2024-04-26T18:00:19.881 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/31 file after the snapshot 2024-04-26T18:00:19.889 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/32 file after the snapshot 2024-04-26T18:00:19.890 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/33 file after the snapshot 2024-04-26T18:00:19.890 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/34 file after the snapshot 2024-04-26T18:00:19.891 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/35 file after the snapshot 2024-04-26T18:00:19.892 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/36 file after the snapshot 2024-04-26T18:00:19.893 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/37 file after the snapshot 2024-04-26T18:00:19.894 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/38 file after the snapshot 2024-04-26T18:00:19.895 INFO:tasks.workunit.client.0.smithi139.stdout: create 120/39 file after the snapshot 2024-04-26T18:00:19.896 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/.snap/snap-subdir-test 2024-04-26T18:00:19.910 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/30 file after the snapshot 2024-04-26T18:00:19.912 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/31 file after the snapshot 2024-04-26T18:00:19.914 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/32 file after the snapshot 2024-04-26T18:00:19.917 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/33 file after the snapshot 2024-04-26T18:00:19.921 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/34 file after the snapshot 2024-04-26T18:00:19.927 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/35 file after the snapshot 2024-04-26T18:00:19.928 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/36 file after the snapshot 2024-04-26T18:00:19.928 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/37 file after the snapshot 2024-04-26T18:00:19.930 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/38 file after the snapshot 2024-04-26T18:00:19.930 INFO:tasks.workunit.client.0.smithi139.stdout: create 121/39 file after the snapshot 2024-04-26T18:00:19.931 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/.snap/snap-subdir-test 2024-04-26T18:00:19.946 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/30 file after the snapshot 2024-04-26T18:00:19.947 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/31 file after the snapshot 2024-04-26T18:00:19.948 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/32 file after the snapshot 2024-04-26T18:00:19.953 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/33 file after the snapshot 2024-04-26T18:00:19.959 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/34 file after the snapshot 2024-04-26T18:00:19.961 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/35 file after the snapshot 2024-04-26T18:00:19.963 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/36 file after the snapshot 2024-04-26T18:00:19.963 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/37 file after the snapshot 2024-04-26T18:00:19.964 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/38 file after the snapshot 2024-04-26T18:00:19.965 INFO:tasks.workunit.client.0.smithi139.stdout: create 122/39 file after the snapshot 2024-04-26T18:00:19.966 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/.snap/snap-subdir-test 2024-04-26T18:00:19.981 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/30 file after the snapshot 2024-04-26T18:00:19.983 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/31 file after the snapshot 2024-04-26T18:00:19.984 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/32 file after the snapshot 2024-04-26T18:00:19.987 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/33 file after the snapshot 2024-04-26T18:00:19.995 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/34 file after the snapshot 2024-04-26T18:00:19.998 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/35 file after the snapshot 2024-04-26T18:00:19.999 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/36 file after the snapshot 2024-04-26T18:00:19.999 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/37 file after the snapshot 2024-04-26T18:00:20.000 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/38 file after the snapshot 2024-04-26T18:00:20.001 INFO:tasks.workunit.client.0.smithi139.stdout: create 123/39 file after the snapshot 2024-04-26T18:00:20.002 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/.snap/snap-subdir-test 2024-04-26T18:00:20.016 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/30 file after the snapshot 2024-04-26T18:00:20.019 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/31 file after the snapshot 2024-04-26T18:00:20.019 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/32 file after the snapshot 2024-04-26T18:00:20.024 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/33 file after the snapshot 2024-04-26T18:00:20.025 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/34 file after the snapshot 2024-04-26T18:00:20.025 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/35 file after the snapshot 2024-04-26T18:00:20.025 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/36 file after the snapshot 2024-04-26T18:00:20.025 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/37 file after the snapshot 2024-04-26T18:00:20.025 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/38 file after the snapshot 2024-04-26T18:00:20.031 INFO:tasks.workunit.client.0.smithi139.stdout: create 124/39 file after the snapshot 2024-04-26T18:00:20.036 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/.snap/snap-subdir-test 2024-04-26T18:00:20.051 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/30 file after the snapshot 2024-04-26T18:00:20.052 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/31 file after the snapshot 2024-04-26T18:00:20.053 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/32 file after the snapshot 2024-04-26T18:00:20.054 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/33 file after the snapshot 2024-04-26T18:00:20.056 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/34 file after the snapshot 2024-04-26T18:00:20.058 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/35 file after the snapshot 2024-04-26T18:00:20.065 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/36 file after the snapshot 2024-04-26T18:00:20.478 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/37 file after the snapshot 2024-04-26T18:00:20.785 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/38 file after the snapshot 2024-04-26T18:00:20.786 INFO:tasks.workunit.client.0.smithi139.stdout: create 125/39 file after the snapshot 2024-04-26T18:00:20.787 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/.snap/snap-subdir-test 2024-04-26T18:00:20.808 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/30 file after the snapshot 2024-04-26T18:00:20.812 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/31 file after the snapshot 2024-04-26T18:00:20.814 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/32 file after the snapshot 2024-04-26T18:00:20.816 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/33 file after the snapshot 2024-04-26T18:00:20.821 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/34 file after the snapshot 2024-04-26T18:00:20.829 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/35 file after the snapshot 2024-04-26T18:00:20.833 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/36 file after the snapshot 2024-04-26T18:00:20.835 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/37 file after the snapshot 2024-04-26T18:00:20.836 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/38 file after the snapshot 2024-04-26T18:00:20.837 INFO:tasks.workunit.client.0.smithi139.stdout: create 126/39 file after the snapshot 2024-04-26T18:00:20.839 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/.snap/snap-subdir-test 2024-04-26T18:00:20.855 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/30 file after the snapshot 2024-04-26T18:00:20.856 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/31 file after the snapshot 2024-04-26T18:00:20.857 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/32 file after the snapshot 2024-04-26T18:00:20.861 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/33 file after the snapshot 2024-04-26T18:00:20.867 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/34 file after the snapshot 2024-04-26T18:00:20.870 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/35 file after the snapshot 2024-04-26T18:00:20.871 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/36 file after the snapshot 2024-04-26T18:00:20.872 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/37 file after the snapshot 2024-04-26T18:00:20.873 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/38 file after the snapshot 2024-04-26T18:00:20.873 INFO:tasks.workunit.client.0.smithi139.stdout: create 127/39 file after the snapshot 2024-04-26T18:00:20.874 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/.snap/snap-subdir-test 2024-04-26T18:00:20.889 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/30 file after the snapshot 2024-04-26T18:00:20.893 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/31 file after the snapshot 2024-04-26T18:00:20.900 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/32 file after the snapshot 2024-04-26T18:00:20.904 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/33 file after the snapshot 2024-04-26T18:00:20.905 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/34 file after the snapshot 2024-04-26T18:00:20.906 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/35 file after the snapshot 2024-04-26T18:00:20.907 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/36 file after the snapshot 2024-04-26T18:00:20.907 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/37 file after the snapshot 2024-04-26T18:00:20.908 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/38 file after the snapshot 2024-04-26T18:00:20.909 INFO:tasks.workunit.client.0.smithi139.stdout: create 128/39 file after the snapshot 2024-04-26T18:00:21.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/.snap/snap-subdir-test 2024-04-26T18:00:21.181 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/30 file after the snapshot 2024-04-26T18:00:21.184 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/31 file after the snapshot 2024-04-26T18:00:21.188 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/32 file after the snapshot 2024-04-26T18:00:21.195 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/33 file after the snapshot 2024-04-26T18:00:21.197 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/34 file after the snapshot 2024-04-26T18:00:21.198 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/35 file after the snapshot 2024-04-26T18:00:21.199 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/36 file after the snapshot 2024-04-26T18:00:21.200 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/37 file after the snapshot 2024-04-26T18:00:21.201 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/38 file after the snapshot 2024-04-26T18:00:21.201 INFO:tasks.workunit.client.0.smithi139.stdout: create 129/39 file after the snapshot 2024-04-26T18:00:21.202 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/.snap/snap-subdir-test 2024-04-26T18:00:21.219 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/30 file after the snapshot 2024-04-26T18:00:21.220 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/31 file after the snapshot 2024-04-26T18:00:21.222 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/32 file after the snapshot 2024-04-26T18:00:21.223 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/33 file after the snapshot 2024-04-26T18:00:21.224 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/34 file after the snapshot 2024-04-26T18:00:21.228 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/35 file after the snapshot 2024-04-26T18:00:21.232 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/36 file after the snapshot 2024-04-26T18:00:21.385 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/37 file after the snapshot 2024-04-26T18:00:21.385 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/38 file after the snapshot 2024-04-26T18:00:21.386 INFO:tasks.workunit.client.0.smithi139.stdout: create 130/39 file after the snapshot 2024-04-26T18:00:21.387 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/.snap/snap-subdir-test 2024-04-26T18:00:21.403 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/30 file after the snapshot 2024-04-26T18:00:21.405 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/31 file after the snapshot 2024-04-26T18:00:21.406 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/32 file after the snapshot 2024-04-26T18:00:21.407 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/33 file after the snapshot 2024-04-26T18:00:21.411 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/34 file after the snapshot 2024-04-26T18:00:21.414 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/35 file after the snapshot 2024-04-26T18:00:21.421 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/36 file after the snapshot 2024-04-26T18:00:21.422 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/37 file after the snapshot 2024-04-26T18:00:21.423 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/38 file after the snapshot 2024-04-26T18:00:21.424 INFO:tasks.workunit.client.0.smithi139.stdout: create 131/39 file after the snapshot 2024-04-26T18:00:21.425 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/.snap/snap-subdir-test 2024-04-26T18:00:21.439 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/30 file after the snapshot 2024-04-26T18:00:21.441 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/31 file after the snapshot 2024-04-26T18:00:21.443 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/32 file after the snapshot 2024-04-26T18:00:21.445 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/33 file after the snapshot 2024-04-26T18:00:21.446 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/34 file after the snapshot 2024-04-26T18:00:21.447 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/35 file after the snapshot 2024-04-26T18:00:21.448 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/36 file after the snapshot 2024-04-26T18:00:21.450 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/37 file after the snapshot 2024-04-26T18:00:21.457 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/38 file after the snapshot 2024-04-26T18:00:21.458 INFO:tasks.workunit.client.0.smithi139.stdout: create 132/39 file after the snapshot 2024-04-26T18:00:21.458 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/.snap/snap-subdir-test 2024-04-26T18:00:21.478 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/30 file after the snapshot 2024-04-26T18:00:21.479 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/31 file after the snapshot 2024-04-26T18:00:21.481 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/32 file after the snapshot 2024-04-26T18:00:21.483 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/33 file after the snapshot 2024-04-26T18:00:21.489 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/34 file after the snapshot 2024-04-26T18:00:21.494 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/35 file after the snapshot 2024-04-26T18:00:21.495 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/36 file after the snapshot 2024-04-26T18:00:21.496 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/37 file after the snapshot 2024-04-26T18:00:21.496 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/38 file after the snapshot 2024-04-26T18:00:21.497 INFO:tasks.workunit.client.0.smithi139.stdout: create 133/39 file after the snapshot 2024-04-26T18:00:21.498 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/.snap/snap-subdir-test 2024-04-26T18:00:21.887 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/30 file after the snapshot 2024-04-26T18:00:21.889 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/31 file after the snapshot 2024-04-26T18:00:21.890 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/32 file after the snapshot 2024-04-26T18:00:21.892 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/33 file after the snapshot 2024-04-26T18:00:21.894 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/34 file after the snapshot 2024-04-26T18:00:21.896 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/35 file after the snapshot 2024-04-26T18:00:21.902 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/36 file after the snapshot 2024-04-26T18:00:21.948 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/37 file after the snapshot 2024-04-26T18:00:21.949 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/38 file after the snapshot 2024-04-26T18:00:21.949 INFO:tasks.workunit.client.0.smithi139.stdout: create 134/39 file after the snapshot 2024-04-26T18:00:21.950 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/.snap/snap-subdir-test 2024-04-26T18:00:21.971 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/30 file after the snapshot 2024-04-26T18:00:21.973 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/31 file after the snapshot 2024-04-26T18:00:21.978 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/32 file after the snapshot 2024-04-26T18:00:21.981 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/33 file after the snapshot 2024-04-26T18:00:21.987 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/34 file after the snapshot 2024-04-26T18:00:21.988 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/35 file after the snapshot 2024-04-26T18:00:21.988 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/36 file after the snapshot 2024-04-26T18:00:21.989 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/37 file after the snapshot 2024-04-26T18:00:21.990 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/38 file after the snapshot 2024-04-26T18:00:21.990 INFO:tasks.workunit.client.0.smithi139.stdout: create 135/39 file after the snapshot 2024-04-26T18:00:21.991 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/.snap/snap-subdir-test 2024-04-26T18:00:22.012 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/30 file after the snapshot 2024-04-26T18:00:22.014 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/31 file after the snapshot 2024-04-26T18:00:22.016 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/32 file after the snapshot 2024-04-26T18:00:22.023 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/33 file after the snapshot 2024-04-26T18:00:22.027 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/34 file after the snapshot 2024-04-26T18:00:22.028 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/35 file after the snapshot 2024-04-26T18:00:22.029 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/36 file after the snapshot 2024-04-26T18:00:22.030 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/37 file after the snapshot 2024-04-26T18:00:22.030 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/38 file after the snapshot 2024-04-26T18:00:22.031 INFO:tasks.workunit.client.0.smithi139.stdout: create 136/39 file after the snapshot 2024-04-26T18:00:22.032 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/.snap/snap-subdir-test 2024-04-26T18:00:22.053 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/30 file after the snapshot 2024-04-26T18:00:22.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/31 file after the snapshot 2024-04-26T18:00:22.056 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/32 file after the snapshot 2024-04-26T18:00:22.059 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/33 file after the snapshot 2024-04-26T18:00:22.065 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/34 file after the snapshot 2024-04-26T18:00:22.069 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/35 file after the snapshot 2024-04-26T18:00:22.070 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/36 file after the snapshot 2024-04-26T18:00:22.071 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/37 file after the snapshot 2024-04-26T18:00:22.072 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/38 file after the snapshot 2024-04-26T18:00:22.073 INFO:tasks.workunit.client.0.smithi139.stdout: create 137/39 file after the snapshot 2024-04-26T18:00:22.073 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/.snap/snap-subdir-test 2024-04-26T18:00:22.089 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/30 file after the snapshot 2024-04-26T18:00:22.091 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/31 file after the snapshot 2024-04-26T18:00:22.092 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/32 file after the snapshot 2024-04-26T18:00:22.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/33 file after the snapshot 2024-04-26T18:00:22.100 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/34 file after the snapshot 2024-04-26T18:00:22.107 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/35 file after the snapshot 2024-04-26T18:00:22.109 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/36 file after the snapshot 2024-04-26T18:00:22.110 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/37 file after the snapshot 2024-04-26T18:00:22.111 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/38 file after the snapshot 2024-04-26T18:00:22.113 INFO:tasks.workunit.client.0.smithi139.stdout: create 138/39 file after the snapshot 2024-04-26T18:00:22.114 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/.snap/snap-subdir-test 2024-04-26T18:00:22.135 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/30 file after the snapshot 2024-04-26T18:00:22.136 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/31 file after the snapshot 2024-04-26T18:00:22.138 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/32 file after the snapshot 2024-04-26T18:00:22.141 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/33 file after the snapshot 2024-04-26T18:00:22.146 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/34 file after the snapshot 2024-04-26T18:00:22.188 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/35 file after the snapshot 2024-04-26T18:00:22.198 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/36 file after the snapshot 2024-04-26T18:00:22.199 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/37 file after the snapshot 2024-04-26T18:00:22.199 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/38 file after the snapshot 2024-04-26T18:00:22.200 INFO:tasks.workunit.client.0.smithi139.stdout: create 139/39 file after the snapshot 2024-04-26T18:00:22.201 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/.snap/snap-subdir-test 2024-04-26T18:00:22.216 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/30 file after the snapshot 2024-04-26T18:00:22.219 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/31 file after the snapshot 2024-04-26T18:00:22.220 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/32 file after the snapshot 2024-04-26T18:00:22.224 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/33 file after the snapshot 2024-04-26T18:00:22.224 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/34 file after the snapshot 2024-04-26T18:00:22.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/35 file after the snapshot 2024-04-26T18:00:22.234 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/36 file after the snapshot 2024-04-26T18:00:22.235 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/37 file after the snapshot 2024-04-26T18:00:22.236 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/38 file after the snapshot 2024-04-26T18:00:22.236 INFO:tasks.workunit.client.0.smithi139.stdout: create 140/39 file after the snapshot 2024-04-26T18:00:22.237 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/.snap/snap-subdir-test 2024-04-26T18:00:22.254 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/30 file after the snapshot 2024-04-26T18:00:22.255 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/31 file after the snapshot 2024-04-26T18:00:22.261 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/32 file after the snapshot 2024-04-26T18:00:22.261 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/33 file after the snapshot 2024-04-26T18:00:22.268 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/34 file after the snapshot 2024-04-26T18:00:22.270 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/35 file after the snapshot 2024-04-26T18:00:22.271 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/36 file after the snapshot 2024-04-26T18:00:22.272 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/37 file after the snapshot 2024-04-26T18:00:22.273 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/38 file after the snapshot 2024-04-26T18:00:22.274 INFO:tasks.workunit.client.0.smithi139.stdout: create 141/39 file after the snapshot 2024-04-26T18:00:22.275 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/.snap/snap-subdir-test 2024-04-26T18:00:22.296 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/30 file after the snapshot 2024-04-26T18:00:22.298 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/31 file after the snapshot 2024-04-26T18:00:22.299 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/32 file after the snapshot 2024-04-26T18:00:22.300 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/33 file after the snapshot 2024-04-26T18:00:22.301 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/34 file after the snapshot 2024-04-26T18:00:22.306 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/35 file after the snapshot 2024-04-26T18:00:22.312 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/36 file after the snapshot 2024-04-26T18:00:22.314 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/37 file after the snapshot 2024-04-26T18:00:22.314 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/38 file after the snapshot 2024-04-26T18:00:22.315 INFO:tasks.workunit.client.0.smithi139.stdout: create 142/39 file after the snapshot 2024-04-26T18:00:22.316 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/.snap/snap-subdir-test 2024-04-26T18:00:22.331 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/30 file after the snapshot 2024-04-26T18:00:22.332 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/31 file after the snapshot 2024-04-26T18:00:22.333 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/32 file after the snapshot 2024-04-26T18:00:22.334 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/33 file after the snapshot 2024-04-26T18:00:22.336 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/34 file after the snapshot 2024-04-26T18:00:22.337 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/35 file after the snapshot 2024-04-26T18:00:22.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/36 file after the snapshot 2024-04-26T18:00:22.341 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/37 file after the snapshot 2024-04-26T18:00:22.353 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/38 file after the snapshot 2024-04-26T18:00:22.354 INFO:tasks.workunit.client.0.smithi139.stdout: create 143/39 file after the snapshot 2024-04-26T18:00:22.355 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/.snap/snap-subdir-test 2024-04-26T18:00:22.615 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/30 file after the snapshot 2024-04-26T18:00:22.616 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/31 file after the snapshot 2024-04-26T18:00:22.618 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/32 file after the snapshot 2024-04-26T18:00:22.618 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/33 file after the snapshot 2024-04-26T18:00:22.619 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/34 file after the snapshot 2024-04-26T18:00:22.621 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/35 file after the snapshot 2024-04-26T18:00:22.622 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/36 file after the snapshot 2024-04-26T18:00:22.623 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/37 file after the snapshot 2024-04-26T18:00:22.630 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/38 file after the snapshot 2024-04-26T18:00:22.633 INFO:tasks.workunit.client.0.smithi139.stdout: create 144/39 file after the snapshot 2024-04-26T18:00:22.635 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/.snap/snap-subdir-test 2024-04-26T18:00:22.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/30 file after the snapshot 2024-04-26T18:00:22.652 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/31 file after the snapshot 2024-04-26T18:00:22.653 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/32 file after the snapshot 2024-04-26T18:00:22.654 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/33 file after the snapshot 2024-04-26T18:00:22.658 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/34 file after the snapshot 2024-04-26T18:00:22.659 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/35 file after the snapshot 2024-04-26T18:00:22.659 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/36 file after the snapshot 2024-04-26T18:00:22.663 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/37 file after the snapshot 2024-04-26T18:00:22.667 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/38 file after the snapshot 2024-04-26T18:00:22.668 INFO:tasks.workunit.client.0.smithi139.stdout: create 145/39 file after the snapshot 2024-04-26T18:00:22.669 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/.snap/snap-subdir-test 2024-04-26T18:00:22.688 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/30 file after the snapshot 2024-04-26T18:00:22.690 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/31 file after the snapshot 2024-04-26T18:00:22.691 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/32 file after the snapshot 2024-04-26T18:00:22.692 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/33 file after the snapshot 2024-04-26T18:00:22.697 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/34 file after the snapshot 2024-04-26T18:00:22.700 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/35 file after the snapshot 2024-04-26T18:00:22.917 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/36 file after the snapshot 2024-04-26T18:00:22.946 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/37 file after the snapshot 2024-04-26T18:00:23.486 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/38 file after the snapshot 2024-04-26T18:00:23.623 INFO:tasks.workunit.client.0.smithi139.stdout: create 146/39 file after the snapshot 2024-04-26T18:00:23.624 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/.snap/snap-subdir-test 2024-04-26T18:00:23.649 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/30 file after the snapshot 2024-04-26T18:00:23.651 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/31 file after the snapshot 2024-04-26T18:00:23.652 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/32 file after the snapshot 2024-04-26T18:00:23.654 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/33 file after the snapshot 2024-04-26T18:00:23.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/34 file after the snapshot 2024-04-26T18:00:23.998 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/35 file after the snapshot 2024-04-26T18:00:24.010 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/36 file after the snapshot 2024-04-26T18:00:24.019 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/37 file after the snapshot 2024-04-26T18:00:24.028 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/38 file after the snapshot 2024-04-26T18:00:24.040 INFO:tasks.workunit.client.0.smithi139.stdout: create 147/39 file after the snapshot 2024-04-26T18:00:24.070 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/.snap/snap-subdir-test 2024-04-26T18:00:25.708 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/30 file after the snapshot 2024-04-26T18:00:25.714 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/31 file after the snapshot 2024-04-26T18:00:25.723 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/32 file after the snapshot 2024-04-26T18:00:25.723 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/33 file after the snapshot 2024-04-26T18:00:25.724 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/34 file after the snapshot 2024-04-26T18:00:25.725 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/35 file after the snapshot 2024-04-26T18:00:25.726 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/36 file after the snapshot 2024-04-26T18:00:25.727 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/37 file after the snapshot 2024-04-26T18:00:25.728 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/38 file after the snapshot 2024-04-26T18:00:25.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 148/39 file after the snapshot 2024-04-26T18:00:25.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/.snap/snap-subdir-test 2024-04-26T18:00:25.739 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/30 file after the snapshot 2024-04-26T18:00:25.740 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/31 file after the snapshot 2024-04-26T18:00:25.741 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/32 file after the snapshot 2024-04-26T18:00:25.742 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/33 file after the snapshot 2024-04-26T18:00:25.743 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/34 file after the snapshot 2024-04-26T18:00:25.743 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/35 file after the snapshot 2024-04-26T18:00:25.744 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/36 file after the snapshot 2024-04-26T18:00:25.745 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/37 file after the snapshot 2024-04-26T18:00:25.746 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/38 file after the snapshot 2024-04-26T18:00:25.746 INFO:tasks.workunit.client.0.smithi139.stdout: create 149/39 file after the snapshot 2024-04-26T18:00:25.747 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/.snap/snap-subdir-test 2024-04-26T18:00:25.756 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/30 file after the snapshot 2024-04-26T18:00:25.757 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/31 file after the snapshot 2024-04-26T18:00:25.758 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/32 file after the snapshot 2024-04-26T18:00:25.759 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/33 file after the snapshot 2024-04-26T18:00:25.759 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/34 file after the snapshot 2024-04-26T18:00:25.760 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/35 file after the snapshot 2024-04-26T18:00:25.761 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/36 file after the snapshot 2024-04-26T18:00:25.762 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/37 file after the snapshot 2024-04-26T18:00:25.763 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/38 file after the snapshot 2024-04-26T18:00:25.763 INFO:tasks.workunit.client.0.smithi139.stdout: create 150/39 file after the snapshot 2024-04-26T18:00:25.764 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/.snap/snap-subdir-test 2024-04-26T18:00:25.773 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/30 file after the snapshot 2024-04-26T18:00:25.775 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/31 file after the snapshot 2024-04-26T18:00:25.776 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/32 file after the snapshot 2024-04-26T18:00:25.776 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/33 file after the snapshot 2024-04-26T18:00:25.777 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/34 file after the snapshot 2024-04-26T18:00:25.778 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/35 file after the snapshot 2024-04-26T18:00:25.778 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/36 file after the snapshot 2024-04-26T18:00:25.779 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/37 file after the snapshot 2024-04-26T18:00:25.780 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/38 file after the snapshot 2024-04-26T18:00:25.780 INFO:tasks.workunit.client.0.smithi139.stdout: create 151/39 file after the snapshot 2024-04-26T18:00:25.781 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/.snap/snap-subdir-test 2024-04-26T18:00:25.791 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/30 file after the snapshot 2024-04-26T18:00:25.792 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/31 file after the snapshot 2024-04-26T18:00:25.792 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/32 file after the snapshot 2024-04-26T18:00:25.793 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/33 file after the snapshot 2024-04-26T18:00:25.794 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/34 file after the snapshot 2024-04-26T18:00:25.795 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/35 file after the snapshot 2024-04-26T18:00:25.795 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/36 file after the snapshot 2024-04-26T18:00:25.796 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/37 file after the snapshot 2024-04-26T18:00:25.797 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/38 file after the snapshot 2024-04-26T18:00:25.798 INFO:tasks.workunit.client.0.smithi139.stdout: create 152/39 file after the snapshot 2024-04-26T18:00:25.798 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/.snap/snap-subdir-test 2024-04-26T18:00:25.807 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/30 file after the snapshot 2024-04-26T18:00:25.808 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/31 file after the snapshot 2024-04-26T18:00:25.809 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/32 file after the snapshot 2024-04-26T18:00:25.810 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/33 file after the snapshot 2024-04-26T18:00:25.810 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/34 file after the snapshot 2024-04-26T18:00:25.811 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/35 file after the snapshot 2024-04-26T18:00:25.812 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/36 file after the snapshot 2024-04-26T18:00:25.813 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/37 file after the snapshot 2024-04-26T18:00:25.814 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/38 file after the snapshot 2024-04-26T18:00:25.814 INFO:tasks.workunit.client.0.smithi139.stdout: create 153/39 file after the snapshot 2024-04-26T18:00:25.815 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/.snap/snap-subdir-test 2024-04-26T18:00:25.836 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/30 file after the snapshot 2024-04-26T18:00:25.837 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/31 file after the snapshot 2024-04-26T18:00:25.838 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/32 file after the snapshot 2024-04-26T18:00:25.839 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/33 file after the snapshot 2024-04-26T18:00:25.841 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/34 file after the snapshot 2024-04-26T18:00:25.842 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/35 file after the snapshot 2024-04-26T18:00:25.843 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/36 file after the snapshot 2024-04-26T18:00:25.844 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/37 file after the snapshot 2024-04-26T18:00:25.845 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/38 file after the snapshot 2024-04-26T18:00:25.846 INFO:tasks.workunit.client.0.smithi139.stdout: create 154/39 file after the snapshot 2024-04-26T18:00:25.848 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/.snap/snap-subdir-test 2024-04-26T18:00:25.858 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/30 file after the snapshot 2024-04-26T18:00:25.859 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/31 file after the snapshot 2024-04-26T18:00:25.860 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/32 file after the snapshot 2024-04-26T18:00:25.861 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/33 file after the snapshot 2024-04-26T18:00:25.862 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/34 file after the snapshot 2024-04-26T18:00:25.863 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/35 file after the snapshot 2024-04-26T18:00:25.863 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/36 file after the snapshot 2024-04-26T18:00:25.864 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/37 file after the snapshot 2024-04-26T18:00:25.865 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/38 file after the snapshot 2024-04-26T18:00:25.866 INFO:tasks.workunit.client.0.smithi139.stdout: create 155/39 file after the snapshot 2024-04-26T18:00:25.866 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/.snap/snap-subdir-test 2024-04-26T18:00:25.875 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/30 file after the snapshot 2024-04-26T18:00:25.876 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/31 file after the snapshot 2024-04-26T18:00:25.877 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/32 file after the snapshot 2024-04-26T18:00:25.878 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/33 file after the snapshot 2024-04-26T18:00:25.878 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/34 file after the snapshot 2024-04-26T18:00:25.879 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/35 file after the snapshot 2024-04-26T18:00:25.880 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/36 file after the snapshot 2024-04-26T18:00:25.881 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/37 file after the snapshot 2024-04-26T18:00:25.881 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/38 file after the snapshot 2024-04-26T18:00:25.882 INFO:tasks.workunit.client.0.smithi139.stdout: create 156/39 file after the snapshot 2024-04-26T18:00:25.883 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/.snap/snap-subdir-test 2024-04-26T18:00:25.892 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/30 file after the snapshot 2024-04-26T18:00:25.893 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/31 file after the snapshot 2024-04-26T18:00:25.894 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/32 file after the snapshot 2024-04-26T18:00:25.894 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/33 file after the snapshot 2024-04-26T18:00:25.895 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/34 file after the snapshot 2024-04-26T18:00:25.896 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/35 file after the snapshot 2024-04-26T18:00:25.897 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/36 file after the snapshot 2024-04-26T18:00:25.897 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/37 file after the snapshot 2024-04-26T18:00:25.898 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/38 file after the snapshot 2024-04-26T18:00:25.899 INFO:tasks.workunit.client.0.smithi139.stdout: create 157/39 file after the snapshot 2024-04-26T18:00:25.899 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/.snap/snap-subdir-test 2024-04-26T18:00:25.909 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/30 file after the snapshot 2024-04-26T18:00:25.909 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/31 file after the snapshot 2024-04-26T18:00:25.910 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/32 file after the snapshot 2024-04-26T18:00:25.911 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/33 file after the snapshot 2024-04-26T18:00:25.912 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/34 file after the snapshot 2024-04-26T18:00:25.912 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/35 file after the snapshot 2024-04-26T18:00:25.913 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/36 file after the snapshot 2024-04-26T18:00:25.914 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/37 file after the snapshot 2024-04-26T18:00:25.914 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/38 file after the snapshot 2024-04-26T18:00:25.915 INFO:tasks.workunit.client.0.smithi139.stdout: create 158/39 file after the snapshot 2024-04-26T18:00:25.916 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/.snap/snap-subdir-test 2024-04-26T18:00:25.925 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/30 file after the snapshot 2024-04-26T18:00:25.926 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/31 file after the snapshot 2024-04-26T18:00:25.926 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/32 file after the snapshot 2024-04-26T18:00:25.927 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/33 file after the snapshot 2024-04-26T18:00:25.928 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/34 file after the snapshot 2024-04-26T18:00:25.929 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/35 file after the snapshot 2024-04-26T18:00:25.929 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/36 file after the snapshot 2024-04-26T18:00:25.930 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/37 file after the snapshot 2024-04-26T18:00:25.931 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/38 file after the snapshot 2024-04-26T18:00:25.932 INFO:tasks.workunit.client.0.smithi139.stdout: create 159/39 file after the snapshot 2024-04-26T18:00:25.932 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/.snap/snap-subdir-test 2024-04-26T18:00:26.190 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/30 file after the snapshot 2024-04-26T18:00:26.191 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/31 file after the snapshot 2024-04-26T18:00:26.192 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/32 file after the snapshot 2024-04-26T18:00:26.192 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/33 file after the snapshot 2024-04-26T18:00:26.193 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/34 file after the snapshot 2024-04-26T18:00:26.194 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/35 file after the snapshot 2024-04-26T18:00:26.195 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/36 file after the snapshot 2024-04-26T18:00:26.195 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/37 file after the snapshot 2024-04-26T18:00:26.196 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/38 file after the snapshot 2024-04-26T18:00:26.197 INFO:tasks.workunit.client.0.smithi139.stdout: create 160/39 file after the snapshot 2024-04-26T18:00:26.198 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/.snap/snap-subdir-test 2024-04-26T18:00:26.207 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/30 file after the snapshot 2024-04-26T18:00:26.208 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/31 file after the snapshot 2024-04-26T18:00:26.208 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/32 file after the snapshot 2024-04-26T18:00:26.209 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/33 file after the snapshot 2024-04-26T18:00:26.210 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/34 file after the snapshot 2024-04-26T18:00:26.211 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/35 file after the snapshot 2024-04-26T18:00:26.211 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/36 file after the snapshot 2024-04-26T18:00:26.212 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/37 file after the snapshot 2024-04-26T18:00:26.213 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/38 file after the snapshot 2024-04-26T18:00:26.213 INFO:tasks.workunit.client.0.smithi139.stdout: create 161/39 file after the snapshot 2024-04-26T18:00:26.214 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/.snap/snap-subdir-test 2024-04-26T18:00:26.223 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/30 file after the snapshot 2024-04-26T18:00:26.224 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/31 file after the snapshot 2024-04-26T18:00:26.225 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/32 file after the snapshot 2024-04-26T18:00:26.225 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/33 file after the snapshot 2024-04-26T18:00:26.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/34 file after the snapshot 2024-04-26T18:00:26.227 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/35 file after the snapshot 2024-04-26T18:00:26.228 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/36 file after the snapshot 2024-04-26T18:00:26.228 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/37 file after the snapshot 2024-04-26T18:00:26.229 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/38 file after the snapshot 2024-04-26T18:00:26.230 INFO:tasks.workunit.client.0.smithi139.stdout: create 162/39 file after the snapshot 2024-04-26T18:00:26.231 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/.snap/snap-subdir-test 2024-04-26T18:00:26.240 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/30 file after the snapshot 2024-04-26T18:00:26.240 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/31 file after the snapshot 2024-04-26T18:00:26.241 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/32 file after the snapshot 2024-04-26T18:00:26.242 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/33 file after the snapshot 2024-04-26T18:00:26.242 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/34 file after the snapshot 2024-04-26T18:00:26.243 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/35 file after the snapshot 2024-04-26T18:00:26.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/36 file after the snapshot 2024-04-26T18:00:26.245 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/37 file after the snapshot 2024-04-26T18:00:26.245 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/38 file after the snapshot 2024-04-26T18:00:26.246 INFO:tasks.workunit.client.0.smithi139.stdout: create 163/39 file after the snapshot 2024-04-26T18:00:26.247 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/.snap/snap-subdir-test 2024-04-26T18:00:26.256 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/30 file after the snapshot 2024-04-26T18:00:26.256 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/31 file after the snapshot 2024-04-26T18:00:26.257 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/32 file after the snapshot 2024-04-26T18:00:26.258 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/33 file after the snapshot 2024-04-26T18:00:26.258 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/34 file after the snapshot 2024-04-26T18:00:26.259 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/35 file after the snapshot 2024-04-26T18:00:26.260 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/36 file after the snapshot 2024-04-26T18:00:26.260 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/37 file after the snapshot 2024-04-26T18:00:26.261 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/38 file after the snapshot 2024-04-26T18:00:26.262 INFO:tasks.workunit.client.0.smithi139.stdout: create 164/39 file after the snapshot 2024-04-26T18:00:26.263 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/.snap/snap-subdir-test 2024-04-26T18:00:26.272 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/30 file after the snapshot 2024-04-26T18:00:26.273 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/31 file after the snapshot 2024-04-26T18:00:26.273 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/32 file after the snapshot 2024-04-26T18:00:26.274 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/33 file after the snapshot 2024-04-26T18:00:26.275 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/34 file after the snapshot 2024-04-26T18:00:26.275 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/35 file after the snapshot 2024-04-26T18:00:26.276 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/36 file after the snapshot 2024-04-26T18:00:26.277 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/37 file after the snapshot 2024-04-26T18:00:26.278 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/38 file after the snapshot 2024-04-26T18:00:26.278 INFO:tasks.workunit.client.0.smithi139.stdout: create 165/39 file after the snapshot 2024-04-26T18:00:26.279 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/.snap/snap-subdir-test 2024-04-26T18:00:26.288 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/30 file after the snapshot 2024-04-26T18:00:26.289 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/31 file after the snapshot 2024-04-26T18:00:26.290 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/32 file after the snapshot 2024-04-26T18:00:26.290 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/33 file after the snapshot 2024-04-26T18:00:26.493 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/34 file after the snapshot 2024-04-26T18:00:26.500 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/35 file after the snapshot 2024-04-26T18:00:26.501 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/36 file after the snapshot 2024-04-26T18:00:26.502 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/37 file after the snapshot 2024-04-26T18:00:26.503 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/38 file after the snapshot 2024-04-26T18:00:26.504 INFO:tasks.workunit.client.0.smithi139.stdout: create 166/39 file after the snapshot 2024-04-26T18:00:26.505 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/.snap/snap-subdir-test 2024-04-26T18:00:26.515 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/30 file after the snapshot 2024-04-26T18:00:26.515 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/31 file after the snapshot 2024-04-26T18:00:26.516 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/32 file after the snapshot 2024-04-26T18:00:26.517 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/33 file after the snapshot 2024-04-26T18:00:26.523 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/34 file after the snapshot 2024-04-26T18:00:26.524 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/35 file after the snapshot 2024-04-26T18:00:26.525 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/36 file after the snapshot 2024-04-26T18:00:26.895 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/37 file after the snapshot 2024-04-26T18:00:26.895 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/38 file after the snapshot 2024-04-26T18:00:26.895 INFO:tasks.workunit.client.0.smithi139.stdout: create 167/39 file after the snapshot 2024-04-26T18:00:26.896 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/.snap/snap-subdir-test 2024-04-26T18:00:27.902 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/30 file after the snapshot 2024-04-26T18:00:27.902 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/31 file after the snapshot 2024-04-26T18:00:27.903 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/32 file after the snapshot 2024-04-26T18:00:27.904 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/33 file after the snapshot 2024-04-26T18:00:27.905 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/34 file after the snapshot 2024-04-26T18:00:27.906 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/35 file after the snapshot 2024-04-26T18:00:27.912 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/36 file after the snapshot 2024-04-26T18:00:27.921 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/37 file after the snapshot 2024-04-26T18:00:27.922 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/38 file after the snapshot 2024-04-26T18:00:27.923 INFO:tasks.workunit.client.0.smithi139.stdout: create 168/39 file after the snapshot 2024-04-26T18:00:27.924 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/.snap/snap-subdir-test 2024-04-26T18:00:27.936 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/30 file after the snapshot 2024-04-26T18:00:27.937 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/31 file after the snapshot 2024-04-26T18:00:27.938 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/32 file after the snapshot 2024-04-26T18:00:27.938 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/33 file after the snapshot 2024-04-26T18:00:27.939 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/34 file after the snapshot 2024-04-26T18:00:27.942 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/35 file after the snapshot 2024-04-26T18:00:27.951 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/36 file after the snapshot 2024-04-26T18:00:27.952 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/37 file after the snapshot 2024-04-26T18:00:27.953 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/38 file after the snapshot 2024-04-26T18:00:27.954 INFO:tasks.workunit.client.0.smithi139.stdout: create 169/39 file after the snapshot 2024-04-26T18:00:27.955 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/.snap/snap-subdir-test 2024-04-26T18:00:27.967 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/30 file after the snapshot 2024-04-26T18:00:27.968 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/31 file after the snapshot 2024-04-26T18:00:27.969 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/32 file after the snapshot 2024-04-26T18:00:27.970 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/33 file after the snapshot 2024-04-26T18:00:27.970 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/34 file after the snapshot 2024-04-26T18:00:27.971 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/35 file after the snapshot 2024-04-26T18:00:27.972 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/36 file after the snapshot 2024-04-26T18:00:27.973 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/37 file after the snapshot 2024-04-26T18:00:27.974 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/38 file after the snapshot 2024-04-26T18:00:27.975 INFO:tasks.workunit.client.0.smithi139.stdout: create 170/39 file after the snapshot 2024-04-26T18:00:27.975 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/.snap/snap-subdir-test 2024-04-26T18:00:27.987 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/30 file after the snapshot 2024-04-26T18:00:27.988 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/31 file after the snapshot 2024-04-26T18:00:27.988 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/32 file after the snapshot 2024-04-26T18:00:27.989 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/33 file after the snapshot 2024-04-26T18:00:27.990 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/34 file after the snapshot 2024-04-26T18:00:27.991 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/35 file after the snapshot 2024-04-26T18:00:27.992 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/36 file after the snapshot 2024-04-26T18:00:27.992 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/37 file after the snapshot 2024-04-26T18:00:27.993 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/38 file after the snapshot 2024-04-26T18:00:27.994 INFO:tasks.workunit.client.0.smithi139.stdout: create 171/39 file after the snapshot 2024-04-26T18:00:27.995 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/.snap/snap-subdir-test 2024-04-26T18:00:28.479 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/30 file after the snapshot 2024-04-26T18:00:28.481 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/31 file after the snapshot 2024-04-26T18:00:28.481 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/32 file after the snapshot 2024-04-26T18:00:28.485 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/33 file after the snapshot 2024-04-26T18:00:28.485 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/34 file after the snapshot 2024-04-26T18:00:28.485 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/35 file after the snapshot 2024-04-26T18:00:28.485 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/36 file after the snapshot 2024-04-26T18:00:28.485 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/37 file after the snapshot 2024-04-26T18:00:28.487 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/38 file after the snapshot 2024-04-26T18:00:28.487 INFO:tasks.workunit.client.0.smithi139.stdout: create 172/39 file after the snapshot 2024-04-26T18:00:28.493 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/.snap/snap-subdir-test 2024-04-26T18:00:28.505 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/30 file after the snapshot 2024-04-26T18:00:28.507 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/31 file after the snapshot 2024-04-26T18:00:28.507 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/32 file after the snapshot 2024-04-26T18:00:28.511 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/33 file after the snapshot 2024-04-26T18:00:28.511 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/34 file after the snapshot 2024-04-26T18:00:28.511 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/35 file after the snapshot 2024-04-26T18:00:28.511 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/36 file after the snapshot 2024-04-26T18:00:28.511 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/37 file after the snapshot 2024-04-26T18:00:28.513 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/38 file after the snapshot 2024-04-26T18:00:28.513 INFO:tasks.workunit.client.0.smithi139.stdout: create 173/39 file after the snapshot 2024-04-26T18:00:28.519 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/.snap/snap-subdir-test 2024-04-26T18:00:28.525 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/30 file after the snapshot 2024-04-26T18:00:28.526 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/31 file after the snapshot 2024-04-26T18:00:28.526 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/32 file after the snapshot 2024-04-26T18:00:28.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/33 file after the snapshot 2024-04-26T18:00:28.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/34 file after the snapshot 2024-04-26T18:00:28.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/35 file after the snapshot 2024-04-26T18:00:28.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/36 file after the snapshot 2024-04-26T18:00:28.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/37 file after the snapshot 2024-04-26T18:00:28.532 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/38 file after the snapshot 2024-04-26T18:00:28.533 INFO:tasks.workunit.client.0.smithi139.stdout: create 174/39 file after the snapshot 2024-04-26T18:00:28.533 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/.snap/snap-subdir-test 2024-04-26T18:00:28.544 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/30 file after the snapshot 2024-04-26T18:00:28.545 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/31 file after the snapshot 2024-04-26T18:00:28.545 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/32 file after the snapshot 2024-04-26T18:00:28.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/33 file after the snapshot 2024-04-26T18:00:28.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/34 file after the snapshot 2024-04-26T18:00:28.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/35 file after the snapshot 2024-04-26T18:00:28.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/36 file after the snapshot 2024-04-26T18:00:28.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/37 file after the snapshot 2024-04-26T18:00:28.551 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/38 file after the snapshot 2024-04-26T18:00:28.552 INFO:tasks.workunit.client.0.smithi139.stdout: create 175/39 file after the snapshot 2024-04-26T18:00:28.552 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/.snap/snap-subdir-test 2024-04-26T18:00:28.562 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/30 file after the snapshot 2024-04-26T18:00:28.563 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/31 file after the snapshot 2024-04-26T18:00:28.564 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/32 file after the snapshot 2024-04-26T18:00:28.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/33 file after the snapshot 2024-04-26T18:00:28.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/34 file after the snapshot 2024-04-26T18:00:28.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/35 file after the snapshot 2024-04-26T18:00:28.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/36 file after the snapshot 2024-04-26T18:00:28.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/37 file after the snapshot 2024-04-26T18:00:28.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/38 file after the snapshot 2024-04-26T18:00:28.570 INFO:tasks.workunit.client.0.smithi139.stdout: create 176/39 file after the snapshot 2024-04-26T18:00:28.570 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/.snap/snap-subdir-test 2024-04-26T18:00:28.583 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/30 file after the snapshot 2024-04-26T18:00:28.583 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/31 file after the snapshot 2024-04-26T18:00:28.583 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/32 file after the snapshot 2024-04-26T18:00:28.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/33 file after the snapshot 2024-04-26T18:00:28.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/34 file after the snapshot 2024-04-26T18:00:28.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/35 file after the snapshot 2024-04-26T18:00:28.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/36 file after the snapshot 2024-04-26T18:00:28.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/37 file after the snapshot 2024-04-26T18:00:28.587 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/38 file after the snapshot 2024-04-26T18:00:28.587 INFO:tasks.workunit.client.0.smithi139.stdout: create 177/39 file after the snapshot 2024-04-26T18:00:28.588 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/.snap/snap-subdir-test 2024-04-26T18:00:28.597 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/30 file after the snapshot 2024-04-26T18:00:28.599 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/31 file after the snapshot 2024-04-26T18:00:28.599 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/32 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/33 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/34 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/35 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/36 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/37 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/38 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 178/39 file after the snapshot 2024-04-26T18:00:28.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/.snap/snap-subdir-test 2024-04-26T18:00:28.615 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/30 file after the snapshot 2024-04-26T18:00:28.617 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/31 file after the snapshot 2024-04-26T18:00:28.617 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/32 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/33 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/34 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/35 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/36 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/37 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/38 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 179/39 file after the snapshot 2024-04-26T18:00:28.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/.snap/snap-subdir-test 2024-04-26T18:00:28.633 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/30 file after the snapshot 2024-04-26T18:00:28.635 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/31 file after the snapshot 2024-04-26T18:00:28.635 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/32 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/33 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/34 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/35 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/36 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/37 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/38 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 180/39 file after the snapshot 2024-04-26T18:00:28.643 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/.snap/snap-subdir-test 2024-04-26T18:00:28.651 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/30 file after the snapshot 2024-04-26T18:00:28.652 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/31 file after the snapshot 2024-04-26T18:00:28.652 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/32 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/33 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/34 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/35 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/36 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/37 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/38 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 181/39 file after the snapshot 2024-04-26T18:00:28.660 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/.snap/snap-subdir-test 2024-04-26T18:00:28.668 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/30 file after the snapshot 2024-04-26T18:00:28.669 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/31 file after the snapshot 2024-04-26T18:00:28.670 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/32 file after the snapshot 2024-04-26T18:00:28.670 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/33 file after the snapshot 2024-04-26T18:00:28.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/34 file after the snapshot 2024-04-26T18:00:28.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/35 file after the snapshot 2024-04-26T18:00:28.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/36 file after the snapshot 2024-04-26T18:00:28.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/37 file after the snapshot 2024-04-26T18:00:28.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/38 file after the snapshot 2024-04-26T18:00:28.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 182/39 file after the snapshot 2024-04-26T18:00:28.678 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/.snap/snap-subdir-test 2024-04-26T18:00:28.685 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/30 file after the snapshot 2024-04-26T18:00:28.687 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/31 file after the snapshot 2024-04-26T18:00:28.687 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/32 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/33 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/34 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/35 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/36 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/37 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/38 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 183/39 file after the snapshot 2024-04-26T18:00:28.694 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/.snap/snap-subdir-test 2024-04-26T18:00:28.702 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/30 file after the snapshot 2024-04-26T18:00:28.704 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/31 file after the snapshot 2024-04-26T18:00:28.704 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/32 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/33 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/34 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/35 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/36 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/37 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/38 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 184/39 file after the snapshot 2024-04-26T18:00:28.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/.snap/snap-subdir-test 2024-04-26T18:00:28.720 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/30 file after the snapshot 2024-04-26T18:00:28.722 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/31 file after the snapshot 2024-04-26T18:00:28.722 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/32 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/33 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/34 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/35 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/36 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/37 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/38 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 185/39 file after the snapshot 2024-04-26T18:00:28.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/.snap/snap-subdir-test 2024-04-26T18:00:28.738 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/30 file after the snapshot 2024-04-26T18:00:28.746 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/31 file after the snapshot 2024-04-26T18:00:29.122 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/32 file after the snapshot 2024-04-26T18:00:29.123 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/33 file after the snapshot 2024-04-26T18:00:29.502 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/34 file after the snapshot 2024-04-26T18:00:29.599 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/35 file after the snapshot 2024-04-26T18:00:29.600 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/36 file after the snapshot 2024-04-26T18:00:29.601 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/37 file after the snapshot 2024-04-26T18:00:29.602 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/38 file after the snapshot 2024-04-26T18:00:29.603 INFO:tasks.workunit.client.0.smithi139.stdout: create 186/39 file after the snapshot 2024-04-26T18:00:29.603 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/.snap/snap-subdir-test 2024-04-26T18:00:29.825 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/30 file after the snapshot 2024-04-26T18:00:29.827 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/31 file after the snapshot 2024-04-26T18:00:29.828 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/32 file after the snapshot 2024-04-26T18:00:29.830 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/33 file after the snapshot 2024-04-26T18:00:29.831 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/34 file after the snapshot 2024-04-26T18:00:29.833 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/35 file after the snapshot 2024-04-26T18:00:29.833 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/36 file after the snapshot 2024-04-26T18:00:29.834 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/37 file after the snapshot 2024-04-26T18:00:29.835 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/38 file after the snapshot 2024-04-26T18:00:29.836 INFO:tasks.workunit.client.0.smithi139.stdout: create 187/39 file after the snapshot 2024-04-26T18:00:29.837 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/.snap/snap-subdir-test 2024-04-26T18:00:30.359 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/30 file after the snapshot 2024-04-26T18:00:30.360 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/31 file after the snapshot 2024-04-26T18:00:30.361 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/32 file after the snapshot 2024-04-26T18:00:30.361 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/33 file after the snapshot 2024-04-26T18:00:30.362 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/34 file after the snapshot 2024-04-26T18:00:30.363 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/35 file after the snapshot 2024-04-26T18:00:30.364 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/36 file after the snapshot 2024-04-26T18:00:30.365 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/37 file after the snapshot 2024-04-26T18:00:30.366 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/38 file after the snapshot 2024-04-26T18:00:30.367 INFO:tasks.workunit.client.0.smithi139.stdout: create 188/39 file after the snapshot 2024-04-26T18:00:30.368 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/.snap/snap-subdir-test 2024-04-26T18:00:30.526 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/30 file after the snapshot 2024-04-26T18:00:30.527 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/31 file after the snapshot 2024-04-26T18:00:30.528 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/32 file after the snapshot 2024-04-26T18:00:30.529 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/33 file after the snapshot 2024-04-26T18:00:30.530 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/34 file after the snapshot 2024-04-26T18:00:30.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/35 file after the snapshot 2024-04-26T18:00:30.532 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/36 file after the snapshot 2024-04-26T18:00:30.532 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/37 file after the snapshot 2024-04-26T18:00:30.533 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/38 file after the snapshot 2024-04-26T18:00:30.534 INFO:tasks.workunit.client.0.smithi139.stdout: create 189/39 file after the snapshot 2024-04-26T18:00:30.535 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/.snap/snap-subdir-test 2024-04-26T18:00:30.546 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/30 file after the snapshot 2024-04-26T18:00:30.547 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/31 file after the snapshot 2024-04-26T18:00:30.548 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/32 file after the snapshot 2024-04-26T18:00:30.549 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/33 file after the snapshot 2024-04-26T18:00:30.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/34 file after the snapshot 2024-04-26T18:00:30.551 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/35 file after the snapshot 2024-04-26T18:00:30.552 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/36 file after the snapshot 2024-04-26T18:00:30.552 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/37 file after the snapshot 2024-04-26T18:00:30.553 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/38 file after the snapshot 2024-04-26T18:00:30.554 INFO:tasks.workunit.client.0.smithi139.stdout: create 190/39 file after the snapshot 2024-04-26T18:00:30.555 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/.snap/snap-subdir-test 2024-04-26T18:00:30.566 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/30 file after the snapshot 2024-04-26T18:00:30.567 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/31 file after the snapshot 2024-04-26T18:00:30.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/32 file after the snapshot 2024-04-26T18:00:30.569 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/33 file after the snapshot 2024-04-26T18:00:30.569 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/34 file after the snapshot 2024-04-26T18:00:30.570 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/35 file after the snapshot 2024-04-26T18:00:30.571 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/36 file after the snapshot 2024-04-26T18:00:30.572 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/37 file after the snapshot 2024-04-26T18:00:30.573 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/38 file after the snapshot 2024-04-26T18:00:30.574 INFO:tasks.workunit.client.0.smithi139.stdout: create 191/39 file after the snapshot 2024-04-26T18:00:30.574 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/.snap/snap-subdir-test 2024-04-26T18:00:30.584 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/30 file after the snapshot 2024-04-26T18:00:30.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/31 file after the snapshot 2024-04-26T18:00:30.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/32 file after the snapshot 2024-04-26T18:00:30.589 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/33 file after the snapshot 2024-04-26T18:00:30.589 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/34 file after the snapshot 2024-04-26T18:00:30.589 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/35 file after the snapshot 2024-04-26T18:00:30.593 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/36 file after the snapshot 2024-04-26T18:00:30.593 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/37 file after the snapshot 2024-04-26T18:00:30.594 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/38 file after the snapshot 2024-04-26T18:00:30.594 INFO:tasks.workunit.client.0.smithi139.stdout: create 192/39 file after the snapshot 2024-04-26T18:00:30.594 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/.snap/snap-subdir-test 2024-04-26T18:00:30.605 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/30 file after the snapshot 2024-04-26T18:00:30.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/31 file after the snapshot 2024-04-26T18:00:30.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/32 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/33 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/34 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/35 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/36 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/37 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/38 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 193/39 file after the snapshot 2024-04-26T18:00:30.614 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/.snap/snap-subdir-test 2024-04-26T18:00:30.623 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/30 file after the snapshot 2024-04-26T18:00:30.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/31 file after the snapshot 2024-04-26T18:00:30.625 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/32 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/33 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/34 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/35 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/36 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/37 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/38 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 194/39 file after the snapshot 2024-04-26T18:00:30.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/.snap/snap-subdir-test 2024-04-26T18:00:30.641 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/30 file after the snapshot 2024-04-26T18:00:30.642 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/31 file after the snapshot 2024-04-26T18:00:30.642 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/32 file after the snapshot 2024-04-26T18:00:30.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/33 file after the snapshot 2024-04-26T18:00:30.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/34 file after the snapshot 2024-04-26T18:00:30.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/35 file after the snapshot 2024-04-26T18:00:30.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/36 file after the snapshot 2024-04-26T18:00:30.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/37 file after the snapshot 2024-04-26T18:00:30.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/38 file after the snapshot 2024-04-26T18:00:31.033 INFO:tasks.workunit.client.0.smithi139.stdout: create 195/39 file after the snapshot 2024-04-26T18:00:31.033 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/.snap/snap-subdir-test 2024-04-26T18:00:31.046 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/30 file after the snapshot 2024-04-26T18:00:31.048 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/31 file after the snapshot 2024-04-26T18:00:31.048 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/32 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/33 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/34 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/35 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/36 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/37 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/38 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 196/39 file after the snapshot 2024-04-26T18:00:31.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/.snap/snap-subdir-test 2024-04-26T18:00:31.066 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/30 file after the snapshot 2024-04-26T18:00:31.068 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/31 file after the snapshot 2024-04-26T18:00:31.068 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/32 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/33 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/34 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/35 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/36 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/37 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/38 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 197/39 file after the snapshot 2024-04-26T18:00:31.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/.snap/snap-subdir-test 2024-04-26T18:00:31.086 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/30 file after the snapshot 2024-04-26T18:00:31.088 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/31 file after the snapshot 2024-04-26T18:00:31.088 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/32 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/33 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/34 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/35 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/36 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/37 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/38 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 198/39 file after the snapshot 2024-04-26T18:00:31.096 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/.snap/snap-subdir-test 2024-04-26T18:00:31.104 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/30 file after the snapshot 2024-04-26T18:00:31.105 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/31 file after the snapshot 2024-04-26T18:00:31.106 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/32 file after the snapshot 2024-04-26T18:00:31.106 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/33 file after the snapshot 2024-04-26T18:00:31.107 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/34 file after the snapshot 2024-04-26T18:00:31.108 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/35 file after the snapshot 2024-04-26T18:00:31.108 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/36 file after the snapshot 2024-04-26T18:00:31.109 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/37 file after the snapshot 2024-04-26T18:00:31.110 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/38 file after the snapshot 2024-04-26T18:00:31.111 INFO:tasks.workunit.client.0.smithi139.stdout: create 199/39 file after the snapshot 2024-04-26T18:00:31.111 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/.snap/snap-subdir-test 2024-04-26T18:00:31.121 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/30 file after the snapshot 2024-04-26T18:00:31.123 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/31 file after the snapshot 2024-04-26T18:00:31.123 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/32 file after the snapshot 2024-04-26T18:00:31.129 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/33 file after the snapshot 2024-04-26T18:00:31.129 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/34 file after the snapshot 2024-04-26T18:00:31.129 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/35 file after the snapshot 2024-04-26T18:00:31.129 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/36 file after the snapshot 2024-04-26T18:00:31.129 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/37 file after the snapshot 2024-04-26T18:00:31.129 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/38 file after the snapshot 2024-04-26T18:00:31.130 INFO:tasks.workunit.client.0.smithi139.stdout: create 200/39 file after the snapshot 2024-04-26T18:00:31.130 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/.snap/snap-subdir-test 2024-04-26T18:00:31.139 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/30 file after the snapshot 2024-04-26T18:00:31.140 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/31 file after the snapshot 2024-04-26T18:00:31.140 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/32 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/33 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/34 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/35 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/36 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/37 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/38 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 201/39 file after the snapshot 2024-04-26T18:00:31.148 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/.snap/snap-subdir-test 2024-04-26T18:00:31.156 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/30 file after the snapshot 2024-04-26T18:00:31.158 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/31 file after the snapshot 2024-04-26T18:00:31.158 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/32 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/33 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/34 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/35 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/36 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/37 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/38 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 202/39 file after the snapshot 2024-04-26T18:00:31.165 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/.snap/snap-subdir-test 2024-04-26T18:00:31.174 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/30 file after the snapshot 2024-04-26T18:00:31.175 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/31 file after the snapshot 2024-04-26T18:00:31.175 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/32 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/33 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/34 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/35 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/36 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/37 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/38 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 203/39 file after the snapshot 2024-04-26T18:00:31.183 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/.snap/snap-subdir-test 2024-04-26T18:00:31.191 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/30 file after the snapshot 2024-04-26T18:00:31.199 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/31 file after the snapshot 2024-04-26T18:00:31.200 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/32 file after the snapshot 2024-04-26T18:00:31.201 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/33 file after the snapshot 2024-04-26T18:00:31.202 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/34 file after the snapshot 2024-04-26T18:00:31.203 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/35 file after the snapshot 2024-04-26T18:00:31.204 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/36 file after the snapshot 2024-04-26T18:00:31.205 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/37 file after the snapshot 2024-04-26T18:00:31.206 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/38 file after the snapshot 2024-04-26T18:00:31.206 INFO:tasks.workunit.client.0.smithi139.stdout: create 204/39 file after the snapshot 2024-04-26T18:00:31.207 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/.snap/snap-subdir-test 2024-04-26T18:00:31.217 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/30 file after the snapshot 2024-04-26T18:00:31.219 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/31 file after the snapshot 2024-04-26T18:00:31.219 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/32 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/33 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/34 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/35 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/36 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/37 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/38 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 205/39 file after the snapshot 2024-04-26T18:00:31.226 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/.snap/snap-subdir-test 2024-04-26T18:00:31.234 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/30 file after the snapshot 2024-04-26T18:00:31.236 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/31 file after the snapshot 2024-04-26T18:00:31.236 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/32 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/33 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/34 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/35 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/36 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/37 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/38 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 206/39 file after the snapshot 2024-04-26T18:00:31.244 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/.snap/snap-subdir-test 2024-04-26T18:00:32.252 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/30 file after the snapshot 2024-04-26T18:00:32.253 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/31 file after the snapshot 2024-04-26T18:00:32.254 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/32 file after the snapshot 2024-04-26T18:00:32.255 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/33 file after the snapshot 2024-04-26T18:00:32.256 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/34 file after the snapshot 2024-04-26T18:00:32.257 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/35 file after the snapshot 2024-04-26T18:00:32.258 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/36 file after the snapshot 2024-04-26T18:00:32.259 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/37 file after the snapshot 2024-04-26T18:00:32.259 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/38 file after the snapshot 2024-04-26T18:00:32.260 INFO:tasks.workunit.client.0.smithi139.stdout: create 207/39 file after the snapshot 2024-04-26T18:00:32.261 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/.snap/snap-subdir-test 2024-04-26T18:00:32.274 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/30 file after the snapshot 2024-04-26T18:00:32.275 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/31 file after the snapshot 2024-04-26T18:00:32.277 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/32 file after the snapshot 2024-04-26T18:00:32.278 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/33 file after the snapshot 2024-04-26T18:00:32.279 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/34 file after the snapshot 2024-04-26T18:00:32.280 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/35 file after the snapshot 2024-04-26T18:00:32.282 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/36 file after the snapshot 2024-04-26T18:00:32.283 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/37 file after the snapshot 2024-04-26T18:00:32.285 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/38 file after the snapshot 2024-04-26T18:00:32.286 INFO:tasks.workunit.client.0.smithi139.stdout: create 208/39 file after the snapshot 2024-04-26T18:00:32.287 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/.snap/snap-subdir-test 2024-04-26T18:00:32.300 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/30 file after the snapshot 2024-04-26T18:00:32.301 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/31 file after the snapshot 2024-04-26T18:00:32.302 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/32 file after the snapshot 2024-04-26T18:00:32.303 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/33 file after the snapshot 2024-04-26T18:00:32.305 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/34 file after the snapshot 2024-04-26T18:00:32.306 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/35 file after the snapshot 2024-04-26T18:00:32.307 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/36 file after the snapshot 2024-04-26T18:00:32.309 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/37 file after the snapshot 2024-04-26T18:00:32.310 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/38 file after the snapshot 2024-04-26T18:00:32.311 INFO:tasks.workunit.client.0.smithi139.stdout: create 209/39 file after the snapshot 2024-04-26T18:00:32.313 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/.snap/snap-subdir-test 2024-04-26T18:00:32.325 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/30 file after the snapshot 2024-04-26T18:00:32.326 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/31 file after the snapshot 2024-04-26T18:00:32.327 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/32 file after the snapshot 2024-04-26T18:00:32.329 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/33 file after the snapshot 2024-04-26T18:00:32.330 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/34 file after the snapshot 2024-04-26T18:00:32.331 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/35 file after the snapshot 2024-04-26T18:00:32.332 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/36 file after the snapshot 2024-04-26T18:00:32.334 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/37 file after the snapshot 2024-04-26T18:00:32.335 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/38 file after the snapshot 2024-04-26T18:00:32.336 INFO:tasks.workunit.client.0.smithi139.stdout: create 210/39 file after the snapshot 2024-04-26T18:00:32.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/.snap/snap-subdir-test 2024-04-26T18:00:32.349 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/30 file after the snapshot 2024-04-26T18:00:32.351 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/31 file after the snapshot 2024-04-26T18:00:32.352 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/32 file after the snapshot 2024-04-26T18:00:32.353 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/33 file after the snapshot 2024-04-26T18:00:32.354 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/34 file after the snapshot 2024-04-26T18:00:32.356 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/35 file after the snapshot 2024-04-26T18:00:32.357 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/36 file after the snapshot 2024-04-26T18:00:32.358 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/37 file after the snapshot 2024-04-26T18:00:32.359 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/38 file after the snapshot 2024-04-26T18:00:32.361 INFO:tasks.workunit.client.0.smithi139.stdout: create 211/39 file after the snapshot 2024-04-26T18:00:32.362 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/.snap/snap-subdir-test 2024-04-26T18:00:32.373 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/30 file after the snapshot 2024-04-26T18:00:32.510 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/31 file after the snapshot 2024-04-26T18:00:33.287 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/32 file after the snapshot 2024-04-26T18:00:33.288 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/33 file after the snapshot 2024-04-26T18:00:33.289 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/34 file after the snapshot 2024-04-26T18:00:33.290 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/35 file after the snapshot 2024-04-26T18:00:33.291 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/36 file after the snapshot 2024-04-26T18:00:33.292 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/37 file after the snapshot 2024-04-26T18:00:33.294 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/38 file after the snapshot 2024-04-26T18:00:33.295 INFO:tasks.workunit.client.0.smithi139.stdout: create 212/39 file after the snapshot 2024-04-26T18:00:33.296 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/.snap/snap-subdir-test 2024-04-26T18:00:33.310 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/30 file after the snapshot 2024-04-26T18:00:33.312 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/31 file after the snapshot 2024-04-26T18:00:33.313 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/32 file after the snapshot 2024-04-26T18:00:33.314 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/33 file after the snapshot 2024-04-26T18:00:33.316 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/34 file after the snapshot 2024-04-26T18:00:33.317 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/35 file after the snapshot 2024-04-26T18:00:33.318 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/36 file after the snapshot 2024-04-26T18:00:33.320 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/37 file after the snapshot 2024-04-26T18:00:33.321 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/38 file after the snapshot 2024-04-26T18:00:33.322 INFO:tasks.workunit.client.0.smithi139.stdout: create 213/39 file after the snapshot 2024-04-26T18:00:33.324 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/.snap/snap-subdir-test 2024-04-26T18:00:33.335 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/30 file after the snapshot 2024-04-26T18:00:33.337 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/31 file after the snapshot 2024-04-26T18:00:33.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/32 file after the snapshot 2024-04-26T18:00:33.339 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/33 file after the snapshot 2024-04-26T18:00:33.341 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/34 file after the snapshot 2024-04-26T18:00:33.342 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/35 file after the snapshot 2024-04-26T18:00:33.343 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/36 file after the snapshot 2024-04-26T18:00:33.344 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/37 file after the snapshot 2024-04-26T18:00:33.346 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/38 file after the snapshot 2024-04-26T18:00:33.347 INFO:tasks.workunit.client.0.smithi139.stdout: create 214/39 file after the snapshot 2024-04-26T18:00:33.348 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/.snap/snap-subdir-test 2024-04-26T18:00:33.360 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/30 file after the snapshot 2024-04-26T18:00:33.361 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/31 file after the snapshot 2024-04-26T18:00:33.362 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/32 file after the snapshot 2024-04-26T18:00:33.364 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/33 file after the snapshot 2024-04-26T18:00:33.365 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/34 file after the snapshot 2024-04-26T18:00:33.375 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/35 file after the snapshot 2024-04-26T18:00:33.376 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/36 file after the snapshot 2024-04-26T18:00:33.377 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/37 file after the snapshot 2024-04-26T18:00:33.379 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/38 file after the snapshot 2024-04-26T18:00:33.380 INFO:tasks.workunit.client.0.smithi139.stdout: create 215/39 file after the snapshot 2024-04-26T18:00:33.382 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/.snap/snap-subdir-test 2024-04-26T18:00:33.393 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/30 file after the snapshot 2024-04-26T18:00:33.394 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/31 file after the snapshot 2024-04-26T18:00:33.396 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/32 file after the snapshot 2024-04-26T18:00:33.397 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/33 file after the snapshot 2024-04-26T18:00:33.398 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/34 file after the snapshot 2024-04-26T18:00:33.399 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/35 file after the snapshot 2024-04-26T18:00:33.401 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/36 file after the snapshot 2024-04-26T18:00:33.402 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/37 file after the snapshot 2024-04-26T18:00:33.403 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/38 file after the snapshot 2024-04-26T18:00:33.408 INFO:tasks.workunit.client.0.smithi139.stdout: create 216/39 file after the snapshot 2024-04-26T18:00:33.409 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/.snap/snap-subdir-test 2024-04-26T18:00:33.543 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/30 file after the snapshot 2024-04-26T18:00:33.969 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/31 file after the snapshot 2024-04-26T18:00:33.970 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/32 file after the snapshot 2024-04-26T18:00:33.971 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/33 file after the snapshot 2024-04-26T18:00:33.972 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/34 file after the snapshot 2024-04-26T18:00:33.973 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/35 file after the snapshot 2024-04-26T18:00:33.974 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/36 file after the snapshot 2024-04-26T18:00:33.975 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/37 file after the snapshot 2024-04-26T18:00:33.976 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/38 file after the snapshot 2024-04-26T18:00:33.977 INFO:tasks.workunit.client.0.smithi139.stdout: create 217/39 file after the snapshot 2024-04-26T18:00:33.978 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/.snap/snap-subdir-test 2024-04-26T18:00:33.991 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/30 file after the snapshot 2024-04-26T18:00:33.997 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/31 file after the snapshot 2024-04-26T18:00:34.006 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/32 file after the snapshot 2024-04-26T18:00:34.007 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/33 file after the snapshot 2024-04-26T18:00:34.008 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/34 file after the snapshot 2024-04-26T18:00:34.009 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/35 file after the snapshot 2024-04-26T18:00:34.010 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/36 file after the snapshot 2024-04-26T18:00:34.011 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/37 file after the snapshot 2024-04-26T18:00:34.012 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/38 file after the snapshot 2024-04-26T18:00:34.013 INFO:tasks.workunit.client.0.smithi139.stdout: create 218/39 file after the snapshot 2024-04-26T18:00:34.014 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/.snap/snap-subdir-test 2024-04-26T18:00:34.025 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/30 file after the snapshot 2024-04-26T18:00:34.026 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/31 file after the snapshot 2024-04-26T18:00:34.027 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/32 file after the snapshot 2024-04-26T18:00:34.028 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/33 file after the snapshot 2024-04-26T18:00:34.029 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/34 file after the snapshot 2024-04-26T18:00:34.030 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/35 file after the snapshot 2024-04-26T18:00:34.030 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/36 file after the snapshot 2024-04-26T18:00:34.031 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/37 file after the snapshot 2024-04-26T18:00:34.032 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/38 file after the snapshot 2024-04-26T18:00:34.033 INFO:tasks.workunit.client.0.smithi139.stdout: create 219/39 file after the snapshot 2024-04-26T18:00:34.494 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/.snap/snap-subdir-test 2024-04-26T18:00:35.022 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/30 file after the snapshot 2024-04-26T18:00:35.028 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/31 file after the snapshot 2024-04-26T18:00:35.037 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/32 file after the snapshot 2024-04-26T18:00:35.037 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/33 file after the snapshot 2024-04-26T18:00:35.039 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/34 file after the snapshot 2024-04-26T18:00:35.040 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/35 file after the snapshot 2024-04-26T18:00:35.041 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/36 file after the snapshot 2024-04-26T18:00:35.042 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/37 file after the snapshot 2024-04-26T18:00:35.043 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/38 file after the snapshot 2024-04-26T18:00:35.044 INFO:tasks.workunit.client.0.smithi139.stdout: create 220/39 file after the snapshot 2024-04-26T18:00:35.045 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/.snap/snap-subdir-test 2024-04-26T18:00:35.057 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/30 file after the snapshot 2024-04-26T18:00:35.058 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/31 file after the snapshot 2024-04-26T18:00:35.059 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/32 file after the snapshot 2024-04-26T18:00:35.060 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/33 file after the snapshot 2024-04-26T18:00:35.061 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/34 file after the snapshot 2024-04-26T18:00:35.062 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/35 file after the snapshot 2024-04-26T18:00:35.063 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/36 file after the snapshot 2024-04-26T18:00:35.064 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/37 file after the snapshot 2024-04-26T18:00:35.064 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/38 file after the snapshot 2024-04-26T18:00:35.065 INFO:tasks.workunit.client.0.smithi139.stdout: create 221/39 file after the snapshot 2024-04-26T18:00:35.066 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/.snap/snap-subdir-test 2024-04-26T18:00:35.286 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/30 file after the snapshot 2024-04-26T18:00:35.287 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/31 file after the snapshot 2024-04-26T18:00:35.288 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/32 file after the snapshot 2024-04-26T18:00:35.289 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/33 file after the snapshot 2024-04-26T18:00:35.290 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/34 file after the snapshot 2024-04-26T18:00:35.291 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/35 file after the snapshot 2024-04-26T18:00:35.292 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/36 file after the snapshot 2024-04-26T18:00:35.293 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/37 file after the snapshot 2024-04-26T18:00:35.294 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/38 file after the snapshot 2024-04-26T18:00:35.295 INFO:tasks.workunit.client.0.smithi139.stdout: create 222/39 file after the snapshot 2024-04-26T18:00:35.296 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/.snap/snap-subdir-test 2024-04-26T18:00:35.308 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/30 file after the snapshot 2024-04-26T18:00:35.316 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/31 file after the snapshot 2024-04-26T18:00:35.317 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/32 file after the snapshot 2024-04-26T18:00:35.318 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/33 file after the snapshot 2024-04-26T18:00:35.319 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/34 file after the snapshot 2024-04-26T18:00:35.320 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/35 file after the snapshot 2024-04-26T18:00:35.321 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/36 file after the snapshot 2024-04-26T18:00:35.323 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/37 file after the snapshot 2024-04-26T18:00:35.324 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/38 file after the snapshot 2024-04-26T18:00:35.325 INFO:tasks.workunit.client.0.smithi139.stdout: create 223/39 file after the snapshot 2024-04-26T18:00:35.326 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/.snap/snap-subdir-test 2024-04-26T18:00:35.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/30 file after the snapshot 2024-04-26T18:00:35.339 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/31 file after the snapshot 2024-04-26T18:00:35.340 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/32 file after the snapshot 2024-04-26T18:00:35.341 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/33 file after the snapshot 2024-04-26T18:00:35.342 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/34 file after the snapshot 2024-04-26T18:00:35.343 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/35 file after the snapshot 2024-04-26T18:00:35.346 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/36 file after the snapshot 2024-04-26T18:00:35.347 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/37 file after the snapshot 2024-04-26T18:00:35.348 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/38 file after the snapshot 2024-04-26T18:00:35.349 INFO:tasks.workunit.client.0.smithi139.stdout: create 224/39 file after the snapshot 2024-04-26T18:00:35.350 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/.snap/snap-subdir-test 2024-04-26T18:00:35.362 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/30 file after the snapshot 2024-04-26T18:00:35.363 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/31 file after the snapshot 2024-04-26T18:00:35.364 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/32 file after the snapshot 2024-04-26T18:00:35.364 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/33 file after the snapshot 2024-04-26T18:00:35.365 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/34 file after the snapshot 2024-04-26T18:00:35.366 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/35 file after the snapshot 2024-04-26T18:00:35.368 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/36 file after the snapshot 2024-04-26T18:00:35.368 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/37 file after the snapshot 2024-04-26T18:00:35.369 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/38 file after the snapshot 2024-04-26T18:00:35.369 INFO:tasks.workunit.client.0.smithi139.stdout: create 225/39 file after the snapshot 2024-04-26T18:00:35.370 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/.snap/snap-subdir-test 2024-04-26T18:00:35.527 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/30 file after the snapshot 2024-04-26T18:00:35.567 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:35.571 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:36.029 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/31 file after the snapshot 2024-04-26T18:00:36.030 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/32 file after the snapshot 2024-04-26T18:00:36.031 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/33 file after the snapshot 2024-04-26T18:00:36.032 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/34 file after the snapshot 2024-04-26T18:00:36.033 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/35 file after the snapshot 2024-04-26T18:00:36.034 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/36 file after the snapshot 2024-04-26T18:00:36.035 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/37 file after the snapshot 2024-04-26T18:00:36.036 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/38 file after the snapshot 2024-04-26T18:00:36.037 INFO:tasks.workunit.client.0.smithi139.stdout: create 226/39 file after the snapshot 2024-04-26T18:00:36.039 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/.snap/snap-subdir-test 2024-04-26T18:00:36.053 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/30 file after the snapshot 2024-04-26T18:00:36.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/31 file after the snapshot 2024-04-26T18:00:36.056 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/32 file after the snapshot 2024-04-26T18:00:36.056 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/33 file after the snapshot 2024-04-26T18:00:36.057 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/34 file after the snapshot 2024-04-26T18:00:36.058 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/35 file after the snapshot 2024-04-26T18:00:36.059 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/36 file after the snapshot 2024-04-26T18:00:36.060 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/37 file after the snapshot 2024-04-26T18:00:36.061 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/38 file after the snapshot 2024-04-26T18:00:36.062 INFO:tasks.workunit.client.0.smithi139.stdout: create 227/39 file after the snapshot 2024-04-26T18:00:36.063 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/.snap/snap-subdir-test 2024-04-26T18:00:36.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/30 file after the snapshot 2024-04-26T18:00:36.077 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/31 file after the snapshot 2024-04-26T18:00:36.077 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/32 file after the snapshot 2024-04-26T18:00:36.084 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/33 file after the snapshot 2024-04-26T18:00:36.085 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/34 file after the snapshot 2024-04-26T18:00:36.086 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/35 file after the snapshot 2024-04-26T18:00:36.087 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/36 file after the snapshot 2024-04-26T18:00:36.088 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/37 file after the snapshot 2024-04-26T18:00:36.089 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/38 file after the snapshot 2024-04-26T18:00:36.090 INFO:tasks.workunit.client.0.smithi139.stdout: create 228/39 file after the snapshot 2024-04-26T18:00:36.091 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/.snap/snap-subdir-test 2024-04-26T18:00:36.479 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/30 file after the snapshot 2024-04-26T18:00:36.479 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/31 file after the snapshot 2024-04-26T18:00:36.480 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/32 file after the snapshot 2024-04-26T18:00:36.481 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/33 file after the snapshot 2024-04-26T18:00:36.482 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/34 file after the snapshot 2024-04-26T18:00:36.858 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/35 file after the snapshot 2024-04-26T18:00:36.859 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/36 file after the snapshot 2024-04-26T18:00:36.860 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/37 file after the snapshot 2024-04-26T18:00:36.861 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/38 file after the snapshot 2024-04-26T18:00:36.862 INFO:tasks.workunit.client.0.smithi139.stdout: create 229/39 file after the snapshot 2024-04-26T18:00:36.864 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/.snap/snap-subdir-test 2024-04-26T18:00:36.878 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/30 file after the snapshot 2024-04-26T18:00:36.879 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/31 file after the snapshot 2024-04-26T18:00:36.880 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/32 file after the snapshot 2024-04-26T18:00:36.881 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/33 file after the snapshot 2024-04-26T18:00:36.882 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/34 file after the snapshot 2024-04-26T18:00:36.883 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/35 file after the snapshot 2024-04-26T18:00:36.884 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/36 file after the snapshot 2024-04-26T18:00:36.885 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/37 file after the snapshot 2024-04-26T18:00:36.885 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/38 file after the snapshot 2024-04-26T18:00:36.886 INFO:tasks.workunit.client.0.smithi139.stdout: create 230/39 file after the snapshot 2024-04-26T18:00:36.887 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/.snap/snap-subdir-test 2024-04-26T18:00:37.503 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/30 file after the snapshot 2024-04-26T18:00:37.504 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/31 file after the snapshot 2024-04-26T18:00:37.505 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/32 file after the snapshot 2024-04-26T18:00:37.506 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/33 file after the snapshot 2024-04-26T18:00:37.511 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/34 file after the snapshot 2024-04-26T18:00:37.512 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/35 file after the snapshot 2024-04-26T18:00:37.513 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/36 file after the snapshot 2024-04-26T18:00:37.514 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/37 file after the snapshot 2024-04-26T18:00:37.515 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/38 file after the snapshot 2024-04-26T18:00:37.516 INFO:tasks.workunit.client.0.smithi139.stdout: create 231/39 file after the snapshot 2024-04-26T18:00:37.517 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/.snap/snap-subdir-test 2024-04-26T18:00:37.534 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/30 file after the snapshot 2024-04-26T18:00:37.542 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/31 file after the snapshot 2024-04-26T18:00:37.543 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/32 file after the snapshot 2024-04-26T18:00:37.544 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/33 file after the snapshot 2024-04-26T18:00:37.545 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/34 file after the snapshot 2024-04-26T18:00:37.546 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/35 file after the snapshot 2024-04-26T18:00:37.547 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/36 file after the snapshot 2024-04-26T18:00:37.548 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/37 file after the snapshot 2024-04-26T18:00:37.549 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/38 file after the snapshot 2024-04-26T18:00:37.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 232/39 file after the snapshot 2024-04-26T18:00:37.551 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/.snap/snap-subdir-test 2024-04-26T18:00:37.758 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/30 file after the snapshot 2024-04-26T18:00:37.760 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/31 file after the snapshot 2024-04-26T18:00:37.768 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/32 file after the snapshot 2024-04-26T18:00:37.768 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/33 file after the snapshot 2024-04-26T18:00:37.769 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/34 file after the snapshot 2024-04-26T18:00:37.770 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/35 file after the snapshot 2024-04-26T18:00:37.771 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/36 file after the snapshot 2024-04-26T18:00:37.772 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/37 file after the snapshot 2024-04-26T18:00:37.773 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/38 file after the snapshot 2024-04-26T18:00:37.774 INFO:tasks.workunit.client.0.smithi139.stdout: create 233/39 file after the snapshot 2024-04-26T18:00:37.775 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/.snap/snap-subdir-test 2024-04-26T18:00:37.789 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/30 file after the snapshot 2024-04-26T18:00:37.790 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/31 file after the snapshot 2024-04-26T18:00:37.791 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/32 file after the snapshot 2024-04-26T18:00:37.792 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/33 file after the snapshot 2024-04-26T18:00:37.793 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/34 file after the snapshot 2024-04-26T18:00:37.793 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/35 file after the snapshot 2024-04-26T18:00:37.794 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/36 file after the snapshot 2024-04-26T18:00:37.795 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/37 file after the snapshot 2024-04-26T18:00:37.796 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/38 file after the snapshot 2024-04-26T18:00:37.797 INFO:tasks.workunit.client.0.smithi139.stdout: create 234/39 file after the snapshot 2024-04-26T18:00:37.798 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/.snap/snap-subdir-test 2024-04-26T18:00:37.809 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/30 file after the snapshot 2024-04-26T18:00:37.810 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/31 file after the snapshot 2024-04-26T18:00:37.811 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/32 file after the snapshot 2024-04-26T18:00:37.812 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/33 file after the snapshot 2024-04-26T18:00:37.813 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/34 file after the snapshot 2024-04-26T18:00:37.814 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/35 file after the snapshot 2024-04-26T18:00:37.814 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/36 file after the snapshot 2024-04-26T18:00:37.815 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/37 file after the snapshot 2024-04-26T18:00:37.816 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/38 file after the snapshot 2024-04-26T18:00:37.817 INFO:tasks.workunit.client.0.smithi139.stdout: create 235/39 file after the snapshot 2024-04-26T18:00:37.818 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/.snap/snap-subdir-test 2024-04-26T18:00:37.829 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/30 file after the snapshot 2024-04-26T18:00:37.830 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/31 file after the snapshot 2024-04-26T18:00:37.831 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/32 file after the snapshot 2024-04-26T18:00:37.832 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/33 file after the snapshot 2024-04-26T18:00:37.833 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/34 file after the snapshot 2024-04-26T18:00:37.833 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/35 file after the snapshot 2024-04-26T18:00:37.834 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/36 file after the snapshot 2024-04-26T18:00:37.835 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/37 file after the snapshot 2024-04-26T18:00:37.836 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/38 file after the snapshot 2024-04-26T18:00:37.837 INFO:tasks.workunit.client.0.smithi139.stdout: create 236/39 file after the snapshot 2024-04-26T18:00:37.838 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/.snap/snap-subdir-test 2024-04-26T18:00:37.849 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/30 file after the snapshot 2024-04-26T18:00:37.850 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/31 file after the snapshot 2024-04-26T18:00:37.850 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/32 file after the snapshot 2024-04-26T18:00:37.851 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/33 file after the snapshot 2024-04-26T18:00:37.852 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/34 file after the snapshot 2024-04-26T18:00:37.853 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/35 file after the snapshot 2024-04-26T18:00:37.854 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/36 file after the snapshot 2024-04-26T18:00:37.854 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/37 file after the snapshot 2024-04-26T18:00:37.855 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/38 file after the snapshot 2024-04-26T18:00:37.856 INFO:tasks.workunit.client.0.smithi139.stdout: create 237/39 file after the snapshot 2024-04-26T18:00:37.857 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/.snap/snap-subdir-test 2024-04-26T18:00:37.867 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/30 file after the snapshot 2024-04-26T18:00:37.868 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/31 file after the snapshot 2024-04-26T18:00:37.869 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/32 file after the snapshot 2024-04-26T18:00:37.870 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/33 file after the snapshot 2024-04-26T18:00:37.871 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/34 file after the snapshot 2024-04-26T18:00:37.871 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/35 file after the snapshot 2024-04-26T18:00:37.872 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/36 file after the snapshot 2024-04-26T18:00:37.873 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/37 file after the snapshot 2024-04-26T18:00:37.874 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/38 file after the snapshot 2024-04-26T18:00:37.875 INFO:tasks.workunit.client.0.smithi139.stdout: create 238/39 file after the snapshot 2024-04-26T18:00:37.875 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/.snap/snap-subdir-test 2024-04-26T18:00:37.886 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/30 file after the snapshot 2024-04-26T18:00:37.887 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/31 file after the snapshot 2024-04-26T18:00:37.887 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/32 file after the snapshot 2024-04-26T18:00:37.888 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/33 file after the snapshot 2024-04-26T18:00:37.889 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/34 file after the snapshot 2024-04-26T18:00:37.890 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/35 file after the snapshot 2024-04-26T18:00:37.891 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/36 file after the snapshot 2024-04-26T18:00:37.891 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/37 file after the snapshot 2024-04-26T18:00:37.892 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/38 file after the snapshot 2024-04-26T18:00:37.893 INFO:tasks.workunit.client.0.smithi139.stdout: create 239/39 file after the snapshot 2024-04-26T18:00:37.894 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/.snap/snap-subdir-test 2024-04-26T18:00:37.904 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/30 file after the snapshot 2024-04-26T18:00:37.905 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/31 file after the snapshot 2024-04-26T18:00:37.906 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/32 file after the snapshot 2024-04-26T18:00:37.906 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/33 file after the snapshot 2024-04-26T18:00:37.907 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/34 file after the snapshot 2024-04-26T18:00:37.908 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/35 file after the snapshot 2024-04-26T18:00:37.909 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/36 file after the snapshot 2024-04-26T18:00:37.909 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/37 file after the snapshot 2024-04-26T18:00:37.910 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/38 file after the snapshot 2024-04-26T18:00:37.911 INFO:tasks.workunit.client.0.smithi139.stdout: create 240/39 file after the snapshot 2024-04-26T18:00:37.911 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/.snap/snap-subdir-test 2024-04-26T18:00:37.922 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/30 file after the snapshot 2024-04-26T18:00:37.922 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/31 file after the snapshot 2024-04-26T18:00:37.923 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/32 file after the snapshot 2024-04-26T18:00:37.924 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/33 file after the snapshot 2024-04-26T18:00:37.925 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/34 file after the snapshot 2024-04-26T18:00:37.925 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/35 file after the snapshot 2024-04-26T18:00:37.926 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/36 file after the snapshot 2024-04-26T18:00:37.927 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/37 file after the snapshot 2024-04-26T18:00:37.928 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/38 file after the snapshot 2024-04-26T18:00:37.929 INFO:tasks.workunit.client.0.smithi139.stdout: create 241/39 file after the snapshot 2024-04-26T18:00:37.930 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/.snap/snap-subdir-test 2024-04-26T18:00:37.939 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/30 file after the snapshot 2024-04-26T18:00:37.940 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/31 file after the snapshot 2024-04-26T18:00:37.941 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/32 file after the snapshot 2024-04-26T18:00:37.942 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/33 file after the snapshot 2024-04-26T18:00:37.942 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/34 file after the snapshot 2024-04-26T18:00:37.943 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/35 file after the snapshot 2024-04-26T18:00:37.944 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/36 file after the snapshot 2024-04-26T18:00:37.945 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/37 file after the snapshot 2024-04-26T18:00:37.946 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/38 file after the snapshot 2024-04-26T18:00:37.946 INFO:tasks.workunit.client.0.smithi139.stdout: create 242/39 file after the snapshot 2024-04-26T18:00:37.947 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/.snap/snap-subdir-test 2024-04-26T18:00:37.957 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/30 file after the snapshot 2024-04-26T18:00:37.958 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/31 file after the snapshot 2024-04-26T18:00:37.959 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/32 file after the snapshot 2024-04-26T18:00:37.959 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/33 file after the snapshot 2024-04-26T18:00:37.960 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/34 file after the snapshot 2024-04-26T18:00:37.961 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/35 file after the snapshot 2024-04-26T18:00:37.962 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/36 file after the snapshot 2024-04-26T18:00:37.962 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/37 file after the snapshot 2024-04-26T18:00:37.963 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/38 file after the snapshot 2024-04-26T18:00:37.964 INFO:tasks.workunit.client.0.smithi139.stdout: create 243/39 file after the snapshot 2024-04-26T18:00:37.965 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/.snap/snap-subdir-test 2024-04-26T18:00:37.975 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/30 file after the snapshot 2024-04-26T18:00:37.975 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/31 file after the snapshot 2024-04-26T18:00:37.976 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/32 file after the snapshot 2024-04-26T18:00:37.977 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/33 file after the snapshot 2024-04-26T18:00:37.978 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/34 file after the snapshot 2024-04-26T18:00:37.978 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/35 file after the snapshot 2024-04-26T18:00:37.979 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/36 file after the snapshot 2024-04-26T18:00:37.980 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/37 file after the snapshot 2024-04-26T18:00:37.981 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/38 file after the snapshot 2024-04-26T18:00:37.981 INFO:tasks.workunit.client.0.smithi139.stdout: create 244/39 file after the snapshot 2024-04-26T18:00:37.982 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/.snap/snap-subdir-test 2024-04-26T18:00:38.473 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/30 file after the snapshot 2024-04-26T18:00:38.474 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/31 file after the snapshot 2024-04-26T18:00:38.475 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/32 file after the snapshot 2024-04-26T18:00:38.476 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/33 file after the snapshot 2024-04-26T18:00:38.477 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/34 file after the snapshot 2024-04-26T18:00:38.478 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/35 file after the snapshot 2024-04-26T18:00:38.479 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/36 file after the snapshot 2024-04-26T18:00:38.479 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/37 file after the snapshot 2024-04-26T18:00:38.480 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/38 file after the snapshot 2024-04-26T18:00:38.481 INFO:tasks.workunit.client.0.smithi139.stdout: create 245/39 file after the snapshot 2024-04-26T18:00:38.482 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/.snap/snap-subdir-test 2024-04-26T18:00:38.496 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/30 file after the snapshot 2024-04-26T18:00:38.497 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/31 file after the snapshot 2024-04-26T18:00:38.497 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/32 file after the snapshot 2024-04-26T18:00:38.498 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/33 file after the snapshot 2024-04-26T18:00:38.499 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/34 file after the snapshot 2024-04-26T18:00:38.500 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/35 file after the snapshot 2024-04-26T18:00:38.500 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/36 file after the snapshot 2024-04-26T18:00:38.501 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/37 file after the snapshot 2024-04-26T18:00:38.502 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/38 file after the snapshot 2024-04-26T18:00:38.503 INFO:tasks.workunit.client.0.smithi139.stdout: create 246/39 file after the snapshot 2024-04-26T18:00:38.503 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/.snap/snap-subdir-test 2024-04-26T18:00:38.517 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/30 file after the snapshot 2024-04-26T18:00:38.518 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/31 file after the snapshot 2024-04-26T18:00:38.519 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/32 file after the snapshot 2024-04-26T18:00:38.520 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/33 file after the snapshot 2024-04-26T18:00:38.520 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/34 file after the snapshot 2024-04-26T18:00:38.521 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/35 file after the snapshot 2024-04-26T18:00:38.522 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/36 file after the snapshot 2024-04-26T18:00:38.523 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/37 file after the snapshot 2024-04-26T18:00:38.523 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/38 file after the snapshot 2024-04-26T18:00:38.524 INFO:tasks.workunit.client.0.smithi139.stdout: create 247/39 file after the snapshot 2024-04-26T18:00:38.525 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/.snap/snap-subdir-test 2024-04-26T18:00:38.539 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/30 file after the snapshot 2024-04-26T18:00:38.540 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/31 file after the snapshot 2024-04-26T18:00:38.541 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/32 file after the snapshot 2024-04-26T18:00:38.541 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/33 file after the snapshot 2024-04-26T18:00:38.542 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/34 file after the snapshot 2024-04-26T18:00:38.543 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/35 file after the snapshot 2024-04-26T18:00:38.544 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/36 file after the snapshot 2024-04-26T18:00:38.544 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/37 file after the snapshot 2024-04-26T18:00:38.545 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/38 file after the snapshot 2024-04-26T18:00:38.546 INFO:tasks.workunit.client.0.smithi139.stdout: create 248/39 file after the snapshot 2024-04-26T18:00:38.807 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/.snap/snap-subdir-test 2024-04-26T18:00:38.820 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/30 file after the snapshot 2024-04-26T18:00:38.821 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/31 file after the snapshot 2024-04-26T18:00:38.822 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/32 file after the snapshot 2024-04-26T18:00:38.823 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/33 file after the snapshot 2024-04-26T18:00:38.824 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/34 file after the snapshot 2024-04-26T18:00:38.824 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/35 file after the snapshot 2024-04-26T18:00:38.825 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/36 file after the snapshot 2024-04-26T18:00:38.826 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/37 file after the snapshot 2024-04-26T18:00:38.827 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/38 file after the snapshot 2024-04-26T18:00:38.828 INFO:tasks.workunit.client.0.smithi139.stdout: create 249/39 file after the snapshot 2024-04-26T18:00:38.828 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/.snap/snap-subdir-test 2024-04-26T18:00:38.839 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/30 file after the snapshot 2024-04-26T18:00:38.840 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/31 file after the snapshot 2024-04-26T18:00:38.841 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/32 file after the snapshot 2024-04-26T18:00:38.842 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/33 file after the snapshot 2024-04-26T18:00:38.843 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/34 file after the snapshot 2024-04-26T18:00:38.843 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/35 file after the snapshot 2024-04-26T18:00:38.844 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/36 file after the snapshot 2024-04-26T18:00:38.845 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/37 file after the snapshot 2024-04-26T18:00:38.846 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/38 file after the snapshot 2024-04-26T18:00:38.847 INFO:tasks.workunit.client.0.smithi139.stdout: create 250/39 file after the snapshot 2024-04-26T18:00:38.847 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/.snap/snap-subdir-test 2024-04-26T18:00:38.859 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/30 file after the snapshot 2024-04-26T18:00:38.860 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/31 file after the snapshot 2024-04-26T18:00:38.860 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/32 file after the snapshot 2024-04-26T18:00:38.861 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/33 file after the snapshot 2024-04-26T18:00:38.862 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/34 file after the snapshot 2024-04-26T18:00:38.863 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/35 file after the snapshot 2024-04-26T18:00:38.863 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/36 file after the snapshot 2024-04-26T18:00:38.864 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/37 file after the snapshot 2024-04-26T18:00:38.865 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/38 file after the snapshot 2024-04-26T18:00:38.866 INFO:tasks.workunit.client.0.smithi139.stdout: create 251/39 file after the snapshot 2024-04-26T18:00:38.866 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/.snap/snap-subdir-test 2024-04-26T18:00:38.885 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/30 file after the snapshot 2024-04-26T18:00:38.886 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/31 file after the snapshot 2024-04-26T18:00:38.887 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/32 file after the snapshot 2024-04-26T18:00:38.887 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/33 file after the snapshot 2024-04-26T18:00:38.888 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/34 file after the snapshot 2024-04-26T18:00:38.889 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/35 file after the snapshot 2024-04-26T18:00:38.890 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/36 file after the snapshot 2024-04-26T18:00:38.891 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/37 file after the snapshot 2024-04-26T18:00:38.891 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/38 file after the snapshot 2024-04-26T18:00:38.892 INFO:tasks.workunit.client.0.smithi139.stdout: create 252/39 file after the snapshot 2024-04-26T18:00:38.893 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/.snap/snap-subdir-test 2024-04-26T18:00:38.904 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/30 file after the snapshot 2024-04-26T18:00:38.905 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/31 file after the snapshot 2024-04-26T18:00:38.905 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/32 file after the snapshot 2024-04-26T18:00:38.906 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/33 file after the snapshot 2024-04-26T18:00:38.907 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/34 file after the snapshot 2024-04-26T18:00:38.908 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/35 file after the snapshot 2024-04-26T18:00:38.908 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/36 file after the snapshot 2024-04-26T18:00:38.909 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/37 file after the snapshot 2024-04-26T18:00:38.910 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/38 file after the snapshot 2024-04-26T18:00:38.911 INFO:tasks.workunit.client.0.smithi139.stdout: create 253/39 file after the snapshot 2024-04-26T18:00:38.911 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/.snap/snap-subdir-test 2024-04-26T18:00:38.923 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/30 file after the snapshot 2024-04-26T18:00:38.924 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/31 file after the snapshot 2024-04-26T18:00:38.925 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/32 file after the snapshot 2024-04-26T18:00:38.925 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/33 file after the snapshot 2024-04-26T18:00:38.926 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/34 file after the snapshot 2024-04-26T18:00:38.927 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/35 file after the snapshot 2024-04-26T18:00:38.927 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/36 file after the snapshot 2024-04-26T18:00:38.928 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/37 file after the snapshot 2024-04-26T18:00:38.929 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/38 file after the snapshot 2024-04-26T18:00:38.930 INFO:tasks.workunit.client.0.smithi139.stdout: create 254/39 file after the snapshot 2024-04-26T18:00:38.930 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/.snap/snap-subdir-test 2024-04-26T18:00:38.942 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/30 file after the snapshot 2024-04-26T18:00:38.942 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/31 file after the snapshot 2024-04-26T18:00:38.943 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/32 file after the snapshot 2024-04-26T18:00:38.944 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/33 file after the snapshot 2024-04-26T18:00:38.945 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/34 file after the snapshot 2024-04-26T18:00:38.945 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/35 file after the snapshot 2024-04-26T18:00:38.946 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/36 file after the snapshot 2024-04-26T18:00:38.947 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/37 file after the snapshot 2024-04-26T18:00:38.947 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/38 file after the snapshot 2024-04-26T18:00:38.948 INFO:tasks.workunit.client.0.smithi139.stdout: create 255/39 file after the snapshot 2024-04-26T18:00:38.949 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/.snap/snap-subdir-test 2024-04-26T18:00:38.960 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/30 file after the snapshot 2024-04-26T18:00:38.961 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/31 file after the snapshot 2024-04-26T18:00:38.962 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/32 file after the snapshot 2024-04-26T18:00:38.962 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/33 file after the snapshot 2024-04-26T18:00:38.963 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/34 file after the snapshot 2024-04-26T18:00:38.964 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/35 file after the snapshot 2024-04-26T18:00:38.964 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/36 file after the snapshot 2024-04-26T18:00:38.965 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/37 file after the snapshot 2024-04-26T18:00:38.966 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/38 file after the snapshot 2024-04-26T18:00:38.967 INFO:tasks.workunit.client.0.smithi139.stdout: create 256/39 file after the snapshot 2024-04-26T18:00:38.968 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/.snap/snap-subdir-test 2024-04-26T18:00:38.978 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/30 file after the snapshot 2024-04-26T18:00:38.979 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/31 file after the snapshot 2024-04-26T18:00:38.980 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/32 file after the snapshot 2024-04-26T18:00:38.980 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/33 file after the snapshot 2024-04-26T18:00:38.981 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/34 file after the snapshot 2024-04-26T18:00:38.982 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/35 file after the snapshot 2024-04-26T18:00:38.982 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/36 file after the snapshot 2024-04-26T18:00:38.983 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/37 file after the snapshot 2024-04-26T18:00:38.984 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/38 file after the snapshot 2024-04-26T18:00:38.985 INFO:tasks.workunit.client.0.smithi139.stdout: create 257/39 file after the snapshot 2024-04-26T18:00:38.985 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/.snap/snap-subdir-test 2024-04-26T18:00:38.996 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/30 file after the snapshot 2024-04-26T18:00:38.997 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/31 file after the snapshot 2024-04-26T18:00:38.997 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/32 file after the snapshot 2024-04-26T18:00:38.998 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/33 file after the snapshot 2024-04-26T18:00:38.999 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/34 file after the snapshot 2024-04-26T18:00:39.000 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/35 file after the snapshot 2024-04-26T18:00:39.001 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/36 file after the snapshot 2024-04-26T18:00:39.001 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/37 file after the snapshot 2024-04-26T18:00:39.002 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/38 file after the snapshot 2024-04-26T18:00:39.003 INFO:tasks.workunit.client.0.smithi139.stdout: create 258/39 file after the snapshot 2024-04-26T18:00:39.004 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/.snap/snap-subdir-test 2024-04-26T18:00:39.016 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/30 file after the snapshot 2024-04-26T18:00:39.016 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/31 file after the snapshot 2024-04-26T18:00:39.017 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/32 file after the snapshot 2024-04-26T18:00:39.018 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/33 file after the snapshot 2024-04-26T18:00:39.018 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/34 file after the snapshot 2024-04-26T18:00:39.019 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/35 file after the snapshot 2024-04-26T18:00:39.020 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/36 file after the snapshot 2024-04-26T18:00:39.021 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/37 file after the snapshot 2024-04-26T18:00:39.022 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/38 file after the snapshot 2024-04-26T18:00:39.022 INFO:tasks.workunit.client.0.smithi139.stdout: create 259/39 file after the snapshot 2024-04-26T18:00:39.023 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/.snap/snap-subdir-test 2024-04-26T18:00:39.034 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/30 file after the snapshot 2024-04-26T18:00:39.035 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/31 file after the snapshot 2024-04-26T18:00:39.036 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/32 file after the snapshot 2024-04-26T18:00:39.037 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/33 file after the snapshot 2024-04-26T18:00:39.037 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/34 file after the snapshot 2024-04-26T18:00:39.038 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/35 file after the snapshot 2024-04-26T18:00:39.039 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/36 file after the snapshot 2024-04-26T18:00:39.040 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/37 file after the snapshot 2024-04-26T18:00:39.040 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/38 file after the snapshot 2024-04-26T18:00:39.041 INFO:tasks.workunit.client.0.smithi139.stdout: create 260/39 file after the snapshot 2024-04-26T18:00:39.042 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/.snap/snap-subdir-test 2024-04-26T18:00:39.053 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/30 file after the snapshot 2024-04-26T18:00:39.054 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/31 file after the snapshot 2024-04-26T18:00:39.055 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/32 file after the snapshot 2024-04-26T18:00:39.056 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/33 file after the snapshot 2024-04-26T18:00:39.056 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/34 file after the snapshot 2024-04-26T18:00:39.057 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/35 file after the snapshot 2024-04-26T18:00:39.058 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/36 file after the snapshot 2024-04-26T18:00:39.059 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/37 file after the snapshot 2024-04-26T18:00:39.059 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/38 file after the snapshot 2024-04-26T18:00:39.060 INFO:tasks.workunit.client.0.smithi139.stdout: create 261/39 file after the snapshot 2024-04-26T18:00:39.061 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/.snap/snap-subdir-test 2024-04-26T18:00:39.072 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/30 file after the snapshot 2024-04-26T18:00:39.073 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/31 file after the snapshot 2024-04-26T18:00:39.074 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/32 file after the snapshot 2024-04-26T18:00:39.074 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/33 file after the snapshot 2024-04-26T18:00:39.075 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/34 file after the snapshot 2024-04-26T18:00:39.076 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/35 file after the snapshot 2024-04-26T18:00:39.077 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/36 file after the snapshot 2024-04-26T18:00:39.077 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/37 file after the snapshot 2024-04-26T18:00:39.078 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/38 file after the snapshot 2024-04-26T18:00:39.079 INFO:tasks.workunit.client.0.smithi139.stdout: create 262/39 file after the snapshot 2024-04-26T18:00:39.080 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/.snap/snap-subdir-test 2024-04-26T18:00:39.486 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/30 file after the snapshot 2024-04-26T18:00:39.487 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/31 file after the snapshot 2024-04-26T18:00:39.488 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/32 file after the snapshot 2024-04-26T18:00:39.489 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/33 file after the snapshot 2024-04-26T18:00:39.489 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/34 file after the snapshot 2024-04-26T18:00:39.490 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/35 file after the snapshot 2024-04-26T18:00:39.491 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/36 file after the snapshot 2024-04-26T18:00:39.492 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/37 file after the snapshot 2024-04-26T18:00:39.492 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/38 file after the snapshot 2024-04-26T18:00:39.493 INFO:tasks.workunit.client.0.smithi139.stdout: create 263/39 file after the snapshot 2024-04-26T18:00:39.494 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/.snap/snap-subdir-test 2024-04-26T18:00:39.505 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/30 file after the snapshot 2024-04-26T18:00:39.506 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/31 file after the snapshot 2024-04-26T18:00:39.507 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/32 file after the snapshot 2024-04-26T18:00:39.508 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/33 file after the snapshot 2024-04-26T18:00:39.509 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/34 file after the snapshot 2024-04-26T18:00:39.509 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/35 file after the snapshot 2024-04-26T18:00:39.510 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/36 file after the snapshot 2024-04-26T18:00:39.511 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/37 file after the snapshot 2024-04-26T18:00:39.512 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/38 file after the snapshot 2024-04-26T18:00:39.513 INFO:tasks.workunit.client.0.smithi139.stdout: create 264/39 file after the snapshot 2024-04-26T18:00:39.513 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/.snap/snap-subdir-test 2024-04-26T18:00:39.525 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/30 file after the snapshot 2024-04-26T18:00:39.527 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/31 file after the snapshot 2024-04-26T18:00:39.527 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/32 file after the snapshot 2024-04-26T18:00:39.528 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/33 file after the snapshot 2024-04-26T18:00:39.529 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/34 file after the snapshot 2024-04-26T18:00:39.529 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/35 file after the snapshot 2024-04-26T18:00:39.530 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/36 file after the snapshot 2024-04-26T18:00:39.531 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/37 file after the snapshot 2024-04-26T18:00:39.532 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/38 file after the snapshot 2024-04-26T18:00:39.532 INFO:tasks.workunit.client.0.smithi139.stdout: create 265/39 file after the snapshot 2024-04-26T18:00:39.533 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/.snap/snap-subdir-test 2024-04-26T18:00:39.544 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/30 file after the snapshot 2024-04-26T18:00:39.545 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/31 file after the snapshot 2024-04-26T18:00:39.546 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/32 file after the snapshot 2024-04-26T18:00:39.546 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/33 file after the snapshot 2024-04-26T18:00:39.547 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/34 file after the snapshot 2024-04-26T18:00:39.548 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/35 file after the snapshot 2024-04-26T18:00:39.549 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/36 file after the snapshot 2024-04-26T18:00:39.549 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/37 file after the snapshot 2024-04-26T18:00:39.550 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/38 file after the snapshot 2024-04-26T18:00:39.551 INFO:tasks.workunit.client.0.smithi139.stdout: create 266/39 file after the snapshot 2024-04-26T18:00:39.551 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/.snap/snap-subdir-test 2024-04-26T18:00:39.562 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/30 file after the snapshot 2024-04-26T18:00:39.563 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/31 file after the snapshot 2024-04-26T18:00:39.563 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/32 file after the snapshot 2024-04-26T18:00:39.564 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/33 file after the snapshot 2024-04-26T18:00:39.565 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/34 file after the snapshot 2024-04-26T18:00:39.566 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/35 file after the snapshot 2024-04-26T18:00:39.566 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/36 file after the snapshot 2024-04-26T18:00:39.567 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/37 file after the snapshot 2024-04-26T18:00:39.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/38 file after the snapshot 2024-04-26T18:00:39.568 INFO:tasks.workunit.client.0.smithi139.stdout: create 267/39 file after the snapshot 2024-04-26T18:00:39.569 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/.snap/snap-subdir-test 2024-04-26T18:00:39.580 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/30 file after the snapshot 2024-04-26T18:00:39.581 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/31 file after the snapshot 2024-04-26T18:00:39.582 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/32 file after the snapshot 2024-04-26T18:00:39.582 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/33 file after the snapshot 2024-04-26T18:00:39.583 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/34 file after the snapshot 2024-04-26T18:00:39.584 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/35 file after the snapshot 2024-04-26T18:00:39.584 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/36 file after the snapshot 2024-04-26T18:00:39.585 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/37 file after the snapshot 2024-04-26T18:00:39.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/38 file after the snapshot 2024-04-26T18:00:39.586 INFO:tasks.workunit.client.0.smithi139.stdout: create 268/39 file after the snapshot 2024-04-26T18:00:39.587 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/.snap/snap-subdir-test 2024-04-26T18:00:39.602 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/30 file after the snapshot 2024-04-26T18:00:39.602 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/31 file after the snapshot 2024-04-26T18:00:39.603 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/32 file after the snapshot 2024-04-26T18:00:39.604 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/33 file after the snapshot 2024-04-26T18:00:39.605 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/34 file after the snapshot 2024-04-26T18:00:39.605 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/35 file after the snapshot 2024-04-26T18:00:39.606 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/36 file after the snapshot 2024-04-26T18:00:39.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/37 file after the snapshot 2024-04-26T18:00:39.607 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/38 file after the snapshot 2024-04-26T18:00:39.608 INFO:tasks.workunit.client.0.smithi139.stdout: create 269/39 file after the snapshot 2024-04-26T18:00:39.609 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/.snap/snap-subdir-test 2024-04-26T18:00:39.620 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/30 file after the snapshot 2024-04-26T18:00:39.621 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/31 file after the snapshot 2024-04-26T18:00:39.622 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/32 file after the snapshot 2024-04-26T18:00:39.622 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/33 file after the snapshot 2024-04-26T18:00:39.623 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/34 file after the snapshot 2024-04-26T18:00:39.624 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/35 file after the snapshot 2024-04-26T18:00:40.031 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/36 file after the snapshot 2024-04-26T18:00:40.032 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/37 file after the snapshot 2024-04-26T18:00:40.033 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/38 file after the snapshot 2024-04-26T18:00:40.034 INFO:tasks.workunit.client.0.smithi139.stdout: create 270/39 file after the snapshot 2024-04-26T18:00:40.035 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/.snap/snap-subdir-test 2024-04-26T18:00:40.046 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/30 file after the snapshot 2024-04-26T18:00:40.047 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/31 file after the snapshot 2024-04-26T18:00:40.047 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/32 file after the snapshot 2024-04-26T18:00:40.048 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/33 file after the snapshot 2024-04-26T18:00:40.049 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/34 file after the snapshot 2024-04-26T18:00:40.050 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/35 file after the snapshot 2024-04-26T18:00:40.051 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/36 file after the snapshot 2024-04-26T18:00:40.051 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/37 file after the snapshot 2024-04-26T18:00:40.052 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/38 file after the snapshot 2024-04-26T18:00:40.053 INFO:tasks.workunit.client.0.smithi139.stdout: create 271/39 file after the snapshot 2024-04-26T18:00:40.054 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/.snap/snap-subdir-test 2024-04-26T18:00:40.065 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/30 file after the snapshot 2024-04-26T18:00:40.066 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/31 file after the snapshot 2024-04-26T18:00:40.067 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/32 file after the snapshot 2024-04-26T18:00:40.068 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/33 file after the snapshot 2024-04-26T18:00:40.068 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/34 file after the snapshot 2024-04-26T18:00:40.069 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/35 file after the snapshot 2024-04-26T18:00:40.070 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/36 file after the snapshot 2024-04-26T18:00:40.071 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/37 file after the snapshot 2024-04-26T18:00:40.072 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/38 file after the snapshot 2024-04-26T18:00:40.074 INFO:tasks.workunit.client.0.smithi139.stdout: create 272/39 file after the snapshot 2024-04-26T18:00:40.074 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/.snap/snap-subdir-test 2024-04-26T18:00:40.336 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/30 file after the snapshot 2024-04-26T18:00:40.337 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/31 file after the snapshot 2024-04-26T18:00:40.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/32 file after the snapshot 2024-04-26T18:00:40.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/33 file after the snapshot 2024-04-26T18:00:40.339 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/34 file after the snapshot 2024-04-26T18:00:40.340 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/35 file after the snapshot 2024-04-26T18:00:40.341 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/36 file after the snapshot 2024-04-26T18:00:40.342 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/37 file after the snapshot 2024-04-26T18:00:40.342 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/38 file after the snapshot 2024-04-26T18:00:40.343 INFO:tasks.workunit.client.0.smithi139.stdout: create 273/39 file after the snapshot 2024-04-26T18:00:40.344 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/.snap/snap-subdir-test 2024-04-26T18:00:40.355 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/30 file after the snapshot 2024-04-26T18:00:40.356 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/31 file after the snapshot 2024-04-26T18:00:40.357 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/32 file after the snapshot 2024-04-26T18:00:40.358 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/33 file after the snapshot 2024-04-26T18:00:40.359 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/34 file after the snapshot 2024-04-26T18:00:40.359 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/35 file after the snapshot 2024-04-26T18:00:40.360 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/36 file after the snapshot 2024-04-26T18:00:40.361 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/37 file after the snapshot 2024-04-26T18:00:40.362 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/38 file after the snapshot 2024-04-26T18:00:40.362 INFO:tasks.workunit.client.0.smithi139.stdout: create 274/39 file after the snapshot 2024-04-26T18:00:40.363 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/.snap/snap-subdir-test 2024-04-26T18:00:40.375 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/30 file after the snapshot 2024-04-26T18:00:40.376 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/31 file after the snapshot 2024-04-26T18:00:40.376 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/32 file after the snapshot 2024-04-26T18:00:40.377 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/33 file after the snapshot 2024-04-26T18:00:40.378 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/34 file after the snapshot 2024-04-26T18:00:40.379 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/35 file after the snapshot 2024-04-26T18:00:40.380 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/36 file after the snapshot 2024-04-26T18:00:40.380 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/37 file after the snapshot 2024-04-26T18:00:40.381 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/38 file after the snapshot 2024-04-26T18:00:40.382 INFO:tasks.workunit.client.0.smithi139.stdout: create 275/39 file after the snapshot 2024-04-26T18:00:40.383 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/.snap/snap-subdir-test 2024-04-26T18:00:40.394 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/30 file after the snapshot 2024-04-26T18:00:40.395 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/31 file after the snapshot 2024-04-26T18:00:40.395 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/32 file after the snapshot 2024-04-26T18:00:40.396 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/33 file after the snapshot 2024-04-26T18:00:40.397 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/34 file after the snapshot 2024-04-26T18:00:40.398 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/35 file after the snapshot 2024-04-26T18:00:40.398 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/36 file after the snapshot 2024-04-26T18:00:40.399 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/37 file after the snapshot 2024-04-26T18:00:40.400 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/38 file after the snapshot 2024-04-26T18:00:40.401 INFO:tasks.workunit.client.0.smithi139.stdout: create 276/39 file after the snapshot 2024-04-26T18:00:40.402 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/.snap/snap-subdir-test 2024-04-26T18:00:40.413 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/30 file after the snapshot 2024-04-26T18:00:40.413 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/31 file after the snapshot 2024-04-26T18:00:40.414 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/32 file after the snapshot 2024-04-26T18:00:40.415 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/33 file after the snapshot 2024-04-26T18:00:40.416 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/34 file after the snapshot 2024-04-26T18:00:40.417 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/35 file after the snapshot 2024-04-26T18:00:40.417 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/36 file after the snapshot 2024-04-26T18:00:40.418 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/37 file after the snapshot 2024-04-26T18:00:40.419 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/38 file after the snapshot 2024-04-26T18:00:40.420 INFO:tasks.workunit.client.0.smithi139.stdout: create 277/39 file after the snapshot 2024-04-26T18:00:40.421 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/.snap/snap-subdir-test 2024-04-26T18:00:40.432 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/30 file after the snapshot 2024-04-26T18:00:40.433 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/31 file after the snapshot 2024-04-26T18:00:40.434 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/32 file after the snapshot 2024-04-26T18:00:40.434 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/33 file after the snapshot 2024-04-26T18:00:40.435 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/34 file after the snapshot 2024-04-26T18:00:40.435 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/35 file after the snapshot 2024-04-26T18:00:40.436 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/36 file after the snapshot 2024-04-26T18:00:40.437 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/37 file after the snapshot 2024-04-26T18:00:40.438 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/38 file after the snapshot 2024-04-26T18:00:40.438 INFO:tasks.workunit.client.0.smithi139.stdout: create 278/39 file after the snapshot 2024-04-26T18:00:40.439 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/.snap/snap-subdir-test 2024-04-26T18:00:40.631 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/30 file after the snapshot 2024-04-26T18:00:40.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/31 file after the snapshot 2024-04-26T18:00:40.632 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/32 file after the snapshot 2024-04-26T18:00:40.633 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/33 file after the snapshot 2024-04-26T18:00:40.634 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/34 file after the snapshot 2024-04-26T18:00:40.635 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/35 file after the snapshot 2024-04-26T18:00:40.635 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/36 file after the snapshot 2024-04-26T18:00:40.636 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/37 file after the snapshot 2024-04-26T18:00:40.637 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/38 file after the snapshot 2024-04-26T18:00:40.637 INFO:tasks.workunit.client.0.smithi139.stdout: create 279/39 file after the snapshot 2024-04-26T18:00:40.638 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/.snap/snap-subdir-test 2024-04-26T18:00:40.649 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/30 file after the snapshot 2024-04-26T18:00:40.650 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/31 file after the snapshot 2024-04-26T18:00:40.651 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/32 file after the snapshot 2024-04-26T18:00:40.651 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/33 file after the snapshot 2024-04-26T18:00:40.652 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/34 file after the snapshot 2024-04-26T18:00:40.653 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/35 file after the snapshot 2024-04-26T18:00:40.654 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/36 file after the snapshot 2024-04-26T18:00:40.654 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/37 file after the snapshot 2024-04-26T18:00:40.655 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/38 file after the snapshot 2024-04-26T18:00:40.656 INFO:tasks.workunit.client.0.smithi139.stdout: create 280/39 file after the snapshot 2024-04-26T18:00:40.657 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/.snap/snap-subdir-test 2024-04-26T18:00:40.667 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/30 file after the snapshot 2024-04-26T18:00:40.668 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/31 file after the snapshot 2024-04-26T18:00:40.669 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/32 file after the snapshot 2024-04-26T18:00:40.669 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/33 file after the snapshot 2024-04-26T18:00:40.670 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/34 file after the snapshot 2024-04-26T18:00:40.671 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/35 file after the snapshot 2024-04-26T18:00:40.672 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/36 file after the snapshot 2024-04-26T18:00:40.672 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/37 file after the snapshot 2024-04-26T18:00:40.673 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/38 file after the snapshot 2024-04-26T18:00:40.674 INFO:tasks.workunit.client.0.smithi139.stdout: create 281/39 file after the snapshot 2024-04-26T18:00:40.675 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/.snap/snap-subdir-test 2024-04-26T18:00:40.686 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/30 file after the snapshot 2024-04-26T18:00:40.687 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/31 file after the snapshot 2024-04-26T18:00:40.687 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/32 file after the snapshot 2024-04-26T18:00:40.688 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/33 file after the snapshot 2024-04-26T18:00:40.689 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/34 file after the snapshot 2024-04-26T18:00:40.690 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/35 file after the snapshot 2024-04-26T18:00:40.690 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/36 file after the snapshot 2024-04-26T18:00:40.691 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/37 file after the snapshot 2024-04-26T18:00:40.692 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/38 file after the snapshot 2024-04-26T18:00:40.693 INFO:tasks.workunit.client.0.smithi139.stdout: create 282/39 file after the snapshot 2024-04-26T18:00:40.693 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/.snap/snap-subdir-test 2024-04-26T18:00:40.704 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/30 file after the snapshot 2024-04-26T18:00:40.705 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/31 file after the snapshot 2024-04-26T18:00:40.705 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/32 file after the snapshot 2024-04-26T18:00:40.706 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/33 file after the snapshot 2024-04-26T18:00:40.707 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/34 file after the snapshot 2024-04-26T18:00:40.708 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/35 file after the snapshot 2024-04-26T18:00:40.709 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/36 file after the snapshot 2024-04-26T18:00:40.709 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/37 file after the snapshot 2024-04-26T18:00:40.710 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/38 file after the snapshot 2024-04-26T18:00:40.711 INFO:tasks.workunit.client.0.smithi139.stdout: create 283/39 file after the snapshot 2024-04-26T18:00:40.712 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/.snap/snap-subdir-test 2024-04-26T18:00:40.723 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/30 file after the snapshot 2024-04-26T18:00:40.724 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/31 file after the snapshot 2024-04-26T18:00:40.725 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/32 file after the snapshot 2024-04-26T18:00:40.726 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/33 file after the snapshot 2024-04-26T18:00:40.726 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/34 file after the snapshot 2024-04-26T18:00:40.727 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/35 file after the snapshot 2024-04-26T18:00:40.728 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/36 file after the snapshot 2024-04-26T18:00:40.728 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/37 file after the snapshot 2024-04-26T18:00:40.729 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/38 file after the snapshot 2024-04-26T18:00:40.730 INFO:tasks.workunit.client.0.smithi139.stdout: create 284/39 file after the snapshot 2024-04-26T18:00:40.731 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/.snap/snap-subdir-test 2024-04-26T18:00:40.743 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/30 file after the snapshot 2024-04-26T18:00:40.744 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/31 file after the snapshot 2024-04-26T18:00:40.745 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/32 file after the snapshot 2024-04-26T18:00:40.746 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/33 file after the snapshot 2024-04-26T18:00:41.445 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/34 file after the snapshot 2024-04-26T18:00:41.446 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/35 file after the snapshot 2024-04-26T18:00:41.448 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/36 file after the snapshot 2024-04-26T18:00:41.449 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/37 file after the snapshot 2024-04-26T18:00:41.450 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/38 file after the snapshot 2024-04-26T18:00:41.452 INFO:tasks.workunit.client.0.smithi139.stdout: create 285/39 file after the snapshot 2024-04-26T18:00:41.453 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/.snap/snap-subdir-test 2024-04-26T18:00:41.470 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/30 file after the snapshot 2024-04-26T18:00:41.471 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/31 file after the snapshot 2024-04-26T18:00:41.472 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/32 file after the snapshot 2024-04-26T18:00:41.473 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/33 file after the snapshot 2024-04-26T18:00:41.474 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/34 file after the snapshot 2024-04-26T18:00:41.474 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/35 file after the snapshot 2024-04-26T18:00:41.475 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/36 file after the snapshot 2024-04-26T18:00:41.476 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/37 file after the snapshot 2024-04-26T18:00:41.477 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/38 file after the snapshot 2024-04-26T18:00:41.478 INFO:tasks.workunit.client.0.smithi139.stdout: create 286/39 file after the snapshot 2024-04-26T18:00:41.479 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/.snap/snap-subdir-test 2024-04-26T18:00:41.492 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/30 file after the snapshot 2024-04-26T18:00:41.493 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/31 file after the snapshot 2024-04-26T18:00:41.750 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/32 file after the snapshot 2024-04-26T18:00:41.751 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/33 file after the snapshot 2024-04-26T18:00:41.752 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/34 file after the snapshot 2024-04-26T18:00:41.753 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/35 file after the snapshot 2024-04-26T18:00:41.754 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/36 file after the snapshot 2024-04-26T18:00:41.755 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/37 file after the snapshot 2024-04-26T18:00:41.756 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/38 file after the snapshot 2024-04-26T18:00:41.757 INFO:tasks.workunit.client.0.smithi139.stdout: create 287/39 file after the snapshot 2024-04-26T18:00:41.758 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/.snap/snap-subdir-test 2024-04-26T18:00:41.774 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/30 file after the snapshot 2024-04-26T18:00:41.775 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/31 file after the snapshot 2024-04-26T18:00:41.775 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/32 file after the snapshot 2024-04-26T18:00:41.776 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/33 file after the snapshot 2024-04-26T18:00:41.777 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/34 file after the snapshot 2024-04-26T18:00:41.778 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/35 file after the snapshot 2024-04-26T18:00:41.779 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/36 file after the snapshot 2024-04-26T18:00:41.780 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/37 file after the snapshot 2024-04-26T18:00:41.781 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/38 file after the snapshot 2024-04-26T18:00:41.782 INFO:tasks.workunit.client.0.smithi139.stdout: create 288/39 file after the snapshot 2024-04-26T18:00:41.782 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/.snap/snap-subdir-test 2024-04-26T18:00:41.796 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/30 file after the snapshot 2024-04-26T18:00:41.797 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/31 file after the snapshot 2024-04-26T18:00:41.799 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/32 file after the snapshot 2024-04-26T18:00:41.800 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/33 file after the snapshot 2024-04-26T18:00:41.801 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/34 file after the snapshot 2024-04-26T18:00:42.468 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/35 file after the snapshot 2024-04-26T18:00:42.469 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/36 file after the snapshot 2024-04-26T18:00:42.470 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/37 file after the snapshot 2024-04-26T18:00:42.472 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/38 file after the snapshot 2024-04-26T18:00:42.474 INFO:tasks.workunit.client.0.smithi139.stdout: create 289/39 file after the snapshot 2024-04-26T18:00:42.475 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/.snap/snap-subdir-test 2024-04-26T18:00:42.491 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/30 file after the snapshot 2024-04-26T18:00:42.492 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/31 file after the snapshot 2024-04-26T18:00:42.494 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/32 file after the snapshot 2024-04-26T18:00:42.495 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/33 file after the snapshot 2024-04-26T18:00:42.496 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/34 file after the snapshot 2024-04-26T18:00:42.498 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/35 file after the snapshot 2024-04-26T18:00:42.499 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/36 file after the snapshot 2024-04-26T18:00:42.500 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/37 file after the snapshot 2024-04-26T18:00:42.502 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/38 file after the snapshot 2024-04-26T18:00:42.503 INFO:tasks.workunit.client.0.smithi139.stdout: create 290/39 file after the snapshot 2024-04-26T18:00:42.505 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/.snap/snap-subdir-test 2024-04-26T18:00:42.519 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/30 file after the snapshot 2024-04-26T18:00:42.520 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/31 file after the snapshot 2024-04-26T18:00:42.521 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/32 file after the snapshot 2024-04-26T18:00:42.523 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/33 file after the snapshot 2024-04-26T18:00:42.524 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/34 file after the snapshot 2024-04-26T18:00:42.525 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/35 file after the snapshot 2024-04-26T18:00:42.526 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/36 file after the snapshot 2024-04-26T18:00:42.528 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/37 file after the snapshot 2024-04-26T18:00:42.529 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/38 file after the snapshot 2024-04-26T18:00:42.530 INFO:tasks.workunit.client.0.smithi139.stdout: create 291/39 file after the snapshot 2024-04-26T18:00:42.532 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/.snap/snap-subdir-test 2024-04-26T18:00:42.545 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/30 file after the snapshot 2024-04-26T18:00:42.546 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/31 file after the snapshot 2024-04-26T18:00:42.548 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/32 file after the snapshot 2024-04-26T18:00:42.549 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/33 file after the snapshot 2024-04-26T18:00:42.551 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/34 file after the snapshot 2024-04-26T18:00:42.552 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/35 file after the snapshot 2024-04-26T18:00:42.553 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/36 file after the snapshot 2024-04-26T18:00:42.556 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/37 file after the snapshot 2024-04-26T18:00:42.556 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/38 file after the snapshot 2024-04-26T18:00:42.557 INFO:tasks.workunit.client.0.smithi139.stdout: create 292/39 file after the snapshot 2024-04-26T18:00:42.558 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/.snap/snap-subdir-test 2024-04-26T18:00:42.572 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/30 file after the snapshot 2024-04-26T18:00:42.573 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/31 file after the snapshot 2024-04-26T18:00:42.574 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/32 file after the snapshot 2024-04-26T18:00:42.576 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/33 file after the snapshot 2024-04-26T18:00:42.576 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/34 file after the snapshot 2024-04-26T18:00:43.333 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/35 file after the snapshot 2024-04-26T18:00:43.335 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/36 file after the snapshot 2024-04-26T18:00:43.336 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/37 file after the snapshot 2024-04-26T18:00:43.338 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/38 file after the snapshot 2024-04-26T18:00:43.339 INFO:tasks.workunit.client.0.smithi139.stdout: create 293/39 file after the snapshot 2024-04-26T18:00:43.341 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/.snap/snap-subdir-test 2024-04-26T18:00:43.357 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/30 file after the snapshot 2024-04-26T18:00:43.358 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/31 file after the snapshot 2024-04-26T18:00:43.360 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/32 file after the snapshot 2024-04-26T18:00:43.361 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/33 file after the snapshot 2024-04-26T18:00:43.362 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/34 file after the snapshot 2024-04-26T18:00:43.364 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/35 file after the snapshot 2024-04-26T18:00:43.365 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/36 file after the snapshot 2024-04-26T18:00:43.367 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/37 file after the snapshot 2024-04-26T18:00:43.368 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/38 file after the snapshot 2024-04-26T18:00:43.369 INFO:tasks.workunit.client.0.smithi139.stdout: create 294/39 file after the snapshot 2024-04-26T18:00:43.371 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/.snap/snap-subdir-test 2024-04-26T18:00:43.385 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/30 file after the snapshot 2024-04-26T18:00:43.386 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/31 file after the snapshot 2024-04-26T18:00:43.388 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/32 file after the snapshot 2024-04-26T18:00:43.389 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/33 file after the snapshot 2024-04-26T18:00:43.390 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/34 file after the snapshot 2024-04-26T18:00:43.392 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/35 file after the snapshot 2024-04-26T18:00:43.393 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/36 file after the snapshot 2024-04-26T18:00:43.394 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/37 file after the snapshot 2024-04-26T18:00:43.396 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/38 file after the snapshot 2024-04-26T18:00:43.397 INFO:tasks.workunit.client.0.smithi139.stdout: create 295/39 file after the snapshot 2024-04-26T18:00:43.399 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/.snap/snap-subdir-test 2024-04-26T18:00:43.413 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/30 file after the snapshot 2024-04-26T18:00:43.414 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/31 file after the snapshot 2024-04-26T18:00:43.415 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/32 file after the snapshot 2024-04-26T18:00:43.417 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/33 file after the snapshot 2024-04-26T18:00:43.418 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/34 file after the snapshot 2024-04-26T18:00:43.419 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/35 file after the snapshot 2024-04-26T18:00:43.420 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/36 file after the snapshot 2024-04-26T18:00:43.422 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/37 file after the snapshot 2024-04-26T18:00:43.423 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/38 file after the snapshot 2024-04-26T18:00:43.424 INFO:tasks.workunit.client.0.smithi139.stdout: create 296/39 file after the snapshot 2024-04-26T18:00:43.426 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/.snap/snap-subdir-test 2024-04-26T18:00:43.698 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/30 file after the snapshot 2024-04-26T18:00:43.698 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/31 file after the snapshot 2024-04-26T18:00:43.699 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/32 file after the snapshot 2024-04-26T18:00:43.700 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/33 file after the snapshot 2024-04-26T18:00:43.701 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/34 file after the snapshot 2024-04-26T18:00:43.702 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/35 file after the snapshot 2024-04-26T18:00:43.703 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/36 file after the snapshot 2024-04-26T18:00:43.704 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/37 file after the snapshot 2024-04-26T18:00:43.705 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/38 file after the snapshot 2024-04-26T18:00:43.705 INFO:tasks.workunit.client.0.smithi139.stdout: create 297/39 file after the snapshot 2024-04-26T18:00:43.706 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/.snap/snap-subdir-test 2024-04-26T18:00:43.903 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/30 file after the snapshot 2024-04-26T18:00:43.903 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/31 file after the snapshot 2024-04-26T18:00:43.904 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/32 file after the snapshot 2024-04-26T18:00:43.905 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/33 file after the snapshot 2024-04-26T18:00:43.906 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/34 file after the snapshot 2024-04-26T18:00:43.907 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/35 file after the snapshot 2024-04-26T18:00:43.908 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/36 file after the snapshot 2024-04-26T18:00:43.909 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/37 file after the snapshot 2024-04-26T18:00:43.910 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/38 file after the snapshot 2024-04-26T18:00:43.911 INFO:tasks.workunit.client.0.smithi139.stdout: create 298/39 file after the snapshot 2024-04-26T18:00:43.918 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/.snap/snap-subdir-test 2024-04-26T18:00:43.933 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/30 file after the snapshot 2024-04-26T18:00:43.933 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/31 file after the snapshot 2024-04-26T18:00:43.935 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/32 file after the snapshot 2024-04-26T18:00:43.935 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/33 file after the snapshot 2024-04-26T18:00:43.936 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/34 file after the snapshot 2024-04-26T18:00:43.937 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/35 file after the snapshot 2024-04-26T18:00:43.938 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/36 file after the snapshot 2024-04-26T18:00:43.939 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/37 file after the snapshot 2024-04-26T18:00:43.940 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/38 file after the snapshot 2024-04-26T18:00:43.941 INFO:tasks.workunit.client.0.smithi139.stdout: create 299/39 file after the snapshot 2024-04-26T18:00:43.942 INFO:tasks.workunit.client.0.smithi139.stdout:Take second snapshot .snap/test2 2024-04-26T18:00:43.957 INFO:tasks.workunit.client.0.smithi139.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2024-04-26T18:00:44.164 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2024-04-26T18:00:44.164 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2024-04-26T18:00:44.164 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2024-04-26T18:00:44.164 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2024-04-26T18:00:44.165 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2024-04-26T18:00:44.166 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2024-04-26T18:00:44.167 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2024-04-26T18:00:44.168 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2024-04-26T18:00:44.169 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2024-04-26T18:00:44.170 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2024-04-26T18:00:44.170 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2024-04-26T18:00:44.170 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2024-04-26T18:00:44.170 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2024-04-26T18:00:44.170 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2024-04-26T18:00:44.170 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2024-04-26T18:00:44.170 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2024-04-26T18:00:44.296 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2024-04-26T18:00:44.297 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2024-04-26T18:00:44.298 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2024-04-26T18:00:44.299 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2024-04-26T18:00:44.300 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2024-04-26T18:00:44.301 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2024-04-26T18:00:44.302 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2024-04-26T18:00:45.540 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2024-04-26T18:00:45.540 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2024-04-26T18:00:45.541 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2024-04-26T18:00:45.542 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2024-04-26T18:00:45.543 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2024-04-26T18:00:45.544 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2024-04-26T18:00:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2024-04-26T18:00:45.546 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2024-04-26T18:00:45.683 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2024-04-26T18:00:45.683 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2024-04-26T18:00:45.683 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2024-04-26T18:00:45.683 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2024-04-26T18:00:45.683 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2024-04-26T18:00:45.683 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2024-04-26T18:00:45.684 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2024-04-26T18:00:45.685 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2024-04-26T18:00:45.686 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2024-04-26T18:00:45.687 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2024-04-26T18:00:45.688 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2024-04-26T18:00:45.689 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2024-04-26T18:00:45.689 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2024-04-26T18:00:45.689 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2024-04-26T18:00:45.689 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2024-04-26T18:00:45.689 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2024-04-26T18:00:45.817 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2024-04-26T18:00:45.817 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2024-04-26T18:00:45.817 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2024-04-26T18:00:45.818 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2024-04-26T18:00:45.819 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2024-04-26T18:00:45.820 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2024-04-26T18:00:45.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2024-04-26T18:00:45.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2024-04-26T18:00:45.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2024-04-26T18:00:45.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2024-04-26T18:00:46.210 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2024-04-26T18:00:46.210 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2024-04-26T18:00:46.210 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2024-04-26T18:00:46.210 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2024-04-26T18:00:46.210 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2024-04-26T18:00:46.210 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2024-04-26T18:00:46.211 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2024-04-26T18:00:46.212 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2024-04-26T18:00:46.213 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2024-04-26T18:00:46.214 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2024-04-26T18:00:46.215 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2024-04-26T18:00:48.184 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2024-04-26T18:00:48.185 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2024-04-26T18:00:48.186 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2024-04-26T18:00:48.187 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2024-04-26T18:00:48.188 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2024-04-26T18:00:48.189 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2024-04-26T18:00:48.190 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2024-04-26T18:00:48.338 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2024-04-26T18:00:48.339 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2024-04-26T18:00:48.340 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2024-04-26T18:00:48.341 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2024-04-26T18:00:48.342 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2024-04-26T18:00:48.343 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2024-04-26T18:00:48.344 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2024-04-26T18:00:49.375 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2024-04-26T18:00:49.376 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2024-04-26T18:00:49.377 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2024-04-26T18:00:49.378 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2024-04-26T18:00:49.379 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2024-04-26T18:00:49.380 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2024-04-26T18:00:49.381 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2024-04-26T18:00:49.381 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2024-04-26T18:00:49.381 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2024-04-26T18:00:50.868 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2024-04-26T18:00:50.868 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2024-04-26T18:00:50.868 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2024-04-26T18:00:50.869 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2024-04-26T18:00:50.870 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2024-04-26T18:00:50.871 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2024-04-26T18:00:50.872 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2024-04-26T18:00:50.873 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2024-04-26T18:00:50.874 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2024-04-26T18:00:50.875 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2024-04-26T18:00:50.875 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2024-04-26T18:00:50.875 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2024-04-26T18:00:51.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2024-04-26T18:00:51.821 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2024-04-26T18:00:51.822 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2024-04-26T18:00:51.823 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2024-04-26T18:00:51.824 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2024-04-26T18:00:51.825 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2024-04-26T18:00:51.826 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2024-04-26T18:00:51.827 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2024-04-26T18:00:51.827 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2024-04-26T18:00:51.827 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2024-04-26T18:00:51.827 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2024-04-26T18:00:51.827 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2024-04-26T18:00:51.827 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2024-04-26T18:00:51.827 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2024-04-26T18:00:53.238 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2024-04-26T18:00:53.239 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2024-04-26T18:00:53.240 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2024-04-26T18:00:53.241 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2024-04-26T18:00:53.242 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2024-04-26T18:00:53.243 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2024-04-26T18:00:54.066 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2024-04-26T18:00:54.067 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2024-04-26T18:00:54.068 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2024-04-26T18:00:54.069 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2024-04-26T18:00:54.070 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2024-04-26T18:00:54.071 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2024-04-26T18:00:54.249 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2024-04-26T18:00:54.250 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2024-04-26T18:00:54.251 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2024-04-26T18:00:54.252 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2024-04-26T18:00:54.253 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2024-04-26T18:00:54.254 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2024-04-26T18:00:54.255 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2024-04-26T18:00:54.255 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2024-04-26T18:00:54.255 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2024-04-26T18:00:54.386 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2024-04-26T18:00:54.386 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2024-04-26T18:00:54.387 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2024-04-26T18:00:54.388 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2024-04-26T18:00:54.389 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2024-04-26T18:00:54.390 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2024-04-26T18:00:54.391 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2024-04-26T18:00:54.391 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2024-04-26T18:00:54.391 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2024-04-26T18:00:54.391 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2024-04-26T18:00:54.391 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2024-04-26T18:00:54.391 INFO:tasks.workunit.client.0.smithi139.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2024-04-26T18:00:54.391 INFO:tasks.workunit.client.0.smithi139.stdout:Take third snapshot .snap/test3 2024-04-26T18:00:54.463 INFO:tasks.workunit.client.0.smithi139.stdout:Delete the snapshots... 2024-04-26T18:00:57.518 INFO:tasks.workunit.client.0.smithi139.stdout:.//.snap/test1 2024-04-26T18:00:57.518 INFO:tasks.workunit.client.0.smithi139.stdout:.//.snap/test2 2024-04-26T18:00:57.518 INFO:tasks.workunit.client.0.smithi139.stdout:.//.snap/test3 2024-04-26T18:00:57.522 INFO:tasks.workunit.client.0.smithi139.stdout:./274/.snap/snap-subdir-test 2024-04-26T18:00:57.526 INFO:tasks.workunit.client.0.smithi139.stdout:./166/.snap/snap-subdir-test 2024-04-26T18:00:57.530 INFO:tasks.workunit.client.0.smithi139.stdout:./256/.snap/snap-subdir-test 2024-04-26T18:00:57.534 INFO:tasks.workunit.client.0.smithi139.stdout:./247/.snap/snap-subdir-test 2024-04-26T18:00:57.538 INFO:tasks.workunit.client.0.smithi139.stdout:./248/.snap/snap-subdir-test 2024-04-26T18:00:57.543 INFO:tasks.workunit.client.0.smithi139.stdout:./147/.snap/snap-subdir-test 2024-04-26T18:00:57.547 INFO:tasks.workunit.client.0.smithi139.stdout:./151/.snap/snap-subdir-test 2024-04-26T18:00:57.552 INFO:tasks.workunit.client.0.smithi139.stdout:./170/.snap/snap-subdir-test 2024-04-26T18:00:57.556 INFO:tasks.workunit.client.0.smithi139.stdout:./167/.snap/snap-subdir-test 2024-04-26T18:00:57.559 INFO:tasks.workunit.client.0.smithi139.stdout:./140/.snap/snap-subdir-test 2024-04-26T18:00:57.564 INFO:tasks.workunit.client.0.smithi139.stdout:./142/.snap/snap-subdir-test 2024-04-26T18:00:57.569 INFO:tasks.workunit.client.0.smithi139.stdout:./150/.snap/snap-subdir-test 2024-04-26T18:00:57.574 INFO:tasks.workunit.client.0.smithi139.stdout:./273/.snap/snap-subdir-test 2024-04-26T18:00:57.580 INFO:tasks.workunit.client.0.smithi139.stdout:./269/.snap/snap-subdir-test 2024-04-26T18:00:57.583 INFO:tasks.workunit.client.0.smithi139.stdout:./105/.snap/snap-subdir-test 2024-04-26T18:00:57.587 INFO:tasks.workunit.client.0.smithi139.stdout:./210/.snap/snap-subdir-test 2024-04-26T18:00:57.591 INFO:tasks.workunit.client.0.smithi139.stdout:./265/.snap/snap-subdir-test 2024-04-26T18:00:58.456 INFO:tasks.workunit.client.0.smithi139.stdout:./218/.snap/snap-subdir-test 2024-04-26T18:00:58.461 INFO:tasks.workunit.client.0.smithi139.stdout:./290/.snap/snap-subdir-test 2024-04-26T18:00:58.467 INFO:tasks.workunit.client.0.smithi139.stdout:./149/.snap/snap-subdir-test 2024-04-26T18:00:58.470 INFO:tasks.workunit.client.0.smithi139.stdout:./109/.snap/snap-subdir-test 2024-04-26T18:00:58.475 INFO:tasks.workunit.client.0.smithi139.stdout:./292/.snap/snap-subdir-test 2024-04-26T18:00:58.480 INFO:tasks.workunit.client.0.smithi139.stdout:./242/.snap/snap-subdir-test 2024-04-26T18:00:58.485 INFO:tasks.workunit.client.0.smithi139.stdout:./158/.snap/snap-subdir-test 2024-04-26T18:00:58.691 INFO:tasks.workunit.client.0.smithi139.stdout:./243/.snap/snap-subdir-test 2024-04-26T18:00:58.695 INFO:tasks.workunit.client.0.smithi139.stdout:./106/.snap/snap-subdir-test 2024-04-26T18:00:59.286 INFO:tasks.workunit.client.0.smithi139.stdout:./250/.snap/snap-subdir-test 2024-04-26T18:00:59.293 INFO:tasks.workunit.client.0.smithi139.stdout:./221/.snap/snap-subdir-test 2024-04-26T18:00:59.298 INFO:tasks.workunit.client.0.smithi139.stdout:./244/.snap/snap-subdir-test 2024-04-26T18:00:59.304 INFO:tasks.workunit.client.0.smithi139.stdout:./258/.snap/snap-subdir-test 2024-04-26T18:00:59.309 INFO:tasks.workunit.client.0.smithi139.stdout:./268/.snap/snap-subdir-test 2024-04-26T18:00:59.314 INFO:tasks.workunit.client.0.smithi139.stdout:./189/.snap/snap-subdir-test 2024-04-26T18:00:59.319 INFO:tasks.workunit.client.0.smithi139.stdout:./285/.snap/snap-subdir-test 2024-04-26T18:00:59.323 INFO:tasks.workunit.client.0.smithi139.stdout:./208/.snap/snap-subdir-test 2024-04-26T18:00:59.328 INFO:tasks.workunit.client.0.smithi139.stdout:./288/.snap/snap-subdir-test 2024-04-26T18:00:59.331 INFO:tasks.workunit.client.0.smithi139.stdout:./209/.snap/snap-subdir-test 2024-04-26T18:01:00.737 INFO:tasks.workunit.client.0.smithi139.stdout:./253/.snap/snap-subdir-test 2024-04-26T18:01:00.741 INFO:tasks.workunit.client.0.smithi139.stdout:./249/.snap/snap-subdir-test 2024-04-26T18:01:00.746 INFO:tasks.workunit.client.0.smithi139.stdout:./133/.snap/snap-subdir-test 2024-04-26T18:01:00.750 INFO:tasks.workunit.client.0.smithi139.stdout:./291/.snap/snap-subdir-test 2024-04-26T18:01:00.754 INFO:tasks.workunit.client.0.smithi139.stdout:./226/.snap/snap-subdir-test 2024-04-26T18:01:00.758 INFO:tasks.workunit.client.0.smithi139.stdout:./173/.snap/snap-subdir-test 2024-04-26T18:01:00.762 INFO:tasks.workunit.client.0.smithi139.stdout:./174/.snap/snap-subdir-test 2024-04-26T18:01:00.766 INFO:tasks.workunit.client.0.smithi139.stdout:./299/.snap/snap-subdir-test 2024-04-26T18:01:00.770 INFO:tasks.workunit.client.0.smithi139.stdout:./262/.snap/snap-subdir-test 2024-04-26T18:01:00.774 INFO:tasks.workunit.client.0.smithi139.stdout:./231/.snap/snap-subdir-test 2024-04-26T18:01:00.779 INFO:tasks.workunit.client.0.smithi139.stdout:./214/.snap/snap-subdir-test 2024-04-26T18:01:00.783 INFO:tasks.workunit.client.0.smithi139.stdout:./281/.snap/snap-subdir-test 2024-04-26T18:01:00.788 INFO:tasks.workunit.client.0.smithi139.stdout:./289/.snap/snap-subdir-test 2024-04-26T18:01:00.792 INFO:tasks.workunit.client.0.smithi139.stdout:./283/.snap/snap-subdir-test 2024-04-26T18:01:00.797 INFO:tasks.workunit.client.0.smithi139.stdout:./232/.snap/snap-subdir-test 2024-04-26T18:01:00.801 INFO:tasks.workunit.client.0.smithi139.stdout:./298/.snap/snap-subdir-test 2024-04-26T18:01:00.805 INFO:tasks.workunit.client.0.smithi139.stdout:./233/.snap/snap-subdir-test 2024-04-26T18:01:00.810 INFO:tasks.workunit.client.0.smithi139.stdout:./155/.snap/snap-subdir-test 2024-04-26T18:01:00.814 INFO:tasks.workunit.client.0.smithi139.stdout:./114/.snap/snap-subdir-test 2024-04-26T18:01:00.817 INFO:tasks.workunit.client.0.smithi139.stdout:./159/.snap/snap-subdir-test 2024-04-26T18:01:00.822 INFO:tasks.workunit.client.0.smithi139.stdout:./187/.snap/snap-subdir-test 2024-04-26T18:01:00.826 INFO:tasks.workunit.client.0.smithi139.stdout:./185/.snap/snap-subdir-test 2024-04-26T18:01:00.830 INFO:tasks.workunit.client.0.smithi139.stdout:./293/.snap/snap-subdir-test 2024-04-26T18:01:00.835 INFO:tasks.workunit.client.0.smithi139.stdout:./228/.snap/snap-subdir-test 2024-04-26T18:01:00.839 INFO:tasks.workunit.client.0.smithi139.stdout:./120/.snap/snap-subdir-test 2024-04-26T18:01:00.842 INFO:tasks.workunit.client.0.smithi139.stdout:./110/.snap/snap-subdir-test 2024-04-26T18:01:00.846 INFO:tasks.workunit.client.0.smithi139.stdout:./267/.snap/snap-subdir-test 2024-04-26T18:01:01.598 INFO:tasks.workunit.client.0.smithi139.stdout:./202/.snap/snap-subdir-test 2024-04-26T18:01:01.603 INFO:tasks.workunit.client.0.smithi139.stdout:./137/.snap/snap-subdir-test 2024-04-26T18:01:01.608 INFO:tasks.workunit.client.0.smithi139.stdout:./246/.snap/snap-subdir-test 2024-04-26T18:01:01.612 INFO:tasks.workunit.client.0.smithi139.stdout:./219/.snap/snap-subdir-test 2024-04-26T18:01:01.616 INFO:tasks.workunit.client.0.smithi139.stdout:./198/.snap/snap-subdir-test 2024-04-26T18:01:01.621 INFO:tasks.workunit.client.0.smithi139.stdout:./136/.snap/snap-subdir-test 2024-04-26T18:01:01.880 INFO:tasks.workunit.client.0.smithi139.stdout:./270/.snap/snap-subdir-test 2024-04-26T18:01:02.560 INFO:tasks.workunit.client.0.smithi139.stdout:./125/.snap/snap-subdir-test 2024-04-26T18:01:02.565 INFO:tasks.workunit.client.0.smithi139.stdout:./194/.snap/snap-subdir-test 2024-04-26T18:01:02.569 INFO:tasks.workunit.client.0.smithi139.stdout:./119/.snap/snap-subdir-test 2024-04-26T18:01:02.573 INFO:tasks.workunit.client.0.smithi139.stdout:./297/.snap/snap-subdir-test 2024-04-26T18:01:02.579 INFO:tasks.workunit.client.0.smithi139.stdout:./230/.snap/snap-subdir-test 2024-04-26T18:01:02.583 INFO:tasks.workunit.client.0.smithi139.stdout:./260/.snap/snap-subdir-test 2024-04-26T18:01:02.587 INFO:tasks.workunit.client.0.smithi139.stdout:./157/.snap/snap-subdir-test 2024-04-26T18:01:02.591 INFO:tasks.workunit.client.0.smithi139.stdout:./172/.snap/snap-subdir-test 2024-04-26T18:01:02.595 INFO:tasks.workunit.client.0.smithi139.stdout:./277/.snap/snap-subdir-test 2024-04-26T18:01:02.599 INFO:tasks.workunit.client.0.smithi139.stdout:./186/.snap/snap-subdir-test 2024-04-26T18:01:02.603 INFO:tasks.workunit.client.0.smithi139.stdout:./237/.snap/snap-subdir-test 2024-04-26T18:01:02.607 INFO:tasks.workunit.client.0.smithi139.stdout:./190/.snap/snap-subdir-test 2024-04-26T18:01:02.611 INFO:tasks.workunit.client.0.smithi139.stdout:./213/.snap/snap-subdir-test 2024-04-26T18:01:02.615 INFO:tasks.workunit.client.0.smithi139.stdout:./104/.snap/snap-subdir-test 2024-04-26T18:01:02.620 INFO:tasks.workunit.client.0.smithi139.stdout:./164/.snap/snap-subdir-test 2024-04-26T18:01:02.623 INFO:tasks.workunit.client.0.smithi139.stdout:./112/.snap/snap-subdir-test 2024-04-26T18:01:02.627 INFO:tasks.workunit.client.0.smithi139.stdout:./295/.snap/snap-subdir-test 2024-04-26T18:01:02.633 INFO:tasks.workunit.client.0.smithi139.stdout:./272/.snap/snap-subdir-test 2024-04-26T18:01:02.638 INFO:tasks.workunit.client.0.smithi139.stdout:./100/.snap/snap-subdir-test 2024-04-26T18:01:02.643 INFO:tasks.workunit.client.0.smithi139.stdout:./134/.snap/snap-subdir-test 2024-04-26T18:01:02.648 INFO:tasks.workunit.client.0.smithi139.stdout:./200/.snap/snap-subdir-test 2024-04-26T18:01:02.653 INFO:tasks.workunit.client.0.smithi139.stdout:./115/.snap/snap-subdir-test 2024-04-26T18:01:02.657 INFO:tasks.workunit.client.0.smithi139.stdout:./284/.snap/snap-subdir-test 2024-04-26T18:01:02.662 INFO:tasks.workunit.client.0.smithi139.stdout:./280/.snap/snap-subdir-test 2024-04-26T18:01:02.667 INFO:tasks.workunit.client.0.smithi139.stdout:./116/.snap/snap-subdir-test 2024-04-26T18:01:02.672 INFO:tasks.workunit.client.0.smithi139.stdout:./245/.snap/snap-subdir-test 2024-04-26T18:01:02.677 INFO:tasks.workunit.client.0.smithi139.stdout:./195/.snap/snap-subdir-test 2024-04-26T18:01:02.682 INFO:tasks.workunit.client.0.smithi139.stdout:./138/.snap/snap-subdir-test 2024-04-26T18:01:02.687 INFO:tasks.workunit.client.0.smithi139.stdout:./135/.snap/snap-subdir-test 2024-04-26T18:01:02.954 INFO:tasks.workunit.client.0.smithi139.stdout:./117/.snap/snap-subdir-test 2024-04-26T18:01:02.960 INFO:tasks.workunit.client.0.smithi139.stdout:./241/.snap/snap-subdir-test 2024-04-26T18:01:02.966 INFO:tasks.workunit.client.0.smithi139.stdout:./143/.snap/snap-subdir-test 2024-04-26T18:01:02.972 INFO:tasks.workunit.client.0.smithi139.stdout:./180/.snap/snap-subdir-test 2024-04-26T18:01:02.978 INFO:tasks.workunit.client.0.smithi139.stdout:./126/.snap/snap-subdir-test 2024-04-26T18:01:02.982 INFO:tasks.workunit.client.0.smithi139.stdout:./161/.snap/snap-subdir-test 2024-04-26T18:01:02.987 INFO:tasks.workunit.client.0.smithi139.stdout:./204/.snap/snap-subdir-test 2024-04-26T18:01:02.992 INFO:tasks.workunit.client.0.smithi139.stdout:./176/.snap/snap-subdir-test 2024-04-26T18:01:02.998 INFO:tasks.workunit.client.0.smithi139.stdout:./255/.snap/snap-subdir-test 2024-04-26T18:01:03.002 INFO:tasks.workunit.client.0.smithi139.stdout:./215/.snap/snap-subdir-test 2024-04-26T18:01:03.007 INFO:tasks.workunit.client.0.smithi139.stdout:./111/.snap/snap-subdir-test 2024-04-26T18:01:03.012 INFO:tasks.workunit.client.0.smithi139.stdout:./238/.snap/snap-subdir-test 2024-04-26T18:01:03.017 INFO:tasks.workunit.client.0.smithi139.stdout:./191/.snap/snap-subdir-test 2024-04-26T18:01:03.022 INFO:tasks.workunit.client.0.smithi139.stdout:./184/.snap/snap-subdir-test 2024-04-26T18:01:03.027 INFO:tasks.workunit.client.0.smithi139.stdout:./192/.snap/snap-subdir-test 2024-04-26T18:01:03.032 INFO:tasks.workunit.client.0.smithi139.stdout:./103/.snap/snap-subdir-test 2024-04-26T18:01:03.037 INFO:tasks.workunit.client.0.smithi139.stdout:./128/.snap/snap-subdir-test 2024-04-26T18:01:03.042 INFO:tasks.workunit.client.0.smithi139.stdout:./229/.snap/snap-subdir-test 2024-04-26T18:01:03.047 INFO:tasks.workunit.client.0.smithi139.stdout:./144/.snap/snap-subdir-test 2024-04-26T18:01:03.052 INFO:tasks.workunit.client.0.smithi139.stdout:./146/.snap/snap-subdir-test 2024-04-26T18:01:03.057 INFO:tasks.workunit.client.0.smithi139.stdout:./227/.snap/snap-subdir-test 2024-04-26T18:01:03.062 INFO:tasks.workunit.client.0.smithi139.stdout:./278/.snap/snap-subdir-test 2024-04-26T18:01:03.066 INFO:tasks.workunit.client.0.smithi139.stdout:./141/.snap/snap-subdir-test 2024-04-26T18:01:03.070 INFO:tasks.workunit.client.0.smithi139.stdout:./234/.snap/snap-subdir-test 2024-04-26T18:01:03.074 INFO:tasks.workunit.client.0.smithi139.stdout:./225/.snap/snap-subdir-test 2024-04-26T18:01:03.077 INFO:tasks.workunit.client.0.smithi139.stdout:./182/.snap/snap-subdir-test 2024-04-26T18:01:03.081 INFO:tasks.workunit.client.0.smithi139.stdout:./107/.snap/snap-subdir-test 2024-04-26T18:01:03.085 INFO:tasks.workunit.client.0.smithi139.stdout:./178/.snap/snap-subdir-test 2024-04-26T18:01:03.089 INFO:tasks.workunit.client.0.smithi139.stdout:./266/.snap/snap-subdir-test 2024-04-26T18:01:03.093 INFO:tasks.workunit.client.0.smithi139.stdout:./240/.snap/snap-subdir-test 2024-04-26T18:01:03.096 INFO:tasks.workunit.client.0.smithi139.stdout:./156/.snap/snap-subdir-test 2024-04-26T18:01:03.100 INFO:tasks.workunit.client.0.smithi139.stdout:./131/.snap/snap-subdir-test 2024-04-26T18:01:03.103 INFO:tasks.workunit.client.0.smithi139.stdout:./123/.snap/snap-subdir-test 2024-04-26T18:01:03.107 INFO:tasks.workunit.client.0.smithi139.stdout:./160/.snap/snap-subdir-test 2024-04-26T18:01:03.112 INFO:tasks.workunit.client.0.smithi139.stdout:./165/.snap/snap-subdir-test 2024-04-26T18:01:03.115 INFO:tasks.workunit.client.0.smithi139.stdout:./101/.snap/snap-subdir-test 2024-04-26T18:01:03.118 INFO:tasks.workunit.client.0.smithi139.stdout:./148/.snap/snap-subdir-test 2024-04-26T18:01:04.104 INFO:tasks.workunit.client.0.smithi139.stdout:./168/.snap/snap-subdir-test 2024-04-26T18:01:04.108 INFO:tasks.workunit.client.0.smithi139.stdout:./179/.snap/snap-subdir-test 2024-04-26T18:01:04.113 INFO:tasks.workunit.client.0.smithi139.stdout:./257/.snap/snap-subdir-test 2024-04-26T18:01:04.117 INFO:tasks.workunit.client.0.smithi139.stdout:./252/.snap/snap-subdir-test 2024-04-26T18:01:04.121 INFO:tasks.workunit.client.0.smithi139.stdout:./132/.snap/snap-subdir-test 2024-04-26T18:01:04.126 INFO:tasks.workunit.client.0.smithi139.stdout:./236/.snap/snap-subdir-test 2024-04-26T18:01:04.130 INFO:tasks.workunit.client.0.smithi139.stdout:./211/.snap/snap-subdir-test 2024-04-26T18:01:04.134 INFO:tasks.workunit.client.0.smithi139.stdout:./199/.snap/snap-subdir-test 2024-04-26T18:01:04.138 INFO:tasks.workunit.client.0.smithi139.stdout:./205/.snap/snap-subdir-test 2024-04-26T18:01:04.143 INFO:tasks.workunit.client.0.smithi139.stdout:./163/.snap/snap-subdir-test 2024-04-26T18:01:04.147 INFO:tasks.workunit.client.0.smithi139.stdout:./261/.snap/snap-subdir-test 2024-04-26T18:01:04.151 INFO:tasks.workunit.client.0.smithi139.stdout:./201/.snap/snap-subdir-test 2024-04-26T18:01:04.155 INFO:tasks.workunit.client.0.smithi139.stdout:./282/.snap/snap-subdir-test 2024-04-26T18:01:04.158 INFO:tasks.workunit.client.0.smithi139.stdout:./296/.snap/snap-subdir-test 2024-04-26T18:01:04.163 INFO:tasks.workunit.client.0.smithi139.stdout:./217/.snap/snap-subdir-test 2024-04-26T18:01:04.168 INFO:tasks.workunit.client.0.smithi139.stdout:./153/.snap/snap-subdir-test 2024-04-26T18:01:04.172 INFO:tasks.workunit.client.0.smithi139.stdout:./206/.snap/snap-subdir-test 2024-04-26T18:01:04.176 INFO:tasks.workunit.client.0.smithi139.stdout:./122/.snap/snap-subdir-test 2024-04-26T18:01:04.180 INFO:tasks.workunit.client.0.smithi139.stdout:./162/.snap/snap-subdir-test 2024-04-26T18:01:04.184 INFO:tasks.workunit.client.0.smithi139.stdout:./197/.snap/snap-subdir-test 2024-04-26T18:01:04.188 INFO:tasks.workunit.client.0.smithi139.stdout:./216/.snap/snap-subdir-test 2024-04-26T18:01:06.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:06.022 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:06.218 INFO:tasks.workunit.client.0.smithi139.stdout:./254/.snap/snap-subdir-test 2024-04-26T18:01:06.221 INFO:tasks.workunit.client.0.smithi139.stdout:./113/.snap/snap-subdir-test 2024-04-26T18:01:06.226 INFO:tasks.workunit.client.0.smithi139.stdout:./152/.snap/snap-subdir-test 2024-04-26T18:01:06.230 INFO:tasks.workunit.client.0.smithi139.stdout:./121/.snap/snap-subdir-test 2024-04-26T18:01:06.233 INFO:tasks.workunit.client.0.smithi139.stdout:./118/.snap/snap-subdir-test 2024-04-26T18:01:06.237 INFO:tasks.workunit.client.0.smithi139.stdout:./196/.snap/snap-subdir-test 2024-04-26T18:01:06.241 INFO:tasks.workunit.client.0.smithi139.stdout:./124/.snap/snap-subdir-test 2024-04-26T18:01:06.502 INFO:tasks.workunit.client.0.smithi139.stdout:./239/.snap/snap-subdir-test 2024-04-26T18:01:06.507 INFO:tasks.workunit.client.0.smithi139.stdout:./188/.snap/snap-subdir-test 2024-04-26T18:01:06.768 INFO:tasks.workunit.client.0.smithi139.stdout:./287/.snap/snap-subdir-test 2024-04-26T18:01:06.773 INFO:tasks.workunit.client.0.smithi139.stdout:./275/.snap/snap-subdir-test 2024-04-26T18:01:06.778 INFO:tasks.workunit.client.0.smithi139.stdout:./259/.snap/snap-subdir-test 2024-04-26T18:01:06.783 INFO:tasks.workunit.client.0.smithi139.stdout:./224/.snap/snap-subdir-test 2024-04-26T18:01:06.787 INFO:tasks.workunit.client.0.smithi139.stdout:./264/.snap/snap-subdir-test 2024-04-26T18:01:06.792 INFO:tasks.workunit.client.0.smithi139.stdout:./145/.snap/snap-subdir-test 2024-04-26T18:01:06.796 INFO:tasks.workunit.client.0.smithi139.stdout:./279/.snap/snap-subdir-test 2024-04-26T18:01:06.801 INFO:tasks.workunit.client.0.smithi139.stdout:./263/.snap/snap-subdir-test 2024-04-26T18:01:06.805 INFO:tasks.workunit.client.0.smithi139.stdout:./130/.snap/snap-subdir-test 2024-04-26T18:01:07.809 INFO:tasks.workunit.client.0.smithi139.stdout:./193/.snap/snap-subdir-test 2024-04-26T18:01:07.814 INFO:tasks.workunit.client.0.smithi139.stdout:./223/.snap/snap-subdir-test 2024-04-26T18:01:07.819 INFO:tasks.workunit.client.0.smithi139.stdout:./207/.snap/snap-subdir-test 2024-04-26T18:01:08.250 INFO:tasks.workunit.client.0.smithi139.stdout:./276/.snap/snap-subdir-test 2024-04-26T18:01:08.255 INFO:tasks.workunit.client.0.smithi139.stdout:./271/.snap/snap-subdir-test 2024-04-26T18:01:08.260 INFO:tasks.workunit.client.0.smithi139.stdout:./251/.snap/snap-subdir-test 2024-04-26T18:01:08.264 INFO:tasks.workunit.client.0.smithi139.stdout:./175/.snap/snap-subdir-test 2024-04-26T18:01:08.269 INFO:tasks.workunit.client.0.smithi139.stdout:./222/.snap/snap-subdir-test 2024-04-26T18:01:08.274 INFO:tasks.workunit.client.0.smithi139.stdout:./220/.snap/snap-subdir-test 2024-04-26T18:01:08.278 INFO:tasks.workunit.client.0.smithi139.stdout:./203/.snap/snap-subdir-test 2024-04-26T18:01:08.283 INFO:tasks.workunit.client.0.smithi139.stdout:./181/.snap/snap-subdir-test 2024-04-26T18:01:08.287 INFO:tasks.workunit.client.0.smithi139.stdout:./286/.snap/snap-subdir-test 2024-04-26T18:01:08.293 INFO:tasks.workunit.client.0.smithi139.stdout:./127/.snap/snap-subdir-test 2024-04-26T18:01:08.295 INFO:tasks.workunit.client.0.smithi139.stdout:./108/.snap/snap-subdir-test 2024-04-26T18:01:08.299 INFO:tasks.workunit.client.0.smithi139.stdout:./183/.snap/snap-subdir-test 2024-04-26T18:01:08.304 INFO:tasks.workunit.client.0.smithi139.stdout:./294/.snap/snap-subdir-test 2024-04-26T18:01:08.308 INFO:tasks.workunit.client.0.smithi139.stdout:./235/.snap/snap-subdir-test 2024-04-26T18:01:08.319 INFO:tasks.workunit.client.0.smithi139.stdout:./177/.snap/snap-subdir-test 2024-04-26T18:01:08.323 INFO:tasks.workunit.client.0.smithi139.stdout:./169/.snap/snap-subdir-test 2024-04-26T18:01:08.327 INFO:tasks.workunit.client.0.smithi139.stdout:./212/.snap/snap-subdir-test 2024-04-26T18:01:08.332 INFO:tasks.workunit.client.0.smithi139.stdout:./154/.snap/snap-subdir-test 2024-04-26T18:01:08.336 INFO:tasks.workunit.client.0.smithi139.stdout:./171/.snap/snap-subdir-test 2024-04-26T18:01:08.340 INFO:tasks.workunit.client.0.smithi139.stdout:./139/.snap/snap-subdir-test 2024-04-26T18:01:08.344 INFO:tasks.workunit.client.0.smithi139.stdout:./102/.snap/snap-subdir-test 2024-04-26T18:01:08.348 INFO:tasks.workunit.client.0.smithi139.stdout:./129/.snap/snap-subdir-test 2024-04-26T18:01:13.602 INFO:tasks.workunit.client.0.smithi139.stdout:Delete all the files and directories ... 2024-04-26T18:01:14.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/19' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/15' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/31' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/36' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/20' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/12' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/39' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/10' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/34' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/38' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/11' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/16' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/32' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/30' 2024-04-26T18:01:14.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/14' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/18' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/13' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/33' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/17' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/35' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './100/37' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './100' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/19' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/15' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/31' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/36' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/20' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/12' 2024-04-26T18:01:14.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/39' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/10' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/34' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/38' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/11' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/16' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/32' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/30' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/14' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/18' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/13' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/33' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/17' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/35' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './101/37' 2024-04-26T18:01:14.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './101' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/19' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/15' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/31' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/36' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/20' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/12' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/39' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/10' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/34' 2024-04-26T18:01:14.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/38' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/11' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/16' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/32' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/30' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/14' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/18' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/13' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/33' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/17' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/35' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './102/37' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './102' 2024-04-26T18:01:14.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/19' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/15' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/31' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/36' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/20' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/12' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/39' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/10' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/34' 2024-04-26T18:01:14.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/38' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/11' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/16' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/32' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/30' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/14' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/18' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/13' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/33' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/17' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/35' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './103/37' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './103' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/19' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/15' 2024-04-26T18:01:14.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/31' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/36' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/20' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/12' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/39' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/10' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/34' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/38' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/11' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/16' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/32' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/30' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/14' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/18' 2024-04-26T18:01:14.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/13' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/33' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/17' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/35' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './104/37' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './104' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/19' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/15' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/31' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/36' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/20' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/12' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/39' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/10' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/34' 2024-04-26T18:01:14.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/38' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/11' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/16' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/32' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/30' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/14' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/18' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/13' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/33' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/17' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/35' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './105/37' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './105' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/19' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/15' 2024-04-26T18:01:14.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/31' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/36' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/20' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/12' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/39' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/10' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/34' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/38' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/11' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/16' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/32' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/30' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/14' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/18' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/13' 2024-04-26T18:01:14.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/33' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/17' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/35' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './106/37' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './106' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/19' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/15' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/31' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/36' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/20' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/12' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/39' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/10' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/34' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/38' 2024-04-26T18:01:14.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/11' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/16' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/32' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/30' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/14' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/18' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/13' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/33' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/17' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/35' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './107/37' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './107' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/19' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/15' 2024-04-26T18:01:14.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/31' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/36' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/20' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/12' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/39' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/10' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/34' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/38' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/11' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/16' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/32' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/30' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/14' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/18' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/13' 2024-04-26T18:01:14.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/33' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/17' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/35' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './108/37' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './108' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/19' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/15' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/31' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/36' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/20' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/12' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/39' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/10' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/34' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/38' 2024-04-26T18:01:14.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/11' 2024-04-26T18:01:14.322 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/16' 2024-04-26T18:01:14.322 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/32' 2024-04-26T18:01:14.322 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/30' 2024-04-26T18:01:15.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/14' 2024-04-26T18:01:15.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/18' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/13' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/33' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/17' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/35' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './109/37' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './109' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/19' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/15' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/31' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/36' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/20' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/12' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/39' 2024-04-26T18:01:15.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/10' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/34' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/38' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/11' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/16' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/32' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/30' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/14' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/18' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/13' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/33' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/17' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/35' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './110/37' 2024-04-26T18:01:15.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './110' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/19' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/15' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/31' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/36' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/20' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/12' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/39' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/10' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/34' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/38' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/11' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/16' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/32' 2024-04-26T18:01:15.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/30' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/14' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/18' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/13' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/33' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/17' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/35' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './111/37' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './111' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/19' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/15' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/31' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/36' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/20' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/12' 2024-04-26T18:01:15.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/39' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/10' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/34' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/38' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/11' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/16' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/32' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/30' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/14' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/18' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/13' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/33' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/17' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/35' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './112/37' 2024-04-26T18:01:15.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './112' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/19' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/15' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/31' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/36' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/20' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/12' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/39' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/10' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/34' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/38' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/11' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/16' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/32' 2024-04-26T18:01:15.766 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/30' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/14' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/18' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/13' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/33' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/17' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/35' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './113/37' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './113' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/19' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/15' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/31' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/36' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/20' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/12' 2024-04-26T18:01:15.767 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/39' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/10' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/34' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/38' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/11' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/16' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/32' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/30' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/14' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/18' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/13' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/33' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/17' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/35' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed './114/37' 2024-04-26T18:01:15.768 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './114' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/19' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/15' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/31' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/36' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/20' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/12' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/39' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/10' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/34' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/38' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/11' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/16' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/32' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/30' 2024-04-26T18:01:15.769 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/14' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/18' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/13' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/33' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/17' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/35' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './115/37' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './115' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/19' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/15' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/31' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/36' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/20' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/12' 2024-04-26T18:01:15.770 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/39' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/10' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/34' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/38' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/11' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/16' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/32' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/30' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/14' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/18' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/13' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/33' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/17' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/35' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed './116/37' 2024-04-26T18:01:15.771 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './116' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/19' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/15' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/31' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/36' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/20' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/12' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/39' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/10' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/34' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/38' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/11' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/16' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/32' 2024-04-26T18:01:15.772 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/30' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/14' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/18' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/13' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/33' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/17' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/35' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './117/37' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './117' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/19' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/15' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/31' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/36' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/20' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/12' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/39' 2024-04-26T18:01:15.773 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/10' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/34' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/38' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/11' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/16' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/32' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/30' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/14' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/18' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/13' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/33' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/17' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/35' 2024-04-26T18:01:15.774 INFO:tasks.workunit.client.0.smithi139.stdout:removed './118/37' 2024-04-26T18:01:15.775 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './118' 2024-04-26T18:01:15.775 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/19' 2024-04-26T18:01:15.775 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/15' 2024-04-26T18:01:15.775 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/31' 2024-04-26T18:01:15.775 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/36' 2024-04-26T18:01:15.775 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/20' 2024-04-26T18:01:15.775 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/12' 2024-04-26T18:01:17.519 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/39' 2024-04-26T18:01:17.519 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/10' 2024-04-26T18:01:17.519 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/34' 2024-04-26T18:01:17.519 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/38' 2024-04-26T18:01:17.519 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/11' 2024-04-26T18:01:17.519 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/16' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/32' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/30' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/14' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/18' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/13' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/33' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/17' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/35' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './119/37' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './119' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/19' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/15' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/31' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/36' 2024-04-26T18:01:17.520 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/20' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/12' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/39' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/10' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/34' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/38' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/11' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/16' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/32' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/30' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/14' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/18' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/13' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/33' 2024-04-26T18:01:17.521 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/17' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/35' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './120/37' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './120' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/19' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/15' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/31' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/36' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/20' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/12' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/39' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/10' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/34' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/38' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/11' 2024-04-26T18:01:17.522 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/16' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/32' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/30' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/14' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/18' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/13' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/33' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/17' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/35' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './121/37' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './121' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/19' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/15' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/31' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/36' 2024-04-26T18:01:17.523 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/20' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/12' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/39' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/10' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/34' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/38' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/11' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/16' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/32' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/30' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/14' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/18' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/13' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/33' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/17' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/35' 2024-04-26T18:01:17.524 INFO:tasks.workunit.client.0.smithi139.stdout:removed './122/37' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './122' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/19' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/15' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/31' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/36' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/20' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/12' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/39' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/10' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/34' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/38' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/11' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/16' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/32' 2024-04-26T18:01:17.525 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/30' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/14' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/18' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/13' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/33' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/17' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/35' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './123/37' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './123' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/19' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/15' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/31' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/36' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/20' 2024-04-26T18:01:17.526 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/12' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/39' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/10' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/34' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/38' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/11' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/16' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/32' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/30' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/14' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/18' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/13' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/33' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/17' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/35' 2024-04-26T18:01:17.527 INFO:tasks.workunit.client.0.smithi139.stdout:removed './124/37' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './124' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/19' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/15' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/31' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/36' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/20' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/12' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/39' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/10' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/34' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/38' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/11' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/16' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/32' 2024-04-26T18:01:17.528 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/30' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/14' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/18' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/13' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/33' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/17' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/35' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './125/37' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './125' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/19' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/15' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/31' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/36' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/20' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/12' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/39' 2024-04-26T18:01:17.529 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/10' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/34' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/38' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/11' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/16' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/32' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/30' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/14' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/18' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/13' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/33' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/17' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/35' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed './126/37' 2024-04-26T18:01:17.530 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './126' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/19' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/15' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/31' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/36' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/20' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/12' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/39' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/10' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/34' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/38' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/11' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/16' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/32' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/30' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/14' 2024-04-26T18:01:17.531 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/18' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/13' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/33' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/17' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/35' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './127/37' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './127' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/19' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/15' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/31' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/36' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/20' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/12' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/39' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/10' 2024-04-26T18:01:17.532 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/34' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/38' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/11' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/16' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/32' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/30' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/14' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/18' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/13' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/33' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/17' 2024-04-26T18:01:17.533 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/35' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed './128/37' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './128' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/19' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/15' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/31' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/36' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/20' 2024-04-26T18:01:18.192 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/12' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/39' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/10' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/34' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/38' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/11' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/16' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/32' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/30' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/14' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/18' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/13' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/33' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/17' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/35' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed './129/37' 2024-04-26T18:01:18.193 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './129' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/19' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/15' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/31' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/36' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/20' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/12' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/39' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/10' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/34' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/38' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/11' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/16' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/32' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/30' 2024-04-26T18:01:18.194 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/14' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/18' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/13' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/33' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/17' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/35' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './130/37' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './130' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/19' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/15' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/31' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/36' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/20' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/12' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/39' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/10' 2024-04-26T18:01:18.195 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/34' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/38' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/11' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/16' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/32' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/30' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/14' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/18' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/13' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/33' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/17' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/35' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './131/37' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './131' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/19' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/15' 2024-04-26T18:01:18.196 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/31' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/36' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/20' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/12' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/39' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/10' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/34' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/38' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/11' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/16' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/32' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/30' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/14' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/18' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/13' 2024-04-26T18:01:18.197 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/33' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/17' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/35' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './132/37' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './132' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/19' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/15' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/31' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/36' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/20' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/12' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/39' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/10' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/34' 2024-04-26T18:01:18.198 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/38' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/11' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/16' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/32' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/30' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/14' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/18' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/13' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/33' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/17' 2024-04-26T18:01:18.199 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/35' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './133/37' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './133' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/19' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/15' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/31' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/36' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/20' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/12' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/39' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/10' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/34' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/38' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/11' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/16' 2024-04-26T18:01:18.200 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/32' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/30' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/14' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/18' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/13' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/33' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/17' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/35' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './134/37' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './134' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/19' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/15' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/31' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/36' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/20' 2024-04-26T18:01:18.201 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/12' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/39' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/10' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/34' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/38' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/11' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/16' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/32' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/30' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/14' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/18' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/13' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/33' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/17' 2024-04-26T18:01:18.202 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/35' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './135/37' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './135' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/19' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/15' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/31' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/36' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/20' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/12' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/39' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/10' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/34' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/38' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/11' 2024-04-26T18:01:18.203 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/16' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/32' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/30' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/14' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/18' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/13' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/33' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/17' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/35' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './136/37' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './136' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/19' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/15' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/31' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/36' 2024-04-26T18:01:18.204 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/20' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/12' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/39' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/10' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/34' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/38' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/11' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/16' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/32' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/30' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/14' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/18' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/13' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/33' 2024-04-26T18:01:18.205 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/17' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/35' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './137/37' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './137' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/19' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/15' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/31' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/36' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/20' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/12' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/39' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/10' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/34' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/38' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/11' 2024-04-26T18:01:18.206 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/16' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/32' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/30' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/14' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/18' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/13' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/33' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/17' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/35' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './138/37' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './138' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/19' 2024-04-26T18:01:18.657 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/15' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/31' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/36' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/20' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/12' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/39' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/10' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/34' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/38' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/11' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/16' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/32' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/30' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/14' 2024-04-26T18:01:18.658 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/18' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/13' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/33' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/17' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/35' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './139/37' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './139' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/19' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/15' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/31' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/36' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/20' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/12' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/39' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/10' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/34' 2024-04-26T18:01:18.659 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/38' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/11' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/16' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/32' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/30' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/14' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/18' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/13' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/33' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/17' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/35' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './140/37' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './140' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/19' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/15' 2024-04-26T18:01:18.660 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/31' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/36' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/20' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/12' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/39' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/10' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/34' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/38' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/11' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/16' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/32' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/30' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/14' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/18' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/13' 2024-04-26T18:01:18.661 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/33' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/17' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/35' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './141/37' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './141' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/19' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/15' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/31' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/36' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/20' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/12' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/39' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/10' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/34' 2024-04-26T18:01:18.662 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/38' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/11' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/16' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/32' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/30' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/14' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/18' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/13' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/33' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/17' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/35' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './142/37' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './142' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/19' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/15' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/31' 2024-04-26T18:01:18.663 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/36' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/20' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/12' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/39' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/10' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/34' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/38' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/11' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/16' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/32' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/30' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/14' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/18' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/13' 2024-04-26T18:01:18.664 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/33' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/17' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/35' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './143/37' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './143' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/19' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/15' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/31' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/36' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/20' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/12' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/39' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/10' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/34' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/38' 2024-04-26T18:01:18.665 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/11' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/16' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/32' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/30' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/14' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/18' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/13' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/33' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/17' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/35' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './144/37' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './144' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/19' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/15' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/31' 2024-04-26T18:01:18.666 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/36' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/20' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/12' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/39' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/10' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/34' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/38' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/11' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/16' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/32' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/30' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/14' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/18' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/13' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/33' 2024-04-26T18:01:18.667 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/17' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/35' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './145/37' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './145' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/19' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/15' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/31' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/36' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/20' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/12' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/39' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/10' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/34' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/38' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/11' 2024-04-26T18:01:18.668 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/16' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/32' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/30' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/14' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/18' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/13' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/33' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/17' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/35' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './146/37' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './146' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/19' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/15' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/31' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/36' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/20' 2024-04-26T18:01:18.669 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/12' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/39' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/10' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/34' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/38' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/11' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/16' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/32' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/30' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/14' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/18' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/13' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/33' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/17' 2024-04-26T18:01:18.670 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/35' 2024-04-26T18:01:18.671 INFO:tasks.workunit.client.0.smithi139.stdout:removed './147/37' 2024-04-26T18:01:18.671 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './147' 2024-04-26T18:01:18.671 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/19' 2024-04-26T18:01:18.671 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/15' 2024-04-26T18:01:18.671 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/31' 2024-04-26T18:01:18.671 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/36' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/20' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/12' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/39' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/10' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/34' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/38' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/11' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/16' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/32' 2024-04-26T18:01:20.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/30' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/14' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/18' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/13' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/33' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/17' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/35' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './148/37' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './148' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/19' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/15' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/31' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/36' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/20' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/12' 2024-04-26T18:01:20.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/39' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/10' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/34' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/38' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/11' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/16' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/32' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/30' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/14' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/18' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/13' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/33' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/17' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/35' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './149/37' 2024-04-26T18:01:20.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './149' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/19' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/15' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/31' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/36' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/20' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/12' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/39' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/10' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/34' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/38' 2024-04-26T18:01:20.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/11' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/16' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/32' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/30' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/14' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/18' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/13' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/33' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/17' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/35' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './150/37' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './150' 2024-04-26T18:01:20.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/19' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/15' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/31' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/36' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/20' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/12' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/39' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/10' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/34' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/38' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/11' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/16' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/32' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/30' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/14' 2024-04-26T18:01:20.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/18' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/13' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/33' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/17' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/35' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './151/37' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './151' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/19' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/15' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/31' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/36' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/20' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/12' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/39' 2024-04-26T18:01:20.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/10' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/34' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/38' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/11' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/16' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/32' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/30' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/14' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/18' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/13' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/33' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/17' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/35' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './152/37' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './152' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/19' 2024-04-26T18:01:20.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/15' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/31' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/36' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/20' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/12' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/39' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/10' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/34' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/38' 2024-04-26T18:01:20.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/11' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/16' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/32' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/30' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/14' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/18' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/13' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/33' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/17' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/35' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './153/37' 2024-04-26T18:01:20.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './153' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/19' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/15' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/31' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/36' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/20' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/12' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/39' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/10' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/34' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/38' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/11' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/16' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/32' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/30' 2024-04-26T18:01:20.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/14' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/18' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/13' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/33' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/17' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/35' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './154/37' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './154' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/19' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/15' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/31' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/36' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/20' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/12' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/39' 2024-04-26T18:01:20.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/10' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/34' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/38' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/11' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/16' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/32' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/30' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/14' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/18' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/13' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/33' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/17' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/35' 2024-04-26T18:01:20.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './155/37' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './155' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/19' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/15' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/31' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/36' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/20' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/12' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/39' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/10' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/34' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/38' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/11' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/16' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/32' 2024-04-26T18:01:20.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/30' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/14' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/18' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/13' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/33' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/17' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/35' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './156/37' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './156' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/19' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/15' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/31' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/36' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/20' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/12' 2024-04-26T18:01:20.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/39' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/10' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/34' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/38' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/11' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/16' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/32' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/30' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/14' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/18' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/13' 2024-04-26T18:01:20.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/33' 2024-04-26T18:01:23.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/17' 2024-04-26T18:01:23.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/35' 2024-04-26T18:01:23.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './157/37' 2024-04-26T18:01:23.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './157' 2024-04-26T18:01:23.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/19' 2024-04-26T18:01:23.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/15' 2024-04-26T18:01:23.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/31' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/36' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/20' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/12' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/39' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/10' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/34' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/38' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/11' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/16' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/32' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/30' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/14' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/18' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/13' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/33' 2024-04-26T18:01:23.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/17' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/35' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './158/37' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './158' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/19' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/15' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/31' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/36' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/20' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/12' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/39' 2024-04-26T18:01:23.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/10' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/34' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/38' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/11' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/16' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/32' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/30' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/14' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/18' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/13' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/33' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/17' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/35' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './159/37' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './159' 2024-04-26T18:01:23.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/19' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/15' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/31' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/36' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/20' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/12' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/39' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/10' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/34' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/38' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/11' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/16' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/32' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/30' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/14' 2024-04-26T18:01:23.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/18' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/13' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/33' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/17' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/35' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './160/37' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './160' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/19' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/15' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/31' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/36' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/20' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/12' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/39' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/10' 2024-04-26T18:01:23.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/34' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/38' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/11' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/16' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/32' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/30' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/14' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/18' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/13' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/33' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/17' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/35' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './161/37' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './161' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/19' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/15' 2024-04-26T18:01:23.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/31' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/36' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/20' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/12' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/39' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/10' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/34' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/38' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/11' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/16' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/32' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/30' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/14' 2024-04-26T18:01:23.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/18' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/13' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/33' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/17' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/35' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './162/37' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './162' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/19' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/15' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/31' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/36' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/20' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/12' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/39' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/10' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/34' 2024-04-26T18:01:23.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/38' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/11' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/16' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/32' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/30' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/14' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/18' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/13' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/33' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/17' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/35' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './163/37' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './163' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/19' 2024-04-26T18:01:23.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/15' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/31' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/36' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/20' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/12' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/39' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/10' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/34' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/38' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/11' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/16' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/32' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/30' 2024-04-26T18:01:23.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/14' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/18' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/13' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/33' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/17' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/35' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './164/37' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './164' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/19' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/15' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/31' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/36' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/20' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/12' 2024-04-26T18:01:23.886 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/39' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/10' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/34' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/38' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/11' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/16' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/32' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/30' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/14' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/18' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/13' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/33' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/17' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/35' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed './165/37' 2024-04-26T18:01:23.887 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './165' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/19' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/15' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/31' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/36' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/20' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/12' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/39' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/10' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/34' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/38' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/11' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/16' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/32' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/30' 2024-04-26T18:01:23.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/14' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/18' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/13' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/33' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/17' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/35' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './166/37' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './166' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/19' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/15' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/31' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/36' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/20' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/12' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/39' 2024-04-26T18:01:23.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/10' 2024-04-26T18:01:23.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/34' 2024-04-26T18:01:23.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/38' 2024-04-26T18:01:27.043 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/11' 2024-04-26T18:01:27.043 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/16' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/32' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/30' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/14' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/18' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/13' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/33' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/17' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/35' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './167/37' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './167' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/19' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/15' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/31' 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/36' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/20' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/12' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/39' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/10' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/34' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/38' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/11' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/16' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/32' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/30' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/14' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/18' 2024-04-26T18:01:27.045 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/13' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/33' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/17' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/35' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './168/37' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './168' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/19' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/15' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/31' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/36' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/20' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/12' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/39' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/10' 2024-04-26T18:01:27.046 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/34' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/38' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/11' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/16' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/32' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/30' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/14' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/18' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/13' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/33' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/17' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/35' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './169/37' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './169' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/19' 2024-04-26T18:01:27.047 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/15' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/31' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/36' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/20' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/12' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/39' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/10' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/34' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/38' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/11' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/16' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/32' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/30' 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/14' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/18' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/13' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/33' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/17' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/35' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './170/37' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './170' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/19' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/15' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/31' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/36' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/20' 2024-04-26T18:01:27.049 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/12' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/39' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/10' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/34' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/38' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/11' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/16' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/32' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/30' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/14' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/18' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/13' 2024-04-26T18:01:27.050 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/33' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/17' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/35' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './171/37' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './171' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/19' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/15' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/31' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/36' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/20' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/12' 2024-04-26T18:01:27.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/39' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/10' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/34' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/38' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/11' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/16' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/32' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/30' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/14' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/18' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/13' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/33' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/17' 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/35' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './172/37' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './172' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/19' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/15' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/31' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/36' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/20' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/12' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/39' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/10' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/34' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/38' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/11' 2024-04-26T18:01:27.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/16' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/32' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/30' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/14' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/18' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/13' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/33' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/17' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/35' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './173/37' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './173' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/19' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/15' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/31' 2024-04-26T18:01:27.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/36' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/20' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/12' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/39' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/10' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/34' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/38' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/11' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/16' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/32' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/30' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/14' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/18' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/13' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/33' 2024-04-26T18:01:27.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/17' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/35' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './174/37' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './174' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/19' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/15' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/31' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/36' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/20' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/12' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/39' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/10' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/34' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/38' 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/11' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/16' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/32' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/30' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/14' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/18' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/13' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/33' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/17' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/35' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './175/37' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './175' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/19' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/15' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/31' 2024-04-26T18:01:27.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/36' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/20' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/12' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/39' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/10' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/34' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/38' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/11' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/16' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/32' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/30' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/14' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/18' 2024-04-26T18:01:27.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/13' 2024-04-26T18:01:27.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/33' 2024-04-26T18:01:27.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/17' 2024-04-26T18:01:27.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/35' 2024-04-26T18:01:27.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './176/37' 2024-04-26T18:01:27.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './176' 2024-04-26T18:01:27.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/19' 2024-04-26T18:01:27.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/15' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/31' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/36' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/20' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/12' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/39' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/10' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/34' 2024-04-26T18:01:28.534 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/38' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/11' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/16' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/32' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/30' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/14' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/18' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/13' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/33' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/17' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/35' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed './177/37' 2024-04-26T18:01:28.535 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './177' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/19' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/15' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/31' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/36' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/20' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/12' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/39' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/10' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/34' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/38' 2024-04-26T18:01:28.536 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/11' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/16' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/32' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/30' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/14' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/18' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/13' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/33' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/17' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/35' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './178/37' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './178' 2024-04-26T18:01:28.537 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/19' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/15' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/31' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/36' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/20' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/12' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/39' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/10' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/34' 2024-04-26T18:01:28.538 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/38' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/11' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/16' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/32' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/30' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/14' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/18' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/13' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/33' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/17' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/35' 2024-04-26T18:01:28.539 INFO:tasks.workunit.client.0.smithi139.stdout:removed './179/37' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './179' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/19' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/15' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/31' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/36' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/20' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/12' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/39' 2024-04-26T18:01:28.540 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/10' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/34' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/38' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/11' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/16' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/32' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/30' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/14' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/18' 2024-04-26T18:01:28.541 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/13' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/33' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/17' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/35' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './180/37' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './180' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/19' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/15' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/31' 2024-04-26T18:01:28.542 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/36' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/20' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/12' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/39' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/10' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/34' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/38' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/11' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/16' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/32' 2024-04-26T18:01:28.543 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/30' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/14' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/18' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/13' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/33' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/17' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/35' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './181/37' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './181' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/19' 2024-04-26T18:01:28.544 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/15' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/31' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/36' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/20' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/12' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/39' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/10' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/34' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/38' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/11' 2024-04-26T18:01:28.545 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/16' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/32' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/30' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/14' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/18' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/13' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/33' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/17' 2024-04-26T18:01:28.546 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/35' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './182/37' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './182' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/19' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/15' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/31' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/36' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/20' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/12' 2024-04-26T18:01:28.547 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/39' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/10' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/34' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/38' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/11' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/16' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/32' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/30' 2024-04-26T18:01:28.548 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/14' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/18' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/13' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/33' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/17' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/35' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './183/37' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './183' 2024-04-26T18:01:28.549 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/19' 2024-04-26T18:01:28.550 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/15' 2024-04-26T18:01:28.550 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/31' 2024-04-26T18:01:28.550 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/36' 2024-04-26T18:01:28.550 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/20' 2024-04-26T18:01:28.550 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/12' 2024-04-26T18:01:28.550 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/39' 2024-04-26T18:01:28.551 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/10' 2024-04-26T18:01:28.551 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/34' 2024-04-26T18:01:28.551 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/38' 2024-04-26T18:01:28.551 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/11' 2024-04-26T18:01:28.551 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/16' 2024-04-26T18:01:28.551 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/32' 2024-04-26T18:01:28.551 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/30' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/14' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/18' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/13' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/33' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/17' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/35' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './184/37' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './184' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/19' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/15' 2024-04-26T18:01:28.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/31' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/36' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/20' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/12' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/39' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/10' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/34' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/38' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/11' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/16' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/32' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/30' 2024-04-26T18:01:28.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/14' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/18' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/13' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/33' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/17' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/35' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './185/37' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './185' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/19' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/15' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/31' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/36' 2024-04-26T18:01:28.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/20' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/12' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/39' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/10' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/34' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/38' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/11' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/16' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/32' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/30' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/14' 2024-04-26T18:01:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/18' 2024-04-26T18:01:31.466 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/13' 2024-04-26T18:01:31.467 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/33' 2024-04-26T18:01:31.467 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/17' 2024-04-26T18:01:31.467 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/35' 2024-04-26T18:01:31.467 INFO:tasks.workunit.client.0.smithi139.stdout:removed './186/37' 2024-04-26T18:01:31.467 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './186' 2024-04-26T18:01:31.467 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/19' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/15' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/31' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/36' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/20' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/12' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/39' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/10' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/34' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/38' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/11' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/16' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/32' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/30' 2024-04-26T18:01:31.468 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/14' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/18' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/13' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/33' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/17' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/35' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './187/37' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './187' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/19' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/15' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/31' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/36' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/20' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/12' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/39' 2024-04-26T18:01:31.469 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/10' 2024-04-26T18:01:31.470 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/34' 2024-04-26T18:01:31.470 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/38' 2024-04-26T18:01:31.470 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/11' 2024-04-26T18:01:31.470 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/16' 2024-04-26T18:01:31.470 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/32' 2024-04-26T18:01:31.470 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/30' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/14' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/18' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/13' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/33' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/17' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/35' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './188/37' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './188' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/19' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/15' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/31' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/36' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/20' 2024-04-26T18:01:31.471 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/12' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/39' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/10' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/34' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/38' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/11' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/16' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/32' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/30' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/14' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/18' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/13' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/33' 2024-04-26T18:01:31.472 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/17' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/35' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed './189/37' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './189' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/19' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/15' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/31' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/36' 2024-04-26T18:01:31.473 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/20' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/12' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/39' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/10' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/34' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/38' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/11' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/16' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/32' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/30' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/14' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/18' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/13' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/33' 2024-04-26T18:01:31.474 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/17' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/35' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './190/37' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './190' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/19' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/15' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/31' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/36' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/20' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/12' 2024-04-26T18:01:31.475 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/39' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/10' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/34' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/38' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/11' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/16' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/32' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/30' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/14' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/18' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/13' 2024-04-26T18:01:31.476 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/33' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/17' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/35' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './191/37' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './191' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/19' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/15' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/31' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/36' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/20' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/12' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/39' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/10' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/34' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/38' 2024-04-26T18:01:31.477 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/11' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/16' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/32' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/30' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/14' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/18' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/13' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/33' 2024-04-26T18:01:31.478 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/17' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/35' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './192/37' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './192' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/19' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/15' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/31' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/36' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/20' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/12' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/39' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/10' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/34' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/38' 2024-04-26T18:01:31.479 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/11' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/16' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/32' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/30' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/14' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/18' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/13' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/33' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/17' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/35' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './193/37' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './193' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/19' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/15' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/31' 2024-04-26T18:01:31.480 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/36' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/20' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/12' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/39' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/10' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/34' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/38' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/11' 2024-04-26T18:01:31.481 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/16' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/32' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/30' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/14' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/18' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/13' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/33' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/17' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/35' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './194/37' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './194' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/19' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/15' 2024-04-26T18:01:31.482 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/31' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/36' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/20' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/12' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/39' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/10' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/34' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/38' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/11' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/16' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/32' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/30' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/14' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/18' 2024-04-26T18:01:31.483 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/13' 2024-04-26T18:01:31.484 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/33' 2024-04-26T18:01:31.484 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/17' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/35' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './195/37' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './195' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/19' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/15' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/31' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/36' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/20' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/12' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/39' 2024-04-26T18:01:31.485 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/10' 2024-04-26T18:01:31.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/34' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/38' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/11' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/16' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/32' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/30' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/14' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/18' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/13' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/33' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/17' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/35' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './196/37' 2024-04-26T18:01:31.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './196' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/19' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/15' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/31' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/36' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/20' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/12' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/39' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/10' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/34' 2024-04-26T18:01:31.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/38' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/11' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/16' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/32' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/30' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/14' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/18' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/13' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/33' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/17' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/35' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './197/37' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './197' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/19' 2024-04-26T18:01:31.873 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/15' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/31' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/36' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/20' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/12' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/39' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/10' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/34' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/38' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/11' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/16' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/32' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/30' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/14' 2024-04-26T18:01:31.874 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/18' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/13' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/33' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/17' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/35' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './198/37' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './198' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/19' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/15' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/31' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/36' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/20' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/12' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/39' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/10' 2024-04-26T18:01:31.875 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/34' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/38' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/11' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/16' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/32' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/30' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/14' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/18' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/13' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/33' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/17' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/35' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './199/37' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './199' 2024-04-26T18:01:31.876 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/21' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/27' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/31' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/36' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/20' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/39' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/34' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/38' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/28' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/24' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/29' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/32' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/22' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/25' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/30' 2024-04-26T18:01:31.877 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/33' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/23' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/35' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/26' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './200/37' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './200' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/21' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/27' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/31' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/36' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/20' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/39' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/34' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/38' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/28' 2024-04-26T18:01:31.878 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/24' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/29' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/32' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/22' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/25' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/30' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/33' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/23' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/35' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/26' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './201/37' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './201' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/21' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/27' 2024-04-26T18:01:31.879 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/31' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/36' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/20' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/39' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/34' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/38' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/28' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/24' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/29' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/32' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/22' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/25' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/30' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/33' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/23' 2024-04-26T18:01:31.880 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/35' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/26' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './202/37' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './202' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/21' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/27' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/31' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/36' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/20' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/39' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/34' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/38' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/28' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/24' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/29' 2024-04-26T18:01:31.881 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/32' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/22' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/25' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/30' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/33' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/23' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/35' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/26' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './203/37' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './203' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/21' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/27' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/31' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/36' 2024-04-26T18:01:31.882 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/20' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/39' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/34' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/38' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/28' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/24' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/29' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/32' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/22' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/25' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/30' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/33' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/23' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/35' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/26' 2024-04-26T18:01:31.883 INFO:tasks.workunit.client.0.smithi139.stdout:removed './204/37' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './204' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/21' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/27' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/31' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/36' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/20' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/39' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/34' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/38' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/28' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/24' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/29' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/32' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/22' 2024-04-26T18:01:31.884 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/25' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/30' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/33' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/23' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/35' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/26' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './205/37' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './205' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/21' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/27' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/31' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/36' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/20' 2024-04-26T18:01:31.885 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/39' 2024-04-26T18:01:35.501 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/34' 2024-04-26T18:01:35.501 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/38' 2024-04-26T18:01:35.501 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/28' 2024-04-26T18:01:35.501 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/24' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/29' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/32' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/22' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/25' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/30' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/33' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/23' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/35' 2024-04-26T18:01:35.502 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/26' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './206/37' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './206' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/21' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/27' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/31' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/36' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/20' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/39' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/34' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/38' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/28' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/24' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/29' 2024-04-26T18:01:35.503 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/32' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/22' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/25' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/30' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/33' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/23' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/35' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/26' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './207/37' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './207' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/21' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/27' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/31' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/36' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/20' 2024-04-26T18:01:35.504 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/39' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/34' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/38' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/28' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/24' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/29' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/32' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/22' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/25' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/30' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/33' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/23' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/35' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/26' 2024-04-26T18:01:35.505 INFO:tasks.workunit.client.0.smithi139.stdout:removed './208/37' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './208' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/21' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/27' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/31' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/36' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/20' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/39' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/34' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/38' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/28' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/24' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/29' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/32' 2024-04-26T18:01:35.506 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/22' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/25' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/30' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/33' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/23' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/35' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/26' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './209/37' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './209' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/21' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/27' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/31' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/36' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/20' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/39' 2024-04-26T18:01:35.507 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/34' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/38' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/28' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/24' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/29' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/32' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/22' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/25' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/30' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/33' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/23' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/35' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/26' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './210/37' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './210' 2024-04-26T18:01:35.508 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/21' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/27' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/31' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/36' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/20' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/39' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/34' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/38' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/28' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/24' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/29' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/32' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/22' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/25' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/30' 2024-04-26T18:01:35.509 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/33' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/23' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/35' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/26' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './211/37' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './211' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/21' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/27' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/31' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/36' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/20' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/39' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/34' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/38' 2024-04-26T18:01:35.510 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/28' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/24' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/29' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/32' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/22' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/25' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/30' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/33' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/23' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/35' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/26' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './212/37' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './212' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/21' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/27' 2024-04-26T18:01:35.511 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/31' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/36' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/20' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/39' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/34' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/38' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/28' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/24' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/29' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/32' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/22' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/25' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/30' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/33' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/23' 2024-04-26T18:01:35.512 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/35' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/26' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './213/37' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './213' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/21' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/27' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/31' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/36' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/20' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/39' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/34' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/38' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/28' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/24' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/29' 2024-04-26T18:01:35.513 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/32' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/22' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/25' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/30' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/33' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/23' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/35' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/26' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './214/37' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './214' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/21' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/27' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/31' 2024-04-26T18:01:35.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/36' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/20' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/39' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/34' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/38' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/28' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/24' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/29' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/32' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/22' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/25' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/30' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/33' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/23' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/35' 2024-04-26T18:01:35.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/26' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './215/37' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './215' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/21' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/27' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/31' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/36' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/20' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/39' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/34' 2024-04-26T18:01:35.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/38' 2024-04-26T18:01:36.107 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:36.110 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:36.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/28' 2024-04-26T18:01:36.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/24' 2024-04-26T18:01:36.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/29' 2024-04-26T18:01:36.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/32' 2024-04-26T18:01:36.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/22' 2024-04-26T18:01:36.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/25' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/30' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/33' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/23' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/35' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/26' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './216/37' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './216' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/21' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/27' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/31' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/36' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/20' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/39' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/34' 2024-04-26T18:01:36.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/38' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/28' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/24' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/29' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/32' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/22' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/25' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/30' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/33' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/23' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/35' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/26' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './217/37' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './217' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/21' 2024-04-26T18:01:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/27' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/31' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/36' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/20' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/39' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/34' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/38' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/28' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/24' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/29' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/32' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/22' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/25' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/30' 2024-04-26T18:01:36.614 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/33' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/23' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/35' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/26' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './218/37' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './218' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/21' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/27' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/31' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/36' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/20' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/39' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/34' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/38' 2024-04-26T18:01:36.615 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/28' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/24' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/29' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/32' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/22' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/25' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/30' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/33' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/23' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/35' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/26' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './219/37' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './219' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/21' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/27' 2024-04-26T18:01:36.616 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/31' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/36' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/20' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/39' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/34' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/38' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/28' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/24' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/29' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/32' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/22' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/25' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/30' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/33' 2024-04-26T18:01:36.617 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/23' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/35' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/26' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './220/37' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './220' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/21' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/27' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/31' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/36' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/20' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/39' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/34' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/38' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/28' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/24' 2024-04-26T18:01:36.618 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/29' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/32' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/22' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/25' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/30' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/33' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/23' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/35' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/26' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './221/37' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './221' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/21' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/27' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/31' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/36' 2024-04-26T18:01:36.619 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/20' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/39' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/34' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/38' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/28' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/24' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/29' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/32' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/22' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/25' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/30' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/33' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/23' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/35' 2024-04-26T18:01:36.620 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/26' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './222/37' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './222' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/21' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/27' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/31' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/36' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/20' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/39' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/34' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/38' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/28' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/24' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/29' 2024-04-26T18:01:36.621 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/32' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/22' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/25' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/30' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/33' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/23' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/35' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/26' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './223/37' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './223' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/21' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/27' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/31' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/36' 2024-04-26T18:01:36.622 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/20' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/39' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/34' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/38' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/28' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/24' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/29' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/32' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/22' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/25' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/30' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/33' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/23' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/35' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/26' 2024-04-26T18:01:36.623 INFO:tasks.workunit.client.0.smithi139.stdout:removed './224/37' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './224' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/21' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/27' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/31' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/36' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/20' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/39' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/34' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/38' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/28' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/24' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/29' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/32' 2024-04-26T18:01:36.624 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/22' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/25' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/30' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/33' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/23' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/35' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/26' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './225/37' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './225' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/21' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/27' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/31' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/36' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/20' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/39' 2024-04-26T18:01:36.625 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/34' 2024-04-26T18:01:36.626 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/38' 2024-04-26T18:01:36.626 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/28' 2024-04-26T18:01:36.626 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/24' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/29' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/32' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/22' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/25' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/30' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/33' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/23' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/35' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/26' 2024-04-26T18:01:38.393 INFO:tasks.workunit.client.0.smithi139.stdout:removed './226/37' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './226' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/21' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/27' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/31' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/36' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/20' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/39' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/34' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/38' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/28' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/24' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/29' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/32' 2024-04-26T18:01:38.394 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/22' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/25' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/30' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/33' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/23' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/35' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/26' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './227/37' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './227' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/21' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/27' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/31' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/36' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/20' 2024-04-26T18:01:38.395 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/39' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/34' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/38' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/28' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/24' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/29' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/32' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/22' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/25' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/30' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/33' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/23' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/35' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/26' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed './228/37' 2024-04-26T18:01:38.396 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './228' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/21' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/27' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/31' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/36' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/20' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/39' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/34' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/38' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/28' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/24' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/29' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/32' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/22' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/25' 2024-04-26T18:01:38.397 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/30' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/33' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/23' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/35' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/26' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './229/37' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './229' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/21' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/27' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/31' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/36' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/20' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/39' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/34' 2024-04-26T18:01:38.398 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/38' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/28' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/24' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/29' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/32' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/22' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/25' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/30' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/33' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/23' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/35' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/26' 2024-04-26T18:01:38.399 INFO:tasks.workunit.client.0.smithi139.stdout:removed './230/37' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './230' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/21' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/27' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/31' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/36' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/20' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/39' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/34' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/38' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/28' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/24' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/29' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/32' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/22' 2024-04-26T18:01:38.400 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/25' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/30' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/33' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/23' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/35' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/26' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './231/37' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './231' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/21' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/27' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/31' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/36' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/20' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/39' 2024-04-26T18:01:38.401 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/34' 2024-04-26T18:01:38.402 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/38' 2024-04-26T18:01:38.402 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/28' 2024-04-26T18:01:38.402 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/24' 2024-04-26T18:01:38.402 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/29' 2024-04-26T18:01:38.402 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/32' 2024-04-26T18:01:38.402 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/22' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/25' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/30' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/33' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/23' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/35' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/26' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './232/37' 2024-04-26T18:01:38.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './232' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/21' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/27' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/31' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/36' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/20' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/39' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/34' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/38' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/28' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/24' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/29' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/32' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/22' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/25' 2024-04-26T18:01:38.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/30' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/33' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/23' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/35' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/26' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './233/37' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './233' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/21' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/27' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/31' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/36' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/20' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/39' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/34' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/38' 2024-04-26T18:01:38.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/28' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/24' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/29' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/32' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/22' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/25' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/30' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/33' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/23' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/35' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/26' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './234/37' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './234' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/21' 2024-04-26T18:01:38.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/27' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/31' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/36' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/20' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/39' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/34' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/38' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/28' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/24' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/29' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/32' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/22' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/25' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/30' 2024-04-26T18:01:38.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/33' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/23' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/35' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/26' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './235/37' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './235' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/21' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/27' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/31' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/36' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/20' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/39' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/34' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/38' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/28' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/24' 2024-04-26T18:01:38.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/29' 2024-04-26T18:01:38.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/32' 2024-04-26T18:01:39.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/22' 2024-04-26T18:01:39.888 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/25' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/30' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/33' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/23' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/35' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/26' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './236/37' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './236' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/21' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/27' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/31' 2024-04-26T18:01:39.889 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/36' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/20' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/39' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/34' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/38' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/28' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/24' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/29' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/32' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/22' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/25' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/30' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/33' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/23' 2024-04-26T18:01:39.890 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/35' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/26' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './237/37' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './237' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/21' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/27' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/31' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/36' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/20' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/39' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/34' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/38' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/28' 2024-04-26T18:01:39.891 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/24' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/29' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/32' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/22' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/25' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/30' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/33' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/23' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/35' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/26' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './238/37' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './238' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/21' 2024-04-26T18:01:39.892 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/27' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/31' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/36' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/20' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/39' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/34' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/38' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/28' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/24' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/29' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/32' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/22' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/25' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/30' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/33' 2024-04-26T18:01:39.893 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/23' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/35' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/26' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './239/37' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './239' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/21' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/27' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/31' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/36' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/20' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/39' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/34' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/38' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/28' 2024-04-26T18:01:39.894 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/24' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/29' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/32' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/22' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/25' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/30' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/33' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/23' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/35' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/26' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './240/37' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './240' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/21' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/27' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/31' 2024-04-26T18:01:39.895 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/36' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/20' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/39' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/34' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/38' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/28' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/24' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/29' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/32' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/22' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/25' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/30' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/33' 2024-04-26T18:01:39.896 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/23' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/35' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/26' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './241/37' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './241' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/21' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/27' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/31' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/36' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/20' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/39' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/34' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/38' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/28' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/24' 2024-04-26T18:01:39.897 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/29' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/32' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/22' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/25' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/30' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/33' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/23' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/35' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/26' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './242/37' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './242' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/21' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/27' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/31' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/36' 2024-04-26T18:01:39.898 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/20' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/39' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/34' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/38' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/28' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/24' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/29' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/32' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/22' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/25' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/30' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/33' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/23' 2024-04-26T18:01:39.899 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/35' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/26' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './243/37' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './243' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/21' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/27' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/31' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/36' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/20' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/39' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/34' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/38' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/28' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/24' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/29' 2024-04-26T18:01:39.900 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/32' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/22' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/25' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/30' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/33' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/23' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/35' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/26' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './244/37' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './244' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/21' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/27' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/31' 2024-04-26T18:01:39.901 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/36' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/20' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/39' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/34' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/38' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/28' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/24' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/29' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/32' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/22' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/25' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/30' 2024-04-26T18:01:39.902 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/33' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/23' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/35' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/26' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './245/37' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './245' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/21' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/27' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/31' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/36' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/20' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/39' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/34' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/38' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/28' 2024-04-26T18:01:39.903 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/24' 2024-04-26T18:01:39.904 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/29' 2024-04-26T18:01:39.904 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/32' 2024-04-26T18:01:39.904 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/22' 2024-04-26T18:01:42.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/25' 2024-04-26T18:01:42.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/30' 2024-04-26T18:01:42.403 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/33' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/23' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/35' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/26' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './246/37' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './246' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/21' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/27' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/31' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/36' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/20' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/39' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/34' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/38' 2024-04-26T18:01:42.404 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/28' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/24' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/29' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/32' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/22' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/25' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/30' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/33' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/23' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/35' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/26' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './247/37' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './247' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/21' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/27' 2024-04-26T18:01:42.405 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/31' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/36' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/20' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/39' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/34' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/38' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/28' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/24' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/29' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/32' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/22' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/25' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/30' 2024-04-26T18:01:42.406 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/33' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/23' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/35' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/26' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './248/37' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './248' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/21' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/27' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/31' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/36' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/20' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/39' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/34' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/38' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/28' 2024-04-26T18:01:42.407 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/24' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/29' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/32' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/22' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/25' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/30' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/33' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/23' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/35' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/26' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './249/37' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './249' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/21' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/27' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/31' 2024-04-26T18:01:42.408 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/36' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/20' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/39' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/34' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/38' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/28' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/24' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/29' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/32' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/22' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/25' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/30' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/33' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/23' 2024-04-26T18:01:42.409 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/35' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/26' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './250/37' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './250' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/21' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/27' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/31' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/36' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/20' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/39' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/34' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/38' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/28' 2024-04-26T18:01:42.410 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/24' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/29' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/32' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/22' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/25' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/30' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/33' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/23' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/35' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/26' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './251/37' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './251' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/21' 2024-04-26T18:01:42.411 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/27' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/31' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/36' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/20' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/39' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/34' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/38' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/28' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/24' 2024-04-26T18:01:42.412 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/29' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/32' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/22' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/25' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/30' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/33' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/23' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/35' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/26' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './252/37' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './252' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/21' 2024-04-26T18:01:42.413 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/27' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/31' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/36' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/20' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/39' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/34' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/38' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/28' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/24' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/29' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/32' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/22' 2024-04-26T18:01:42.414 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/25' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/30' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/33' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/23' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/35' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/26' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './253/37' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './253' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/21' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/27' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/31' 2024-04-26T18:01:42.415 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/36' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/20' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/39' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/34' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/38' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/28' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/24' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/29' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/32' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/22' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/25' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/30' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/33' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/23' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/35' 2024-04-26T18:01:42.416 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/26' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './254/37' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './254' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/21' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/27' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/31' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/36' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/20' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/39' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/34' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/38' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/28' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/24' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/29' 2024-04-26T18:01:42.417 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/32' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/22' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/25' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/30' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/33' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/23' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/35' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/26' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './255/37' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './255' 2024-04-26T18:01:42.418 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/21' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/27' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/31' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/36' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/20' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/39' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/34' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/38' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/28' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/24' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/29' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/32' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/22' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/25' 2024-04-26T18:01:42.419 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/30' 2024-04-26T18:01:44.099 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/33' 2024-04-26T18:01:44.099 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/23' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/35' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/26' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './256/37' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './256' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/21' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/27' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/31' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/36' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/20' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/39' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/34' 2024-04-26T18:01:44.100 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/38' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/28' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/24' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/29' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/32' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/22' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/25' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/30' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/33' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/23' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/35' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/26' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed './257/37' 2024-04-26T18:01:44.101 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './257' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/21' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/27' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/31' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/36' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/20' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/39' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/34' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/38' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/28' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/24' 2024-04-26T18:01:44.102 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/29' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/32' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/22' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/25' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/30' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/33' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/23' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/35' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/26' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './258/37' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './258' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/21' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/27' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/31' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/36' 2024-04-26T18:01:44.103 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/20' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/39' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/34' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/38' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/28' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/24' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/29' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/32' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/22' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/25' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/30' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/33' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/23' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/35' 2024-04-26T18:01:44.104 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/26' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './259/37' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './259' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/21' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/27' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/31' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/36' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/20' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/39' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/34' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/38' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/28' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/24' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/29' 2024-04-26T18:01:44.105 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/32' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/22' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/25' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/30' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/33' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/23' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/35' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/26' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './260/37' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './260' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/21' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/27' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/31' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/36' 2024-04-26T18:01:44.106 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/20' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/39' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/34' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/38' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/28' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/24' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/29' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/32' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/22' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/25' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/30' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/33' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/23' 2024-04-26T18:01:44.107 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/35' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/26' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './261/37' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './261' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/21' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/27' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/31' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/36' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/20' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/39' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/34' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/38' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/28' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/24' 2024-04-26T18:01:44.108 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/29' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/32' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/22' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/25' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/30' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/33' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/23' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/35' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/26' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './262/37' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './262' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/21' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/27' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/31' 2024-04-26T18:01:44.109 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/36' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/20' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/39' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/34' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/38' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/28' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/24' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/29' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/32' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/22' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/25' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/30' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/33' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/23' 2024-04-26T18:01:44.110 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/35' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/26' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './263/37' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './263' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/21' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/27' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/31' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/36' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/20' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/39' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/34' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/38' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/28' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/24' 2024-04-26T18:01:44.111 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/29' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/32' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/22' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/25' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/30' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/33' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/23' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/35' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/26' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './264/37' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './264' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/21' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/27' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/31' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/36' 2024-04-26T18:01:44.112 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/20' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/39' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/34' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/38' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/28' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/24' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/29' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/32' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/22' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/25' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/30' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/33' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/23' 2024-04-26T18:01:44.113 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/35' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/26' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './265/37' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './265' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/21' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/27' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/31' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/36' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/20' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/39' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/34' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/38' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/28' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/24' 2024-04-26T18:01:44.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/29' 2024-04-26T18:01:44.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/32' 2024-04-26T18:01:44.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/22' 2024-04-26T18:01:44.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/25' 2024-04-26T18:01:44.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/30' 2024-04-26T18:01:44.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/33' 2024-04-26T18:01:44.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/23' 2024-04-26T18:01:45.141 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/35' 2024-04-26T18:01:45.141 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/26' 2024-04-26T18:01:45.141 INFO:tasks.workunit.client.0.smithi139.stdout:removed './266/37' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './266' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/21' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/27' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/31' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/36' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/20' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/39' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/34' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/38' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/28' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/24' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/29' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/32' 2024-04-26T18:01:45.142 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/22' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/25' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/30' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/33' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/23' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/35' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/26' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './267/37' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './267' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/21' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/27' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/31' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/36' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/20' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/39' 2024-04-26T18:01:45.143 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/34' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/38' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/28' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/24' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/29' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/32' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/22' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/25' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/30' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/33' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/23' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/35' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/26' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './268/37' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './268' 2024-04-26T18:01:45.144 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/21' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/27' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/31' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/36' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/20' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/39' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/34' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/38' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/28' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/24' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/29' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/32' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/22' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/25' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/30' 2024-04-26T18:01:45.145 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/33' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/23' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/35' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/26' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './269/37' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './269' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/21' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/27' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/31' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/36' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/20' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/39' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/34' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/38' 2024-04-26T18:01:45.146 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/28' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/24' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/29' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/32' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/22' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/25' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/30' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/33' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/23' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/35' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/26' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './270/37' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './270' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/21' 2024-04-26T18:01:45.147 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/27' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/31' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/36' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/20' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/39' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/34' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/38' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/28' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/24' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/29' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/32' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/22' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/25' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/30' 2024-04-26T18:01:45.148 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/33' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/23' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/35' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/26' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './271/37' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './271' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/21' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/27' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/31' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/36' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/20' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/39' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/34' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/38' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/28' 2024-04-26T18:01:45.149 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/24' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/29' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/32' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/22' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/25' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/30' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/33' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/23' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/35' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/26' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './272/37' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './272' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/21' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/27' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/31' 2024-04-26T18:01:45.150 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/36' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/20' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/39' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/34' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/38' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/28' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/24' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/29' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/32' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/22' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/25' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/30' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/33' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/23' 2024-04-26T18:01:45.151 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/35' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/26' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './273/37' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './273' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/21' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/27' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/31' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/36' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/20' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/39' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/34' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/38' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/28' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/24' 2024-04-26T18:01:45.152 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/29' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/32' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/22' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/25' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/30' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/33' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/23' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/35' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/26' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './274/37' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './274' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/21' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/27' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/31' 2024-04-26T18:01:45.153 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/36' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/20' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/39' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/34' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/38' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/28' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/24' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/29' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/32' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/22' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/25' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/30' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/33' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/23' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/35' 2024-04-26T18:01:45.154 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/26' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './275/37' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './275' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/21' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/27' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/31' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/36' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/20' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/39' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/34' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/38' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/28' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/24' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/29' 2024-04-26T18:01:45.155 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/32' 2024-04-26T18:01:45.156 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/22' 2024-04-26T18:01:45.156 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/25' 2024-04-26T18:01:45.156 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/30' 2024-04-26T18:01:45.156 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/33' 2024-04-26T18:01:45.156 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/23' 2024-04-26T18:01:45.156 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/35' 2024-04-26T18:01:45.156 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/26' 2024-04-26T18:01:46.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './276/37' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './276' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/21' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/27' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/31' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/36' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/20' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/39' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/34' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/38' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/28' 2024-04-26T18:01:46.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/24' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/29' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/32' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/22' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/25' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/30' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/33' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/23' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/35' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/26' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './277/37' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './277' 2024-04-26T18:01:46.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/21' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/27' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/31' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/36' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/20' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/39' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/34' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/38' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/28' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/24' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/29' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/32' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/22' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/25' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/30' 2024-04-26T18:01:46.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/33' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/23' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/35' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/26' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './278/37' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './278' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/21' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/27' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/31' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/36' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/20' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/39' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/34' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/38' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/28' 2024-04-26T18:01:46.309 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/24' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/29' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/32' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/22' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/25' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/30' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/33' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/23' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/35' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/26' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './279/37' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './279' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/21' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/27' 2024-04-26T18:01:46.310 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/31' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/36' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/20' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/39' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/34' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/38' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/28' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/24' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/29' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/32' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/22' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/25' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/30' 2024-04-26T18:01:46.311 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/33' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/23' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/35' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/26' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './280/37' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './280' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/21' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/27' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/31' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/36' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/20' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/39' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/34' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/38' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/28' 2024-04-26T18:01:46.312 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/24' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/29' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/32' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/22' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/25' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/30' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/33' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/23' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/35' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/26' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './281/37' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './281' 2024-04-26T18:01:46.313 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/21' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/27' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/31' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/36' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/20' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/39' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/34' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/38' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/28' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/24' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/29' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/32' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/22' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/25' 2024-04-26T18:01:46.314 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/30' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/33' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/23' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/35' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/26' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './282/37' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './282' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/21' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/27' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/31' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/36' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/20' 2024-04-26T18:01:46.315 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/39' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/34' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/38' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/28' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/24' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/29' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/32' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/22' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/25' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/30' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/33' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/23' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/35' 2024-04-26T18:01:46.316 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/26' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './283/37' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './283' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/21' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/27' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/31' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/36' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/20' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/39' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/34' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/38' 2024-04-26T18:01:46.317 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/28' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/24' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/29' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/32' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/22' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/25' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/30' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/33' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/23' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/35' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/26' 2024-04-26T18:01:46.318 INFO:tasks.workunit.client.0.smithi139.stdout:removed './284/37' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './284' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/21' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/27' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/31' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/36' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/20' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/39' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/34' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/38' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/28' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/24' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/29' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/32' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/22' 2024-04-26T18:01:46.319 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/25' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/30' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/33' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/23' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/35' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/26' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './285/37' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './285' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/21' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/27' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/31' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/36' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/20' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/39' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/34' 2024-04-26T18:01:46.320 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/38' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/28' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/24' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/29' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/32' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/22' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/25' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/30' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/33' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/23' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/35' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/26' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed './286/37' 2024-04-26T18:01:46.321 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './286' 2024-04-26T18:01:46.910 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/21' 2024-04-26T18:01:46.910 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/27' 2024-04-26T18:01:46.910 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/31' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/36' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/20' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/39' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/34' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/38' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/28' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/24' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/29' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/32' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/22' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/25' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/30' 2024-04-26T18:01:46.911 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/33' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/23' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/35' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/26' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './287/37' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './287' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/21' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/27' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/31' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/36' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/20' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/39' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/34' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/38' 2024-04-26T18:01:46.912 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/28' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/24' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/29' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/32' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/22' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/25' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/30' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/33' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/23' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/35' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/26' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './288/37' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './288' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/21' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/27' 2024-04-26T18:01:46.913 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/31' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/36' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/20' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/39' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/34' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/38' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/28' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/24' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/29' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/32' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/22' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/25' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/30' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/33' 2024-04-26T18:01:46.914 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/23' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/35' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/26' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './289/37' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './289' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/21' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/27' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/31' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/36' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/20' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/39' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/34' 2024-04-26T18:01:46.915 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/38' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/28' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/24' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/29' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/32' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/22' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/25' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/30' 2024-04-26T18:01:46.916 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/33' 2024-04-26T18:01:46.917 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/23' 2024-04-26T18:01:46.917 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/35' 2024-04-26T18:01:46.917 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/26' 2024-04-26T18:01:46.917 INFO:tasks.workunit.client.0.smithi139.stdout:removed './290/37' 2024-04-26T18:01:46.917 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './290' 2024-04-26T18:01:46.917 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/21' 2024-04-26T18:01:46.917 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/27' 2024-04-26T18:01:46.918 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/31' 2024-04-26T18:01:46.918 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/36' 2024-04-26T18:01:46.918 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/20' 2024-04-26T18:01:46.918 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/39' 2024-04-26T18:01:46.918 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/34' 2024-04-26T18:01:46.918 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/38' 2024-04-26T18:01:46.919 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/28' 2024-04-26T18:01:46.919 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/24' 2024-04-26T18:01:46.919 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/29' 2024-04-26T18:01:46.919 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/32' 2024-04-26T18:01:46.919 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/22' 2024-04-26T18:01:46.919 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/25' 2024-04-26T18:01:46.919 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/30' 2024-04-26T18:01:46.920 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/33' 2024-04-26T18:01:46.920 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/23' 2024-04-26T18:01:46.920 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/35' 2024-04-26T18:01:46.920 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/26' 2024-04-26T18:01:46.920 INFO:tasks.workunit.client.0.smithi139.stdout:removed './291/37' 2024-04-26T18:01:46.920 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './291' 2024-04-26T18:01:46.920 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/21' 2024-04-26T18:01:46.921 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/27' 2024-04-26T18:01:46.921 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/31' 2024-04-26T18:01:46.921 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/36' 2024-04-26T18:01:46.921 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/20' 2024-04-26T18:01:46.921 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/39' 2024-04-26T18:01:46.921 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/34' 2024-04-26T18:01:46.922 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/38' 2024-04-26T18:01:46.922 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/28' 2024-04-26T18:01:46.922 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/24' 2024-04-26T18:01:46.922 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/29' 2024-04-26T18:01:46.922 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/32' 2024-04-26T18:01:46.922 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/22' 2024-04-26T18:01:46.923 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/25' 2024-04-26T18:01:46.923 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/30' 2024-04-26T18:01:46.923 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/33' 2024-04-26T18:01:46.923 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/23' 2024-04-26T18:01:46.923 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/35' 2024-04-26T18:01:46.923 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/26' 2024-04-26T18:01:46.923 INFO:tasks.workunit.client.0.smithi139.stdout:removed './292/37' 2024-04-26T18:01:46.924 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './292' 2024-04-26T18:01:46.924 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/21' 2024-04-26T18:01:46.924 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/27' 2024-04-26T18:01:46.924 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/31' 2024-04-26T18:01:46.924 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/36' 2024-04-26T18:01:46.924 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/20' 2024-04-26T18:01:46.925 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/39' 2024-04-26T18:01:46.925 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/34' 2024-04-26T18:01:46.925 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/38' 2024-04-26T18:01:46.925 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/28' 2024-04-26T18:01:46.925 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/24' 2024-04-26T18:01:46.925 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/29' 2024-04-26T18:01:46.926 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/32' 2024-04-26T18:01:46.926 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/22' 2024-04-26T18:01:46.926 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/25' 2024-04-26T18:01:46.926 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/30' 2024-04-26T18:01:46.926 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/33' 2024-04-26T18:01:46.926 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/23' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/35' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/26' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './293/37' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './293' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/21' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/27' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/31' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/36' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/20' 2024-04-26T18:01:46.927 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/39' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/34' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/38' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/28' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/24' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/29' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/32' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/22' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/25' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/30' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/33' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/23' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/35' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/26' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed './294/37' 2024-04-26T18:01:46.928 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './294' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/21' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/27' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/31' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/36' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/20' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/39' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/34' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/38' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/28' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/24' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/29' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/32' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/22' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/25' 2024-04-26T18:01:46.929 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/30' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/33' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/23' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/35' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/26' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './295/37' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './295' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/21' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/27' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/31' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/36' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/20' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/39' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/34' 2024-04-26T18:01:46.930 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/38' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/28' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/24' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/29' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/32' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/22' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/25' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/30' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/33' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/23' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/35' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/26' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './296/37' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './296' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/21' 2024-04-26T18:01:46.931 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/27' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/31' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/36' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/20' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/39' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/34' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/38' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/28' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/24' 2024-04-26T18:01:48.218 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/29' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/32' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/22' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/25' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/30' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/33' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/23' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/35' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/26' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './297/37' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './297' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/21' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/27' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/31' 2024-04-26T18:01:48.219 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/36' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/20' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/39' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/34' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/38' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/28' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/24' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/29' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/32' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/22' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/25' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/30' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/33' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/23' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/35' 2024-04-26T18:01:48.220 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/26' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './298/37' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './298' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/21' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/27' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/31' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/36' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/20' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/39' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/34' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/38' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/28' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/24' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/29' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/32' 2024-04-26T18:01:48.221 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/22' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/25' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/30' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/33' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/23' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/35' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/26' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './299/37' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './299' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/19' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/15' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/20' 2024-04-26T18:01:48.222 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/12' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/10' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/11' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/16' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/14' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/18' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/13' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/166/17' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/166' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/19' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/15' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/20' 2024-04-26T18:01:48.223 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/12' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/10' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/11' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/16' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/14' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/18' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/13' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/147/17' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/147' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/19' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/15' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/20' 2024-04-26T18:01:48.224 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/12' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/10' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/11' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/16' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/14' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/18' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/13' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/151/17' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/151' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/19' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/15' 2024-04-26T18:01:48.225 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/20' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/12' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/10' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/11' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/16' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/14' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/18' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/13' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/170/17' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/170' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/19' 2024-04-26T18:01:48.226 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/15' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/20' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/12' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/10' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/11' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/16' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/14' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/18' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/13' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/167/17' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/167' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/19' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/15' 2024-04-26T18:01:48.227 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/20' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/12' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/10' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/11' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/16' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/14' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/18' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/13' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/140/17' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/140' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/19' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/15' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/20' 2024-04-26T18:01:48.228 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/12' 2024-04-26T18:01:48.229 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/10' 2024-04-26T18:01:49.714 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/11' 2024-04-26T18:01:49.714 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/16' 2024-04-26T18:01:49.714 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/14' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/18' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/13' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/142/17' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/142' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/19' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/15' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/20' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/12' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/10' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/11' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/16' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/14' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/18' 2024-04-26T18:01:49.715 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/13' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/150/17' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/150' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/19' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/15' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/20' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/12' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/10' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/11' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/16' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/14' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/18' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/13' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/105/17' 2024-04-26T18:01:49.716 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/105' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/19' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/15' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/20' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/12' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/10' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/11' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/16' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/14' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/18' 2024-04-26T18:01:49.717 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/13' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/149/17' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/149' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/19' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/15' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/20' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/12' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/10' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/11' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/16' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/14' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/18' 2024-04-26T18:01:49.718 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/13' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/109/17' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/109' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/19' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/15' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/20' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/12' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/10' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/11' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/16' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/14' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/18' 2024-04-26T18:01:49.719 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/13' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/158/17' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/158' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/19' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/15' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/20' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/12' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/10' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/11' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/16' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/14' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/18' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/13' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/106/17' 2024-04-26T18:01:49.720 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/106' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/19' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/15' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/20' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/12' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/10' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/11' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/16' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/14' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/18' 2024-04-26T18:01:49.721 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/13' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/189/17' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/189' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/19' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/15' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/20' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/12' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/10' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/11' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/16' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/14' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/18' 2024-04-26T18:01:49.722 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/13' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/133/17' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/133' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/19' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/15' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/20' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/12' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/10' 2024-04-26T18:01:49.723 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/11' 2024-04-26T18:01:49.736 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:01:49.736 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-26T18:01:49.736 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:01:49.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.847+0000 7fd705e09640 1 Processor -- start 2024-04-26T18:01:49.847 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.847+0000 7fd705e09640 1 -- start start 2024-04-26T18:01:49.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.847+0000 7fd705e09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c89f0 0x7fd70015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:49.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.847+0000 7fd705e09640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7000736a0 con 0x7fd7000c7c20 2024-04-26T18:01:49.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.847+0000 7fd705e09640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7000c62e0 con 0x7fd700152cb0 2024-04-26T18:01:49.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.847+0000 7fd705e09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd700073940 con 0x7fd7000c89f0 2024-04-26T18:01:49.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6fffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd7000c7c20 0x7fd7001630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46730/0 (socket says 172.21.15.139:46730) 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6fffff640 1 -- 172.21.15.139:0/3321450765 learned_addr learned my addr 172.21.15.139:0/3321450765 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6feffd640 1 --2- 172.21.15.139:0/3321450765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c89f0 0x7fd70015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6fe7fc640 1 -- 172.21.15.139:0/3321450765 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951932692 0 0) 0x7fd7000736a0 con 0x7fd7000c7c20 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6fe7fc640 1 -- 172.21.15.139:0/3321450765 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e8003520 con 0x7fd7000c7c20 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6fe7fc640 1 -- 172.21.15.139:0/3321450765 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398254642 0 0) 0x7fd7000c62e0 con 0x7fd700152cb0 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6fe7fc640 1 -- 172.21.15.139:0/3321450765 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7000736a0 con 0x7fd700152cb0 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6feffd640 1 -- 172.21.15.139:0/3321450765 >> v1:172.21.15.143:6789/0 conn(0x7fd700152cb0 legacy=0x7fd7000cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6feffd640 1 -- 172.21.15.139:0/3321450765 >> v1:172.21.15.139:6789/0 conn(0x7fd7000c7c20 legacy=0x7fd7001630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:49.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.848+0000 7fd6feffd640 1 -- 172.21.15.139:0/3321450765 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7000c48c0 con 0x7fd7000c89f0 2024-04-26T18:01:49.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.849+0000 7fd6feffd640 1 --2- 172.21.15.139:0/3321450765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c89f0 0x7fd70015bd50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097d0 tx=0x7fd6f002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efa730c0544a611b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:49.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.849+0000 7fd6fe7fc640 1 -- 172.21.15.139:0/3321450765 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0037070 con 0x7fd7000c89f0 2024-04-26T18:01:49.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.849+0000 7fd6fe7fc640 1 -- 172.21.15.139:0/3321450765 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f0032440 con 0x7fd7000c89f0 2024-04-26T18:01:49.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.849+0000 7fd6fe7fc640 1 -- 172.21.15.139:0/3321450765 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00327f0 con 0x7fd7000c89f0 2024-04-26T18:01:49.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.849+0000 7fd705e09640 1 -- 172.21.15.139:0/3321450765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c89f0 msgr2=0x7fd70015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.849+0000 7fd705e09640 1 --2- 172.21.15.139:0/3321450765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c89f0 0x7fd70015bd50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00097d0 tx=0x7fd6f002a290 comp rx=0 tx=0).stop 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.850+0000 7fd705e09640 1 -- 172.21.15.139:0/3321450765 shutdown_connections 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.850+0000 7fd705e09640 1 --2- 172.21.15.139:0/3321450765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c89f0 0x7fd70015bd50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.850+0000 7fd705e09640 1 -- 172.21.15.139:0/3321450765 >> 172.21.15.139:0/3321450765 conn(0x7fd700068270 msgr2=0x7fd700068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.850+0000 7fd705e09640 1 -- 172.21.15.139:0/3321450765 shutdown_connections 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.850+0000 7fd705e09640 1 -- 172.21.15.139:0/3321450765 wait complete. 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.851+0000 7fd705e09640 1 Processor -- start 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.851+0000 7fd705e09640 1 -- start start 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd705e09640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c7c20 0x7fd7001e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd705e09640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7000c89f0 0x7fd70014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd705e09640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd700152cb0 0x7fd70014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd705e09640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7000c4d20 con 0x7fd700152cb0 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd705e09640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd7000c4ba0 con 0x7fd7000c89f0 2024-04-26T18:01:49.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd705e09640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd7000cdb70 con 0x7fd7000c7c20 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd700152cb0 0x7fd70014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd700152cb0 0x7fd70014a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46238/0 (socket says 172.21.15.139:46238) 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 -- 172.21.15.139:0/377846800 learned_addr learned my addr 172.21.15.139:0/377846800 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6feffd640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7000c89f0 0x7fd70014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6ff7fe640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c7c20 0x7fd7001e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 -- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c7c20 msgr2=0x7fd7001e1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c7c20 0x7fd7001e1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 -- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7000c89f0 msgr2=0x7fd70014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7000c89f0 0x7fd70014a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 -- 172.21.15.139:0/377846800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7001ee740 con 0x7fd700152cb0 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6feffd640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7000c89f0 0x7fd70014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6fffff640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd700152cb0 0x7fd70014a9e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800cac0 tx=0x7fd6f800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6e7fff640 1 -- 172.21.15.139:0/377846800 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8017070 con 0x7fd700152cb0 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6e7fff640 1 -- 172.21.15.139:0/377846800 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f800ac30 con 0x7fd700152cb0 2024-04-26T18:01:49.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7001edbc0 con 0x7fd700152cb0 2024-04-26T18:01:49.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.852+0000 7fd6e7fff640 1 -- 172.21.15.139:0/377846800 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8012400 con 0x7fd700152cb0 2024-04-26T18:01:49.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.853+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7001ee180 con 0x7fd700152cb0 2024-04-26T18:01:49.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.853+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd700076d20 con 0x7fd700152cb0 2024-04-26T18:01:49.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.854+0000 7fd6e7fff640 1 -- 172.21.15.139:0/377846800 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6f801a070 con 0x7fd700152cb0 2024-04-26T18:01:49.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.854+0000 7fd6e7fff640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd6ec06c8f0 0x7fd6ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:49.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.855+0000 7fd6ff7fe640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd6ec06c8f0 0x7fd6ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:49.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.855+0000 7fd6e7fff640 1 -- 172.21.15.139:0/377846800 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7fd6f808bc80 con 0x7fd700152cb0 2024-04-26T18:01:49.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.855+0000 7fd6ff7fe640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd6ec06c8f0 0x7fd6ec06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4007fd0 tx=0x7fd6f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:49.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:49.859+0000 7fd6e7fff640 1 -- 172.21.15.139:0/377846800 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd6f80595b0 con 0x7fd700152cb0 2024-04-26T18:01:50.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.118+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd700073480 con 0x7fd700152cb0 2024-04-26T18:01:50.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.119+0000 7fd6e7fff640 1 -- 172.21.15.139:0/377846800 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fd6f808b030 con 0x7fd700152cb0 2024-04-26T18:01:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:01:50.119 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:01:50.119 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:01:50.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd6ec06c8f0 msgr2=0x7fd6ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd6ec06c8f0 0x7fd6ec06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4007fd0 tx=0x7fd6f4009040 comp rx=0 tx=0).stop 2024-04-26T18:01:50.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd700152cb0 msgr2=0x7fd70014a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd700152cb0 0x7fd70014a9e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800cac0 tx=0x7fd6f800cf80 comp rx=0 tx=0).stop 2024-04-26T18:01:50.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 shutdown_connections 2024-04-26T18:01:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd6ec06c8f0 0x7fd6ec06edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd700152cb0 0x7fd70014a9e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd7000c89f0 0x7fd70014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 --2- 172.21.15.139:0/377846800 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd7000c7c20 0x7fd7001e1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 >> 172.21.15.139:0/377846800 conn(0x7fd700068270 msgr2=0x7fd7000728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 shutdown_connections 2024-04-26T18:01:50.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.121+0000 7fd705e09640 1 -- 172.21.15.139:0/377846800 wait complete. 2024-04-26T18:01:50.132 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-26T18:01:50.132 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-26T18:01:50.159 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/16' 2024-04-26T18:01:50.159 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/14' 2024-04-26T18:01:50.159 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/18' 2024-04-26T18:01:50.159 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/13' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/173/17' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/173' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/19' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/15' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/20' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/12' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/10' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/11' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/16' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/14' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/18' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/13' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/174/17' 2024-04-26T18:01:50.160 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/174' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/19' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/15' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/20' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/12' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/10' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/11' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/16' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/14' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/18' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/13' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/155/17' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/155' 2024-04-26T18:01:50.161 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/19' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/15' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/20' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/12' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/10' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/11' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/16' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/14' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/18' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/13' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/114/17' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/114' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/19' 2024-04-26T18:01:50.162 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/15' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/20' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/12' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/10' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/11' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/16' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/14' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/18' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/13' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/159/17' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/159' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/19' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/15' 2024-04-26T18:01:50.163 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/20' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/12' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/10' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/11' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/16' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/14' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/18' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/13' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/187/17' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/187' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/19' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/15' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/20' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/12' 2024-04-26T18:01:50.164 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/10' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/11' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/16' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/14' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/18' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/13' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/185/17' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/185' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/19' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/15' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/20' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/12' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/10' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/11' 2024-04-26T18:01:50.165 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/16' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/14' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/18' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/13' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/120/17' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/120' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/19' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/15' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/20' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/12' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/10' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/11' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/16' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/14' 2024-04-26T18:01:50.166 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/18' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/13' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/110/17' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/110' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/19' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/15' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/20' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/12' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/10' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/11' 2024-04-26T18:01:50.167 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/16' 2024-04-26T18:01:50.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.239+0000 7faefc033640 1 Processor -- start 2024-04-26T18:01:50.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.239+0000 7faefc033640 1 -- start start 2024-04-26T18:01:50.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefc033640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefc033640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faef40cf630 0x7faef4166440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefc033640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef4156250 con 0x7faef4155e70 2024-04-26T18:01:50.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefc033640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7faef415c670 con 0x7faef40cf630 2024-04-26T18:01:50.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefc033640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faef415bac0 con 0x7faef40c9be0 2024-04-26T18:01:50.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefa5d0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7faef40cf630 0x7faef4166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faef9dcf640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7faef4155e70 0x7faef40c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:46744/0 (socket says 172.21.15.139:46744) 2024-04-26T18:01:50.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faef9dcf640 1 -- 172.21.15.139:0/1627316370 learned_addr learned my addr 172.21.15.139:0/1627316370 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:01:50.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faef95ce640 1 --2- 172.21.15.139:0/1627316370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefa5d0640 1 -- 172.21.15.139:0/1627316370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 msgr2=0x7faef40cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefa5d0640 1 --2- 172.21.15.139:0/1627316370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefa5d0640 1 -- 172.21.15.139:0/1627316370 >> v1:172.21.15.139:6789/0 conn(0x7faef4155e70 legacy=0x7faef40c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faef8dcd640 1 -- 172.21.15.139:0/1627316370 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128954558 0 0) 0x7faef0001110 con 0x7faef4155e70 2024-04-26T18:01:50.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.240+0000 7faefa5d0640 1 -- 172.21.15.139:0/1627316370 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef4070ac0 con 0x7faef40cf630 2024-04-26T18:01:50.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.241+0000 7faefa5d0640 1 --2- 172.21.15.139:0/1627316370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef4166440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faeec009d90 tx=0x7faeec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3af8cdc05fd2c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:50.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.241+0000 7faef8dcd640 1 -- 172.21.15.139:0/1627316370 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec007740 con 0x7faef40cf630 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.241+0000 7faef8dcd640 1 -- 172.21.15.139:0/1627316370 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec0078e0 con 0x7faef40cf630 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.241+0000 7faef8dcd640 1 -- 172.21.15.139:0/1627316370 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec007cb0 con 0x7faef40cf630 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.241+0000 7faefc033640 1 -- 172.21.15.139:0/1627316370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 msgr2=0x7faef4166440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.241+0000 7faefc033640 1 --2- 172.21.15.139:0/1627316370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef4166440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faeec009d90 tx=0x7faeec02a6f0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.242+0000 7faefc033640 1 -- 172.21.15.139:0/1627316370 shutdown_connections 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.242+0000 7faefc033640 1 --2- 172.21.15.139:0/1627316370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef4166440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.242+0000 7faefc033640 1 --2- 172.21.15.139:0/1627316370 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.242+0000 7faefc033640 1 -- 172.21.15.139:0/1627316370 >> 172.21.15.139:0/1627316370 conn(0x7faef4068090 msgr2=0x7faef4068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.242+0000 7faefc033640 1 -- 172.21.15.139:0/1627316370 shutdown_connections 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.242+0000 7faefc033640 1 -- 172.21.15.139:0/1627316370 wait complete. 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 Processor -- start 2024-04-26T18:01:50.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 -- start start 2024-04-26T18:01:50.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef40c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef4155e70 0x7faef41e8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faef415c300 con 0x7faef40cf630 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faef415c020 con 0x7faef4155e70 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faefc033640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faef4070e90 con 0x7faef40c9be0 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.243+0000 7faef95ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef40c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef40c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46258/0 (socket says 172.21.15.139:46258) 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 -- 172.21.15.139:0/3196802984 learned_addr learned my addr 172.21.15.139:0/3196802984 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef9dcf640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faefa5d0640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef4155e70 0x7faef41e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 -- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 msgr2=0x7faef40c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 -- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef4155e70 msgr2=0x7faef41e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef4155e70 0x7faef41e8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 -- 172.21.15.139:0/3196802984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef41f6210 con 0x7faef40cf630 2024-04-26T18:01:50.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faef95ce640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef40c7320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faee400e9e0 tx=0x7faee400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:50.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faeea7fc640 1 -- 172.21.15.139:0/3196802984 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4017070 con 0x7faef40cf630 2024-04-26T18:01:50.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faeea7fc640 1 -- 172.21.15.139:0/3196802984 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee400c9d0 con 0x7faef40cf630 2024-04-26T18:01:50.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faeea7fc640 1 -- 172.21.15.139:0/3196802984 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee400cdc0 con 0x7faef40cf630 2024-04-26T18:01:50.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef40c79b0 con 0x7faef40cf630 2024-04-26T18:01:50.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.244+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef41f5730 con 0x7faef40cf630 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.246+0000 7faeea7fc640 1 -- 172.21.15.139:0/3196802984 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faee401a070 con 0x7faef40cf630 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.246+0000 7faeea7fc640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faed806c920 0x7faed806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.247+0000 7faeea7fc640 1 -- 172.21.15.139:0/3196802984 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7faee408bea0 con 0x7faef40cf630 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.247+0000 7faef9dcf640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faed806c920 0x7faed806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.247+0000 7faef9dcf640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faed806c920 0x7faed806ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faef0007fd0 tx=0x7faef0007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.247+0000 7faefee2a740 1 Processor -- start 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.247+0000 7faefee2a740 1 -- start start 2024-04-26T18:01:50.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a05e0 0x5587fa2df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2dfae0 0x5587fa2a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefee2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefee2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5587fa203d80 con 0x5587fa2a1b40 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5587fa19fc20 con 0x5587fa2dfae0 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5587fa1ffd40 con 0x5587fa2a05e0 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46268/0 (socket says 172.21.15.139:46268) 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 -- 172.21.15.139:0/3553013401 learned_addr learned my addr 172.21.15.139:0/3553013401 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faef9dcf640 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a05e0 0x5587fa2df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faef95ce640 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2dfae0 0x5587fa2a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 -- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a05e0 msgr2=0x5587fa2df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a05e0 0x5587fa2df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 -- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2dfae0 msgr2=0x5587fa2a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2dfae0 0x5587fa2a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.248+0000 7faefa5d0640 1 -- 172.21.15.139:0/3553013401 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587f9fe1d80 con 0x5587fa2a1b40 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefa5d0640 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2a0f00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faeec009eb0 tx=0x7faeec02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa6d267a3e689c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faed77fe640 1 -- 172.21.15.139:0/3553013401 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec0078c0 con 0x5587fa2a1b40 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faed77fe640 1 -- 172.21.15.139:0/3553013401 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec007a60 con 0x5587fa2a1b40 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faed77fe640 1 -- 172.21.15.139:0/3553013401 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec007e30 con 0x5587fa2a1b40 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 -- 172.21.15.139:0/3553013401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 msgr2=0x5587fa2a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2a0f00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faeec009eb0 tx=0x7faeec02e000 comp rx=0 tx=0).stop 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 -- 172.21.15.139:0/3553013401 shutdown_connections 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2a0f00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2dfae0 0x5587fa2a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 --2- 172.21.15.139:0/3553013401 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a05e0 0x5587fa2df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 -- 172.21.15.139:0/3553013401 >> 172.21.15.139:0/3553013401 conn(0x5587fa267740 msgr2=0x5587fa2e4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 -- 172.21.15.139:0/3553013401 shutdown_connections 2024-04-26T18:01:50.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.249+0000 7faefee2a740 1 -- 172.21.15.139:0/3553013401 wait complete. 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.250+0000 7faefee2a740 1 -- start start 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.250+0000 7faefee2a740 1 Processor -- start 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa2caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a1b40 0x5587fa2f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2dfae0 0x5587fa2c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5587fa29ec20 con 0x5587fa2dfae0 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5587fa19d840 con 0x5587fa2a05e0 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5587fa2a2170 con 0x5587fa2a1b40 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 10 client.0 _ll_register_callbacks cb 0x5587fa1a15b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2dfae0 0x5587fa2c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2dfae0 0x5587fa2c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46280/0 (socket says 172.21.15.139:46280) 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 -- 172.21.15.139:0/1247759335 learned_addr learned my addr 172.21.15.139:0/1247759335 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faef95ce640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a1b40 0x5587fa2f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faef9dcf640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa2caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 -- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a1b40 msgr2=0x5587fa2f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a1b40 0x5587fa2f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 -- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 msgr2=0x5587fa2caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa2caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 -- 172.21.15.139:0/1247759335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587fa042510 con 0x5587fa2dfae0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faef95ce640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a1b40 0x5587fa2f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefa5d0640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2dfae0 0x5587fa2c80a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faeec009eb0 tx=0x7faeec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07ed50b4bb0e7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faed4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faed4ff9640 1 -- 172.21.15.139:0/1247759335 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec003da0 con 0x5587fa2dfae0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faed4ff9640 1 -- 172.21.15.139:0/1247759335 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7faeec004030 con 0x5587fa2dfae0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.251+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeec007a60 con 0x5587fa2dfae0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faed4ff9640 1 -- 172.21.15.139:0/1247759335 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7faeec004230 con 0x5587fa2dfae0 2024-04-26T18:01:50.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 10 client.4941 fetch_fsmap learned FSMap version 9 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5587f9ed5670 con 0x5587fa2dfae0 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faed4ff9640 1 -- 172.21.15.139:0/1247759335 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec007a60 con 0x5587fa2dfae0 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faed4ff9640 1 -- 172.21.15.139:0/1247759335 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7faeec0043d0 con 0x5587fa2dfae0 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 10 client.4941 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 10 client.4941 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 20 client.4941 populate_metadata read hostname 'smithi139' 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2c85e0 0x5587fa2f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 4 client.4941 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587fa211990 con 0x5587fa2c85e0 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faef9dcf640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2c85e0 0x5587fa2f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faed4ff9640 10 client.4941 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.252+0000 7faef9dcf640 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2c85e0 0x5587fa2f4c60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96cd338298af1173 server_cookie=808b748a04f49d4a in_seq=0 out_seq=0 2024-04-26T18:01:50.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faed4ff9640 1 -- 172.21.15.139:0/1247759335 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5587fa211990 con 0x5587fa2c85e0 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faed4ff9640 10 client.4941 handle_command_reply: tid=0 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 client.4941 shutdown 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2dfae0 msgr2=0x5587fa2c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2dfae0 0x5587fa2c80a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faeec009eb0 tx=0x7faeec004ab0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 shutdown_connections 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2dfae0 0x5587fa2c80a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2c85e0 0x5587fa2f4c60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2a1b40 0x5587fa2f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faed4ff9640 0 client.4941 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 --2- 172.21.15.139:0/1247759335 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa2caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 >> 172.21.15.139:0/1247759335 conn(0x5587fa267740 msgr2=0x5587fa2a09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 shutdown_connections 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 1 -- 172.21.15.139:0/1247759335 wait complete. 2024-04-26T18:01:50.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.253+0000 7faefee2a740 20 client.4941 trim_cache size 0 max 16384 2024-04-26T18:01:50.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.270+0000 7faefee2a740 1 Processor -- start 2024-04-26T18:01:50.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.270+0000 7faefee2a740 1 -- start start 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faefee2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a05e0 0x5587fa29e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a1b40 0x5587fa29bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa29c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faefee2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faef4200820 con 0x5587fa2a05e0 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faef41ff700 con 0x5587fa2a1b40 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faef41f28f0 con 0x5587fa2dfae0 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faef9dcf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a05e0 0x5587fa29e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faef9dcf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a05e0 0x5587fa29e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46288/0 (socket says 172.21.15.139:46288) 2024-04-26T18:01:50.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faef9dcf640 1 -- 172.21.15.139:0/146652211 learned_addr learned my addr 172.21.15.139:0/146652211 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faefa5d0640 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa29c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.271+0000 7faef95ce640 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a1b40 0x5587fa29bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faef9dcf640 1 -- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 msgr2=0x5587fa29c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faef9dcf640 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa29c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faef9dcf640 1 -- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a1b40 msgr2=0x5587fa29bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faef9dcf640 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a1b40 0x5587fa29bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faef9dcf640 1 -- 172.21.15.139:0/146652211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587fa29dda0 con 0x5587fa2a05e0 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefa5d0640 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa29c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faef95ce640 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a1b40 0x5587fa29bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faef9dcf640 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a05e0 0x5587fa29e1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faef0001ad0 tx=0x7faef0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f971afe647e39e22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faed6ffd640 1 -- 172.21.15.139:0/146652211 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef002e070 con 0x5587fa2a05e0 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faed6ffd640 1 -- 172.21.15.139:0/146652211 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef0023920 con 0x5587fa2a05e0 2024-04-26T18:01:50.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faed6ffd640 1 -- 172.21.15.139:0/146652211 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0023cf0 con 0x5587fa2a05e0 2024-04-26T18:01:50.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 -- 172.21.15.139:0/146652211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a05e0 msgr2=0x5587fa29e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a05e0 0x5587fa29e1c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faef0001ad0 tx=0x7faef0013000 comp rx=0 tx=0).stop 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 -- 172.21.15.139:0/146652211 shutdown_connections 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa29c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a1b40 0x5587fa29bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 --2- 172.21.15.139:0/146652211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a05e0 0x5587fa29e1c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 -- 172.21.15.139:0/146652211 >> 172.21.15.139:0/146652211 conn(0x5587fa267740 msgr2=0x5587fa2ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 -- 172.21.15.139:0/146652211 shutdown_connections 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.272+0000 7faefee2a740 1 -- 172.21.15.139:0/146652211 wait complete. 2024-04-26T18:01:50.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.273+0000 7faefee2a740 1 -- start start 2024-04-26T18:01:50.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.273+0000 7faefee2a740 1 Processor -- start 2024-04-26T18:01:50.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa29b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefee2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2e0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefee2a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa2d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefee2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faef41fe2f0 con 0x5587fa2a1b40 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7faef41ff030 con 0x5587fa2a05e0 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefee2a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7faef41fe990 con 0x5587fa2dfae0 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefee2a740 10 client.0 _ll_register_callbacks cb 0x7faeec0094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2e0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2e0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46294/0 (socket says 172.21.15.139:46294) 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 -- 172.21.15.139:0/3360370575 learned_addr learned my addr 172.21.15.139:0/3360370575 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef9dcf640 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa29b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faefa5d0640 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa2d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 -- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 msgr2=0x5587fa2d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa2d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 -- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 msgr2=0x5587fa29b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa29b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:50.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 -- 172.21.15.139:0/3360370575 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587fa2c83c0 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faef95ce640 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2e0d60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faee4061e60 tx=0x7faee40600b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d180f5538ce954e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.274+0000 7faed4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faed4ff9640 1 -- 172.21.15.139:0/3360370575 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4088060 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faed4ff9640 1 -- 172.21.15.139:0/3360370575 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7faee4058eb0 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faef0023920 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faed4ff9640 1 -- 172.21.15.139:0/3360370575 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7faee4021040 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 10 client.4947 fetch_fsmap learned FSMap version 9 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5587fa2c8a40 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faed4ff9640 1 -- 172.21.15.139:0/3360370575 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef0023920 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faed4ff9640 1 -- 172.21.15.139:0/3360370575 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7faee4024060 con 0x5587fa2a1b40 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 10 client.4947 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 10 client.4947 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:01:50.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 20 client.4947 populate_metadata read hostname 'smithi139' 2024-04-26T18:01:50.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2e12a0 0x5587fa2d6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:50.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 4 client.4947 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-26T18:01:50.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x5587fa20b800 con 0x5587fa2e12a0 2024-04-26T18:01:50.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faef9dcf640 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2e12a0 0x5587fa2d6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:50.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faed4ff9640 10 client.4947 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:01:50.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:50.275+0000 7faef9dcf640 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2e12a0 0x5587fa2d6d50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c6a288ba987636 server_cookie=eacc6a4af97edda9 in_seq=0 out_seq=0 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faed4ff9640 1 -- 172.21.15.139:0/3360370575 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5587fa20b800 con 0x5587fa2e12a0 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faed4ff9640 10 client.4947 handle_command_reply: tid=0 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 client.4947 shutdown 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 msgr2=0x5587fa2e0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2e0d60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faee4061e60 tx=0x7faee40600b0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 shutdown_connections 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5587fa2e12a0 0x5587fa2d6d50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5587fa2dfae0 0x5587fa2d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5587fa2a1b40 0x5587fa2e0d60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 --2- 172.21.15.139:0/3360370575 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5587fa2a05e0 0x5587fa29b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faed4ff9640 0 client.4947 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.518+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 >> 172.21.15.139:0/3360370575 conn(0x5587fa267740 msgr2=0x5587fa2c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 shutdown_connections 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefee2a740 1 -- 172.21.15.139:0/3360370575 wait complete. 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefee2a740 20 client.4947 trim_cache size 0 max 16384 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:01:55.520 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 10, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "4c14625f": { 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 10, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.5, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:01:55.521 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:01:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:01:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:01:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:01:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:01:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:01:55.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:01:55.522 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faed806c920 msgr2=0x7faed806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefc033640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faed806c920 0x7faed806ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faef0007fd0 tx=0x7faef0007de0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 msgr2=0x7faef40c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefc033640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef40c7320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faee400e9e0 tx=0x7faee400eea0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.519+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 shutdown_connections 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.520+0000 7faefc033640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7faed806c920 0x7faed806ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.520+0000 7faefc033640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faef4155e70 0x7faef41e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.520+0000 7faefc033640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef40cf630 0x7faef40c7320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.520+0000 7faefc033640 1 --2- 172.21.15.139:0/3196802984 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7faef40c9be0 0x7faef40c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.520+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 >> 172.21.15.139:0/3196802984 conn(0x7faef4068090 msgr2=0x7faef4153ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:55.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.520+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 shutdown_connections 2024-04-26T18:01:55.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:01:55.520+0000 7faefc033640 1 -- 172.21.15.139:0/3196802984 wait complete. 2024-04-26T18:01:55.534 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4c14625f', quiesce took 5.8 seconds. Will release after: 19.5 2024-04-26T18:02:06.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:06.170 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:15.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:02:15.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.146+0000 7f8866b5f640 1 Processor -- start 2024-04-26T18:02:15.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.146+0000 7f8866b5f640 1 -- start start 2024-04-26T18:02:15.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f8866b5f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f886006fc90 0x7f88600c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f8866b5f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886015cf40 0x7f886015d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f8866b5f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88600ce5e0 con 0x7f88601539c0 2024-04-26T18:02:15.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f8866b5f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f886015a970 con 0x7f886006fc90 2024-04-26T18:02:15.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f8866b5f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f886015a6d0 con 0x7f886015cf40 2024-04-26T18:02:15.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f885ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f886006fc90 0x7f88600c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f885ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f886006fc90 0x7f88600c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41488/0 (socket says 172.21.15.139:41488) 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f885ffff640 1 -- 172.21.15.139:0/2198388478 learned_addr learned my addr 172.21.15.139:0/2198388478 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.147+0000 7f88650fc640 1 --2- 172.21.15.139:0/2198388478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886015cf40 0x7f886015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885ffff640 1 -- 172.21.15.139:0/2198388478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886015cf40 msgr2=0x7f886015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885ffff640 1 --2- 172.21.15.139:0/2198388478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886015cf40 0x7f886015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885ffff640 1 -- 172.21.15.139:0/2198388478 >> v1:172.21.15.143:6789/0 conn(0x7f88601539c0 legacy=0x7f88600c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885ffff640 1 -- 172.21.15.139:0/2198388478 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88600c8270 con 0x7f886006fc90 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885ffff640 1 --2- 172.21.15.139:0/2198388478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886006fc90 0x7f88600c9bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8854009870 tx=0x7f885402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ed864d3a64dc22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885f7fe640 1 -- 172.21.15.139:0/2198388478 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854037070 con 0x7f886006fc90 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885f7fe640 1 -- 172.21.15.139:0/2198388478 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885402ae50 con 0x7f886006fc90 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.148+0000 7f885f7fe640 1 -- 172.21.15.139:0/2198388478 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854032860 con 0x7f886006fc90 2024-04-26T18:02:15.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 -- 172.21.15.139:0/2198388478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886006fc90 msgr2=0x7f88600c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 --2- 172.21.15.139:0/2198388478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886006fc90 0x7f88600c9bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8854009870 tx=0x7f885402a300 comp rx=0 tx=0).stop 2024-04-26T18:02:15.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 -- 172.21.15.139:0/2198388478 shutdown_connections 2024-04-26T18:02:15.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 --2- 172.21.15.139:0/2198388478 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886015cf40 0x7f886015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 --2- 172.21.15.139:0/2198388478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886006fc90 0x7f88600c9bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 -- 172.21.15.139:0/2198388478 >> 172.21.15.139:0/2198388478 conn(0x7f886006c970 msgr2=0x7f88600cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 -- 172.21.15.139:0/2198388478 shutdown_connections 2024-04-26T18:02:15.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.149+0000 7f8866b5f640 1 -- 172.21.15.139:0/2198388478 wait complete. 2024-04-26T18:02:15.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.150+0000 7f8866b5f640 1 Processor -- start 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.150+0000 7f8866b5f640 1 -- start start 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f8866b5f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886006fc90 0x7f886015ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f8866b5f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88601539c0 0x7f886015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f8866b5f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886015cf40 0x7f886015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f8866b5f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8860070950 con 0x7f886015cf40 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f8866b5f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f88600c8510 con 0x7f88601539c0 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f8866b5f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8860153da0 con 0x7f886006fc90 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f88650fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886015cf40 0x7f886015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f88650fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886015cf40 0x7f886015b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41492/0 (socket says 172.21.15.139:41492) 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f88650fc640 1 -- 172.21.15.139:0/1541524047 learned_addr learned my addr 172.21.15.139:0/1541524047 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f88648fb640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886006fc90 0x7f886015ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.151+0000 7f885ffff640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88601539c0 0x7f886015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f88650fc640 1 -- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886006fc90 msgr2=0x7f886015ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f88650fc640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886006fc90 0x7f886015ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f88650fc640 1 -- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88601539c0 msgr2=0x7f886015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f88650fc640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88601539c0 0x7f886015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f88650fc640 1 -- 172.21.15.139:0/1541524047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886014b850 con 0x7f886015cf40 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f88650fc640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886015cf40 0x7f886015b6a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f885800efc0 tx=0x7f885800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f885d7fa640 1 -- 172.21.15.139:0/1541524047 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858018020 con 0x7f886015cf40 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f885d7fa640 1 -- 172.21.15.139:0/1541524047 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8858014480 con 0x7f886015cf40 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f885d7fa640 1 -- 172.21.15.139:0/1541524047 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858014870 con 0x7f886015cf40 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88601e5c50 con 0x7f886015cf40 2024-04-26T18:02:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.152+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886014bda0 con 0x7f886015cf40 2024-04-26T18:02:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.153+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8860076d20 con 0x7f886015cf40 2024-04-26T18:02:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.153+0000 7f885d7fa640 1 -- 172.21.15.139:0/1541524047 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8858005d10 con 0x7f886015cf40 2024-04-26T18:02:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.154+0000 7f885d7fa640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f884c06c8f0 0x7f884c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.154+0000 7f88648fb640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f884c06c8f0 0x7f884c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.154+0000 7f885d7fa640 1 -- 172.21.15.139:0/1541524047 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f885808c9e0 con 0x7f886015cf40 2024-04-26T18:02:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.154+0000 7f88648fb640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f884c06c8f0 0x7f884c06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8850001620 tx=0x7f8850009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.158+0000 7f885d7fa640 1 -- 172.21.15.139:0/1541524047 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8858022070 con 0x7f886015cf40 2024-04-26T18:02:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.372+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88600ce1a0 con 0x7f886015cf40 2024-04-26T18:02:15.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.372+0000 7f885d7fa640 1 -- 172.21.15.139:0/1541524047 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f8858010040 con 0x7f886015cf40 2024-04-26T18:02:15.371 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:02:15.371 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:02:15.372 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:02:15.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f884c06c8f0 msgr2=0x7f884c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f884c06c8f0 0x7f884c06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8850001620 tx=0x7f8850009040 comp rx=0 tx=0).stop 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886015cf40 msgr2=0x7f886015b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886015cf40 0x7f886015b6a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f885800efc0 tx=0x7f885800c490 comp rx=0 tx=0).stop 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 shutdown_connections 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f884c06c8f0 0x7f884c06edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886015cf40 0x7f886015b6a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f88601539c0 0x7f886015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 --2- 172.21.15.139:0/1541524047 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f886006fc90 0x7f886015ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 >> 172.21.15.139:0/1541524047 conn(0x7f886006c970 msgr2=0x7f886015d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 shutdown_connections 2024-04-26T18:02:15.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.374+0000 7f8866b5f640 1 -- 172.21.15.139:0/1541524047 wait complete. 2024-04-26T18:02:15.384 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 4c14625f --release --await' 2024-04-26T18:02:15.384 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 4c14625f --release --await 2024-04-26T18:02:15.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.488+0000 7f75368fc640 1 Processor -- start 2024-04-26T18:02:15.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.488+0000 7f75368fc640 1 -- start start 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.488+0000 7f75368fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7530156010 0x7f75300c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.488+0000 7f75368fc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f753006ccc0 0x7f753006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.488+0000 7f75368fc640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f753006d630 con 0x7f75300cfec0 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.488+0000 7f75368fc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f75300c4c00 con 0x7f7530156010 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.488+0000 7f75368fc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f75300c4ee0 con 0x7f753006ccc0 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7530156010 0x7f75300c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f75300cfec0 0x7f75300ca520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55954/0 (socket says 172.21.15.139:55954) 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752f7fe640 1 -- 172.21.15.139:0/2882491096 learned_addr learned my addr 172.21.15.139:0/2882491096 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f7534e99640 1 --2- 172.21.15.139:0/2882491096 >> v2:172.21.15.143:3300/0 conn(0x7f753006ccc0 0x7f753006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752ffff640 1 -- 172.21.15.139:0/2882491096 >> v2:172.21.15.143:3300/0 conn(0x7f753006ccc0 msgr2=0x7f753006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752ffff640 1 --2- 172.21.15.139:0/2882491096 >> v2:172.21.15.143:3300/0 conn(0x7f753006ccc0 0x7f753006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752ffff640 1 -- 172.21.15.139:0/2882491096 >> v1:172.21.15.139:6789/0 conn(0x7f75300cfec0 legacy=0x7f75300ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752effd640 1 -- 172.21.15.139:0/2882491096 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977364630 0 0) 0x7f753006d630 con 0x7f75300cfec0 2024-04-26T18:02:15.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.489+0000 7f752ffff640 1 -- 172.21.15.139:0/2882491096 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300c51c0 con 0x7f7530156010 2024-04-26T18:02:15.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f752ffff640 1 --2- 172.21.15.139:0/2882491096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7530156010 0x7f75300c58d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f75300c6490 tx=0x7f752002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b37af467ccb741a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f752effd640 1 -- 172.21.15.139:0/2882491096 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520037070 con 0x7f7530156010 2024-04-26T18:02:15.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f752effd640 1 -- 172.21.15.139:0/2882491096 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7520032440 con 0x7f7530156010 2024-04-26T18:02:15.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f752effd640 1 -- 172.21.15.139:0/2882491096 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520032810 con 0x7f7530156010 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 -- 172.21.15.139:0/2882491096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7530156010 msgr2=0x7f75300c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 --2- 172.21.15.139:0/2882491096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7530156010 0x7f75300c58d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f75300c6490 tx=0x7f752002a1a0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 -- 172.21.15.139:0/2882491096 shutdown_connections 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 --2- 172.21.15.139:0/2882491096 >> v2:172.21.15.143:3300/0 conn(0x7f753006ccc0 0x7f753006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 --2- 172.21.15.139:0/2882491096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7530156010 0x7f75300c58d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 -- 172.21.15.139:0/2882491096 >> 172.21.15.139:0/2882491096 conn(0x7f753006fe70 msgr2=0x7f7530070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 -- 172.21.15.139:0/2882491096 shutdown_connections 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.490+0000 7f75368fc640 1 -- 172.21.15.139:0/2882491096 wait complete. 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.491+0000 7f75368fc640 1 Processor -- start 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f75368fc640 1 -- start start 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f75368fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753006ccc0 0x7f753015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f75368fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75300cfec0 0x7f7530150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f75368fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7530156010 0x7f7530151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f75368fc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f75300c5e10 con 0x7f75300cfec0 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f75368fc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75301563f0 con 0x7f7530156010 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f75368fc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75300c5f90 con 0x7f753006ccc0 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75300cfec0 0x7f7530150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75300cfec0 0x7f7530150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41510/0 (socket says 172.21.15.139:41510) 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.492+0000 7f752f7fe640 1 -- 172.21.15.139:0/60467132 learned_addr learned my addr 172.21.15.139:0/60467132 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752ffff640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753006ccc0 0x7f753015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f7534e99640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7530156010 0x7f7530151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752f7fe640 1 -- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753006ccc0 msgr2=0x7f753015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752f7fe640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753006ccc0 0x7f753015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752f7fe640 1 -- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7530156010 msgr2=0x7f7530151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752f7fe640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7530156010 0x7f7530151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752f7fe640 1 -- 172.21.15.139:0/60467132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300b1110 con 0x7f75300cfec0 2024-04-26T18:02:15.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f7534e99640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7530156010 0x7f7530151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:15.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752f7fe640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75300cfec0 0x7f7530150ac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f752400c4e0 tx=0x7f752400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752cff9640 1 -- 172.21.15.139:0/60467132 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524018070 con 0x7f75300cfec0 2024-04-26T18:02:15.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752cff9640 1 -- 172.21.15.139:0/60467132 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524007500 con 0x7f75300cfec0 2024-04-26T18:02:15.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75300ce600 con 0x7f75300cfec0 2024-04-26T18:02:15.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f752cff9640 1 -- 172.21.15.139:0/60467132 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524004a20 con 0x7f75300cfec0 2024-04-26T18:02:15.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.493+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75300ce8a0 con 0x7f75300cfec0 2024-04-26T18:02:15.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.495+0000 7f752cff9640 1 -- 172.21.15.139:0/60467132 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7524004bc0 con 0x7f75300cfec0 2024-04-26T18:02:15.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.495+0000 7f752cff9640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f751c06c8f0 0x7f751c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.495+0000 7f752cff9640 1 -- 172.21.15.139:0/60467132 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f752408b350 con 0x7f75300cfec0 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.495+0000 7f752ffff640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f751c06c8f0 0x7f751c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.496+0000 7f752ffff640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f751c06c8f0 0x7f751c06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7520034000 tx=0x7f752002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.496+0000 7f7539613740 1 Processor -- start 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.496+0000 7f7539613740 1 -- start start 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb44470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb05890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7539613740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb05dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7539613740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b52fa6a040 con 0x55b52fb06a10 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b52fa05b60 con 0x55b52fb054b0 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b52fa66000 con 0x55b52fb449b0 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb05dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb05dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41514/0 (socket says 172.21.15.139:41514) 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 -- 172.21.15.139:0/1502733497 learned_addr learned my addr 172.21.15.139:0/1502733497 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f752ffff640 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb44470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f752f7fe640 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb05890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 -- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 msgr2=0x55b52fb05890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb05890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 -- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 msgr2=0x55b52fb44470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb44470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 -- 172.21.15.139:0/1502733497 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52f9fa9c0 con 0x55b52fb06a10 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7534e99640 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb05dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f75280073e0 tx=0x7f75280078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419dc6aeb447c24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7515ffb640 1 -- 172.21.15.139:0/1502733497 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280147e0 con 0x55b52fb06a10 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7515ffb640 1 -- 172.21.15.139:0/1502733497 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752801a070 con 0x55b52fb06a10 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.497+0000 7f7515ffb640 1 -- 172.21.15.139:0/1502733497 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528014bc0 con 0x55b52fb06a10 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 -- 172.21.15.139:0/1502733497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 msgr2=0x55b52fb05dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb05dd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f75280073e0 tx=0x7f75280078a0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 -- 172.21.15.139:0/1502733497 shutdown_connections 2024-04-26T18:02:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb05dd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb05890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 --2- 172.21.15.139:0/1502733497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb44470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 -- 172.21.15.139:0/1502733497 >> 172.21.15.139:0/1502733497 conn(0x55b52facc930 msgr2=0x55b52fb49450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 -- 172.21.15.139:0/1502733497 shutdown_connections 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.498+0000 7f7539613740 1 -- 172.21.15.139:0/1502733497 wait complete. 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 -- start start 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 Processor -- start 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb05c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb06a10 0x55b52fb55fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fb2f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b52fb03af0 con 0x55b52fb449b0 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b52fa034f0 con 0x55b52fb054b0 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.499+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b52fb07040 con 0x55b52fb06a10 2024-04-26T18:02:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7539613740 10 client.0 _ll_register_callbacks cb 0x55b52fa60c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fb2f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fb2f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41522/0 (socket says 172.21.15.139:41522) 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 -- 172.21.15.139:0/1423230520 learned_addr learned my addr 172.21.15.139:0/1423230520 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f752f7fe640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb06a10 0x55b52fb55fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 -- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb06a10 msgr2=0x55b52fb55fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb06a10 0x55b52fb55fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 -- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 msgr2=0x55b52fb05c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb05c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 -- 172.21.15.139:0/1423230520 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52f77b920 con 0x55b52fb449b0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7534e99640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fb2f8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55b52fb45a50 tx=0x7f7528004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94f3201577ea854 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f750effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f750effd640 1 -- 172.21.15.139:0/1423230520 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528015670 con 0x55b52fb449b0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f750effd640 1 -- 172.21.15.139:0/1423230520 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f7528015810 con 0x55b52fb449b0 2024-04-26T18:02:15.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f752801a070 con 0x55b52fb449b0 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f750effd640 1 -- 172.21.15.139:0/1423230520 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7528032050 con 0x55b52fb449b0 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7539613740 10 client.4968 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b52f847d30 con 0x55b52fb449b0 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f750effd640 1 -- 172.21.15.139:0/1423230520 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752801a070 con 0x55b52fb449b0 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.500+0000 7f750effd640 1 -- 172.21.15.139:0/1423230520 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7528035020 con 0x55b52fb449b0 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f7539613740 10 client.4968 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f7539613740 10 client.4968 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f7539613740 20 client.4968 populate_metadata read hostname 'smithi139' 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f7539613740 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 0x55b52fb416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f7539613740 4 client.4968 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b52fa3da00 con 0x55b52fb2fe80 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f752ffff640 1 -- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 msgr2=0x55b52fb416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f752ffff640 1 -- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 msgr2=0x55b52fb416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f752ffff640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 0x55b52fb416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-04-26T18:02:15.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.501+0000 7f752ffff640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 0x55b52fb416f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:02:15.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.702+0000 7f752ffff640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 0x55b52fb416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.702+0000 7f752ffff640 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 0x55b52fb416f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddf507378b89325a server_cookie=c56e6bbb130f300f in_seq=0 out_seq=0 2024-04-26T18:02:15.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.702+0000 7f750effd640 10 client.4968 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f750effd640 1 -- 172.21.15.139:0/1423230520 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b52fa3da00 con 0x55b52fb2fe80 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f750effd640 10 client.4968 handle_command_reply: tid=0 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 client.4968 shutdown 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 msgr2=0x55b52fb2f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fb2f8f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55b52fb45a50 tx=0x7f7528004ab0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 shutdown_connections 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fb2f8f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fb2fe80 0x55b52fb416f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb06a10 0x55b52fb55fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 --2- 172.21.15.139:0/1423230520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb05c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f750effd640 0 client.4968 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 >> 172.21.15.139:0/1423230520 conn(0x55b52facc930 msgr2=0x55b52fb2ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 shutdown_connections 2024-04-26T18:02:15.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.703+0000 7f7539613740 1 -- 172.21.15.139:0/1423230520 wait complete. 2024-04-26T18:02:15.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.704+0000 7f7539613740 20 client.4968 trim_cache size 0 max 16384 2024-04-26T18:02:15.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.720+0000 7f7539613740 1 Processor -- start 2024-04-26T18:02:15.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f7539613740 1 -- start start 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb3fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f7539613740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb49e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f7539613740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7530200570 con 0x55b52fb06a10 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75301ff450 con 0x55b52fb054b0 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f753014c580 con 0x55b52fb449b0 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41538/0 (socket says 172.21.15.139:41538) 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.721+0000 7f752f7fe640 1 -- 172.21.15.139:0/715471604 learned_addr learned my addr 172.21.15.139:0/715471604 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f752ffff640 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb3fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7534e99640 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb49e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f752f7fe640 1 -- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 msgr2=0x55b52fb49e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f752f7fe640 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb49e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f752f7fe640 1 -- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 msgr2=0x55b52fb3fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f752f7fe640 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb3fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f752f7fe640 1 -- 172.21.15.139:0/715471604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52fb2fc60 con 0x55b52fb06a10 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f752f7fe640 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb498c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f752400cfd0 tx=0x7f7524009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d2d019af70e156 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f75157fa640 1 -- 172.21.15.139:0/715471604 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524061880 con 0x55b52fb06a10 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f75157fa640 1 -- 172.21.15.139:0/715471604 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524056d60 con 0x55b52fb06a10 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f75157fa640 1 -- 172.21.15.139:0/715471604 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752408b0c0 con 0x55b52fb06a10 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7539613740 1 -- 172.21.15.139:0/715471604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 msgr2=0x55b52fb498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7539613740 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb498c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f752400cfd0 tx=0x7f7524009040 comp rx=0 tx=0).stop 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7539613740 1 -- 172.21.15.139:0/715471604 shutdown_connections 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7539613740 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb449b0 0x55b52fb49e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7539613740 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb06a10 0x55b52fb498c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7539613740 1 --2- 172.21.15.139:0/715471604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb054b0 0x55b52fb3fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.722+0000 7f7539613740 1 -- 172.21.15.139:0/715471604 >> 172.21.15.139:0/715471604 conn(0x55b52facc930 msgr2=0x55b52fb05aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.723+0000 7f7539613740 1 -- 172.21.15.139:0/715471604 shutdown_connections 2024-04-26T18:02:15.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.723+0000 7f7539613740 1 -- 172.21.15.139:0/715471604 wait complete. 2024-04-26T18:02:15.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.723+0000 7f7539613740 1 -- start start 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.723+0000 7f7539613740 1 Processor -- start 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb054b0 0x55b52fb525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7539613740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb06a10 0x55b52fb46980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7539613740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fbb99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7539613740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f75301fe020 con 0x55b52fb449b0 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75301fed80 con 0x55b52fb06a10 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7539613740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75301fe6b0 con 0x55b52fb054b0 2024-04-26T18:02:15.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7539613740 10 client.0 _ll_register_callbacks cb 0x7f7528009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fbb99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fbb99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41540/0 (socket says 172.21.15.139:41540) 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 -- 172.21.15.139:0/179938973 learned_addr learned my addr 172.21.15.139:0/179938973 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f752ffff640 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb054b0 0x55b52fb525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f752f7fe640 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb06a10 0x55b52fb46980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 -- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb054b0 msgr2=0x55b52fb525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb054b0 0x55b52fb525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 -- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb06a10 msgr2=0x55b52fb46980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb06a10 0x55b52fb46980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.724+0000 7f7534e99640 1 -- 172.21.15.139:0/179938973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52fb25e50 con 0x55b52fb449b0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7534e99640 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fbb99f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7528009670 tx=0x7f752800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6623b35fcb58e79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f750effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f750effd640 1 -- 172.21.15.139:0/179938973 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752803b060 con 0x55b52fb449b0 2024-04-26T18:02:15.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7524056d60 con 0x55b52fb449b0 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f750effd640 1 -- 172.21.15.139:0/179938973 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f7528015da0 con 0x55b52fb449b0 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f750effd640 1 -- 172.21.15.139:0/179938973 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7528041050 con 0x55b52fb449b0 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 10 client.4974 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b52fb52e50 con 0x55b52fb449b0 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f750effd640 1 -- 172.21.15.139:0/179938973 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7524056d60 con 0x55b52fb449b0 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f750effd640 1 -- 172.21.15.139:0/179938973 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7528035040 con 0x55b52fb449b0 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 10 client.4974 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 10 client.4974 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 20 client.4974 populate_metadata read hostname 'smithi139' 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fbb9f30 0x55b52fbc3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 4 client.4974 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4c14625f", "release": true, "await": true}] 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4c14625f", "release": true, "await": true}) -- 0x55b52fa77c50 con 0x55b52fbb9f30 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.725+0000 7f752ffff640 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fbb9f30 0x55b52fbc3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f750effd640 10 client.4974 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f752ffff640 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fbb9f30 0x55b52fbc3130 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9e16426916a7914 server_cookie=666c75071b3e1a54 in_seq=0 out_seq=0 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f750effd640 1 -- 172.21.15.139:0/179938973 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55b52fa77c50 con 0x55b52fbb9f30 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f750effd640 10 client.4974 handle_command_reply: tid=0 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 client.4974 shutdown 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 msgr2=0x55b52fbb99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fbb99f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7528009670 tx=0x7f752800b040 comp rx=0 tx=0).stop 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 shutdown_connections 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b52fb449b0 0x55b52fbb99f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b52fb06a10 0x55b52fb46980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b52fbb9f30 0x55b52fbc3130 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 --2- 172.21.15.139:0/179938973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b52fb054b0 0x55b52fb525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 >> 172.21.15.139:0/179938973 conn(0x55b52facc930 msgr2=0x55b52fb2e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f750effd640 0 client.4974 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 shutdown_connections 2024-04-26T18:02:15.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 1 -- 172.21.15.139:0/179938973 wait complete. 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.726+0000 7f7539613740 20 client.4974 trim_cache size 0 max 16384 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 12, 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "4c14625f": { 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 12, 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:02:15.733 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.5, 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:15.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:15.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:15.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:15.735 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f751c06c8f0 msgr2=0x7f751c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f751c06c8f0 0x7f751c06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7520034000 tx=0x7f752002e000 comp rx=0 tx=0).stop 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75300cfec0 msgr2=0x7f7530150ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75300cfec0 0x7f7530150ac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f752400c4e0 tx=0x7f752400c9a0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 shutdown_connections 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f751c06c8f0 0x7f751c06edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7530156010 0x7f7530151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75300cfec0 0x7f7530150ac0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 --2- 172.21.15.139:0/60467132 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f753006ccc0 0x7f753015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 >> 172.21.15.139:0/60467132 conn(0x7f753006fe70 msgr2=0x7f75300c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 shutdown_connections 2024-04-26T18:02:15.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.727+0000 7f75368fc640 1 -- 172.21.15.139:0/60467132 wait complete. 2024-04-26T18:02:15.737 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4c14625f', seconds elapsed: 26.0 2024-04-26T18:02:15.738 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-26T18:02:15.738 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.835+0000 7f55eea6d640 1 Processor -- start 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.835+0000 7f55eea6d640 1 -- start start 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55eea6d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e80cf240 0x7f55e80cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55eea6d640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f55e815c140 0x7f55e815c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55eea6d640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e815f490 con 0x7f55e806c310 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55eea6d640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f55e815ca80 con 0x7f55e815c140 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55eea6d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f55e8160010 con 0x7f55e80cf240 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55ed00a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f55e806c310 0x7f55e80cbd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55960/0 (socket says 172.21.15.139:55960) 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55ed00a640 1 -- 172.21.15.139:0/2972090620 learned_addr learned my addr 172.21.15.139:0/2972090620 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:02:15.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55ec809640 1 --2- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e80cf240 0x7f55e80cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55e7fff640 1 --2- 172.21.15.139:0/2972090620 >> v2:172.21.15.143:3300/0 conn(0x7f55e815c140 0x7f55e815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55e77fe640 1 -- 172.21.15.139:0/2972090620 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581517688 0 0) 0x7f55e815f490 con 0x7f55e806c310 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.836+0000 7f55e77fe640 1 -- 172.21.15.139:0/2972090620 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d0003520 con 0x7f55e806c310 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e7fff640 1 -- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e80cf240 msgr2=0x7f55e80cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e7fff640 1 --2- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e80cf240 0x7f55e80cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e7fff640 1 -- 172.21.15.139:0/2972090620 >> v1:172.21.15.139:6789/0 conn(0x7f55e806c310 legacy=0x7f55e80cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e7fff640 1 -- 172.21.15.139:0/2972090620 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e815f770 con 0x7f55e815c140 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55ec809640 1 --2- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e80cf240 0x7f55e80cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:15.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e7fff640 1 --2- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e815c140 0x7f55e815c540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097a0 tx=0x7f55dc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e84caebc63bda5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e77fe640 1 -- 172.21.15.139:0/2972090620 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc037070 con 0x7f55e815c140 2024-04-26T18:02:15.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e77fe640 1 -- 172.21.15.139:0/2972090620 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55dc032440 con 0x7f55e815c140 2024-04-26T18:02:15.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.837+0000 7f55e77fe640 1 -- 172.21.15.139:0/2972090620 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0327f0 con 0x7f55e815c140 2024-04-26T18:02:15.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 -- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e815c140 msgr2=0x7f55e815c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 --2- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e815c140 0x7f55e815c540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0097a0 tx=0x7f55dc02a180 comp rx=0 tx=0).stop 2024-04-26T18:02:15.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 -- 172.21.15.139:0/2972090620 shutdown_connections 2024-04-26T18:02:15.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 --2- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e815c140 0x7f55e815c540 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 --2- 172.21.15.139:0/2972090620 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e80cf240 0x7f55e80cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 -- 172.21.15.139:0/2972090620 >> 172.21.15.139:0/2972090620 conn(0x7f55e8076730 msgr2=0x7f55e8068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 -- 172.21.15.139:0/2972090620 shutdown_connections 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.838+0000 7f55eea6d640 1 -- 172.21.15.139:0/2972090620 wait complete. 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.839+0000 7f55eea6d640 1 Processor -- start 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.839+0000 7f55eea6d640 1 -- start start 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55eea6d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e806c310 0x7f55e815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55eea6d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e80cf240 0x7f55e81e8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55eea6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e815c140 0x7f55e81f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55eea6d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55e815fd30 con 0x7f55e815c140 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55eea6d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f55e815bcb0 con 0x7f55e80cf240 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55eea6d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f55e806e2a0 con 0x7f55e806c310 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e815c140 0x7f55e81f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e815c140 0x7f55e81f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41552/0 (socket says 172.21.15.139:41552) 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 -- 172.21.15.139:0/539276319 learned_addr learned my addr 172.21.15.139:0/539276319 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ec809640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e806c310 0x7f55e815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55e7fff640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e80cf240 0x7f55e81e8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 -- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e806c310 msgr2=0x7f55e815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e806c310 0x7f55e815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 -- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e80cf240 msgr2=0x7f55e81e8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e80cf240 0x7f55e81e8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.840+0000 7f55ed00a640 1 -- 172.21.15.139:0/539276319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e81f1d20 con 0x7f55e815c140 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.841+0000 7f55ed00a640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e815c140 0x7f55e81f24e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f55e000cad0 tx=0x7f55e000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.841+0000 7f55e57fa640 1 -- 172.21.15.139:0/539276319 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0017070 con 0x7f55e815c140 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.841+0000 7f55e57fa640 1 -- 172.21.15.139:0/539276319 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e000ac30 con 0x7f55e815c140 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.841+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e81f5750 con 0x7f55e815c140 2024-04-26T18:02:15.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.841+0000 7f55e57fa640 1 -- 172.21.15.139:0/539276319 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0012400 con 0x7f55e815c140 2024-04-26T18:02:15.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.841+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e81f5d10 con 0x7f55e815c140 2024-04-26T18:02:15.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.842+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e8076d20 con 0x7f55e815c140 2024-04-26T18:02:15.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.842+0000 7f55e57fa640 1 -- 172.21.15.139:0/539276319 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55e001a070 con 0x7f55e815c140 2024-04-26T18:02:15.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.843+0000 7f55e57fa640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f55d406c920 0x7f55d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:15.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.843+0000 7f55e57fa640 1 -- 172.21.15.139:0/539276319 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f55e008bd00 con 0x7f55e815c140 2024-04-26T18:02:15.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.843+0000 7f55ec809640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f55d406c920 0x7f55d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:15.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.843+0000 7f55ec809640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f55d406c920 0x7f55d406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009560 tx=0x7f55d8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:15.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:15.847+0000 7f55e57fa640 1 -- 172.21.15.139:0/539276319 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f55e0059630 con 0x7f55e815c140 2024-04-26T18:02:16.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.060+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55e80715e0 con 0x7f55e815c140 2024-04-26T18:02:16.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.061+0000 7f55e57fa640 1 -- 172.21.15.139:0/539276319 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f55e005d930 con 0x7f55e815c140 2024-04-26T18:02:16.061 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:02:16.061 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:02:16.062 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:02:16.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f55d406c920 msgr2=0x7f55d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f55d406c920 0x7f55d406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009560 tx=0x7f55d8009190 comp rx=0 tx=0).stop 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e815c140 msgr2=0x7f55e81f24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e815c140 0x7f55e81f24e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f55e000cad0 tx=0x7f55e000cf90 comp rx=0 tx=0).stop 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 shutdown_connections 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f55d406c920 0x7f55d406ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55e815c140 0x7f55e81f24e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f55e80cf240 0x7f55e81e8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 --2- 172.21.15.139:0/539276319 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f55e806c310 0x7f55e815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 >> 172.21.15.139:0/539276319 conn(0x7f55e8076730 msgr2=0x7f55e8154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 shutdown_connections 2024-04-26T18:02:16.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.063+0000 7f55eea6d640 1 -- 172.21.15.139:0/539276319 wait complete. 2024-04-26T18:02:16.074 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-26T18:02:16.075 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-26T18:02:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.184+0000 7fc1d099d640 1 Processor -- start 2024-04-26T18:02:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.184+0000 7fc1d099d640 1 -- start start 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1d099d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc071ad0 0x7fc1cc071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1d099d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc1cc0ca8c0 0x7fc1cc0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1d099d640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1cc0ca490 con 0x7fc1cc0c6210 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1d099d640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc1cc0cbfa0 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1d099d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc0cb260 con 0x7fc1cc071ad0 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1cad9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc1cc0ca8c0 0x7fc1cc0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1cad9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc1cc0ca8c0 0x7fc1cc0cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41558/0 (socket says 172.21.15.139:41558) 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1cad9d640 1 -- 172.21.15.139:0/3136857576 learned_addr learned my addr 172.21.15.139:0/3136857576 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.185+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/3136857576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc071ad0 0x7fc1cc071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.186+0000 7fc1cad9d640 1 -- 172.21.15.139:0/3136857576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc071ad0 msgr2=0x7fc1cc071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.186+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/3136857576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc071ad0 0x7fc1cc071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.186+0000 7fc1cad9d640 1 -- 172.21.15.139:0/3136857576 >> v1:172.21.15.143:6789/0 conn(0x7fc1cc0c6210 legacy=0x7fc1cc0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.186+0000 7fc1cad9d640 1 -- 172.21.15.139:0/3136857576 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc0cb8e0 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.186+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/3136857576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0ca8c0 0x7fc1cc0cad20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009e50 tx=0x7fc1bc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57107e849b83bfb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.186+0000 7fc1c959a640 1 -- 172.21.15.139:0/3136857576 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc036070 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.186+0000 7fc1c959a640 1 -- 172.21.15.139:0/3136857576 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc031600 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1c959a640 1 -- 172.21.15.139:0/3136857576 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0319d0 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 -- 172.21.15.139:0/3136857576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0ca8c0 msgr2=0x7fc1cc0cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 --2- 172.21.15.139:0/3136857576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0ca8c0 0x7fc1cc0cad20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc009e50 tx=0x7fc1bc02a710 comp rx=0 tx=0).stop 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 -- 172.21.15.139:0/3136857576 shutdown_connections 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 --2- 172.21.15.139:0/3136857576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0ca8c0 0x7fc1cc0cad20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 --2- 172.21.15.139:0/3136857576 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc071ad0 0x7fc1cc071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 -- 172.21.15.139:0/3136857576 >> 172.21.15.139:0/3136857576 conn(0x7fc1cc0746d0 msgr2=0x7fc1cc076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 -- 172.21.15.139:0/3136857576 shutdown_connections 2024-04-26T18:02:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.187+0000 7fc1d099d640 1 -- 172.21.15.139:0/3136857576 wait complete. 2024-04-26T18:02:16.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.188+0000 7fc1d099d640 1 Processor -- start 2024-04-26T18:02:16.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.188+0000 7fc1d099d640 1 -- start start 2024-04-26T18:02:16.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1d099d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1cc071ad0 0x7fc1cc156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1d099d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0c6210 0x7fc1cc1f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1d099d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc0ca8c0 0x7fc1cc13ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1d099d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0cc4d0 con 0x7fc1cc0c6210 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1d099d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc0cc1f0 con 0x7fc1cc071ad0 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1d099d640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc0cc7b0 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0c6210 0x7fc1cc1f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1ca59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1cc071ad0 0x7fc1cc156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0c6210 0x7fc1cc1f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41566/0 (socket says 172.21.15.139:41566) 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/2371194916 learned_addr learned my addr 172.21.15.139:0/2371194916 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.189+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc0ca8c0 0x7fc1cc13ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1cad9d640 1 -- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1cc071ad0 msgr2=0x7fc1cc156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1cc071ad0 0x7fc1cc156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1cad9d640 1 -- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0c6210 msgr2=0x7fc1cc1f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0c6210 0x7fc1cc1f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1cad9d640 1 -- 172.21.15.139:0/2371194916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc0b2320 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0c6210 0x7fc1cc1f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc0ca8c0 0x7fc1cc13ddd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc030000 tx=0x7fc1bc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1baffd640 1 -- 172.21.15.139:0/2371194916 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc041020 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1baffd640 1 -- 172.21.15.139:0/2371194916 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0077a0 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc0c6b40 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1baffd640 1 -- 172.21.15.139:0/2371194916 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc036040 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.190+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc1f5fb0 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.192+0000 7fc1baffd640 1 -- 172.21.15.139:0/2371194916 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1bc044020 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.193+0000 7fc1baffd640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc1ac06c920 0x7fc1ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.193+0000 7fc1baffd640 1 -- 172.21.15.139:0/2371194916 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7fc1bc0ac950 con 0x7fc1cc0ca8c0 2024-04-26T18:02:16.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.193+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc1ac06c920 0x7fc1ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.193+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc1ac06c920 0x7fc1ac06ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009b40 tx=0x7fc1c4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:16.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 Processor -- start 2024-04-26T18:02:16.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 -- start start 2024-04-26T18:02:16.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad099c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad09f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cd7ac6cd80 con 0x55cd7ad48ae0 2024-04-26T18:02:16.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55cd7ac08c20 con 0x55cd7ad095e0 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.194+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55cd7ac68d40 con 0x55cd7ad0ab40 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1ca59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1cad9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad09f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41574/0 (socket says 172.21.15.139:41574) 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/790534821 learned_addr learned my addr 172.21.15.139:0/790534821 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1ca59c640 1 -- 172.21.15.139:0/790534821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 msgr2=0x55cd7ad09f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad09f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1ca59c640 1 -- 172.21.15.139:0/790534821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 msgr2=0x55cd7ad099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1ca59c640 1 -- 172.21.15.139:0/790534821 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd7aa4ad80 con 0x55cd7ad095e0 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad485a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4011690 tx=0x7fc1c4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ede2e753e0106c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1abfff640 1 -- 172.21.15.139:0/790534821 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c401b070 con 0x55cd7ad095e0 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1abfff640 1 -- 172.21.15.139:0/790534821 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c4027070 con 0x55cd7ad095e0 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.195+0000 7fc1abfff640 1 -- 172.21.15.139:0/790534821 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4003a20 con 0x55cd7ad095e0 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 -- 172.21.15.139:0/790534821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 msgr2=0x55cd7ad485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad485a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4011690 tx=0x7fc1c4014000 comp rx=0 tx=0).stop 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 -- 172.21.15.139:0/790534821 shutdown_connections 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad09f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 --2- 172.21.15.139:0/790534821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad485a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 -- 172.21.15.139:0/790534821 >> 172.21.15.139:0/790534821 conn(0x55cd7acd0740 msgr2=0x55cd7ad4d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 -- 172.21.15.139:0/790534821 shutdown_connections 2024-04-26T18:02:16.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.196+0000 7fc1d378d740 1 -- 172.21.15.139:0/790534821 wait complete. 2024-04-26T18:02:16.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.197+0000 7fc1d378d740 1 -- start start 2024-04-26T18:02:16.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.197+0000 7fc1d378d740 1 Processor -- start 2024-04-26T18:02:16.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad5ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad40440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad46b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cd7ad07c20 con 0x55cd7ad48ae0 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55cd7ac06840 con 0x55cd7ad095e0 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55cd7ad0b170 con 0x55cd7ad0ab40 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 10 client.0 _ll_register_callbacks cb 0x55cd7ac0a5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1ca59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad5ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1ca59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad5ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:35496/0 (socket says 172.21.15.139:35496) 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1ca59c640 1 -- 172.21.15.139:0/655473710 learned_addr learned my addr 172.21.15.139:0/655473710 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad46b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad40440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1cad9d640 1 -- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 msgr2=0x55cd7ad40440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad40440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1cad9d640 1 -- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 msgr2=0x55cd7ad5ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad5ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1cad9d640 1 -- 172.21.15.139:0/655473710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd7aaab510 con 0x55cd7ad48ae0 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad5ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad46b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0aaab0 tx=0x7fc1bc009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a2228f6e921ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1a97fa640 1 -- 172.21.15.139:0/655473710 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc07e370 con 0x55cd7ad48ae0 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1a97fa640 1 -- 172.21.15.139:0/655473710 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7fc1bc007bb0 con 0x55cd7ad48ae0 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1c4027070 con 0x55cd7ad48ae0 2024-04-26T18:02:16.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1a97fa640 1 -- 172.21.15.139:0/655473710 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc1bc07e610 con 0x55cd7ad48ae0 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 10 client.4992 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.198+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cd7a93e670 con 0x55cd7ad48ae0 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1a97fa640 1 -- 172.21.15.139:0/655473710 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c4027070 con 0x55cd7ad48ae0 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1a97fa640 1 -- 172.21.15.139:0/655473710 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc1bc079760 con 0x55cd7ad48ae0 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1d378d740 10 client.4992 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1d378d740 10 client.4992 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1d378d740 20 client.4992 populate_metadata read hostname 'smithi139' 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1d378d740 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad42050 0x55cd7ad42fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1d378d740 4 client.4992 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd7ac7a990 con 0x55cd7ad42050 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad42050 0x55cd7ad42fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1a97fa640 10 client.4992 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.199+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad42050 0x55cd7ad42fb0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113d776fefe329b6 server_cookie=bfa9f1455d992061 in_seq=0 out_seq=0 2024-04-26T18:02:16.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.200+0000 7fc1a97fa640 1 -- 172.21.15.139:0/655473710 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd7ac7a990 con 0x55cd7ad42050 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.200+0000 7fc1a97fa640 10 client.4992 handle_command_reply: tid=0 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.200+0000 7fc1d378d740 1 client.4992 shutdown 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 msgr2=0x55cd7ad46b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad46b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0aaab0 tx=0x7fc1bc009510 comp rx=0 tx=0).stop 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 shutdown_connections 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad48ae0 0x55cd7ad46b80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad42050 0x55cd7ad42fb0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad0ab40 0x55cd7ad40440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 --2- 172.21.15.139:0/655473710 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad5ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1a97fa640 0 client.4992 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 >> 172.21.15.139:0/655473710 conn(0x55cd7acd0740 msgr2=0x55cd7ad0a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 shutdown_connections 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 1 -- 172.21.15.139:0/655473710 wait complete. 2024-04-26T18:02:16.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.201+0000 7fc1d378d740 20 client.4992 trim_cache size 0 max 16384 2024-04-26T18:02:16.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.219+0000 7fc1d378d740 1 Processor -- start 2024-04-26T18:02:16.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.219+0000 7fc1d378d740 1 -- start start 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad07240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad42920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad48ae0 0x55cd7ad42e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1d378d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc2006a0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc1ff580 con 0x55cd7ad095e0 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc0b0620 con 0x55cd7ad48ae0 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad42920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad42920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41594/0 (socket says 172.21.15.139:41594) 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/2842652300 learned_addr learned my addr 172.21.15.139:0/2842652300 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad07240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad48ae0 0x55cd7ad42e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad48ae0 msgr2=0x55cd7ad42e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad48ae0 0x55cd7ad42e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 msgr2=0x55cd7ad07240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad07240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/2842652300 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd7ad4dcd0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad07240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1cad9d640 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad48ae0 0x55cd7ad42e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad42920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0001e00 tx=0x7fc1c0007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95501df1287d5f5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1ab7fe640 1 -- 172.21.15.139:0/2842652300 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0005320 con 0x55cd7ad0ab40 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1ab7fe640 1 -- 172.21.15.139:0/2842652300 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c00035f0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.220+0000 7fc1ab7fe640 1 -- 172.21.15.139:0/2842652300 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00039a0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 -- 172.21.15.139:0/2842652300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 msgr2=0x55cd7ad42920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad42920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0001e00 tx=0x7fc1c0007f10 comp rx=0 tx=0).stop 2024-04-26T18:02:16.223 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 -- 172.21.15.139:0/2842652300 shutdown_connections 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad48ae0 0x55cd7ad42e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad42920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 --2- 172.21.15.139:0/2842652300 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad095e0 0x55cd7ad07240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 -- 172.21.15.139:0/2842652300 >> 172.21.15.139:0/2842652300 conn(0x55cd7acd0740 msgr2=0x55cd7ad46950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 -- 172.21.15.139:0/2842652300 shutdown_connections 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 -- 172.21.15.139:0/2842652300 wait complete. 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.221+0000 7fc1d378d740 1 -- start start 2024-04-26T18:02:16.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.222+0000 7fc1d378d740 1 Processor -- start 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad095e0 0x55cd7ad5a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad03f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad48ae0 0x55cd7adc0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc1529c0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc1feeb0 con 0x55cd7ad48ae0 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc1cc1fe810 con 0x55cd7ad095e0 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 10 client.0 _ll_register_callbacks cb 0x7fc1bc079e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad03f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad03f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41600/0 (socket says 172.21.15.139:41600) 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/3786306347 learned_addr learned my addr 172.21.15.139:0/3786306347 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1cad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad48ae0 0x55cd7adc0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad095e0 0x55cd7ad5a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad095e0 msgr2=0x55cd7ad5a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad095e0 0x55cd7ad5a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad48ae0 msgr2=0x55cd7adc0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad48ae0 0x55cd7adc0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 -- 172.21.15.139:0/3786306347 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd7ad32300 con 0x55cd7ad0ab40 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1c9d9b640 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad03f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009010 tx=0x7fc1c0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728621853deebecf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1a97fa640 1 -- 172.21.15.139:0/3786306347 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0007240 con 0x55cd7ad0ab40 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1a97fa640 1 -- 172.21.15.139:0/3786306347 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7fc1c00073e0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.223+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1c00035f0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1a97fa640 1 -- 172.21.15.139:0/3786306347 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc1c0031050 con 0x55cd7ad0ab40 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 10 client.4998 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cd7ad02f70 con 0x55cd7ad0ab40 2024-04-26T18:02:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1a97fa640 1 -- 172.21.15.139:0/3786306347 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c00035f0 con 0x55cd7ad0ab40 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1a97fa640 1 -- 172.21.15.139:0/3786306347 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc1c0034020 con 0x55cd7ad0ab40 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 10 client.4998 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 10 client.4998 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 20 client.4998 populate_metadata read hostname 'smithi139' 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad63e40 0x55cd7adc1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 4 client.4998 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x55cd7ac74800 con 0x55cd7ad63e40 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad63e40 0x55cd7adc1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.224+0000 7fc1a97fa640 10 client.4998 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:16.225+0000 7fc1ca59c640 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad63e40 0x55cd7adc1280 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2861ba93aee7fcf server_cookie=4187e60b7c01aba4 in_seq=0 out_seq=0 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/14' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/18' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/13' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/137/17' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/137' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/19' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/15' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/20' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/12' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/10' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/11' 2024-04-26T18:02:16.243 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/16' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/14' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/18' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/13' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/198/17' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/198' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/19' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/15' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/20' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/12' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/10' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/11' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/16' 2024-04-26T18:02:16.244 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/14' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/18' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/13' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/136/17' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/136' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/19' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/15' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/20' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/12' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/10' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/11' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/16' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/14' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/18' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/13' 2024-04-26T18:02:16.245 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/125/17' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/125' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/19' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/15' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/20' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/12' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/10' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/11' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/16' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/14' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/18' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/13' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/194/17' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/194' 2024-04-26T18:02:16.246 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/19' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/15' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/20' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/12' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/10' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/11' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/16' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/14' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/18' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/13' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/119/17' 2024-04-26T18:02:16.247 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/119' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/19' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/15' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/20' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/12' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/10' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/11' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/16' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/14' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/18' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/13' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/157/17' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/157' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/19' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/15' 2024-04-26T18:02:16.248 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/20' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/12' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/10' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/11' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/16' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/14' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/18' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/13' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/172/17' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/172' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/19' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/15' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/20' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/12' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/10' 2024-04-26T18:02:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/11' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/16' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/14' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/18' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/13' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/186/17' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/186' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/19' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/15' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/20' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/12' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/10' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/11' 2024-04-26T18:02:16.250 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/16' 2024-04-26T18:02:16.251 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/14' 2024-04-26T18:02:20.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.024+0000 7fc1a97fa640 1 -- 172.21.15.139:0/3786306347 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55cd7ac74800 con 0x55cd7ad63e40 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1a97fa640 10 client.4998 handle_command_reply: tid=0 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 client.4998 shutdown 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 msgr2=0x55cd7ad03f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad03f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009010 tx=0x7fc1c0000bc0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 shutdown_connections 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cd7ad48ae0 0x55cd7adc0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cd7ad0ab40 0x55cd7ad03f30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cd7ad63e40 0x55cd7adc1280 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 --2- 172.21.15.139:0/3786306347 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cd7ad095e0 0x55cd7ad5a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1a97fa640 0 client.4998 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:20.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 >> 172.21.15.139:0/3786306347 conn(0x55cd7acd0740 msgr2=0x55cd7ad467e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 shutdown_connections 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 1 -- 172.21.15.139:0/3786306347 wait complete. 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.025+0000 7fc1d378d740 20 client.4998 trim_cache size 0 max 16384 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 14, 2024-04-26T18:02:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "36f46ac2": { 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 14, 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.5, 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:02:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:02:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:20.029 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc1ac06c920 msgr2=0x7fc1ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc1ac06c920 0x7fc1ac06ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009b40 tx=0x7fc1c4009190 comp rx=0 tx=0).stop 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc0ca8c0 msgr2=0x7fc1cc13ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc0ca8c0 0x7fc1cc13ddd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc030000 tx=0x7fc1bc004a40 comp rx=0 tx=0).stop 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 shutdown_connections 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc1ac06c920 0x7fc1ac06ede0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc1cc0ca8c0 0x7fc1cc13ddd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1cc0c6210 0x7fc1cc1f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 --2- 172.21.15.139:0/2371194916 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc1cc071ad0 0x7fc1cc156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:20.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 >> 172.21.15.139:0/2371194916 conn(0x7fc1cc0746d0 msgr2=0x7fc1cc0c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:20.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 shutdown_connections 2024-04-26T18:02:20.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:20.026+0000 7fc1d099d640 1 -- 172.21.15.139:0/2371194916 wait complete. 2024-04-26T18:02:20.040 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '36f46ac2', quiesce took 4.3 seconds. Will release after: 19.5 2024-04-26T18:02:36.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:36.301 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:39.541 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:02:39.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.649+0000 7f7415c72640 1 Processor -- start 2024-04-26T18:02:39.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.649+0000 7f7415c72640 1 -- start start 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f7415c72640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f74100c89f0 0x7f741015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f7415c72640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74100c7c20 0x7f74100c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f7415c72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74100736a0 con 0x7f7410152cb0 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f7415c72640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f74100c62e0 con 0x7f74100c7c20 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f7415c72640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7410073940 con 0x7f74100c89f0 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74100c7c20 0x7f74100c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f74100c7c20 0x7f74100c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44098/0 (socket says 172.21.15.139:44098) 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740ffff640 1 -- 172.21.15.139:0/4092727712 learned_addr learned my addr 172.21.15.139:0/4092727712 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740effd640 1 --2- 172.21.15.139:0/4092727712 >> v2:172.21.15.143:3300/0 conn(0x7f74100c89f0 0x7f741015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740ffff640 1 -- 172.21.15.139:0/4092727712 >> v2:172.21.15.143:3300/0 conn(0x7f74100c89f0 msgr2=0x7f741015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740ffff640 1 --2- 172.21.15.139:0/4092727712 >> v2:172.21.15.143:3300/0 conn(0x7f74100c89f0 0x7f741015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740ffff640 1 -- 172.21.15.139:0/4092727712 >> v1:172.21.15.143:6789/0 conn(0x7f7410152cb0 legacy=0x7f74100cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:39.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.650+0000 7f740ffff640 1 -- 172.21.15.139:0/4092727712 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74100c48c0 con 0x7f74100c7c20 2024-04-26T18:02:39.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.651+0000 7f740ffff640 1 --2- 172.21.15.139:0/4092727712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c7c20 0x7f74100c67c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f74100cb0b0 tx=0x7f740802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f560554f399618c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.651+0000 7f740e7fc640 1 -- 172.21.15.139:0/4092727712 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408036070 con 0x7f74100c7c20 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.651+0000 7f740e7fc640 1 -- 172.21.15.139:0/4092727712 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7408031600 con 0x7f74100c7c20 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.651+0000 7f740e7fc640 1 -- 172.21.15.139:0/4092727712 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74080319d0 con 0x7f74100c7c20 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 -- 172.21.15.139:0/4092727712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c7c20 msgr2=0x7f74100c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 --2- 172.21.15.139:0/4092727712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c7c20 0x7f74100c67c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f74100cb0b0 tx=0x7f740802a780 comp rx=0 tx=0).stop 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 -- 172.21.15.139:0/4092727712 shutdown_connections 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 --2- 172.21.15.139:0/4092727712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c7c20 0x7f74100c67c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 --2- 172.21.15.139:0/4092727712 >> v2:172.21.15.143:3300/0 conn(0x7f74100c89f0 0x7f741015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 -- 172.21.15.139:0/4092727712 >> 172.21.15.139:0/4092727712 conn(0x7f7410068270 msgr2=0x7f7410068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:39.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 -- 172.21.15.139:0/4092727712 shutdown_connections 2024-04-26T18:02:39.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.652+0000 7f7415c72640 1 -- 172.21.15.139:0/4092727712 wait complete. 2024-04-26T18:02:39.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.653+0000 7f7415c72640 1 Processor -- start 2024-04-26T18:02:39.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.653+0000 7f7415c72640 1 -- start start 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f7415c72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74100c7c20 0x7f7410151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f7415c72640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c89f0 0x7f7410141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f7415c72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7410152cb0 0x7f74101417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f7415c72640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f74100c4d20 con 0x7f74100c89f0 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f7415c72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f74100c4ba0 con 0x7f74100c7c20 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f7415c72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f74100cdb70 con 0x7f7410152cb0 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c89f0 0x7f7410141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c89f0 0x7f7410141270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44100/0 (socket says 172.21.15.139:44100) 2024-04-26T18:02:39.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740effd640 1 -- 172.21.15.139:0/3038769453 learned_addr learned my addr 172.21.15.139:0/3038769453 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740ffff640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7410152cb0 0x7f74101417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740f7fe640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74100c7c20 0x7f7410151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740effd640 1 -- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7410152cb0 msgr2=0x7f74101417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740effd640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7410152cb0 0x7f74101417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740effd640 1 -- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74100c7c20 msgr2=0x7f7410151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.654+0000 7f740effd640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74100c7c20 0x7f7410151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.655+0000 7f740effd640 1 -- 172.21.15.139:0/3038769453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741015b810 con 0x7f74100c89f0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.655+0000 7f740effd640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c89f0 0x7f7410141270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f740400d800 tx=0x7f740400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.655+0000 7f73f7fff640 1 -- 172.21.15.139:0/3038769453 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740400b6c0 con 0x7f74100c89f0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.655+0000 7f73f7fff640 1 -- 172.21.15.139:0/3038769453 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7404019070 con 0x7f74100c89f0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.655+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741015baf0 con 0x7f74100c89f0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.655+0000 7f73f7fff640 1 -- 172.21.15.139:0/3038769453 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740400ba80 con 0x7f74100c89f0 2024-04-26T18:02:39.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.655+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74101599c0 con 0x7f74100c89f0 2024-04-26T18:02:39.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.656+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7410076d20 con 0x7f74100c89f0 2024-04-26T18:02:39.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.656+0000 7f73f7fff640 1 -- 172.21.15.139:0/3038769453 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f740400bc20 con 0x7f74100c89f0 2024-04-26T18:02:39.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.657+0000 7f73f7fff640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f73fc06c8f0 0x7f73fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.657+0000 7f73f7fff640 1 -- 172.21.15.139:0/3038769453 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f740408c260 con 0x7f74100c89f0 2024-04-26T18:02:39.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.657+0000 7f740f7fe640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f73fc06c8f0 0x7f73fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.657+0000 7f740f7fe640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f73fc06c8f0 0x7f73fc06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7400006fd0 tx=0x7f7400009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:39.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.661+0000 7f73f7fff640 1 -- 172.21.15.139:0/3038769453 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7404059cb0 con 0x7f74100c89f0 2024-04-26T18:02:39.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.879+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7410073480 con 0x7f74100c89f0 2024-04-26T18:02:39.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.879+0000 7f73f7fff640 1 -- 172.21.15.139:0/3038769453 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f740405dfb0 con 0x7f74100c89f0 2024-04-26T18:02:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:02:39.879 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:02:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:02:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f73fc06c8f0 msgr2=0x7f73fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f73fc06c8f0 0x7f73fc06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7400006fd0 tx=0x7f7400009060 comp rx=0 tx=0).stop 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c89f0 msgr2=0x7f7410141270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c89f0 0x7f7410141270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f740400d800 tx=0x7f740400dcc0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 shutdown_connections 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f73fc06c8f0 0x7f73fc06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7410152cb0 0x7f74101417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74100c89f0 0x7f7410141270 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 --2- 172.21.15.139:0/3038769453 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f74100c7c20 0x7f7410151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.881+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 >> 172.21.15.139:0/3038769453 conn(0x7f7410068270 msgr2=0x7f74100cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.882+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 shutdown_connections 2024-04-26T18:02:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.882+0000 7f7415c72640 1 -- 172.21.15.139:0/3038769453 wait complete. 2024-04-26T18:02:39.892 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 36f46ac2 --release --await' 2024-04-26T18:02:39.893 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 36f46ac2 --release --await 2024-04-26T18:02:39.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.996+0000 7f2526a37640 1 Processor -- start 2024-04-26T18:02:39.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.996+0000 7f2526a37640 1 -- start start 2024-04-26T18:02:39.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f2526a37640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2520155e70 0x7f25200c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f2526a37640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f2520166440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f2526a37640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2520156250 con 0x7f25200c9be0 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f2526a37640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f252015c670 con 0x7f2520155e70 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f2526a37640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f252015bac0 con 0x7f25200c4740 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2520155e70 0x7f25200c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f25200c9be0 0x7f25200cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:39062/0 (socket says 172.21.15.139:39062) 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251f7fe640 1 -- 172.21.15.139:0/3630541186 learned_addr learned my addr 172.21.15.139:0/3630541186 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f2524fd4640 1 --2- 172.21.15.139:0/3630541186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f2520166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251ffff640 1 -- 172.21.15.139:0/3630541186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 msgr2=0x7f2520166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251effd640 1 -- 172.21.15.139:0/3630541186 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166092373 0 0) 0x7f2510001110 con 0x7f25200c9be0 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251ffff640 1 --2- 172.21.15.139:0/3630541186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f2520166440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251ffff640 1 -- 172.21.15.139:0/3630541186 >> v1:172.21.15.139:6789/0 conn(0x7f25200c9be0 legacy=0x7f25200cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.997+0000 7f251ffff640 1 -- 172.21.15.139:0/3630541186 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2520070ac0 con 0x7f2520155e70 2024-04-26T18:02:39.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f251ffff640 1 --2- 172.21.15.139:0/3630541186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2520155e70 0x7f25200c4200 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f25140097a0 tx=0x7f251402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bd488a72d89a04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f251effd640 1 -- 172.21.15.139:0/3630541186 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514037070 con 0x7f2520155e70 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f251effd640 1 -- 172.21.15.139:0/3630541186 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2514032440 con 0x7f2520155e70 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f251effd640 1 -- 172.21.15.139:0/3630541186 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514032810 con 0x7f2520155e70 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f2526a37640 1 -- 172.21.15.139:0/3630541186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2520155e70 msgr2=0x7f25200c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f2526a37640 1 --2- 172.21.15.139:0/3630541186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2520155e70 0x7f25200c4200 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f25140097a0 tx=0x7f251402a210 comp rx=0 tx=0).stop 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f2526a37640 1 -- 172.21.15.139:0/3630541186 shutdown_connections 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f2526a37640 1 --2- 172.21.15.139:0/3630541186 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f2520166440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f2526a37640 1 --2- 172.21.15.139:0/3630541186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2520155e70 0x7f25200c4200 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.998+0000 7f2526a37640 1 -- 172.21.15.139:0/3630541186 >> 172.21.15.139:0/3630541186 conn(0x7f2520068090 msgr2=0x7f2520068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.999+0000 7f2526a37640 1 -- 172.21.15.139:0/3630541186 shutdown_connections 2024-04-26T18:02:40.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:39.999+0000 7f2526a37640 1 -- 172.21.15.139:0/3630541186 wait complete. 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 Processor -- start 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 -- start start 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f25201f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25200c9be0 0x7f25201e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2520155e70 0x7f252015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f252015c300 con 0x7f25200c9be0 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f252015c020 con 0x7f2520155e70 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.000+0000 7f2526a37640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2520070e90 con 0x7f25200c4740 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25200c9be0 0x7f25201e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25200c9be0 0x7f25201e73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44114/0 (socket says 172.21.15.139:44114) 2024-04-26T18:02:40.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 -- 172.21.15.139:0/3269767610 learned_addr learned my addr 172.21.15.139:0/3269767610 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f2524fd4640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2520155e70 0x7f252015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 -- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 msgr2=0x7f25201f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251ffff640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f25201f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f25201f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 -- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2520155e70 msgr2=0x7f252015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2520155e70 0x7f252015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 -- 172.21.15.139:0/3269767610 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25200cc220 con 0x7f25200c9be0 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f2524fd4640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2520155e70 0x7f252015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251f7fe640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25200c9be0 0x7f25201e73f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f251000c780 tx=0x7f251000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251cff9640 1 -- 172.21.15.139:0/3269767610 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510018070 con 0x7f25200c9be0 2024-04-26T18:02:40.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251cff9640 1 -- 172.21.15.139:0/3269767610 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25100072d0 con 0x7f25200c9be0 2024-04-26T18:02:40.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25200cc4c0 con 0x7f25200c9be0 2024-04-26T18:02:40.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f251cff9640 1 -- 172.21.15.139:0/3269767610 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25100047e0 con 0x7f25200c9be0 2024-04-26T18:02:40.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.001+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25201f21e0 con 0x7f25200c9be0 2024-04-26T18:02:40.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.003+0000 7f251cff9640 1 -- 172.21.15.139:0/3269767610 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f251001b070 con 0x7f25200c9be0 2024-04-26T18:02:40.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.003+0000 7f251cff9640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f250c06c8f0 0x7f250c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.003+0000 7f251cff9640 1 -- 172.21.15.139:0/3269767610 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f251008b2e0 con 0x7f25200c9be0 2024-04-26T18:02:40.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.003+0000 7f251ffff640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f250c06c8f0 0x7f250c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.003+0000 7f251ffff640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f250c06c8f0 0x7f250c06edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2514034000 tx=0x7f251402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.004+0000 7f252982e740 1 Processor -- start 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.004+0000 7f252982e740 1 -- start start 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465ec6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f252982e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e88a10 0x558465e87dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f252982e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558465dec040 con 0x558465ec69b0 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x558465d87b60 con 0x558465e874b0 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x558465de8000 con 0x558465e88a10 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44118/0 (socket says 172.21.15.139:44118) 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 -- 172.21.15.139:0/2882526614 learned_addr learned my addr 172.21.15.139:0/2882526614 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 -- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e88a10 msgr2=0x558465e87dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e88a10 0x558465e87dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 -- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 msgr2=0x558465ec6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251ffff640 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465ec6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465ec6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 -- 172.21.15.139:0/2882526614 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558465d7c9c0 con 0x558465ec69b0 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251ffff640 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465ec6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f251f7fe640 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465e87890 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2510007820 tx=0x7f2510007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1315a76998f0ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f2505ffb640 1 -- 172.21.15.139:0/2882526614 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251005cfa0 con 0x558465ec69b0 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f2505ffb640 1 -- 172.21.15.139:0/2882526614 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25100617d0 con 0x558465ec69b0 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.005+0000 7f2505ffb640 1 -- 172.21.15.139:0/2882526614 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2510056ef0 con 0x558465ec69b0 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 -- 172.21.15.139:0/2882526614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 msgr2=0x558465e87890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465e87890 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2510007820 tx=0x7f2510007eb0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 -- 172.21.15.139:0/2882526614 shutdown_connections 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e88a10 0x558465e87dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 --2- 172.21.15.139:0/2882526614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465ec6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 -- 172.21.15.139:0/2882526614 >> 172.21.15.139:0/2882526614 conn(0x558465e4e930 msgr2=0x558465ecb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 -- 172.21.15.139:0/2882526614 shutdown_connections 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 -- 172.21.15.139:0/2882526614 wait complete. 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.006+0000 7f252982e740 1 -- start start 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 1 Processor -- start 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465eae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e88a10 0x558465ed7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558465e85af0 con 0x558465e88a10 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x558465d854f0 con 0x558465e874b0 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x558465e89040 con 0x558465ec69b0 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f252982e740 10 client.0 _ll_register_callbacks cb 0x558465de2c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.007+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e88a10 0x558465ed7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e88a10 0x558465ed7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44134/0 (socket says 172.21.15.139:44134) 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 -- 172.21.15.139:0/2853476774 learned_addr learned my addr 172.21.15.139:0/2853476774 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f2524fd4640 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251ffff640 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465eae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 -- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 msgr2=0x558465e87890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 -- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 msgr2=0x558465eae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465eae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 -- 172.21.15.139:0/2853476774 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558465afd920 con 0x558465e88a10 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f251f7fe640 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e88a10 0x558465ed7df0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f251005b010 tx=0x7f2510000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a4df197dd3eb65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f24feffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f24feffd640 1 -- 172.21.15.139:0/2853476774 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251005f3d0 con 0x558465e88a10 2024-04-26T18:02:40.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f24feffd640 1 -- 172.21.15.139:0/2853476774 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f2510058040 con 0x558465e88a10 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25100617d0 con 0x558465e88a10 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f24feffd640 1 -- 172.21.15.139:0/2853476774 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2510056d10 con 0x558465e88a10 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f252982e740 10 client.5019 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558465bc9d30 con 0x558465e88a10 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f24feffd640 1 -- 172.21.15.139:0/2853476774 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25100617d0 con 0x558465e88a10 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f24feffd640 1 -- 172.21.15.139:0/2853476774 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2510054940 con 0x558465e88a10 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f252982e740 10 client.5019 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f252982e740 10 client.5019 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f252982e740 20 client.5019 populate_metadata read hostname 'smithi139' 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.008+0000 7f252982e740 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eaede0 0x558465e87dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.009+0000 7f252982e740 4 client.5019 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.009+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558465dbfa00 con 0x558465eaede0 2024-04-26T18:02:40.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.009+0000 7f251ffff640 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eaede0 0x558465e87dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.009+0000 7f251ffff640 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eaede0 0x558465e87dd0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3b3e722014b01f1 server_cookie=467756546fad80ce in_seq=0 out_seq=0 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.009+0000 7f24feffd640 10 client.5019 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f24feffd640 1 -- 172.21.15.139:0/2853476774 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558465dbfa00 con 0x558465eaede0 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f24feffd640 10 client.5019 handle_command_reply: tid=0 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 client.5019 shutdown 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e88a10 msgr2=0x558465ed7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e88a10 0x558465ed7df0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f251005b010 tx=0x7f2510000ed0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 shutdown_connections 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eaede0 0x558465e87dd0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e87890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e88a10 0x558465ed7df0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f24feffd640 0 client.5019 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 --2- 172.21.15.139:0/2853476774 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e874b0 0x558465eae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 >> 172.21.15.139:0/2853476774 conn(0x558465e4e930 msgr2=0x558465e816c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:40.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 shutdown_connections 2024-04-26T18:02:40.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 1 -- 172.21.15.139:0/2853476774 wait complete. 2024-04-26T18:02:40.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.010+0000 7f252982e740 20 client.5019 trim_cache size 0 max 16384 2024-04-26T18:02:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.027+0000 7f252982e740 1 Processor -- start 2024-04-26T18:02:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.027+0000 7f252982e740 1 -- start start 2024-04-26T18:02:40.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e874b0 0x558465edaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ecba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f252982e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465ecbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f252982e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2520200730 con 0x558465ec69b0 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f25201ff610 con 0x558465e88a10 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f25200cafc0 con 0x558465e874b0 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465ecbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465ecbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44148/0 (socket says 172.21.15.139:44148) 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 -- 172.21.15.139:0/374517022 learned_addr learned my addr 172.21.15.139:0/374517022 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f251ffff640 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e874b0 0x558465edaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f251f7fe640 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ecba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 -- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e874b0 msgr2=0x558465edaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e874b0 0x558465edaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 -- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 msgr2=0x558465ecba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ecba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 -- 172.21.15.139:0/374517022 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558465eaeb90 con 0x558465ec69b0 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.028+0000 7f2524fd4640 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465ecbfa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2518007f40 tx=0x7f251800e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efc1541f3c159b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f25057fa640 1 -- 172.21.15.139:0/374517022 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251800b610 con 0x558465ec69b0 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f25057fa640 1 -- 172.21.15.139:0/374517022 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251800b7d0 con 0x558465ec69b0 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f25057fa640 1 -- 172.21.15.139:0/374517022 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251800bbc0 con 0x558465ec69b0 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 -- 172.21.15.139:0/374517022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 msgr2=0x558465ecbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465ecbfa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2518007f40 tx=0x7f251800e880 comp rx=0 tx=0).stop 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 -- 172.21.15.139:0/374517022 shutdown_connections 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465ec69b0 0x558465ecbfa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ecba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 --2- 172.21.15.139:0/374517022 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465e874b0 0x558465edaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 -- 172.21.15.139:0/374517022 >> 172.21.15.139:0/374517022 conn(0x558465e4e930 msgr2=0x558465e84fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:40.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 -- 172.21.15.139:0/374517022 shutdown_connections 2024-04-26T18:02:40.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.029+0000 7f252982e740 1 -- 172.21.15.139:0/374517022 wait complete. 2024-04-26T18:02:40.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.030+0000 7f252982e740 1 -- start start 2024-04-26T18:02:40.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.030+0000 7f252982e740 1 Processor -- start 2024-04-26T18:02:40.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e874b0 0x558465f3b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.035 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ea3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e82e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f25201fe260 con 0x558465e874b0 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f25201fef40 con 0x558465e88a10 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f25201fe870 con 0x558465ec69b0 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 10 client.0 _ll_register_callbacks cb 0x7f2510058d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e874b0 0x558465f3b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e874b0 0x558465f3b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44158/0 (socket says 172.21.15.139:44158) 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 -- 172.21.15.139:0/3263705117 learned_addr learned my addr 172.21.15.139:0/3263705117 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251f7fe640 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ea3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f2524fd4640 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e82e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 -- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 msgr2=0x558465e82e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e82e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 -- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 msgr2=0x558465ea3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ea3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 -- 172.21.15.139:0/3263705117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558465ea4500 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f251ffff640 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e874b0 0x558465f3b360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f25140329f0 tx=0x7f2514004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649020a7d260d650 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f24feffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f24feffd640 1 -- 172.21.15.139:0/3263705117 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514037040 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f24feffd640 1 -- 172.21.15.139:0/3263705117 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6763+0+0 (secure 0 0 0) 0x7f251404d440 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f251800b7d0 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f24feffd640 1 -- 172.21.15.139:0/3263705117 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f251404d640 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 10 client.5025 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.031+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558465eea5e0 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f24feffd640 1 -- 172.21.15.139:0/3263705117 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251800b7d0 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f24feffd640 1 -- 172.21.15.139:0/3263705117 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2514056480 con 0x558465e874b0 2024-04-26T18:02:40.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f252982e740 10 client.5025 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f252982e740 10 client.5025 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f252982e740 20 client.5025 populate_metadata read hostname 'smithi139' 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f252982e740 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eeb420 0x558465e83380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f252982e740 4 client.5025 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "36f46ac2", "release": true, "await": true}] 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "36f46ac2", "release": true, "await": true}) -- 0x558465df9c50 con 0x558465eeb420 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f251f7fe640 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eeb420 0x558465e83380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f251f7fe640 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eeb420 0x558465e83380 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d988842bbf05f5 server_cookie=fd6af1f8fac0330e in_seq=0 out_seq=0 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.032+0000 7f24feffd640 10 client.5025 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f24feffd640 1 -- 172.21.15.139:0/3263705117 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x558465df9c50 con 0x558465eeb420 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f24feffd640 10 client.5025 handle_command_reply: tid=0 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 client.5025 shutdown 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e874b0 msgr2=0x558465f3b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e874b0 0x558465f3b360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f25140329f0 tx=0x7f2514004730 comp rx=0 tx=0).stop 2024-04-26T18:02:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 shutdown_connections 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558465eeb420 0x558465e83380 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558465ec69b0 0x558465e82e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558465e88a10 0x558465ea3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f24feffd640 0 client.5025 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 --2- 172.21.15.139:0/3263705117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558465e874b0 0x558465f3b360 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 >> 172.21.15.139:0/3263705117 conn(0x558465e4e930 msgr2=0x558465ec1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 shutdown_connections 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 1 -- 172.21.15.139:0/3263705117 wait complete. 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.033+0000 7f252982e740 20 client.5025 trim_cache size 0 max 16384 2024-04-26T18:02:40.039 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 16, 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "36f46ac2": { 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 16, 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:02:40.040 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.5, 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:02:40.041 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:02:40.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f250c06c8f0 msgr2=0x7f250c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f250c06c8f0 0x7f250c06edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2514034000 tx=0x7f251402e000 comp rx=0 tx=0).stop 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25200c9be0 msgr2=0x7f25201e73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25200c9be0 0x7f25201e73f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f251000c780 tx=0x7f251000cc40 comp rx=0 tx=0).stop 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 shutdown_connections 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f250c06c8f0 0x7f250c06edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2520155e70 0x7f252015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25200c9be0 0x7f25201e73f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 --2- 172.21.15.139:0/3269767610 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f25200c4740 0x7f25201f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 >> 172.21.15.139:0/3269767610 conn(0x7f2520068090 msgr2=0x7f2520154640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 shutdown_connections 2024-04-26T18:02:40.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:02:40.034+0000 7f2526a37640 1 -- 172.21.15.139:0/3269767610 wait complete. 2024-04-26T18:02:40.044 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '36f46ac2', seconds elapsed: 24.3 2024-04-26T18:02:40.865 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/18' 2024-04-26T18:02:40.865 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/13' 2024-04-26T18:02:40.865 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/190/17' 2024-04-26T18:02:40.865 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/190' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/19' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/15' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/20' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/12' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/10' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/11' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/16' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/14' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/18' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/13' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/104/17' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/104' 2024-04-26T18:02:40.866 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/19' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/15' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/20' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/12' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/10' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/11' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/16' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/14' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/18' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/13' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/164/17' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/164' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/19' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/15' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/20' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/12' 2024-04-26T18:02:40.867 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/10' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/11' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/16' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/14' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/18' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/13' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/112/17' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/112' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/19' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/15' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/20' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/12' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/10' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/11' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/16' 2024-04-26T18:02:40.868 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/14' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/18' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/13' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/100/17' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/100' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/19' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/15' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/20' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/12' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/10' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/11' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/16' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/14' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/18' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/13' 2024-04-26T18:02:40.869 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/134/17' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/134' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/19' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/15' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/20' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/12' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/10' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/11' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/16' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/14' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/18' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/13' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/115/17' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/115' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/19' 2024-04-26T18:02:40.870 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/15' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/20' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/12' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/10' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/11' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/16' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/14' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/18' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/13' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/116/17' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/116' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/19' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/15' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/20' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/12' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/10' 2024-04-26T18:02:40.871 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/11' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/16' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/14' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/18' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/13' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/195/17' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/195' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/19' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/15' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/20' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/12' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/10' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/11' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/16' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/14' 2024-04-26T18:02:40.872 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/18' 2024-04-26T18:02:41.300 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/13' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/138/17' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/138' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/19' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/15' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/20' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/12' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/10' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/11' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/16' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/14' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/18' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/13' 2024-04-26T18:02:41.301 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/135/17' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/135' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/19' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/15' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/20' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/12' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/10' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/11' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/16' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/14' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/18' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/13' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/117/17' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/117' 2024-04-26T18:02:41.302 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/19' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/15' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/20' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/12' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/10' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/11' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/16' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/14' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/18' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/13' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/143/17' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/143' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/19' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/15' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/20' 2024-04-26T18:02:41.303 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/12' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/10' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/11' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/16' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/14' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/18' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/13' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/180/17' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/180' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/19' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/15' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/20' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/12' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/10' 2024-04-26T18:02:41.304 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/11' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/16' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/14' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/18' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/13' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/126/17' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/126' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/19' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/15' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/20' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/12' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/10' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/11' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/16' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/14' 2024-04-26T18:02:41.305 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/18' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/13' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/161/17' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/161' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/19' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/15' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/20' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/12' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/10' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/11' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/16' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/14' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/18' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/13' 2024-04-26T18:02:41.306 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/176/17' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/176' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/19' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/15' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/20' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/12' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/10' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/11' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/16' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/14' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/18' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/13' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/111/17' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/111' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/19' 2024-04-26T18:02:41.307 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/15' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/20' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/12' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/10' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/11' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/16' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/14' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/18' 2024-04-26T18:02:41.308 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/13' 2024-04-26T18:02:43.757 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/191/17' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/191' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/19' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/15' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/20' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/12' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/10' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/11' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/16' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/14' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/18' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/13' 2024-04-26T18:02:43.758 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/184/17' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/184' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/19' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/15' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/20' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/12' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/10' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/11' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/16' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/14' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/18' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/13' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/192/17' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/192' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/19' 2024-04-26T18:02:43.759 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/15' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/20' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/12' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/10' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/11' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/16' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/14' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/18' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/13' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/103/17' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/103' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/19' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/15' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/20' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/12' 2024-04-26T18:02:43.760 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/10' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/11' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/16' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/14' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/18' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/13' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/128/17' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/128' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/19' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/15' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/20' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/12' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/10' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/11' 2024-04-26T18:02:43.761 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/16' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/14' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/18' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/13' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/144/17' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/144' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/19' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/15' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/20' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/12' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/10' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/11' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/16' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/14' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/18' 2024-04-26T18:02:43.762 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/13' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/146/17' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/146' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/19' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/15' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/20' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/12' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/10' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/11' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/16' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/14' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/18' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/13' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/141/17' 2024-04-26T18:02:43.763 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/141' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/19' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/15' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/20' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/12' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/10' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/11' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/16' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/14' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/18' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/13' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/182/17' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/182' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/19' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/15' 2024-04-26T18:02:43.764 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/20' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/12' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/10' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/11' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/16' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/14' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/18' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/13' 2024-04-26T18:02:43.765 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/107/17' 2024-04-26T18:02:45.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/107' 2024-04-26T18:02:45.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/19' 2024-04-26T18:02:45.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/15' 2024-04-26T18:02:45.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/20' 2024-04-26T18:02:45.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/12' 2024-04-26T18:02:45.114 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/10' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/11' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/16' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/14' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/18' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/13' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/178/17' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/178' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/19' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/15' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/20' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/12' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/10' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/11' 2024-04-26T18:02:45.115 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/16' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/14' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/18' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/13' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/156/17' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/156' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/19' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/15' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/20' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/12' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/10' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/11' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/16' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/14' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/18' 2024-04-26T18:02:45.116 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/13' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/131/17' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/131' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/19' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/15' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/20' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/12' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/10' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/11' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/16' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/14' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/18' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/13' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/123/17' 2024-04-26T18:02:45.117 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/123' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/19' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/15' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/20' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/12' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/10' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/11' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/16' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/14' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/18' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/13' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/160/17' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/160' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/19' 2024-04-26T18:02:45.118 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/15' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/20' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/12' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/10' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/11' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/16' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/14' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/18' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/13' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/165/17' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/165' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/19' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/15' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/20' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/12' 2024-04-26T18:02:45.119 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/10' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/11' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/16' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/14' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/18' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/13' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/101/17' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/101' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/19' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/15' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/20' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/12' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/10' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/11' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/16' 2024-04-26T18:02:45.120 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/14' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/18' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/13' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/148/17' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/148' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/19' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/15' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/20' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/12' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/10' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/11' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/16' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/14' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/18' 2024-04-26T18:02:45.121 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/13' 2024-04-26T18:02:45.122 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/168/17' 2024-04-26T18:02:45.122 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/168' 2024-04-26T18:02:48.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/19' 2024-04-26T18:02:48.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/15' 2024-04-26T18:02:48.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/20' 2024-04-26T18:02:48.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/12' 2024-04-26T18:02:48.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/10' 2024-04-26T18:02:48.552 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/11' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/16' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/14' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/18' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/13' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/179/17' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/179' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/19' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/15' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/20' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/12' 2024-04-26T18:02:48.553 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/10' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/11' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/16' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/14' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/18' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/13' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/132/17' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/132' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/19' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/15' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/20' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/12' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/10' 2024-04-26T18:02:48.554 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/11' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/16' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/14' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/18' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/13' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/199/17' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/199' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/19' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/15' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/20' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/12' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/10' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/11' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/16' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/14' 2024-04-26T18:02:48.555 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/18' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/13' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/163/17' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/163' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/19' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/15' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/20' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/12' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/10' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/11' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/16' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/14' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/18' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/13' 2024-04-26T18:02:48.556 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/153/17' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/153' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/19' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/15' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/20' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/12' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/10' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/11' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/16' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/14' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/18' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/13' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/122/17' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/122' 2024-04-26T18:02:48.557 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/19' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/15' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/20' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/12' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/10' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/11' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/16' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/14' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/18' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/13' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/162/17' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/162' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/19' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/15' 2024-04-26T18:02:48.558 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/20' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/12' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/10' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/11' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/16' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/14' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/18' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/13' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/197/17' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/197' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/19' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/15' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/20' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/12' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/10' 2024-04-26T18:02:48.559 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/11' 2024-04-26T18:02:48.560 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/16' 2024-04-26T18:02:48.560 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/14' 2024-04-26T18:02:48.560 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/18' 2024-04-26T18:02:48.560 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/13' 2024-04-26T18:02:48.560 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/113/17' 2024-04-26T18:02:48.560 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/113' 2024-04-26T18:02:48.560 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/19' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/15' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/20' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/12' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/10' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/11' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/16' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/14' 2024-04-26T18:02:49.051 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/18' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/13' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/152/17' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/152' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/19' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/15' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/20' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/12' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/10' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/11' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/16' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/14' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/18' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/13' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/121/17' 2024-04-26T18:02:49.052 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/121' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/19' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/15' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/20' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/12' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/10' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/11' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/16' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/14' 2024-04-26T18:02:49.053 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/18' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/13' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/118/17' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/118' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/19' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/15' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/20' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/12' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/10' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/11' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/16' 2024-04-26T18:02:49.054 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/14' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/18' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/13' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/196/17' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/196' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/19' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/15' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/20' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/12' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/10' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/11' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/16' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/14' 2024-04-26T18:02:49.055 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/18' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/13' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/124/17' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/124' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/19' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/15' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/20' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/12' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/10' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/11' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/16' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/14' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/18' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/13' 2024-04-26T18:02:49.056 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/188/17' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/188' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/19' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/15' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/20' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/12' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/10' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/11' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/16' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/14' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/18' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/13' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/145/17' 2024-04-26T18:02:49.057 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/145' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/19' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/15' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/20' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/12' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/10' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/11' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/16' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/14' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/18' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/13' 2024-04-26T18:02:49.058 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/130/17' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/130' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/19' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/15' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/20' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/12' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/10' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/11' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/16' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/14' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/18' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/13' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/193/17' 2024-04-26T18:02:49.059 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/193' 2024-04-26T18:02:49.060 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/19' 2024-04-26T18:02:49.060 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/15' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/20' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/12' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/10' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/11' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/16' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/14' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/18' 2024-04-26T18:02:49.603 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/13' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/175/17' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/175' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/19' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/15' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/20' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/12' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/10' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/11' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/16' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/14' 2024-04-26T18:02:49.604 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/18' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/13' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/181/17' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/181' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/19' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/15' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/20' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/12' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/10' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/11' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/16' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/14' 2024-04-26T18:02:49.605 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/18' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/13' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/127/17' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/127' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/19' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/15' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/20' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/12' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/10' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/11' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/16' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/14' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/18' 2024-04-26T18:02:49.606 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/13' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/108/17' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/108' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/19' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/15' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/20' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/12' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/10' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/11' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/16' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/14' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/18' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/13' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/183/17' 2024-04-26T18:02:49.607 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/183' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/19' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/15' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/20' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/12' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/10' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/11' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/16' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/14' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/18' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/13' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/177/17' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/177' 2024-04-26T18:02:49.608 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/19' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/15' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/20' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/12' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/10' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/11' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/16' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/14' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/18' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/13' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/169/17' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/169' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/19' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/15' 2024-04-26T18:02:49.609 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/20' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/12' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/10' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/11' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/16' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/14' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/18' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/13' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/154/17' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/154' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/19' 2024-04-26T18:02:49.610 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/15' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/20' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/12' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/10' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/11' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/16' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/14' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/18' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/13' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/171/17' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/171' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/19' 2024-04-26T18:02:49.611 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/15' 2024-04-26T18:02:49.612 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/20' 2024-04-26T18:02:50.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/12' 2024-04-26T18:02:50.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/10' 2024-04-26T18:02:50.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/11' 2024-04-26T18:02:50.514 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/16' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/14' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/18' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/13' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/139/17' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/139' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/19' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/15' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/20' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/12' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/10' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/11' 2024-04-26T18:02:50.515 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/16' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/14' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/18' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/13' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/102/17' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/102' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/19' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/15' 2024-04-26T18:02:50.516 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/20' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/12' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/10' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/11' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/16' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/14' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/18' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/13' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed './copyofsnap1/test1/129/17' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1/129' 2024-04-26T18:02:50.517 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1/test1' 2024-04-26T18:02:50.518 INFO:tasks.workunit.client.0.smithi139.stdout:removed directory './copyofsnap1' 2024-04-26T18:02:50.518 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:02:50.518 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:02:50.518 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:02:50.550 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2024-04-26T18:02:50.550 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-04-26T18:02:50.610 INFO:tasks.workunit.client.0.smithi139.stderr:+ set -e 2024-04-26T18:02:50.611 INFO:tasks.workunit.client.0.smithi139.stderr:+ touch foo 2024-04-26T18:02:50.612 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod +x foo 2024-04-26T18:02:50.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/s 2024-04-26T18:02:50.622 INFO:tasks.workunit.client.0.smithi139.stderr:+ find .snap/s/foo -executable 2024-04-26T18:02:50.622 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep foo 2024-04-26T18:02:50.627 INFO:tasks.workunit.client.0.smithi139.stdout:.snap/s/foo 2024-04-26T18:02:50.627 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir .snap/s 2024-04-26T18:02:50.631 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm foo 2024-04-26T18:02:50.633 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo OK 2024-04-26T18:02:50.634 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:02:50.635 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:02:50.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:02:50.703 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2024-04-26T18:02:50.704 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-04-26T18:02:50.765 INFO:tasks.workunit.client.0.smithi139.stderr:+ set -e 2024-04-26T18:02:50.765 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir foo 2024-04-26T18:02:50.766 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo x 2024-04-26T18:02:50.766 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:51.370 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir foo/.snap/ss 2024-04-26T18:02:51.378 INFO:tasks.workunit.client.0.smithi139.stderr:+ ln foo/x foo/xx 2024-04-26T18:02:51.381 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat foo/.snap/ss/x 2024-04-26T18:02:51.388 INFO:tasks.workunit.client.0.smithi139.stdout:x 2024-04-26T18:02:51.388 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir foo/.snap/ss 2024-04-26T18:02:51.397 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo a 2024-04-26T18:02:51.398 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo b 2024-04-26T18:02:51.400 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir foo/.snap/s 2024-04-26T18:02:51.518 INFO:tasks.workunit.client.0.smithi139.stderr:++ cat foo/.snap/s/a 2024-04-26T18:02:51.528 INFO:tasks.workunit.client.0.smithi139.stderr:+ r=a 2024-04-26T18:02:51.528 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' -z a ']' 2024-04-26T18:02:51.528 INFO:tasks.workunit.client.0.smithi139.stderr:+ ln foo/b foo/b2 2024-04-26T18:02:51.530 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat foo/.snap/s/b 2024-04-26T18:02:51.538 INFO:tasks.workunit.client.0.smithi139.stdout:b 2024-04-26T18:02:51.538 INFO:tasks.workunit.client.0.smithi139.stdout:this used to hang: 2024-04-26T18:02:51.539 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 'this used to hang:' 2024-04-26T18:02:51.539 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo more 2024-04-26T18:02:51.539 INFO:tasks.workunit.client.0.smithi139.stdout:oh, it didn't hang! good job. 2024-04-26T18:02:51.539 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2024-04-26T18:02:51.539 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat foo/b 2024-04-26T18:02:51.540 INFO:tasks.workunit.client.0.smithi139.stdout:b 2024-04-26T18:02:51.540 INFO:tasks.workunit.client.0.smithi139.stdout:more 2024-04-26T18:02:51.540 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir foo/.snap/s 2024-04-26T18:02:51.544 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm -r foo 2024-04-26T18:02:51.557 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:02:51.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo OK 2024-04-26T18:02:51.558 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:02:51.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:02:51.629 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2024-04-26T18:02:51.629 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-04-26T18:02:51.691 INFO:tasks.workunit.client.0.smithi139.stderr:+ set -e 2024-04-26T18:02:51.691 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:51.693 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/bar 2024-04-26T18:02:51.701 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/foo 2024-04-26T18:02:51.721 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/foo 2024-04-26T18:02:51.726 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:51.728 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/bar/a 2024-04-26T18:02:51.730 INFO:tasks.workunit.client.0.smithi139.stdout: File: .snap/bar/a 2024-04-26T18:02:51.730 INFO:tasks.workunit.client.0.smithi139.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T18:02:51.730 INFO:tasks.workunit.client.0.smithi139.stdout:Device: fdh/253d Inode: 1099511633797 Links: 2 2024-04-26T18:02:51.730 INFO:tasks.workunit.client.0.smithi139.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1316/ ubuntu) 2024-04-26T18:02:51.730 INFO:tasks.workunit.client.0.smithi139.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-04-26T18:02:51.731 INFO:tasks.workunit.client.0.smithi139.stdout:Access: 2024-04-26 18:02:51.692210892 +0000 2024-04-26T18:02:51.731 INFO:tasks.workunit.client.0.smithi139.stdout:Modify: 2024-04-26 18:02:51.692210892 +0000 2024-04-26T18:02:51.731 INFO:tasks.workunit.client.0.smithi139.stdout:Change: 2024-04-26 18:02:51.692210892 +0000 2024-04-26T18:02:51.731 INFO:tasks.workunit.client.0.smithi139.stdout: Birth: 2024-04-26 18:02:51.692210892 +0000 2024-04-26T18:02:51.731 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir .snap/bar 2024-04-26T18:02:51.737 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo OK 2024-04-26T18:02:51.738 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:02:51.738 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:02:51.738 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:02:51.805 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2024-04-26T18:02:51.805 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-04-26T18:02:51.865 INFO:tasks.workunit.client.0.smithi139.stderr:+ set -e 2024-04-26T18:02:51.866 INFO:tasks.workunit.client.0.smithi139.stderr:++ seq 1 20 2024-04-26T18:02:51.866 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:51.866 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:51.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:51.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:51.876 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:51.880 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:51.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:51.971 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:51.980 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:51.980 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:51.980 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:51.980 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:51.980 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:51.980 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:51.980 INFO:tasks.workunit.client.0.smithi139.stdout: 47931 ? 00:00:00 ps 2024-04-26T18:02:51.981 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:51.989 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:51.991 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:51.996 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:51.997 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:51.998 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:51.998 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:52.005 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:52.010 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:52.010 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:52.085 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:52.085 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:52.085 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:52.085 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:52.085 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:52.086 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:52.086 INFO:tasks.workunit.client.0.smithi139.stdout: 47941 ? 00:00:00 ps 2024-04-26T18:02:52.086 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:52.094 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:52.096 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:52.101 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:52.101 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:52.103 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:52.103 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:52.110 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:52.127 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:52.128 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:52.202 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:52.208 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:52.208 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:52.208 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:52.208 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:52.208 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:52.208 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:52.208 INFO:tasks.workunit.client.0.smithi139.stdout: 47951 ? 00:00:00 ps 2024-04-26T18:02:52.209 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:52.218 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:52.221 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:52.227 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:52.227 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:52.229 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:52.229 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:52.237 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:52.250 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:52.250 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:52.301 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:52.307 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:52.308 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:52.308 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:52.308 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:52.308 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:52.308 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:52.308 INFO:tasks.workunit.client.0.smithi139.stdout: 47961 ? 00:00:00 ps 2024-04-26T18:02:52.308 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:52.317 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:52.478 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:52.693 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:52.693 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:52.695 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:52.695 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:52.703 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:52.716 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:52.717 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:52.788 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:52.794 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:52.794 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:52.794 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:52.794 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:52.794 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:52.794 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:52.794 INFO:tasks.workunit.client.0.smithi139.stdout: 47971 ? 00:00:00 ps 2024-04-26T18:02:52.795 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:52.804 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:52.806 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:52.811 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:52.811 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:52.813 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:52.813 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:52.821 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:52.833 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:52.834 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:52.885 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:52.891 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:52.891 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:52.892 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:52.892 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:52.892 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:52.892 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:52.892 INFO:tasks.workunit.client.0.smithi139.stdout: 47981 ? 00:00:00 ps 2024-04-26T18:02:52.892 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:52.902 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:52.904 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:52.909 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:52.909 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:52.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:52.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:52.919 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:52.931 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:52.932 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:53.011 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:53.017 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:53.017 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:53.017 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:53.017 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:53.018 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:53.018 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:53.018 INFO:tasks.workunit.client.0.smithi139.stdout: 47991 ? 00:00:00 ps 2024-04-26T18:02:53.018 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:53.026 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:53.028 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:53.033 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:53.033 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:53.035 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:53.035 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:53.043 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:53.491 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:53.491 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:53.546 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:53.552 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:53.552 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:53.552 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:53.552 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:53.552 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:53.552 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:53.552 INFO:tasks.workunit.client.0.smithi139.stdout: 48001 ? 00:00:00 ps 2024-04-26T18:02:53.553 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:53.563 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:53.565 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:53.574 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:53.574 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:53.574 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:53.574 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:53.580 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:53.585 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:53.586 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:53.645 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:53.651 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:53.651 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:53.651 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:53.651 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:53.651 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:53.651 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:53.651 INFO:tasks.workunit.client.0.smithi139.stdout: 48011 ? 00:00:00 ps 2024-04-26T18:02:53.652 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:53.661 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:53.663 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:53.668 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:53.668 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:53.670 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:53.670 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:53.677 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:53.687 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:53.688 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:53.736 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:53.742 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:53.742 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:53.742 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:53.742 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:53.742 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:53.743 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:53.743 INFO:tasks.workunit.client.0.smithi139.stdout: 48021 ? 00:00:00 ps 2024-04-26T18:02:53.743 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:53.753 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:53.755 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:53.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:53.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:53.763 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:53.763 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:54.370 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:55.153 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:55.153 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:56.163 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:56.169 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:56.169 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:56.169 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:56.169 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:56.170 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:56.170 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:56.170 INFO:tasks.workunit.client.0.smithi139.stdout: 48031 ? 00:00:00 ps 2024-04-26T18:02:56.170 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:56.180 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:56.182 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:56.187 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:56.187 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:56.189 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:56.189 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:56.197 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:56.210 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:56.211 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:56.304 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:56.310 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:56.310 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:56.310 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:56.310 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:56.310 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:56.310 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:56.310 INFO:tasks.workunit.client.0.smithi139.stdout: 48041 ? 00:00:00 ps 2024-04-26T18:02:56.311 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:56.319 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:56.321 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:56.326 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:56.326 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:56.582 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:56.582 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:56.601 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:56.618 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:56.619 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:56.673 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stdout: 48051 ? 00:00:00 ps 2024-04-26T18:02:56.679 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:56.690 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:56.693 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:56.699 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:56.699 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:56.701 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:56.702 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:56.709 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:56.714 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:56.715 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:56.762 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:56.768 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:56.768 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:56.768 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:56.768 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:56.768 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:56.768 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:56.768 INFO:tasks.workunit.client.0.smithi139.stdout: 48061 ? 00:00:00 ps 2024-04-26T18:02:56.769 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:56.779 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:56.781 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:56.787 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:56.788 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:56.790 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:56.790 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:56.798 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:56.803 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:56.804 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:56.863 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:56.869 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:56.869 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:56.869 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:56.869 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:56.869 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:56.869 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:56.869 INFO:tasks.workunit.client.0.smithi139.stdout: 48071 ? 00:00:00 ps 2024-04-26T18:02:56.870 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:56.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:56.880 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:56.886 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:56.886 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:56.888 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:56.888 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:56.895 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:56.912 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:56.913 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:56.964 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:56.970 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:56.970 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:56.970 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:56.970 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:56.970 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:56.970 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:56.970 INFO:tasks.workunit.client.0.smithi139.stdout: 48081 ? 00:00:00 ps 2024-04-26T18:02:56.971 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:56.979 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:56.981 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:56.986 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:56.986 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:56.988 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:56.988 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:56.996 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:57.009 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:57.010 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:57.063 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:57.069 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:57.069 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:57.069 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:57.069 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:57.070 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:57.070 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:57.070 INFO:tasks.workunit.client.0.smithi139.stdout: 48091 ? 00:00:00 ps 2024-04-26T18:02:57.070 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:57.081 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:57.083 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:57.088 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:57.088 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:57.090 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:57.090 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:57.460 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:57.548 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:57.549 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:57.615 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:57.621 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:57.621 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:57.621 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:57.621 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:57.621 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:57.621 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:57.621 INFO:tasks.workunit.client.0.smithi139.stdout: 48101 ? 00:00:00 ps 2024-04-26T18:02:57.622 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:57.631 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:57.633 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:57.638 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:57.638 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:57.640 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:57.640 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:57.818 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:58.225 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:58.226 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:58.289 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:58.295 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:58.296 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:58.296 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:58.296 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:58.296 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:58.296 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:58.296 INFO:tasks.workunit.client.0.smithi139.stdout: 48111 ? 00:00:00 ps 2024-04-26T18:02:58.296 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:58.308 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:58.311 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:58.317 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 20` 2024-04-26T18:02:58.317 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a 2024-04-26T18:02:58.319 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/one 2024-04-26T18:02:58.319 INFO:tasks.workunit.client.0.smithi139.stderr:+ cat 2024-04-26T18:02:58.329 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir a/.snap/two 2024-04-26T18:02:58.334 INFO:tasks.workunit.client.0.smithi139.stderr:+ chmod 777 a/foo 2024-04-26T18:02:58.334 INFO:tasks.workunit.client.0.smithi139.stderr:+ sync 2024-04-26T18:02:58.380 INFO:tasks.workunit.client.0.smithi139.stderr:+ ps 2024-04-26T18:02:58.386 INFO:tasks.workunit.client.0.smithi139.stdout: PID TTY TIME CMD 2024-04-26T18:02:58.386 INFO:tasks.workunit.client.0.smithi139.stdout: 5365 ? 00:00:00 systemd 2024-04-26T18:02:58.386 INFO:tasks.workunit.client.0.smithi139.stdout: 5367 ? 00:00:00 (sd-pam) 2024-04-26T18:02:58.386 INFO:tasks.workunit.client.0.smithi139.stdout: 20473 ? 00:00:00 sshd 2024-04-26T18:02:58.387 INFO:tasks.workunit.client.0.smithi139.stdout: 47905 ? 00:00:00 timeout 2024-04-26T18:02:58.387 INFO:tasks.workunit.client.0.smithi139.stdout: 47923 ? 00:00:00 snaptest-double 2024-04-26T18:02:58.387 INFO:tasks.workunit.client.0.smithi139.stdout: 48121 ? 00:00:00 ps 2024-04-26T18:02:58.387 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:02:58.397 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm a/foo 2024-04-26T18:02:58.399 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir a 2024-04-26T18:02:58.404 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo OK 2024-04-26T18:02:58.405 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:02:58.405 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:02:58.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:02:58.475 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2024-04-26T18:02:58.476 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-04-26T18:02:58.536 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/foo 2024-04-26T18:02:58.543 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2024-04-26T18:02:58.544 INFO:tasks.workunit.client.0.smithi139.stdout:We want ENOENT, not ESTALE, here. 2024-04-26T18:02:58.545 INFO:tasks.workunit.client.0.smithi139.stderr:++ seq 1 100 2024-04-26T18:02:58.545 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.545 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/1 2024-04-26T18:02:58.545 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.554 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2024-04-26T18:02:58.554 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.555 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/2 2024-04-26T18:02:58.555 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.555 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2024-04-26T18:02:58.556 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/3 2024-04-26T18:02:58.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.557 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2024-04-26T18:02:58.558 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.558 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/4 2024-04-26T18:02:58.559 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.559 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2024-04-26T18:02:58.560 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.560 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/5 2024-04-26T18:02:58.561 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.561 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2024-04-26T18:02:58.562 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.562 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/6 2024-04-26T18:02:58.562 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.563 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2024-04-26T18:02:58.564 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.564 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/7 2024-04-26T18:02:58.564 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.565 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2024-04-26T18:02:58.566 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.566 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/8 2024-04-26T18:02:58.566 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.567 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2024-04-26T18:02:58.568 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.568 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/9 2024-04-26T18:02:58.568 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.569 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2024-04-26T18:02:58.570 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.570 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/10 2024-04-26T18:02:58.570 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.571 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2024-04-26T18:02:58.571 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.572 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/11 2024-04-26T18:02:58.572 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.572 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2024-04-26T18:02:58.574 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.574 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/12 2024-04-26T18:02:58.574 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.575 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2024-04-26T18:02:58.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/13 2024-04-26T18:02:58.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.577 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2024-04-26T18:02:58.578 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.578 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/14 2024-04-26T18:02:58.578 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.579 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2024-04-26T18:02:58.580 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.580 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/15 2024-04-26T18:02:58.580 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.580 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2024-04-26T18:02:58.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/16 2024-04-26T18:02:58.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.582 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2024-04-26T18:02:58.583 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.583 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/17 2024-04-26T18:02:58.583 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.583 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2024-04-26T18:02:58.584 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.584 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/18 2024-04-26T18:02:58.584 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.585 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2024-04-26T18:02:58.586 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.586 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/19 2024-04-26T18:02:58.586 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.586 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2024-04-26T18:02:58.587 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.587 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/20 2024-04-26T18:02:58.587 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.588 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2024-04-26T18:02:58.589 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.589 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/21 2024-04-26T18:02:58.589 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.590 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2024-04-26T18:02:58.591 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.591 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/22 2024-04-26T18:02:58.591 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.591 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2024-04-26T18:02:58.592 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.592 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/23 2024-04-26T18:02:58.592 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.592 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2024-04-26T18:02:58.593 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.593 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/24 2024-04-26T18:02:58.593 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.594 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2024-04-26T18:02:58.595 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.595 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/25 2024-04-26T18:02:58.595 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.596 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2024-04-26T18:02:58.596 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.596 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/26 2024-04-26T18:02:58.597 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.597 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2024-04-26T18:02:58.598 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.598 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/27 2024-04-26T18:02:58.598 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.599 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2024-04-26T18:02:58.600 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.600 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/28 2024-04-26T18:02:58.600 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.600 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2024-04-26T18:02:58.601 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.601 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/29 2024-04-26T18:02:58.601 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.601 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2024-04-26T18:02:58.602 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.602 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/30 2024-04-26T18:02:58.602 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.603 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2024-04-26T18:02:58.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/31 2024-04-26T18:02:58.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.603 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2024-04-26T18:02:58.604 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.604 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/32 2024-04-26T18:02:58.604 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.604 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2024-04-26T18:02:58.605 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.605 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/33 2024-04-26T18:02:58.605 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.605 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2024-04-26T18:02:58.606 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.606 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/34 2024-04-26T18:02:58.606 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.606 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2024-04-26T18:02:58.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/35 2024-04-26T18:02:58.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.607 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2024-04-26T18:02:58.608 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.608 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/36 2024-04-26T18:02:58.608 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.608 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2024-04-26T18:02:58.609 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.609 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/37 2024-04-26T18:02:58.609 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.609 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2024-04-26T18:02:58.610 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.610 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/38 2024-04-26T18:02:58.610 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.610 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2024-04-26T18:02:58.611 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.611 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/39 2024-04-26T18:02:58.611 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.611 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2024-04-26T18:02:58.612 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.612 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/40 2024-04-26T18:02:58.612 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.612 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2024-04-26T18:02:58.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/41 2024-04-26T18:02:58.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.613 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2024-04-26T18:02:58.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/42 2024-04-26T18:02:58.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.861 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2024-04-26T18:02:58.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/43 2024-04-26T18:02:58.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.862 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2024-04-26T18:02:58.863 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.863 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/44 2024-04-26T18:02:58.863 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.864 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2024-04-26T18:02:58.864 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.864 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/45 2024-04-26T18:02:58.864 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.865 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2024-04-26T18:02:58.865 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.866 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/46 2024-04-26T18:02:58.866 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.866 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2024-04-26T18:02:58.867 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.867 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/47 2024-04-26T18:02:58.867 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.868 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2024-04-26T18:02:58.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/48 2024-04-26T18:02:58.869 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.869 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2024-04-26T18:02:58.869 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.870 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/49 2024-04-26T18:02:58.870 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.870 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2024-04-26T18:02:58.871 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.871 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/50 2024-04-26T18:02:58.871 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.872 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2024-04-26T18:02:58.872 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.872 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/51 2024-04-26T18:02:58.872 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.873 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2024-04-26T18:02:58.874 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.874 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/52 2024-04-26T18:02:58.874 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.874 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2024-04-26T18:02:58.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/53 2024-04-26T18:02:58.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.876 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2024-04-26T18:02:58.877 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.877 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/54 2024-04-26T18:02:58.877 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.878 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2024-04-26T18:02:58.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/55 2024-04-26T18:02:58.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.879 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2024-04-26T18:02:58.879 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.880 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/56 2024-04-26T18:02:58.880 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.880 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2024-04-26T18:02:58.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/57 2024-04-26T18:02:58.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.882 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2024-04-26T18:02:58.882 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.882 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/58 2024-04-26T18:02:58.882 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.883 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2024-04-26T18:02:58.884 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.884 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/59 2024-04-26T18:02:58.884 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.885 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2024-04-26T18:02:58.885 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.886 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/60 2024-04-26T18:02:58.886 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.886 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2024-04-26T18:02:58.887 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.887 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/61 2024-04-26T18:02:58.887 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.890 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2024-04-26T18:02:58.891 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.891 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/62 2024-04-26T18:02:58.891 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.891 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2024-04-26T18:02:58.891 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.892 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/63 2024-04-26T18:02:58.892 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.892 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2024-04-26T18:02:58.892 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.893 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/64 2024-04-26T18:02:58.893 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.893 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2024-04-26T18:02:58.893 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.893 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/65 2024-04-26T18:02:58.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.894 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2024-04-26T18:02:58.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/66 2024-04-26T18:02:58.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.895 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2024-04-26T18:02:58.895 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.895 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/67 2024-04-26T18:02:58.896 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.896 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2024-04-26T18:02:58.897 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.897 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/68 2024-04-26T18:02:58.897 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.898 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2024-04-26T18:02:58.898 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.899 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/69 2024-04-26T18:02:58.899 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.899 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2024-04-26T18:02:58.900 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.900 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/70 2024-04-26T18:02:58.900 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.900 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2024-04-26T18:02:58.901 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.901 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/71 2024-04-26T18:02:58.901 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.902 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2024-04-26T18:02:58.902 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.902 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/72 2024-04-26T18:02:58.902 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.903 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2024-04-26T18:02:58.903 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.903 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/73 2024-04-26T18:02:58.904 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.904 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2024-04-26T18:02:58.905 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.905 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/74 2024-04-26T18:02:58.905 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.905 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2024-04-26T18:02:58.906 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.906 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/75 2024-04-26T18:02:58.906 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.907 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2024-04-26T18:02:58.907 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.907 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/76 2024-04-26T18:02:58.907 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.908 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2024-04-26T18:02:58.908 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.909 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/77 2024-04-26T18:02:58.909 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.909 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2024-04-26T18:02:58.910 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.910 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/78 2024-04-26T18:02:58.910 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.911 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2024-04-26T18:02:58.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/79 2024-04-26T18:02:58.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.912 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2024-04-26T18:02:58.913 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.913 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/80 2024-04-26T18:02:58.913 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.914 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2024-04-26T18:02:58.914 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.914 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/81 2024-04-26T18:02:58.914 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.915 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2024-04-26T18:02:58.916 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.916 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/82 2024-04-26T18:02:58.916 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.916 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2024-04-26T18:02:58.917 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.917 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/83 2024-04-26T18:02:58.917 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.918 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2024-04-26T18:02:58.918 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.918 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/84 2024-04-26T18:02:58.919 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.919 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2024-04-26T18:02:58.920 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.920 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/85 2024-04-26T18:02:58.920 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.920 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2024-04-26T18:02:58.921 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.921 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/86 2024-04-26T18:02:58.921 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.922 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2024-04-26T18:02:58.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/87 2024-04-26T18:02:58.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.923 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2024-04-26T18:02:58.923 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.923 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/88 2024-04-26T18:02:58.923 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.924 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2024-04-26T18:02:58.924 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.925 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/89 2024-04-26T18:02:58.925 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.925 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2024-04-26T18:02:58.926 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.926 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/90 2024-04-26T18:02:58.926 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.926 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2024-04-26T18:02:58.927 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.927 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/91 2024-04-26T18:02:58.927 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.928 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2024-04-26T18:02:58.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/92 2024-04-26T18:02:58.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.929 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2024-04-26T18:02:58.929 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.929 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/93 2024-04-26T18:02:58.930 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.930 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2024-04-26T18:02:58.931 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.931 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/94 2024-04-26T18:02:58.931 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.931 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2024-04-26T18:02:58.932 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.932 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/95 2024-04-26T18:02:58.932 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.932 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2024-04-26T18:02:58.933 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.933 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/96 2024-04-26T18:02:58.933 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.933 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2024-04-26T18:02:58.934 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.934 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/97 2024-04-26T18:02:58.934 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.935 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2024-04-26T18:02:58.935 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.935 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/98 2024-04-26T18:02:58.935 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.936 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2024-04-26T18:02:58.936 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.936 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/99 2024-04-26T18:02:58.936 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.937 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2024-04-26T18:02:58.937 INFO:tasks.workunit.client.0.smithi139.stderr:+ for f in `seq 1 100` 2024-04-26T18:02:58.937 INFO:tasks.workunit.client.0.smithi139.stderr:+ stat .snap/foo/100 2024-04-26T18:02:58.937 INFO:tasks.workunit.client.0.smithi139.stderr:+ grep 'No such file' 2024-04-26T18:02:58.938 INFO:tasks.workunit.client.0.smithi139.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2024-04-26T18:02:58.938 INFO:tasks.workunit.client.0.smithi139.stderr:+ rmdir .snap/foo 2024-04-26T18:02:58.943 INFO:tasks.workunit.client.0.smithi139.stdout:OK 2024-04-26T18:02:58.944 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo OK 2024-04-26T18:02:58.944 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:02:58.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:02:59.011 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2024-04-26T18:02:59.011 DEBUG:teuthology.orchestra.run.smithi139:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-04-26T18:02:59.070 INFO:tasks.workunit.client.0.smithi139.stderr:+ set -e 2024-04-26T18:02:59.070 INFO:tasks.workunit.client.0.smithi139.stderr:+ sudo git config --global http.sslVerify false 2024-04-26T18:02:59.082 INFO:tasks.workunit.client.0.smithi139.stderr:+ sudo git config --global http.postBuffer 1048576000 2024-04-26T18:02:59.094 INFO:tasks.workunit.client.0.smithi139.stderr:+ retried=false 2024-04-26T18:02:59.095 INFO:tasks.workunit.client.0.smithi139.stderr:+ trap -- retry EXIT 2024-04-26T18:02:59.095 INFO:tasks.workunit.client.0.smithi139.stderr:+ rm -rf ceph 2024-04-26T18:02:59.095 INFO:tasks.workunit.client.0.smithi139.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2024-04-26T18:02:59.095 INFO:tasks.workunit.client.0.smithi139.stderr:Cloning into 'ceph'... 2024-04-26T18:03:06.561 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:03:06.564 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:03:36.673 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:03:36.677 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:03:52.474 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.7 2024-04-26T18:03:52.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:03:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.625+0000 7fbb7c27e640 1 Processor -- start 2024-04-26T18:03:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.625+0000 7fbb7c27e640 1 -- start start 2024-04-26T18:03:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.626+0000 7fbb7c27e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbb74157120 0x7fbb7406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.626+0000 7fbb7c27e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbb740c8b10 0x7fbb74068090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.626+0000 7fbb7c27e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb74157500 con 0x7fbb740685d0 2024-04-26T18:03:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.626+0000 7fbb7c27e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fbb74070030 con 0x7fbb74157120 2024-04-26T18:03:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.626+0000 7fbb7c27e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbb7415d090 con 0x7fbb740c8b10 2024-04-26T18:03:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.626+0000 7fbb7a01a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbb74157120 0x7fbb7406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.627+0000 7fbb7a01a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbb74157120 0x7fbb7406faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54590/0 (socket says 172.21.15.139:54590) 2024-04-26T18:03:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.627+0000 7fbb7a01a640 1 -- 172.21.15.139:0/1245365683 learned_addr learned my addr 172.21.15.139:0/1245365683 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.627+0000 7fbb79819640 1 --2- 172.21.15.139:0/1245365683 >> v2:172.21.15.143:3300/0 conn(0x7fbb740c8b10 0x7fbb74068090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.627+0000 7fbb7a01a640 1 -- 172.21.15.139:0/1245365683 >> v2:172.21.15.143:3300/0 conn(0x7fbb740c8b10 msgr2=0x7fbb74068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.627+0000 7fbb7a01a640 1 --2- 172.21.15.139:0/1245365683 >> v2:172.21.15.143:3300/0 conn(0x7fbb740c8b10 0x7fbb74068090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.627+0000 7fbb7a01a640 1 -- 172.21.15.139:0/1245365683 >> v1:172.21.15.143:6789/0 conn(0x7fbb740685d0 legacy=0x7fbb74159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.627+0000 7fbb7a01a640 1 -- 172.21.15.139:0/1245365683 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7415d330 con 0x7fbb74157120 2024-04-26T18:03:52.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.628+0000 7fbb7a01a640 1 --2- 172.21.15.139:0/1245365683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb74157120 0x7fbb7406faf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbb740c9f30 tx=0x7fbb7002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d0a4923e8848e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:52.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.628+0000 7fbb79018640 1 -- 172.21.15.139:0/1245365683 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70037070 con 0x7fbb74157120 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.628+0000 7fbb79018640 1 -- 172.21.15.139:0/1245365683 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7002ae50 con 0x7fbb74157120 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.628+0000 7fbb79018640 1 -- 172.21.15.139:0/1245365683 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70032860 con 0x7fbb74157120 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 -- 172.21.15.139:0/1245365683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb74157120 msgr2=0x7fbb7406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/1245365683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb74157120 0x7fbb7406faf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbb740c9f30 tx=0x7fbb7002a300 comp rx=0 tx=0).stop 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 -- 172.21.15.139:0/1245365683 shutdown_connections 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/1245365683 >> v2:172.21.15.143:3300/0 conn(0x7fbb740c8b10 0x7fbb74068090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/1245365683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb74157120 0x7fbb7406faf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 -- 172.21.15.139:0/1245365683 >> 172.21.15.139:0/1245365683 conn(0x7fbb740ce110 msgr2=0x7fbb740ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 -- 172.21.15.139:0/1245365683 shutdown_connections 2024-04-26T18:03:52.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.629+0000 7fbb7c27e640 1 -- 172.21.15.139:0/1245365683 wait complete. 2024-04-26T18:03:52.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.631+0000 7fbb7c27e640 1 Processor -- start 2024-04-26T18:03:52.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.631+0000 7fbb7c27e640 1 -- start start 2024-04-26T18:03:52.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7c27e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb740685d0 0x7fbb741f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7c27e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb740c8b10 0x7fbb74155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7c27e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb74157120 0x7fbb741563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7c27e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbb74070250 con 0x7fbb740c8b10 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7c27e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7415d8f0 con 0x7fbb740685d0 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7c27e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbb740c8f30 con 0x7fbb74157120 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb79819640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb740c8b10 0x7fbb74155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb79819640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb740c8b10 0x7fbb74155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54592/0 (socket says 172.21.15.139:54592) 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb79819640 1 -- 172.21.15.139:0/3527546780 learned_addr learned my addr 172.21.15.139:0/3527546780 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7a01a640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb740685d0 0x7fbb741f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.632+0000 7fbb7a81b640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb74157120 0x7fbb741563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb7a01a640 1 -- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb74157120 msgr2=0x7fbb741563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb7a01a640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb74157120 0x7fbb741563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:52.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb7a01a640 1 -- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb740c8b10 msgr2=0x7fbb74155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb7a01a640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb740c8b10 0x7fbb74155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb7a01a640 1 -- 172.21.15.139:0/3527546780 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7414f140 con 0x7fbb740685d0 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb79819640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb740c8b10 0x7fbb74155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb7a01a640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb740685d0 0x7fbb741f58d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb70031000 tx=0x7fbb700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb6affd640 1 -- 172.21.15.139:0/3527546780 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70041070 con 0x7fbb740685d0 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb6affd640 1 -- 172.21.15.139:0/3527546780 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7003c6a0 con 0x7fbb740685d0 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb6affd640 1 -- 172.21.15.139:0/3527546780 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70037040 con 0x7fbb740685d0 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.633+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb740cc090 con 0x7fbb740685d0 2024-04-26T18:03:52.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.634+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb740cc650 con 0x7fbb740685d0 2024-04-26T18:03:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.635+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7406f1e0 con 0x7fbb740685d0 2024-04-26T18:03:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.635+0000 7fbb6affd640 1 -- 172.21.15.139:0/3527546780 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb70044070 con 0x7fbb740685d0 2024-04-26T18:03:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.636+0000 7fbb6affd640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbb5806c8f0 0x7fbb5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.636+0000 7fbb6affd640 1 -- 172.21.15.139:0/3527546780 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fbb700ac5b0 con 0x7fbb740685d0 2024-04-26T18:03:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.636+0000 7fbb79819640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbb5806c8f0 0x7fbb5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:52.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.637+0000 7fbb79819640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbb5806c8f0 0x7fbb5806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb7415cec0 tx=0x7fbb64009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:52.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:52.641+0000 7fbb6affd640 1 -- 172.21.15.139:0/3527546780 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb7406f1e0 con 0x7fbb740685d0 2024-04-26T18:03:53.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.080+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb74076d20 con 0x7fbb740685d0 2024-04-26T18:03:53.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.080+0000 7fbb6affd640 1 -- 172.21.15.139:0/3527546780 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fbb7007a060 con 0x7fbb740685d0 2024-04-26T18:03:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:03:53.081 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:03:53.081 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.083+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbb5806c8f0 msgr2=0x7fbb5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbb5806c8f0 0x7fbb5806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb7415cec0 tx=0x7fbb64009190 comp rx=0 tx=0).stop 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb740685d0 msgr2=0x7fbb741f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb740685d0 0x7fbb741f58d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbb70031000 tx=0x7fbb700046c0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 shutdown_connections 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbb5806c8f0 0x7fbb5806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbb74157120 0x7fbb741563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb740c8b10 0x7fbb74155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 --2- 172.21.15.139:0/3527546780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbb740685d0 0x7fbb741f58d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 >> 172.21.15.139:0/3527546780 conn(0x7fbb740ce110 msgr2=0x7fbb740caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 shutdown_connections 2024-04-26T18:03:53.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.084+0000 7fbb7c27e640 1 -- 172.21.15.139:0/3527546780 wait complete. 2024-04-26T18:03:53.100 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0' 2024-04-26T18:03:53.100 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0 2024-04-26T18:03:53.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.271+0000 7f486f7af640 1 Processor -- start 2024-04-26T18:03:53.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.272+0000 7f486f7af640 1 -- start start 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486f7af640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4868153e40 0x7f486815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486f7af640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f486806d0b0 0x7f4868159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486f7af640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4868072f40 0x7f486806c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486f7af640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f48680c8c90 con 0x7f4868153e40 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486f7af640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f48680c8f30 con 0x7f4868072f40 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486f7af640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f48680c9210 con 0x7f486806d0b0 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4868153e40 0x7f486815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4868153e40 0x7f486815dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54600/0 (socket says 172.21.15.139:54600) 2024-04-26T18:03:53.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 -- 172.21.15.139:0/1306337379 learned_addr learned my addr 172.21.15.139:0/1306337379 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:53.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486cd4a640 1 --2- 172.21.15.139:0/1306337379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f486806d0b0 0x7f4868159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486dd4c640 1 --2- 172.21.15.139:0/1306337379 >> v2:172.21.15.143:3300/0 conn(0x7f4868072f40 0x7f486806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 -- 172.21.15.139:0/1306337379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f486806d0b0 msgr2=0x7f4868159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 --2- 172.21.15.139:0/1306337379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f486806d0b0 0x7f4868159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 -- 172.21.15.139:0/1306337379 >> v2:172.21.15.143:3300/0 conn(0x7f4868072f40 msgr2=0x7f486806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 --2- 172.21.15.139:0/1306337379 >> v2:172.21.15.143:3300/0 conn(0x7f4868072f40 0x7f486806c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.273+0000 7f486d54b640 1 -- 172.21.15.139:0/1306337379 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48680c94f0 con 0x7f4868153e40 2024-04-26T18:03:53.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.275+0000 7f486d54b640 1 --2- 172.21.15.139:0/1306337379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868153e40 0x7f486815dc40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f48680706d0 tx=0x7f486402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7445d6c55cb621 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.275+0000 7f485ffff640 1 -- 172.21.15.139:0/1306337379 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864037070 con 0x7f4868153e40 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.275+0000 7f485ffff640 1 -- 172.21.15.139:0/1306337379 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4864032440 con 0x7f4868153e40 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.275+0000 7f485ffff640 1 -- 172.21.15.139:0/1306337379 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864037070 con 0x7f4868153e40 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 -- 172.21.15.139:0/1306337379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868153e40 msgr2=0x7f486815dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 --2- 172.21.15.139:0/1306337379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868153e40 0x7f486815dc40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f48680706d0 tx=0x7f486402a1e0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 -- 172.21.15.139:0/1306337379 shutdown_connections 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 --2- 172.21.15.139:0/1306337379 >> v2:172.21.15.143:3300/0 conn(0x7f4868072f40 0x7f486806c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 --2- 172.21.15.139:0/1306337379 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f486806d0b0 0x7f4868159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 --2- 172.21.15.139:0/1306337379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868153e40 0x7f486815dc40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 -- 172.21.15.139:0/1306337379 >> 172.21.15.139:0/1306337379 conn(0x7f4868070a50 msgr2=0x7f4868070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 -- 172.21.15.139:0/1306337379 shutdown_connections 2024-04-26T18:03:53.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.276+0000 7f486f7af640 1 -- 172.21.15.139:0/1306337379 wait complete. 2024-04-26T18:03:53.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.277+0000 7f486f7af640 1 Processor -- start 2024-04-26T18:03:53.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.278+0000 7f486f7af640 1 -- start start 2024-04-26T18:03:53.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486f7af640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f486806d0b0 0x7f48680ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486f7af640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868072f40 0x7f486815a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486f7af640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4868153e40 0x7f4868146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486f7af640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f486815d720 con 0x7f4868072f40 2024-04-26T18:03:53.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486f7af640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f486815d440 con 0x7f486806d0b0 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486f7af640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f48680b3b50 con 0x7f4868153e40 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868072f40 0x7f486815a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868072f40 0x7f486815a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54614/0 (socket says 172.21.15.139:54614) 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 -- 172.21.15.139:0/4006072717 learned_addr learned my addr 172.21.15.139:0/4006072717 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486dd4c640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4868153e40 0x7f4868146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486d54b640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f486806d0b0 0x7f48680ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 -- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4868153e40 msgr2=0x7f4868146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4868153e40 0x7f4868146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 -- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f486806d0b0 msgr2=0x7f48680ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f486806d0b0 0x7f48680ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.279+0000 7f486cd4a640 1 -- 172.21.15.139:0/4006072717 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48680cc160 con 0x7f4868072f40 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.280+0000 7f486cd4a640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868072f40 0x7f486815a430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f485800e840 tx=0x7f485800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.280+0000 7f485dffb640 1 -- 172.21.15.139:0/4006072717 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858017070 con 0x7f4868072f40 2024-04-26T18:03:53.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.280+0000 7f485dffb640 1 -- 172.21.15.139:0/4006072717 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485800c940 con 0x7f4868072f40 2024-04-26T18:03:53.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.280+0000 7f485dffb640 1 -- 172.21.15.139:0/4006072717 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485800cd10 con 0x7f4868072f40 2024-04-26T18:03:53.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.281+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4868157b40 con 0x7f4868072f40 2024-04-26T18:03:53.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.281+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48680ced80 con 0x7f4868072f40 2024-04-26T18:03:53.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.283+0000 7f485dffb640 1 -- 172.21.15.139:0/4006072717 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f485801a070 con 0x7f4868072f40 2024-04-26T18:03:53.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.284+0000 7f485dffb640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f484c06c920 0x7f484c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.284+0000 7f485dffb640 1 -- 172.21.15.139:0/4006072717 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4858057ae0 con 0x7f4868072f40 2024-04-26T18:03:53.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.284+0000 7f486d54b640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f484c06c920 0x7f484c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.285+0000 7f486d54b640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f484c06c920 0x7f484c06ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4864034000 tx=0x7f486402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:53.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.286+0000 7f48725a4740 1 Processor -- start 2024-04-26T18:03:53.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.286+0000 7f48725a4740 1 -- start start 2024-04-26T18:03:53.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7b5e0 0x558bacfba5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacf7b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f48725a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacf7bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f48725a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558baceded80 con 0x558bacf7cb40 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x558bace7ac20 con 0x558bacf7b5e0 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x558bacedad40 con 0x558bacfbaae0 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacf7b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486d54b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7b5e0 0x558bacfba5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486dd4c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacf7bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacf7b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:43894/0 (socket says 172.21.15.139:43894) 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486cd4a640 1 -- 172.21.15.139:0/2631712155 learned_addr learned my addr 172.21.15.139:0/2631712155 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486d54b640 1 -- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 msgr2=0x558bacf7b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486d54b640 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacf7b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486d54b640 1 -- 172.21.15.139:0/2631712155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 msgr2=0x558bacf7bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486d54b640 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacf7bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.287+0000 7f486d54b640 1 -- 172.21.15.139:0/2631712155 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558baccbcd80 con 0x558bacf7b5e0 2024-04-26T18:03:53.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.288+0000 7f486d54b640 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7b5e0 0x558bacfba5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4864031000 tx=0x7f486402c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a03e709a45ae0c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:53.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.288+0000 7f484affd640 1 -- 172.21.15.139:0/2631712155 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864037070 con 0x558bacf7b5e0 2024-04-26T18:03:53.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.288+0000 7f484affd640 1 -- 172.21.15.139:0/2631712155 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4864032df0 con 0x558bacf7b5e0 2024-04-26T18:03:53.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.288+0000 7f486dd4c640 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacf7bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:53.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.288+0000 7f484affd640 1 -- 172.21.15.139:0/2631712155 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864004250 con 0x558bacf7b5e0 2024-04-26T18:03:53.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.288+0000 7f486cd4a640 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacf7b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:53.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 -- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7b5e0 msgr2=0x558bacfba5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7b5e0 0x558bacfba5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4864031000 tx=0x7f486402c000 comp rx=0 tx=0).stop 2024-04-26T18:03:53.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 -- 172.21.15.139:0/2631712155 shutdown_connections 2024-04-26T18:03:53.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacf7bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacf7b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 --2- 172.21.15.139:0/2631712155 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7b5e0 0x558bacfba5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 -- 172.21.15.139:0/2631712155 >> 172.21.15.139:0/2631712155 conn(0x558bacf42740 msgr2=0x558bacfbf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 -- 172.21.15.139:0/2631712155 shutdown_connections 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.289+0000 7f48725a4740 1 -- 172.21.15.139:0/2631712155 wait complete. 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.290+0000 7f48725a4740 1 -- start start 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.290+0000 7f48725a4740 1 Processor -- start 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f48725a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7b5e0 0x558bacfb7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7cb40 0x558bacfb3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacfa2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f48725a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558bacf79c20 con 0x558bacf7b5e0 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x558bace78840 con 0x558bacf7cb40 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x558bacf7d170 con 0x558bacfbaae0 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f48725a4740 10 client.0 _ll_register_callbacks cb 0x558bace7c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7b5e0 0x558bacfb7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7b5e0 0x558bacfb7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54636/0 (socket says 172.21.15.139:54636) 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 -- 172.21.15.139:0/1007771973 learned_addr learned my addr 172.21.15.139:0/1007771973 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486cd4a640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7cb40 0x558bacfb3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486dd4c640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacfa2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 -- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 msgr2=0x558bacfa2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacfa2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 -- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7cb40 msgr2=0x558bacfb3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7cb40 0x558bacfb3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486d54b640 1 -- 172.21.15.139:0/1007771973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bacd1d510 con 0x558bacf7b5e0 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.292+0000 7f486cd4a640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7cb40 0x558bacfb3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f486d54b640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7b5e0 0x558bacfb7bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4864009960 tx=0x7f4864004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab78c4df5daa042f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f4843fff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f4843fff640 1 -- 172.21.15.139:0/1007771973 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864058070 con 0x558bacf7b5e0 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4864032df0 con 0x558bacf7b5e0 2024-04-26T18:03:53.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f4843fff640 1 -- 172.21.15.139:0/1007771973 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4864003a20 con 0x558bacf7b5e0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f4843fff640 1 -- 172.21.15.139:0/1007771973 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4864063050 con 0x558bacf7b5e0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 10 client.5043 fetch_fsmap learned FSMap version 9 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558bacbb0670 con 0x558bacf7b5e0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f4843fff640 1 -- 172.21.15.139:0/1007771973 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4864032df0 con 0x558bacf7b5e0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f4843fff640 1 -- 172.21.15.139:0/1007771973 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4864066020 con 0x558bacf7b5e0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 10 client.5043 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 10 client.5043 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 20 client.5043 populate_metadata read hostname 'smithi139' 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bacfcf3d0 0x558bacfcf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 4 client.5043 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.293+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558baceec990 con 0x558bacfcf3d0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.294+0000 7f486cd4a640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bacfcf3d0 0x558bacfcf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.294+0000 7f4843fff640 10 client.5043 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.294+0000 7f486cd4a640 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bacfcf3d0 0x558bacfcf7e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f09c086d683abf server_cookie=cfed88be27a626b1 in_seq=0 out_seq=0 2024-04-26T18:03:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f4843fff640 1 -- 172.21.15.139:0/1007771973 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558baceec990 con 0x558bacfcf3d0 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f4843fff640 10 client.5043 handle_command_reply: tid=0 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 client.5043 shutdown 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7b5e0 msgr2=0x558bacfb7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7b5e0 0x558bacfb7bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4864009960 tx=0x7f4864004730 comp rx=0 tx=0).stop 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 shutdown_connections 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bacfcf3d0 0x558bacfcf7e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacfbaae0 0x558bacfa2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacf7cb40 0x558bacfb3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f4843fff640 0 client.5043 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 --2- 172.21.15.139:0/1007771973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7b5e0 0x558bacfb7bc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 >> 172.21.15.139:0/1007771973 conn(0x558bacf42740 msgr2=0x558bacf7c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 shutdown_connections 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.295+0000 7f48725a4740 1 -- 172.21.15.139:0/1007771973 wait complete. 2024-04-26T18:03:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.296+0000 7f48725a4740 20 client.5043 trim_cache size 0 max 16384 2024-04-26T18:03:53.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.330+0000 7f48725a4740 1 Processor -- start 2024-04-26T18:03:53.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.330+0000 7f48725a4740 1 -- start start 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacf7cb40 0x558bacfa2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f48725a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacfbaae0 0x558bacfb85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f48725a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4868200770 con 0x558bacfbaae0 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f48681ff650 con 0x558bacfb8b10 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f48681fdca0 con 0x558bacf7cb40 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacfbaae0 0x558bacfb85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacfbaae0 0x558bacfb85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54650/0 (socket says 172.21.15.139:54650) 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 -- 172.21.15.139:0/3917348175 learned_addr learned my addr 172.21.15.139:0/3917348175 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486d54b640 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacf7cb40 0x558bacfa2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486dd4c640 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 -- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacf7cb40 msgr2=0x558bacfa2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacf7cb40 0x558bacfa2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 -- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 msgr2=0x558bacfb40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.331+0000 7f486cd4a640 1 -- 172.21.15.139:0/3917348175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bacf79d10 con 0x558bacfbaae0 2024-04-26T18:03:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.332+0000 7f486cd4a640 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacfbaae0 0x558bacfb85d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4858000c00 tx=0x7f485801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec5e16b4790f2a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.332+0000 7f484a7fc640 1 -- 172.21.15.139:0/3917348175 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858073070 con 0x558bacfbaae0 2024-04-26T18:03:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.332+0000 7f484a7fc640 1 -- 172.21.15.139:0/3917348175 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4858087030 con 0x558bacfbaae0 2024-04-26T18:03:53.333 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.332+0000 7f484a7fc640 1 -- 172.21.15.139:0/3917348175 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858078ae0 con 0x558bacfbaae0 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 -- 172.21.15.139:0/3917348175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacfbaae0 msgr2=0x558bacfb85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacfbaae0 0x558bacfb85d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4858000c00 tx=0x7f485801e040 comp rx=0 tx=0).stop 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 -- 172.21.15.139:0/3917348175 shutdown_connections 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacfbaae0 0x558bacfb85d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 --2- 172.21.15.139:0/3917348175 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bacf7cb40 0x558bacfa2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 -- 172.21.15.139:0/3917348175 >> 172.21.15.139:0/3917348175 conn(0x558bacf42740 msgr2=0x558bacfb3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:53.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 -- 172.21.15.139:0/3917348175 shutdown_connections 2024-04-26T18:03:53.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.333+0000 7f48725a4740 1 -- 172.21.15.139:0/3917348175 wait complete. 2024-04-26T18:03:53.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.334+0000 7f48725a4740 1 -- start start 2024-04-26T18:03:53.335 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.334+0000 7f48725a4740 1 Processor -- start 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f48725a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacfa3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f48725a4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bad02fe60 0x558bad0302e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f48725a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f48681fe1e0 con 0x558bacf7cb40 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f48681fef80 con 0x558bacfb8b10 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f48725a4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f48681fe8b0 con 0x558bad02fe60 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f48725a4740 10 client.0 _ll_register_callbacks cb 0x7f486404b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.335+0000 7f486d54b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacfa3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:47094/0 (socket says 172.21.15.139:47094) 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486d54b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacfa3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54652/0 (socket says 172.21.15.139:54652) 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 -- 172.21.15.139:0/4077167615 learned_addr learned my addr 172.21.15.139:0/4077167615 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:03:53.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486dd4c640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bad02fe60 0x558bad0302e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 -- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bad02fe60 msgr2=0x558bad0302e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bad02fe60 0x558bad0302e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 -- 172.21.15.139:0/4077167615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 msgr2=0x558bacfa3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacfa3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 -- 172.21.15.139:0/4077167615 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bacfdf4e0 con 0x558bacfb8b10 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486dd4c640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bad02fe60 0x558bad0302e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486d54b640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacfa3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f486cd4a640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb44d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4858059b30 tx=0x7f485808a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5806cf88ee56049 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f4843fff640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.336+0000 7f4843fff640 1 -- 172.21.15.139:0/4077167615 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858073070 con 0x558bacfb8b10 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f4843fff640 1 -- 172.21.15.139:0/4077167615 <== mon.1 v2:172.21.15.143:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f48580620e0 con 0x558bacfb8b10 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4858087030 con 0x558bacfb8b10 2024-04-26T18:03:53.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f4843fff640 1 -- 172.21.15.139:0/4077167615 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f485807f050 con 0x558bacfb8b10 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 10 client.4867 fetch_fsmap learned FSMap version 9 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558bad030820 con 0x558bacfb8b10 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f4843fff640 1 -- 172.21.15.139:0/4077167615 <== mon.1 v2:172.21.15.143:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48580622e0 con 0x558bacfb8b10 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f4843fff640 1 -- 172.21.15.139:0/4077167615 <== mon.1 v2:172.21.15.143:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4858083660 con 0x558bacfb8b10 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 10 client.4867 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 10 client.4867 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 20 client.4867 populate_metadata read hostname 'smithi139' 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bad039640 0x558bad039a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 4 client.4867 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}] 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.337+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}) -- 0x7f4858087030 con 0x558bad039640 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.338+0000 7f486d54b640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bad039640 0x558bad039a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.338+0000 7f4843fff640 10 client.4867 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:03:53.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.338+0000 7f486d54b640 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bad039640 0x558bad039a50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=922eb6e5a91ab054 server_cookie=d8bd76391a46c649 in_seq=0 out_seq=0 2024-04-26T18:03:53.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.610+0000 7f4843fff640 1 -- 172.21.15.139:0/4077167615 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x7f4858087030 con 0x558bad039640 2024-04-26T18:03:53.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.610+0000 7f4843fff640 10 client.4867 handle_command_reply: tid=0 2024-04-26T18:03:53.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.610+0000 7f48725a4740 1 client.4867 shutdown 2024-04-26T18:03:53.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 msgr2=0x558bacfb44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb44d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4858059b30 tx=0x7f485808a060 comp rx=0 tx=0).stop 2024-04-26T18:03:53.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 shutdown_connections 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558bad039640 0x558bad039a50 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558bad02fe60 0x558bad0302e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558bacfb8b10 0x558bacfb44d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 --2- 172.21.15.139:0/4077167615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bacf7cb40 0x558bacfa3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 >> 172.21.15.139:0/4077167615 conn(0x558bacf42740 msgr2=0x558bacfa2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f4843fff640 0 client.4867 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 shutdown_connections 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 1 -- 172.21.15.139:0/4077167615 wait complete. 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.611+0000 7f48725a4740 20 client.4867 trim_cache size 0 max 16384 2024-04-26T18:03:53.612 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 18, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "7ef29fb": { 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 18, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 91.7, 2024-04-26T18:03:53.613 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:03:53.614 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f484c06c920 msgr2=0x7f484c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f484c06c920 0x7f484c06ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4864034000 tx=0x7f486402e000 comp rx=0 tx=0).stop 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868072f40 msgr2=0x7f486815a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868072f40 0x7f486815a430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f485800e840 tx=0x7f485800ed00 comp rx=0 tx=0).stop 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 shutdown_connections 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f484c06c920 0x7f484c06ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4868153e40 0x7f4868146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4868072f40 0x7f486815a430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 --2- 172.21.15.139:0/4006072717 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f486806d0b0 0x7f48680ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 >> 172.21.15.139:0/4006072717 conn(0x7f4868070a50 msgr2=0x7f48680c3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:53.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 shutdown_connections 2024-04-26T18:03:53.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:03:53.612+0000 7f486f7af640 1 -- 172.21.15.139:0/4006072717 wait complete. 2024-04-26T18:03:53.627 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7ef29fb', quiesce took 1.2 seconds. Will release after: 31.7 2024-04-26T18:04:06.761 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:04:06.764 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:04:25.329 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:04:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.440+0000 7f12bd437640 1 Processor -- start 2024-04-26T18:04:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.440+0000 7f12bd437640 1 -- start start 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.440+0000 7f12bd437640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12b80cd840 0x7f12b815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.440+0000 7f12bd437640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b815f2a0 con 0x7f12b8155da0 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.440+0000 7f12bd437640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b815f580 con 0x7f12b8156180 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.440+0000 7f12bd437640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f12b815cbc0 con 0x7f12b80cd840 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b77fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12b80cd840 0x7f12b815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b77fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f12b80cd840 0x7f12b815c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39252/0 (socket says 172.21.15.139:39252) 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b6ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f12b8155da0 0x7f12b80d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:33268/0 (socket says 172.21.15.139:33268) 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b77fe640 1 -- 172.21.15.139:0/3661891088 learned_addr learned my addr 172.21.15.139:0/3661891088 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:04:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b77fe640 1 -- 172.21.15.139:0/3661891088 >> v1:172.21.15.143:6789/0 conn(0x7f12b8156180 legacy=0x7f12b80c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b77fe640 1 -- 172.21.15.139:0/3661891088 >> v1:172.21.15.139:6789/0 conn(0x7f12b8155da0 legacy=0x7f12b80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b77fe640 1 -- 172.21.15.139:0/3661891088 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b815f860 con 0x7f12b80cd840 2024-04-26T18:04:25.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.441+0000 7f12b5ffb640 1 -- 172.21.15.139:0/3661891088 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428382524 0 0) 0x7f12b815f2a0 con 0x7f12b8155da0 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12b77fe640 1 --2- 172.21.15.139:0/3661891088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80cd840 0x7f12b815c680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009870 tx=0x7f12b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91590f0296a1420 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12b5ffb640 1 -- 172.21.15.139:0/3661891088 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0037070 con 0x7f12b80cd840 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12b5ffb640 1 -- 172.21.15.139:0/3661891088 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b0032440 con 0x7f12b80cd840 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12b5ffb640 1 -- 172.21.15.139:0/3661891088 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0032810 con 0x7f12b80cd840 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12bd437640 1 -- 172.21.15.139:0/3661891088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80cd840 msgr2=0x7f12b815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12bd437640 1 --2- 172.21.15.139:0/3661891088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80cd840 0x7f12b815c680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009870 tx=0x7f12b002a270 comp rx=0 tx=0).stop 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12bd437640 1 -- 172.21.15.139:0/3661891088 shutdown_connections 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12bd437640 1 --2- 172.21.15.139:0/3661891088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80cd840 0x7f12b815c680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12bd437640 1 -- 172.21.15.139:0/3661891088 >> 172.21.15.139:0/3661891088 conn(0x7f12b8068090 msgr2=0x7f12b80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12bd437640 1 -- 172.21.15.139:0/3661891088 shutdown_connections 2024-04-26T18:04:25.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.442+0000 7f12bd437640 1 -- 172.21.15.139:0/3661891088 wait complete. 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 Processor -- start 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 -- start start 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80cd840 0x7f12b80c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b8155da0 0x7f12b81f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80d0700 0x7f12b81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80d19d0 con 0x7f12b80d0700 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80cc730 con 0x7f12b8155da0 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12bd437640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f12b80d1b50 con 0x7f12b80cd840 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80d0700 0x7f12b81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80d0700 0x7f12b81584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39260/0 (socket says 172.21.15.139:39260) 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.444+0000 7f12b77fe640 1 -- 172.21.15.139:0/123009895 learned_addr learned my addr 172.21.15.139:0/123009895 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:04:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b67fc640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b8155da0 0x7f12b81f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b6ffd640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80cd840 0x7f12b80c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b77fe640 1 -- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80cd840 msgr2=0x7f12b80c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b77fe640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80cd840 0x7f12b80c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b77fe640 1 -- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b8155da0 msgr2=0x7f12b81f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b77fe640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b8155da0 0x7f12b81f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b77fe640 1 -- 172.21.15.139:0/123009895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b81567a0 con 0x7f12b80d0700 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12b77fe640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80d0700 0x7f12b81584e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12b002a2b0 tx=0x7f12b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f129f7fe640 1 -- 172.21.15.139:0/123009895 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0037040 con 0x7f12b80d0700 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f129f7fe640 1 -- 172.21.15.139:0/123009895 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b0042070 con 0x7f12b80d0700 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b8156a80 con 0x7f12b80d0700 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f129f7fe640 1 -- 172.21.15.139:0/123009895 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0030c90 con 0x7f12b80d0700 2024-04-26T18:04:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.445+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b815ebc0 con 0x7f12b80d0700 2024-04-26T18:04:25.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.446+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b8076d20 con 0x7f12b80d0700 2024-04-26T18:04:25.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.447+0000 7f129f7fe640 1 -- 172.21.15.139:0/123009895 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12b0047460 con 0x7f12b80d0700 2024-04-26T18:04:25.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.447+0000 7f129f7fe640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12a406c8f0 0x7f12a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.447+0000 7f129f7fe640 1 -- 172.21.15.139:0/123009895 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f12b00aca80 con 0x7f12b80d0700 2024-04-26T18:04:25.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.447+0000 7f12b6ffd640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12a406c8f0 0x7f12a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.448+0000 7f12b6ffd640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12a406c8f0 0x7f12a406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f12a8001920 tx=0x7f12a80018b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.452+0000 7f129f7fe640 1 -- 172.21.15.139:0/123009895 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f12b007a420 con 0x7f12b80d0700 2024-04-26T18:04:25.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.662+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12b80b6ff0 con 0x7f12b80d0700 2024-04-26T18:04:25.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.663+0000 7f129f7fe640 1 -- 172.21.15.139:0/123009895 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f12b007e720 con 0x7f12b80d0700 2024-04-26T18:04:25.663 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:04:25.663 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:04:25.663 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12a406c8f0 msgr2=0x7f12a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12a406c8f0 0x7f12a406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f12a8001920 tx=0x7f12a80018b0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80d0700 msgr2=0x7f12b81584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80d0700 0x7f12b81584e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12b002a2b0 tx=0x7f12b00046c0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 shutdown_connections 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f12a406c8f0 0x7f12a406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12b80d0700 0x7f12b81584e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f12b8155da0 0x7f12b81f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 --2- 172.21.15.139:0/123009895 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f12b80cd840 0x7f12b80c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 >> 172.21.15.139:0/123009895 conn(0x7f12b8068090 msgr2=0x7f12b8152520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 shutdown_connections 2024-04-26T18:04:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.665+0000 7f12bd437640 1 -- 172.21.15.139:0/123009895 wait complete. 2024-04-26T18:04:25.676 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 7ef29fb --release --await' 2024-04-26T18:04:25.676 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 7ef29fb --release --await 2024-04-26T18:04:25.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3c64a9640 1 Processor -- start 2024-04-26T18:04:25.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3c64a9640 1 -- start start 2024-04-26T18:04:25.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3c64a9640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff3c01527f0 0x7ff3c015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3c64a9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff3c00cc0e0 0x7ff3c00cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3c64a9640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c00cca70 con 0x7ff3c015fdf0 2024-04-26T18:04:25.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3c64a9640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c00c6780 con 0x7ff3c01527f0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3c64a9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c015cbc0 con 0x7ff3c00cc0e0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.781+0000 7ff3bffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff3c01527f0 0x7ff3c015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3bf7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff3c015fdf0 0x7ff3c00d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:33272/0 (socket says 172.21.15.139:33272) 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/4280725673 learned_addr learned my addr 172.21.15.139:0/4280725673 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3c4a46640 1 --2- 172.21.15.139:0/4280725673 >> v2:172.21.15.143:3300/0 conn(0x7ff3c00cc0e0 0x7ff3c00cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3bffff640 1 -- 172.21.15.139:0/4280725673 >> v2:172.21.15.143:3300/0 conn(0x7ff3c00cc0e0 msgr2=0x7ff3c00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3bffff640 1 --2- 172.21.15.139:0/4280725673 >> v2:172.21.15.143:3300/0 conn(0x7ff3c00cc0e0 0x7ff3c00cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3bffff640 1 -- 172.21.15.139:0/4280725673 >> v1:172.21.15.139:6789/0 conn(0x7ff3c015fdf0 legacy=0x7ff3c00d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3beffd640 1 -- 172.21.15.139:0/4280725673 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044172564 0 0) 0x7ff3c00cca70 con 0x7ff3c015fdf0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3bffff640 1 -- 172.21.15.139:0/4280725673 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c015c040 con 0x7ff3c01527f0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.782+0000 7ff3bffff640 1 --2- 172.21.15.139:0/4280725673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c015f8b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00097a0 tx=0x7ff3b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2319b6ce4e7163 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3beffd640 1 -- 172.21.15.139:0/4280725673 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0037070 con 0x7ff3c01527f0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3beffd640 1 -- 172.21.15.139:0/4280725673 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b0032440 con 0x7ff3c01527f0 2024-04-26T18:04:25.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3beffd640 1 -- 172.21.15.139:0/4280725673 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0032810 con 0x7ff3c01527f0 2024-04-26T18:04:25.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 -- 172.21.15.139:0/4280725673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 msgr2=0x7ff3c015f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/4280725673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c015f8b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00097a0 tx=0x7ff3b002a1e0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 -- 172.21.15.139:0/4280725673 shutdown_connections 2024-04-26T18:04:25.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/4280725673 >> v2:172.21.15.143:3300/0 conn(0x7ff3c00cc0e0 0x7ff3c00cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/4280725673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c015f8b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 -- 172.21.15.139:0/4280725673 >> 172.21.15.139:0/4280725673 conn(0x7ff3c0076100 msgr2=0x7ff3c0073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 -- 172.21.15.139:0/4280725673 shutdown_connections 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.783+0000 7ff3c64a9640 1 -- 172.21.15.139:0/4280725673 wait complete. 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.784+0000 7ff3c64a9640 1 Processor -- start 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.784+0000 7ff3c64a9640 1 -- start start 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3c64a9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c00cc0e0 0x7ff3c00d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3c64a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c01f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3c64a9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c015fdf0 0x7ff3c014bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3c64a9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c015c8e0 con 0x7ff3c01527f0 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3c64a9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c015c600 con 0x7ff3c00cc0e0 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3c64a9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c00cdb00 con 0x7ff3c015fdf0 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c01f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c01f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39274/0 (socket says 172.21.15.139:39274) 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/3567874362 learned_addr learned my addr 172.21.15.139:0/3567874362 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bffff640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c00cc0e0 0x7ff3c00d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3c4a46640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c015fdf0 0x7ff3c014bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c015fdf0 msgr2=0x7ff3c014bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c015fdf0 0x7ff3c014bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c00cc0e0 msgr2=0x7ff3c00d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c00cc0e0 0x7ff3c00d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.785+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/3567874362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c014cb30 con 0x7ff3c01527f0 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.786+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c01f2010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4001eb0 tx=0x7ff3b400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.786+0000 7ff3bcff9640 1 -- 172.21.15.139:0/3567874362 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4017070 con 0x7ff3c01527f0 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.786+0000 7ff3bcff9640 1 -- 172.21.15.139:0/3567874362 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40074e0 con 0x7ff3c01527f0 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.786+0000 7ff3bcff9640 1 -- 172.21.15.139:0/3567874362 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40059e0 con 0x7ff3c01527f0 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.786+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c014ce10 con 0x7ff3c01527f0 2024-04-26T18:04:25.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.786+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c015efa0 con 0x7ff3c01527f0 2024-04-26T18:04:25.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.787+0000 7ff3bcff9640 1 -- 172.21.15.139:0/3567874362 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3b401a070 con 0x7ff3c01527f0 2024-04-26T18:04:25.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.788+0000 7ff3bcff9640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff3ac06c8f0 0x7ff3ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.788+0000 7ff3bcff9640 1 -- 172.21.15.139:0/3567874362 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ff3b408b2a0 con 0x7ff3c01527f0 2024-04-26T18:04:25.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.788+0000 7ff3bffff640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff3ac06c8f0 0x7ff3ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.788+0000 7ff3bffff640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff3ac06c8f0 0x7ff3ac06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0034000 tx=0x7ff3b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 Processor -- start 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 -- start start 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182887470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182848890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c182849a10 0x55c182848dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c1827ad040 con 0x55c1828484b0 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c182748b60 con 0x55c182849a10 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55c1827a9000 con 0x55c1828879b0 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182887470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182887470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39282/0 (socket says 172.21.15.139:39282) 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.789+0000 7ff3bffff640 1 -- 172.21.15.139:0/4254685071 learned_addr learned my addr 172.21.15.139:0/4254685071 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182848890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3c4a46640 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c182849a10 0x55c182848dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bffff640 1 -- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 msgr2=0x55c182848890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bffff640 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182848890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bffff640 1 -- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c182849a10 msgr2=0x55c182848dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bffff640 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c182849a10 0x55c182848dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bffff640 1 -- 172.21.15.139:0/4254685071 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c18273d9c0 con 0x55c1828484b0 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182848890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3bffff640 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182887470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff3b002a220 tx=0x7ff3b002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14c9bbbd3d9afef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3a5ffb640 1 -- 172.21.15.139:0/4254685071 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b004f070 con 0x55c1828484b0 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3a5ffb640 1 -- 172.21.15.139:0/4254685071 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b0038040 con 0x55c1828484b0 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.790+0000 7ff3a5ffb640 1 -- 172.21.15.139:0/4254685071 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0037050 con 0x55c1828484b0 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 -- 172.21.15.139:0/4254685071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 msgr2=0x55c182887470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182887470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff3b002a220 tx=0x7ff3b002c000 comp rx=0 tx=0).stop 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 -- 172.21.15.139:0/4254685071 shutdown_connections 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c182849a10 0x55c182848dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182848890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/4254685071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182887470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 -- 172.21.15.139:0/4254685071 >> 172.21.15.139:0/4254685071 conn(0x55c18280f930 msgr2=0x55c18288c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 -- 172.21.15.139:0/4254685071 shutdown_connections 2024-04-26T18:04:25.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 -- 172.21.15.139:0/4254685071 wait complete. 2024-04-26T18:04:25.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 -- start start 2024-04-26T18:04:25.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.791+0000 7ff3c91c3740 1 Processor -- start 2024-04-26T18:04:25.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182872e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c182849a10 0x55c182885be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c18289c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c182846af0 con 0x55c1828484b0 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55c1827464f0 con 0x55c1828879b0 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55c18284a040 con 0x55c182849a10 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c91c3740 10 client.0 _ll_register_callbacks cb 0x55c1827a3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182872e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182872e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39284/0 (socket says 172.21.15.139:39284) 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 -- 172.21.15.139:0/1908965933 learned_addr learned my addr 172.21.15.139:0/1908965933 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c182849a10 0x55c182885be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3c4a46640 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c18289c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 -- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c182849a10 msgr2=0x55c182885be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c182849a10 0x55c182885be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 -- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 msgr2=0x55c18289c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c18289c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.792+0000 7ff3bffff640 1 -- 172.21.15.139:0/1908965933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1824be920 con 0x55c1828484b0 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3bffff640 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182872e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff3b002a220 tx=0x7ff3b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe13efc22577ac7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff39effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff39effd640 1 -- 172.21.15.139:0/1908965933 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b005a060 con 0x55c1828484b0 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff39effd640 1 -- 172.21.15.139:0/1908965933 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ff3b0032650 con 0x55c1828484b0 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3b0038040 con 0x55c1828484b0 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff39effd640 1 -- 172.21.15.139:0/1908965933 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff3b0060050 con 0x55c1828484b0 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 10 client.5073 fetch_fsmap learned FSMap version 9 2024-04-26T18:04:25.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c18258ad30 con 0x55c1828484b0 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff39effd640 1 -- 172.21.15.139:0/1908965933 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b0038040 con 0x55c1828484b0 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff39effd640 1 -- 172.21.15.139:0/1908965933 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7ff3b0063020 con 0x55c1828484b0 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 10 client.5073 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 10 client.5073 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 20 client.5073 populate_metadata read hostname 'smithi139' 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c18289c670 0x55c18286f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 4 client.5073 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c182780a00 con 0x55c18289c670 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.793+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c18289c670 0x55c18286f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.794+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c18289c670 0x55c18286f7e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62e7b0b8a6692c87 server_cookie=2e21fec9bb35755d in_seq=0 out_seq=0 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.794+0000 7ff39effd640 10 client.5073 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.794+0000 7ff39effd640 1 -- 172.21.15.139:0/1908965933 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c182780a00 con 0x55c18289c670 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.794+0000 7ff39effd640 10 client.5073 handle_command_reply: tid=0 2024-04-26T18:04:25.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.794+0000 7ff3c91c3740 1 client.5073 shutdown 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 msgr2=0x55c182872e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182872e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff3b002a220 tx=0x7ff3b0004730 comp rx=0 tx=0).stop 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 shutdown_connections 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c18289c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c18289c670 0x55c18286f7e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c182849a10 0x55c182885be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/1908965933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c1828484b0 0x55c182872e20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 >> 172.21.15.139:0/1908965933 conn(0x55c18280f930 msgr2=0x55c182871b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff39effd640 0 client.5073 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:04:25.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 shutdown_connections 2024-04-26T18:04:25.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 1 -- 172.21.15.139:0/1908965933 wait complete. 2024-04-26T18:04:25.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.795+0000 7ff3c91c3740 20 client.5073 trim_cache size 0 max 16384 2024-04-26T18:04:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.812+0000 7ff3c91c3740 1 Processor -- start 2024-04-26T18:04:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.812+0000 7ff3c91c3740 1 -- start start 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828484b0 0x55c182889720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c182889c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182868ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c02003b0 con 0x55c182849a10 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c01ff290 con 0x55c1828484b0 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c015e8c0 con 0x55c1828879b0 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c182889c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c182889c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39292/0 (socket says 172.21.15.139:39292) 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/757195365 learned_addr learned my addr 172.21.15.139:0/757195365 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bffff640 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828484b0 0x55c182889720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3c4a46640 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182868ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 msgr2=0x55c182868ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182868ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828484b0 msgr2=0x55c182889720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828484b0 0x55c182889720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/757195365 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c182880460 con 0x55c182849a10 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c182889c60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4055140 tx=0x7ff3b40892f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8b4aa6a578d459 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.813+0000 7ff3a57fa640 1 -- 172.21.15.139:0/757195365 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4089070 con 0x55c182849a10 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3a57fa640 1 -- 172.21.15.139:0/757195365 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b408b0b0 con 0x55c182849a10 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3a57fa640 1 -- 172.21.15.139:0/757195365 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4056fe0 con 0x55c182849a10 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 -- 172.21.15.139:0/757195365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 msgr2=0x55c182889c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c182889c60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4055140 tx=0x7ff3b40892f0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 -- 172.21.15.139:0/757195365 shutdown_connections 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828879b0 0x55c182868ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c182889c60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/757195365 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828484b0 0x55c182889720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 -- 172.21.15.139:0/757195365 >> 172.21.15.139:0/757195365 conn(0x55c18280f930 msgr2=0x55c18288cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 -- 172.21.15.139:0/757195365 shutdown_connections 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.814+0000 7ff3c91c3740 1 -- 172.21.15.139:0/757195365 wait complete. 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.815+0000 7ff3c91c3740 1 -- start start 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.815+0000 7ff3c91c3740 1 Processor -- start 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828484b0 0x55c1828685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c1828fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c1828898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c01fde40 con 0x55c182849a10 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c01febc0 con 0x55c1828879b0 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c01fe4f0 con 0x55c1828484b0 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 10 client.0 _ll_register_callbacks cb 0x7ff3b004d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c1828fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c1828fcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39304/0 (socket says 172.21.15.139:39304) 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/2704931519 learned_addr learned my addr 172.21.15.139:0/2704931519 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c4a46640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c1828898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bffff640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828484b0 0x55c1828685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828484b0 msgr2=0x55c1828685a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828484b0 0x55c1828685a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 msgr2=0x55c1828898b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c1828898b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 -- 172.21.15.139:0/2704931519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c18287edd0 con 0x55c182849a10 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bffff640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828484b0 0x55c1828685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3bf7fe640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c1828fcbc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40010e0 tx=0x7ff3b4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430958fda93ebd23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff39effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff39effd640 1 -- 172.21.15.139:0/2704931519 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4089070 con 0x55c182849a10 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff39effd640 1 -- 172.21.15.139:0/2704931519 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ff3b4055350 con 0x55c182849a10 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3b408b0b0 con 0x55c182849a10 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff39effd640 1 -- 172.21.15.139:0/2704931519 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff3b4068050 con 0x55c182849a10 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 10 client.5079 fetch_fsmap learned FSMap version 9 2024-04-26T18:04:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.816+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55c182883e40 con 0x55c182849a10 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff39effd640 1 -- 172.21.15.139:0/2704931519 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b408b0b0 con 0x55c182849a10 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff39effd640 1 -- 172.21.15.139:0/2704931519 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7ff3b406b020 con 0x55c182849a10 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3c91c3740 10 client.5079 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3c91c3740 10 client.5079 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3c91c3740 20 client.5079 populate_metadata read hostname 'smithi139' 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c182869350 0x55c182869750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3c91c3740 4 client.5079 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7ef29fb", "release": true, "await": true}] 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7ef29fb", "release": true, "await": true}) -- 0x55c1827bac50 con 0x55c182869350 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3bffff640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c182869350 0x55c182869750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff39effd640 10 client.5079 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.817+0000 7ff3bffff640 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c182869350 0x55c182869750 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bf42bf8a7158fb7 server_cookie=679e39a16b3bffb7 in_seq=0 out_seq=0 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff39effd640 1 -- 172.21.15.139:0/2704931519 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55c1827bac50 con 0x55c182869350 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff39effd640 10 client.5079 handle_command_reply: tid=0 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 client.5079 shutdown 2024-04-26T18:04:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 msgr2=0x55c1828fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c1828fcbc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40010e0 tx=0x7ff3b4014040 comp rx=0 tx=0).stop 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 shutdown_connections 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c1828879b0 0x55c1828898b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c182849a10 0x55c1828fcbc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55c182869350 0x55c182869750 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 --2- 172.21.15.139:0/2704931519 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55c1828484b0 0x55c1828685a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff39effd640 0 client.5079 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 >> 172.21.15.139:0/2704931519 conn(0x55c18280f930 msgr2=0x55c18288caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 shutdown_connections 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 1 -- 172.21.15.139:0/2704931519 wait complete. 2024-04-26T18:04:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c91c3740 20 client.5079 trim_cache size 0 max 16384 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 20, 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "7ef29fb": { 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 20, 2024-04-26T18:04:25.825 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 91.7, 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:04:25.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:04:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:04:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:04:25.827 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:04:25.827 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff3ac06c8f0 msgr2=0x7ff3ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff3ac06c8f0 0x7ff3ac06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0034000 tx=0x7ff3b002e000 comp rx=0 tx=0).stop 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 msgr2=0x7ff3c01f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c01f2010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4001eb0 tx=0x7ff3b400c890 comp rx=0 tx=0).stop 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 shutdown_connections 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff3ac06c8f0 0x7ff3ac06edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff3c015fdf0 0x7ff3c014bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c01527f0 0x7ff3c01f2010 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 --2- 172.21.15.139:0/3567874362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3c00cc0e0 0x7ff3c00d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.818+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 >> 172.21.15.139:0/3567874362 conn(0x7ff3c0076100 msgr2=0x7ff3c014fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.819+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 shutdown_connections 2024-04-26T18:04:25.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:04:25.819+0000 7ff3c64a9640 1 -- 172.21.15.139:0/3567874362 wait complete. 2024-04-26T18:04:25.830 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7ef29fb', seconds elapsed: 33.4 2024-04-26T18:04:36.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:04:36.848 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:06.908 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:06.912 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:24.703 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.7 2024-04-26T18:05:24.703 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:05:24.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.816+0000 7fc527a2a640 1 Processor -- start 2024-04-26T18:05:24.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.816+0000 7fc527a2a640 1 -- start start 2024-04-26T18:05:24.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc527a2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc520153b10 0x7fc5200c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:24.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc527a2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc52015ce60 0x7fc52015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc527a2a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52015d830 con 0x7fc52006e240 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc527a2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc52006e8d0 con 0x7fc520153b10 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc527a2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc520073910 con 0x7fc52015ce60 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc524fc5640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc52006e240 0x7fc5200cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:57214/0 (socket says 172.21.15.139:57214) 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc524fc5640 1 -- 172.21.15.139:0/664030239 learned_addr learned my addr 172.21.15.139:0/664030239 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc5257c6640 1 --2- 172.21.15.139:0/664030239 >> v2:172.21.15.143:3300/0 conn(0x7fc520153b10 0x7fc5200c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc525fc7640 1 --2- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc52015ce60 0x7fc52015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc517fff640 1 -- 172.21.15.139:0/664030239 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636585656 0 0) 0x7fc52015d830 con 0x7fc52006e240 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc517fff640 1 -- 172.21.15.139:0/664030239 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc50c003520 con 0x7fc52006e240 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc5257c6640 1 -- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc52015ce60 msgr2=0x7fc52015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc5257c6640 1 --2- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc52015ce60 0x7fc52015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc5257c6640 1 -- 172.21.15.139:0/664030239 >> v1:172.21.15.139:6789/0 conn(0x7fc52006e240 legacy=0x7fc5200cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc5257c6640 1 -- 172.21.15.139:0/664030239 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5200c7d30 con 0x7fc520153b10 2024-04-26T18:05:24.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.817+0000 7fc525fc7640 1 --2- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc52015ce60 0x7fc52015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.818+0000 7fc5257c6640 1 --2- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc520153b10 0x7fc5200c96d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0097a0 tx=0x7fc51c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acd564fe285fe9e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.818+0000 7fc517fff640 1 -- 172.21.15.139:0/664030239 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c037070 con 0x7fc520153b10 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.818+0000 7fc517fff640 1 -- 172.21.15.139:0/664030239 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51c032440 con 0x7fc520153b10 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.818+0000 7fc517fff640 1 -- 172.21.15.139:0/664030239 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c032810 con 0x7fc520153b10 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 -- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc520153b10 msgr2=0x7fc5200c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 --2- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc520153b10 0x7fc5200c96d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0097a0 tx=0x7fc51c02a210 comp rx=0 tx=0).stop 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 -- 172.21.15.139:0/664030239 shutdown_connections 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 --2- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc52015ce60 0x7fc52015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 --2- 172.21.15.139:0/664030239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc520153b10 0x7fc5200c96d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 -- 172.21.15.139:0/664030239 >> 172.21.15.139:0/664030239 conn(0x7fc520068270 msgr2=0x7fc520068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 -- 172.21.15.139:0/664030239 shutdown_connections 2024-04-26T18:05:24.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.819+0000 7fc527a2a640 1 -- 172.21.15.139:0/664030239 wait complete. 2024-04-26T18:05:24.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.820+0000 7fc527a2a640 1 Processor -- start 2024-04-26T18:05:24.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.820+0000 7fc527a2a640 1 -- start start 2024-04-26T18:05:24.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc527a2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52006e240 0x7fc520154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:24.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc527a2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc520153b10 0x7fc520156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:24.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc527a2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc52015ce60 0x7fc52015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc527a2a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc5200732c0 con 0x7fc52015ce60 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc527a2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc520072fe0 con 0x7fc52006e240 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc527a2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc5200735a0 con 0x7fc520153b10 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc525fc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc52015ce60 0x7fc52015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc5257c6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52006e240 0x7fc520154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc525fc7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc52015ce60 0x7fc52015c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44388/0 (socket says 172.21.15.139:44388) 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc524fc5640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc520153b10 0x7fc520156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc525fc7640 1 -- 172.21.15.139:0/3148857006 learned_addr learned my addr 172.21.15.139:0/3148857006 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc525fc7640 1 -- 172.21.15.139:0/3148857006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc520153b10 msgr2=0x7fc520156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc525fc7640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc520153b10 0x7fc520156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc525fc7640 1 -- 172.21.15.139:0/3148857006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52006e240 msgr2=0x7fc520154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.821+0000 7fc525fc7640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52006e240 0x7fc520154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.822+0000 7fc525fc7640 1 -- 172.21.15.139:0/3148857006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc520156180 con 0x7fc52015ce60 2024-04-26T18:05:24.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.822+0000 7fc525fc7640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc52015ce60 0x7fc52015c030 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc51800efc0 tx=0x7fc51800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:24.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.822+0000 7fc515ffb640 1 -- 172.21.15.139:0/3148857006 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518018030 con 0x7fc52015ce60 2024-04-26T18:05:24.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.822+0000 7fc515ffb640 1 -- 172.21.15.139:0/3148857006 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51800cdf0 con 0x7fc52015ce60 2024-04-26T18:05:24.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.822+0000 7fc515ffb640 1 -- 172.21.15.139:0/3148857006 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518003bb0 con 0x7fc52015ce60 2024-04-26T18:05:24.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.822+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52014d970 con 0x7fc52015ce60 2024-04-26T18:05:24.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.822+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52015cad0 con 0x7fc52015ce60 2024-04-26T18:05:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.823+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc520076d20 con 0x7fc52015ce60 2024-04-26T18:05:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.823+0000 7fc515ffb640 1 -- 172.21.15.139:0/3148857006 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc518005d10 con 0x7fc52015ce60 2024-04-26T18:05:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.824+0000 7fc515ffb640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc50406c8f0 0x7fc50406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.824+0000 7fc515ffb640 1 -- 172.21.15.139:0/3148857006 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc51808c840 con 0x7fc52015ce60 2024-04-26T18:05:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.824+0000 7fc5257c6640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc50406c8f0 0x7fc50406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.824+0000 7fc5257c6640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc50406c8f0 0x7fc50406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc51c034000 tx=0x7fc51c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:24.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:24.828+0000 7fc515ffb640 1 -- 172.21.15.139:0/3148857006 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc518022070 con 0x7fc52015ce60 2024-04-26T18:05:25.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.050+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc52006eab0 con 0x7fc52015ce60 2024-04-26T18:05:25.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.050+0000 7fc515ffb640 1 -- 172.21.15.139:0/3148857006 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fc518010040 con 0x7fc52015ce60 2024-04-26T18:05:25.050 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:05:25.051 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:05:25.051 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc50406c8f0 msgr2=0x7fc50406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc50406c8f0 0x7fc50406edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc51c034000 tx=0x7fc51c02e000 comp rx=0 tx=0).stop 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc52015ce60 msgr2=0x7fc52015c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc52015ce60 0x7fc52015c030 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc51800efc0 tx=0x7fc51800c490 comp rx=0 tx=0).stop 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 shutdown_connections 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc50406c8f0 0x7fc50406edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc52015ce60 0x7fc52015c030 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc520153b10 0x7fc520156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 --2- 172.21.15.139:0/3148857006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc52006e240 0x7fc520154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.052+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 >> 172.21.15.139:0/3148857006 conn(0x7fc520068270 msgr2=0x7fc520151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.053+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 shutdown_connections 2024-04-26T18:05:25.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.053+0000 7fc527a2a640 1 -- 172.21.15.139:0/3148857006 wait complete. 2024-04-26T18:05:25.063 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0' 2024-04-26T18:05:25.063 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0 2024-04-26T18:05:25.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.175+0000 7f1b704a0640 1 Processor -- start 2024-04-26T18:05:25.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.175+0000 7f1b704a0640 1 -- start start 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b704a0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806c4a0 0x7f1b680caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b704a0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1b6806cb20 0x7f1b681665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b704a0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b681563b0 con 0x7f1b680caba0 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b704a0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f1b6815c670 con 0x7f1b6806cb20 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b704a0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6815f930 con 0x7f1b6806c4a0 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b6ea3d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1b6806cb20 0x7f1b681665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b6e23c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1b680caba0 0x7f1b6815f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:57230/0 (socket says 172.21.15.139:57230) 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b6ea3d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1b6806cb20 0x7f1b681665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44390/0 (socket says 172.21.15.139:44390) 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.176+0000 7f1b6e23c640 1 -- 172.21.15.139:0/368739264 learned_addr learned my addr 172.21.15.139:0/368739264 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/368739264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806c4a0 0x7f1b680caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/368739264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806c4a0 msgr2=0x7f1b680caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/368739264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806c4a0 0x7f1b680caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/368739264 >> v1:172.21.15.139:6789/0 conn(0x7f1b680caba0 legacy=0x7f1b6815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6d23a640 1 -- 172.21.15.139:0/368739264 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840488535 0 0) 0x7f1b681563b0 con 0x7f1b680caba0 2024-04-26T18:05:25.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/368739264 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b680b0f60 con 0x7f1b6806cb20 2024-04-26T18:05:25.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/368739264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806c4a0 0x7f1b680caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/368739264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b6806cb20 0x7f1b681665b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b600097a0 tx=0x7f1b6002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9027b0d1faf6f21d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6d23a640 1 -- 172.21.15.139:0/368739264 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60037070 con 0x7f1b6806cb20 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6d23a640 1 -- 172.21.15.139:0/368739264 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b60032440 con 0x7f1b6806cb20 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.177+0000 7f1b6d23a640 1 -- 172.21.15.139:0/368739264 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60032810 con 0x7f1b6806cb20 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 -- 172.21.15.139:0/368739264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b6806cb20 msgr2=0x7f1b681665b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 --2- 172.21.15.139:0/368739264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b6806cb20 0x7f1b681665b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b600097a0 tx=0x7f1b6002a210 comp rx=0 tx=0).stop 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 -- 172.21.15.139:0/368739264 shutdown_connections 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 --2- 172.21.15.139:0/368739264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b6806cb20 0x7f1b681665b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 --2- 172.21.15.139:0/368739264 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806c4a0 0x7f1b680caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 -- 172.21.15.139:0/368739264 >> 172.21.15.139:0/368739264 conn(0x7f1b68070a50 msgr2=0x7f1b68070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 -- 172.21.15.139:0/368739264 shutdown_connections 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.178+0000 7f1b704a0640 1 -- 172.21.15.139:0/368739264 wait complete. 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.179+0000 7f1b704a0640 1 Processor -- start 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.179+0000 7f1b704a0640 1 -- start start 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b704a0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6806c4a0 0x7f1b6815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b704a0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806cb20 0x7f1b681e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b704a0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b680caba0 0x7f1b680b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b704a0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6815c020 con 0x7f1b680caba0 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b704a0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6815bd40 con 0x7f1b6806c4a0 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b704a0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6815c300 con 0x7f1b6806cb20 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b680caba0 0x7f1b680b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b680caba0 0x7f1b680b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44394/0 (socket says 172.21.15.139:44394) 2024-04-26T18:05:25.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1739618785 learned_addr learned my addr 172.21.15.139:0/1739618785 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806cb20 0x7f1b681e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6806c4a0 0x7f1b6815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806cb20 msgr2=0x7f1b681e67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806cb20 0x7f1b681e67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6806c4a0 msgr2=0x7f1b6815cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6806c4a0 0x7f1b6815cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1739618785 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b681e6e60 con 0x7f1b680caba0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806cb20 0x7f1b681e67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6806c4a0 0x7f1b6815cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b680caba0 0x7f1b680b18e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1b600098c0 tx=0x7f1b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.180+0000 7f1b5effd640 1 -- 172.21.15.139:0/1739618785 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60041070 con 0x7f1b680caba0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.181+0000 7f1b5effd640 1 -- 172.21.15.139:0/1739618785 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6003c870 con 0x7f1b680caba0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.181+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b681e7140 con 0x7f1b680caba0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.181+0000 7f1b5effd640 1 -- 172.21.15.139:0/1739618785 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60037040 con 0x7f1b680caba0 2024-04-26T18:05:25.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.181+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b680c4b90 con 0x7f1b680caba0 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.182+0000 7f1b5effd640 1 -- 172.21.15.139:0/1739618785 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b60044070 con 0x7f1b680caba0 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.183+0000 7f1b5effd640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1b4c06c8f0 0x7f1b4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.183+0000 7f1b5effd640 1 -- 172.21.15.139:0/1739618785 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1b600acb80 con 0x7f1b680caba0 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.183+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1b4c06c8f0 0x7f1b4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.183+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1b4c06c8f0 0x7f1b4c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b640012e0 tx=0x7f1b64005b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.184+0000 7f1b731be740 1 Processor -- start 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.184+0000 7f1b731be740 1 -- start start 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.184+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b731be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa30f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b731be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560dba993d80 con 0x560dbaa6fae0 2024-04-26T18:05:25.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560dba92fc20 con 0x560dbaa305e0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560dba98fd40 con 0x560dbaa31b40 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44402/0 (socket says 172.21.15.139:44402) 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 -- 172.21.15.139:0/1540396739 learned_addr learned my addr 172.21.15.139:0/1540396739 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa30f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 -- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 msgr2=0x560dbaa30f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa30f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 -- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 msgr2=0x560dbaa6f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 -- 172.21.15.139:0/1540396739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dba771d80 con 0x560dbaa6fae0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa309c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800a8b0 tx=0x7f1b5800ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389bc8a814ba4d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b4bfff640 1 -- 172.21.15.139:0/1540396739 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58004230 con 0x560dbaa6fae0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b4bfff640 1 -- 172.21.15.139:0/1540396739 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b580043d0 con 0x560dbaa6fae0 2024-04-26T18:05:25.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.185+0000 7f1b4bfff640 1 -- 172.21.15.139:0/1540396739 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5800f960 con 0x560dbaa6fae0 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 -- 172.21.15.139:0/1540396739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 msgr2=0x560dbaa309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa309c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800a8b0 tx=0x7f1b5800ad70 comp rx=0 tx=0).stop 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 -- 172.21.15.139:0/1540396739 shutdown_connections 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa30f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa309c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 --2- 172.21.15.139:0/1540396739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 -- 172.21.15.139:0/1540396739 >> 172.21.15.139:0/1540396739 conn(0x560dba9f7740 msgr2=0x560dbaa74580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 -- 172.21.15.139:0/1540396739 shutdown_connections 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.186+0000 7f1b731be740 1 -- 172.21.15.139:0/1540396739 wait complete. 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.187+0000 7f1b731be740 1 -- start start 2024-04-26T18:05:25.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.187+0000 7f1b731be740 1 Processor -- start 2024-04-26T18:05:25.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.187+0000 7f1b731be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa305e0 0x560dbaa5b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa6fae0 0x560dbaa84470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560dbaa2ec20 con 0x560dbaa305e0 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560dba92d840 con 0x560dbaa6fae0 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560dbaa32170 con 0x560dbaa31b40 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 10 client.0 _ll_register_callbacks cb 0x560dba9315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa305e0 0x560dbaa5b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa305e0 0x560dbaa5b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44416/0 (socket says 172.21.15.139:44416) 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 -- 172.21.15.139:0/1507101874 learned_addr learned my addr 172.21.15.139:0/1507101874 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa6fae0 0x560dbaa84470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 -- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 msgr2=0x560dbaa6cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 -- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa6fae0 msgr2=0x560dbaa84470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa6fae0 0x560dbaa84470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 -- 172.21.15.139:0/1507101874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dba7d2510 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa305e0 0x560dbaa5b0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b640154c0 tx=0x7f1b64011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe6d6bef89f8b3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b497fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b497fa640 1 -- 172.21.15.139:0/1507101874 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64027060 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b497fa640 1 -- 172.21.15.139:0/1507101874 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1b64010040 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b580043d0 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b497fa640 1 -- 172.21.15.139:0/1507101874 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1b64013420 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 10 client.5100 fetch_fsmap learned FSMap version 9 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560dba665670 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.188+0000 7f1b497fa640 1 -- 172.21.15.139:0/1507101874 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b580043d0 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b497fa640 1 -- 172.21.15.139:0/1507101874 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1b640226b0 con 0x560dbaa305e0 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b731be740 10 client.5100 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b731be740 10 client.5100 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:05:25.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b731be740 20 client.5100 populate_metadata read hostname 'smithi139' 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b731be740 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaa6e5a0 0x560dbaa57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b731be740 4 client.5100 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dba9a1990 con 0x560dbaa6e5a0 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaa6e5a0 0x560dbaa57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b497fa640 10 client.5100 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.189+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaa6e5a0 0x560dbaa57080 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e31fc55ee93a58b server_cookie=a660675cecc52fbc in_seq=0 out_seq=0 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b497fa640 1 -- 172.21.15.139:0/1507101874 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560dba9a1990 con 0x560dbaa6e5a0 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b497fa640 10 client.5100 handle_command_reply: tid=0 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 client.5100 shutdown 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa305e0 msgr2=0x560dbaa5b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa305e0 0x560dbaa5b0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b640154c0 tx=0x7f1b64011000 comp rx=0 tx=0).stop 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 shutdown_connections 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa6fae0 0x560dbaa84470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaa6e5a0 0x560dbaa57080 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 --2- 172.21.15.139:0/1507101874 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa305e0 0x560dbaa5b0e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b497fa640 0 client.5100 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:05:25.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 >> 172.21.15.139:0/1507101874 conn(0x560dba9f7740 msgr2=0x560dbaa31250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:25.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 shutdown_connections 2024-04-26T18:05:25.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 1 -- 172.21.15.139:0/1507101874 wait complete. 2024-04-26T18:05:25.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.190+0000 7f1b731be740 20 client.5100 trim_cache size 0 max 16384 2024-04-26T18:05:25.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.207+0000 7f1b731be740 1 Processor -- start 2024-04-26T18:05:25.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.207+0000 7f1b731be740 1 -- start start 2024-04-26T18:05:25.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.209 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b731be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa94960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b731be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68200590 con 0x560dbaa6fae0 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1b681ff470 con 0x560dbaa305e0 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1b680c3f40 con 0x560dbaa31b40 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa94960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa94960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44420/0 (socket says 172.21.15.139:44420) 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1134848799 learned_addr learned my addr 172.21.15.139:0/1134848799 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 msgr2=0x560dbaa6dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 msgr2=0x560dbaa6d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1134848799 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dbaa5aa40 con 0x560dbaa6fae0 2024-04-26T18:05:25.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.208+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa94960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009890 tx=0x7f1b60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cf0b152886f9e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b4b7fe640 1 -- 172.21.15.139:0/1134848799 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6004b040 con 0x560dbaa6fae0 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b4b7fe640 1 -- 172.21.15.139:0/1134848799 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6007a3e0 con 0x560dbaa6fae0 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b4b7fe640 1 -- 172.21.15.139:0/1134848799 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6007e790 con 0x560dbaa6fae0 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 -- 172.21.15.139:0/1134848799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 msgr2=0x560dbaa94960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa94960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009890 tx=0x7f1b60008040 comp rx=0 tx=0).stop 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 -- 172.21.15.139:0/1134848799 shutdown_connections 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa94960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa6dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 --2- 172.21.15.139:0/1134848799 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaa6d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 -- 172.21.15.139:0/1134848799 >> 172.21.15.139:0/1134848799 conn(0x560dba9f7740 msgr2=0x560dbaa2e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 -- 172.21.15.139:0/1134848799 shutdown_connections 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.209+0000 7f1b731be740 1 -- 172.21.15.139:0/1134848799 wait complete. 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.210+0000 7f1b731be740 1 -- start start 2024-04-26T18:05:25.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.210+0000 7f1b731be740 1 Processor -- start 2024-04-26T18:05:25.214 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaaee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa72bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa73100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b681f2810 con 0x560dbaa6fae0 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1b681fedd0 con 0x560dbaa305e0 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1b681fe700 con 0x560dbaa31b40 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 10 client.0 _ll_register_callbacks cb 0x7f1b640072d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa73100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa73100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44424/0 (socket says 172.21.15.139:44424) 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1836073364 learned_addr learned my addr 172.21.15.139:0/1836073364 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaaee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6da3b640 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa72bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 msgr2=0x560dbaa72bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa72bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 msgr2=0x560dbaaee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:25.215 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaaee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 -- 172.21.15.139:0/1836073364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dbaa73640 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b6ea3d640 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa73100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009890 tx=0x7f1b60009160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66eeb0f7e5ba94d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b497fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b497fa640 1 -- 172.21.15.139:0/1836073364 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b60097060 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b497fa640 1 -- 172.21.15.139:0/1836073364 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1b6003ce40 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b6007a3e0 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b497fa640 1 -- 172.21.15.139:0/1836073364 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1b6009e050 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 10 client.5106 fetch_fsmap learned FSMap version 9 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560dbaa30070 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.211+0000 7f1b497fa640 1 -- 172.21.15.139:0/1836073364 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6007a3e0 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b497fa640 1 -- 172.21.15.139:0/1836073364 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1b60082bc0 con 0x560dbaa6fae0 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b731be740 10 client.5106 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b731be740 10 client.5106 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b731be740 20 client.5106 populate_metadata read hostname 'smithi139' 2024-04-26T18:05:25.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b731be740 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaae4900 0x560dbaa82a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:25.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b731be740 4 client.5106 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}] 2024-04-26T18:05:25.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}) -- 0x560dba99b800 con 0x560dbaae4900 2024-04-26T18:05:25.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaae4900 0x560dbaa82a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:25.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b497fa640 10 client.5106 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:05:25.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:25.212+0000 7f1b6e23c640 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaae4900 0x560dbaa82a90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1187ecfb9f8f86d5 server_cookie=113ad941982fa4c2 in_seq=0 out_seq=0 2024-04-26T18:05:31.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b497fa640 1 -- 172.21.15.139:0/1836073364 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x560dba99b800 con 0x560dbaae4900 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b497fa640 10 client.5106 handle_command_reply: tid=0 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 client.5106 shutdown 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 msgr2=0x560dbaa73100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa73100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1b60009890 tx=0x7f1b60009160 comp rx=0 tx=0).stop 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 shutdown_connections 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560dbaa6fae0 0x560dbaa73100 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560dbaae4900 0x560dbaa82a90 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560dbaa31b40 0x560dbaa72bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 --2- 172.21.15.139:0/1836073364 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560dbaa305e0 0x560dbaaee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b497fa640 0 client.5106 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 >> 172.21.15.139:0/1836073364 conn(0x560dba9f7740 msgr2=0x560dbaa6d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:31.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 shutdown_connections 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 1 -- 172.21.15.139:0/1836073364 wait complete. 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.691+0000 7f1b731be740 20 client.5106 trim_cache size 0 max 16384 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 22, 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stdout: "290b9d6d": { 2024-04-26T18:05:31.693 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 22, 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 89.7, 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:05:31.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:05:31.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:05:31.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:05:31.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:05:31.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:05:31.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:05:31.695 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1b4c06c8f0 msgr2=0x7f1b4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1b4c06c8f0 0x7f1b4c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1b640012e0 tx=0x7f1b64005b90 comp rx=0 tx=0).stop 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b680caba0 msgr2=0x7f1b680b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b680caba0 0x7f1b680b18e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1b600098c0 tx=0x7f1b600046c0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 shutdown_connections 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1b4c06c8f0 0x7f1b4c06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b680caba0 0x7f1b680b18e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1b6806cb20 0x7f1b681e67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 --2- 172.21.15.139:0/1739618785 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1b6806c4a0 0x7f1b6815cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 >> 172.21.15.139:0/1739618785 conn(0x7f1b68070a50 msgr2=0x7f1b68153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 shutdown_connections 2024-04-26T18:05:31.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:05:31.692+0000 7f1b704a0640 1 -- 172.21.15.139:0/1739618785 wait complete. 2024-04-26T18:05:31.707 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '290b9d6d', quiesce took 7.0 seconds. Will release after: 29.7 2024-04-26T18:05:37.055 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:37.058 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:01.411 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:06:01.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.521+0000 7ff0004cf640 1 Processor -- start 2024-04-26T18:06:01.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.521+0000 7ff0004cf640 1 -- start start 2024-04-26T18:06:01.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.522+0000 7ff0004cf640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feff815feb0 0x7feff80cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.522+0000 7ff0004cf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7feff80ce030 0x7feff80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.522+0000 7ff0004cf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff815c0c0 con 0x7feff8155fa0 2024-04-26T18:06:01.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.522+0000 7ff0004cf640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7feff81602b0 con 0x7feff815feb0 2024-04-26T18:06:01.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.522+0000 7ff0004cf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7feff815c3a0 con 0x7feff80ce030 2024-04-26T18:06:01.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffda6a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feff815feb0 0x7feff80cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffda6a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7feff815feb0 0x7feff80cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57512/0 (socket says 172.21.15.139:57512) 2024-04-26T18:06:01.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffda6a640 1 -- 172.21.15.139:0/86092545 learned_addr learned my addr 172.21.15.139:0/86092545 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:01.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffea6c640 1 --2- 172.21.15.139:0/86092545 >> v2:172.21.15.143:3300/0 conn(0x7feff80ce030 0x7feff80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffda6a640 1 -- 172.21.15.139:0/86092545 >> v2:172.21.15.143:3300/0 conn(0x7feff80ce030 msgr2=0x7feff80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffda6a640 1 --2- 172.21.15.139:0/86092545 >> v2:172.21.15.143:3300/0 conn(0x7feff80ce030 0x7feff80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffda6a640 1 -- 172.21.15.139:0/86092545 >> v1:172.21.15.143:6789/0 conn(0x7feff8155fa0 legacy=0x7feff80cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.523+0000 7feffda6a640 1 -- 172.21.15.139:0/86092545 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff815c680 con 0x7feff815feb0 2024-04-26T18:06:01.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7feffda6a640 1 --2- 172.21.15.139:0/86092545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff815feb0 0x7feff80cdaf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feff806d570 tx=0x7fefe802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aef87c4fbb8c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7feffd269640 1 -- 172.21.15.139:0/86092545 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8037070 con 0x7feff815feb0 2024-04-26T18:06:01.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7feffd269640 1 -- 172.21.15.139:0/86092545 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe8032440 con 0x7feff815feb0 2024-04-26T18:06:01.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7feffd269640 1 -- 172.21.15.139:0/86092545 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8032810 con 0x7feff815feb0 2024-04-26T18:06:01.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 -- 172.21.15.139:0/86092545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff815feb0 msgr2=0x7feff80cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 --2- 172.21.15.139:0/86092545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff815feb0 0x7feff80cdaf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feff806d570 tx=0x7fefe802a2c0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 -- 172.21.15.139:0/86092545 shutdown_connections 2024-04-26T18:06:01.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 --2- 172.21.15.139:0/86092545 >> v2:172.21.15.143:3300/0 conn(0x7feff80ce030 0x7feff80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 --2- 172.21.15.139:0/86092545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff815feb0 0x7feff80cdaf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 -- 172.21.15.139:0/86092545 >> 172.21.15.139:0/86092545 conn(0x7feff8068090 msgr2=0x7feff80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 -- 172.21.15.139:0/86092545 shutdown_connections 2024-04-26T18:06:01.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.524+0000 7ff0004cf640 1 -- 172.21.15.139:0/86092545 wait complete. 2024-04-26T18:06:01.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 Processor -- start 2024-04-26T18:06:01.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 -- start start 2024-04-26T18:06:01.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feff80ce030 0x7feff81e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff8155fa0 0x7feff81f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feff815feb0 0x7feff81e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feff815bd90 con 0x7feff8155fa0 2024-04-26T18:06:01.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7feff815cc40 con 0x7feff815feb0 2024-04-26T18:06:01.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7ff0004cf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7feff8156380 con 0x7feff80ce030 2024-04-26T18:06:01.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7feffda6a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff8155fa0 0x7feff81f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7feffda6a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff8155fa0 0x7feff81f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57516/0 (socket says 172.21.15.139:57516) 2024-04-26T18:06:01.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7feffda6a640 1 -- 172.21.15.139:0/1389984951 learned_addr learned my addr 172.21.15.139:0/1389984951 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:01.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.526+0000 7feffe26b640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feff80ce030 0x7feff81e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7feffea6c640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feff815feb0 0x7feff81e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7feffda6a640 1 -- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feff80ce030 msgr2=0x7feff81e6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7feffda6a640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feff80ce030 0x7feff81e6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7feffda6a640 1 -- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feff815feb0 msgr2=0x7feff81e53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7feffda6a640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feff815feb0 0x7feff81e53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7feffda6a640 1 -- 172.21.15.139:0/1389984951 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff815f260 con 0x7feff8155fa0 2024-04-26T18:06:01.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7feffda6a640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff8155fa0 0x7feff81f5110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fefe802a300 tx=0x7fefe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7fefeeffd640 1 -- 172.21.15.139:0/1389984951 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8041020 con 0x7feff8155fa0 2024-04-26T18:06:01.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7fefeeffd640 1 -- 172.21.15.139:0/1389984951 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe80306c0 con 0x7feff8155fa0 2024-04-26T18:06:01.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff814ac20 con 0x7feff8155fa0 2024-04-26T18:06:01.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7fefeeffd640 1 -- 172.21.15.139:0/1389984951 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8037040 con 0x7feff8155fa0 2024-04-26T18:06:01.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.527+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff81f5650 con 0x7feff8155fa0 2024-04-26T18:06:01.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.528+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff8069ae0 con 0x7feff8155fa0 2024-04-26T18:06:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.529+0000 7fefeeffd640 1 -- 172.21.15.139:0/1389984951 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefe8044020 con 0x7feff8155fa0 2024-04-26T18:06:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.529+0000 7fefeeffd640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefdc06c920 0x7fefdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.529+0000 7fefeeffd640 1 -- 172.21.15.139:0/1389984951 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fefe80ac620 con 0x7feff8155fa0 2024-04-26T18:06:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.529+0000 7feffe26b640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefdc06c920 0x7fefdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.529+0000 7feffe26b640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefdc06c920 0x7fefdc06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feff4004f60 tx=0x7feff4007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.533+0000 7fefeeffd640 1 -- 172.21.15.139:0/1389984951 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fefe804b030 con 0x7feff8155fa0 2024-04-26T18:06:01.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.744+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feff80ccd90 con 0x7feff8155fa0 2024-04-26T18:06:01.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.744+0000 7fefeeffd640 1 -- 172.21.15.139:0/1389984951 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7feff80ccd90 con 0x7feff8155fa0 2024-04-26T18:06:01.745 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:06:01.745 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:06:01.745 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:06:01.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefdc06c920 msgr2=0x7fefdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefdc06c920 0x7fefdc06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feff4004f60 tx=0x7feff4007e30 comp rx=0 tx=0).stop 2024-04-26T18:06:01.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff8155fa0 msgr2=0x7feff81f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff8155fa0 0x7feff81f5110 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fefe802a300 tx=0x7fefe80046c0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 shutdown_connections 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefdc06c920 0x7fefdc06ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7feff815feb0 0x7feff81e53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feff8155fa0 0x7feff81f5110 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 --2- 172.21.15.139:0/1389984951 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7feff80ce030 0x7feff81e6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 >> 172.21.15.139:0/1389984951 conn(0x7feff8068090 msgr2=0x7feff80b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 shutdown_connections 2024-04-26T18:06:01.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.746+0000 7ff0004cf640 1 -- 172.21.15.139:0/1389984951 wait complete. 2024-04-26T18:06:01.757 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 290b9d6d --release --await' 2024-04-26T18:06:01.757 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 290b9d6d --release --await 2024-04-26T18:06:01.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.861+0000 7f9e37951640 1 Processor -- start 2024-04-26T18:06:01.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.861+0000 7f9e37951640 1 -- start start 2024-04-26T18:06:01.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e37951640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9e30152bc0 0x7f9e300c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e37951640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e300c4ec0 0x7f9e300ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e37951640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e300c4770 con 0x7f9e30072f20 2024-04-26T18:06:01.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e37951640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f9e300733f0 con 0x7f9e30152bc0 2024-04-26T18:06:01.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e37951640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e3006d2f0 con 0x7f9e300c4ec0 2024-04-26T18:06:01.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e356ed640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9e30152bc0 0x7f9e300c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e34eec640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f9e30072f20 0x7f9e300c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43448/0 (socket says 172.21.15.139:43448) 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e34eec640 1 -- 172.21.15.139:0/2448285477 learned_addr learned my addr 172.21.15.139:0/2448285477 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e35eee640 1 --2- 172.21.15.139:0/2448285477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e300c4ec0 0x7f9e300ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e356ed640 1 -- 172.21.15.139:0/2448285477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e300c4ec0 msgr2=0x7f9e300ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e356ed640 1 --2- 172.21.15.139:0/2448285477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e300c4ec0 0x7f9e300ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e356ed640 1 -- 172.21.15.139:0/2448285477 >> v1:172.21.15.139:6789/0 conn(0x7f9e30072f20 legacy=0x7f9e300c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e27fff640 1 -- 172.21.15.139:0/2448285477 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818387214 0 0) 0x7f9e300c4770 con 0x7f9e30072f20 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e356ed640 1 -- 172.21.15.139:0/2448285477 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e30074470 con 0x7f9e30152bc0 2024-04-26T18:06:01.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.862+0000 7f9e35eee640 1 --2- 172.21.15.139:0/2448285477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e300c4ec0 0x7f9e300ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:01.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.863+0000 7f9e356ed640 1 --2- 172.21.15.139:0/2448285477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30152bc0 0x7f9e300c8a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0097a0 tx=0x7f9e2c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c6446b365696ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.863+0000 7f9e27fff640 1 -- 172.21.15.139:0/2448285477 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c037070 con 0x7f9e30152bc0 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.863+0000 7f9e27fff640 1 -- 172.21.15.139:0/2448285477 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2c032440 con 0x7f9e30152bc0 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.863+0000 7f9e27fff640 1 -- 172.21.15.139:0/2448285477 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c032810 con 0x7f9e30152bc0 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 -- 172.21.15.139:0/2448285477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30152bc0 msgr2=0x7f9e300c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 --2- 172.21.15.139:0/2448285477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30152bc0 0x7f9e300c8a30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0097a0 tx=0x7f9e2c02a210 comp rx=0 tx=0).stop 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 -- 172.21.15.139:0/2448285477 shutdown_connections 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 --2- 172.21.15.139:0/2448285477 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e300c4ec0 0x7f9e300ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 --2- 172.21.15.139:0/2448285477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30152bc0 0x7f9e300c8a30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 -- 172.21.15.139:0/2448285477 >> 172.21.15.139:0/2448285477 conn(0x7f9e3006ed70 msgr2=0x7f9e3006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 -- 172.21.15.139:0/2448285477 shutdown_connections 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.864+0000 7f9e37951640 1 -- 172.21.15.139:0/2448285477 wait complete. 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.865+0000 7f9e37951640 1 Processor -- start 2024-04-26T18:06:01.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.865+0000 7f9e37951640 1 -- start start 2024-04-26T18:06:01.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.865+0000 7f9e37951640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30072f20 0x7f9e301e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.865+0000 7f9e37951640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e300c4ec0 0x7f9e30140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e37951640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e30152bc0 0x7f9e30140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e37951640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9e300c4250 con 0x7f9e30072f20 2024-04-26T18:06:01.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e37951640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9e300c3f70 con 0x7f9e300c4ec0 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e37951640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e30152fa0 con 0x7f9e30152bc0 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30072f20 0x7f9e301e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30072f20 0x7f9e301e5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57540/0 (socket says 172.21.15.139:57540) 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 -- 172.21.15.139:0/874433110 learned_addr learned my addr 172.21.15.139:0/874433110 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e35eee640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e30152bc0 0x7f9e30140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 -- 172.21.15.139:0/874433110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e30152bc0 msgr2=0x7f9e30140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e30152bc0 0x7f9e30140eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 -- 172.21.15.139:0/874433110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e300c4ec0 msgr2=0x7f9e30140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e300c4ec0 0x7f9e30140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 -- 172.21.15.139:0/874433110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e301e2ea0 con 0x7f9e30072f20 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e356ed640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30072f20 0x7f9e301e5110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0098c0 tx=0x7f9e2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e25ffb640 1 -- 172.21.15.139:0/874433110 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c037040 con 0x7f9e30072f20 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e25ffb640 1 -- 172.21.15.139:0/874433110 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2c042070 con 0x7f9e30072f20 2024-04-26T18:06:01.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e301e4830 con 0x7f9e30072f20 2024-04-26T18:06:01.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e25ffb640 1 -- 172.21.15.139:0/874433110 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c030a70 con 0x7f9e30072f20 2024-04-26T18:06:01.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.866+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e301f63f0 con 0x7f9e30072f20 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.868+0000 7f9e25ffb640 1 -- 172.21.15.139:0/874433110 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e2c030c10 con 0x7f9e30072f20 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.868+0000 7f9e25ffb640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9e1406c8f0 0x7f9e1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.868+0000 7f9e25ffb640 1 -- 172.21.15.139:0/874433110 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f9e2c0acb00 con 0x7f9e30072f20 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.868+0000 7f9e34eec640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9e1406c8f0 0x7f9e1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.869+0000 7f9e34eec640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9e1406c8f0 0x7f9e1406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e20007fd0 tx=0x7f9e20007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.869+0000 7f9e3a66d740 1 Processor -- start 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.869+0000 7f9e3a66d740 1 -- start start 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce96841470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce96802890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce96803a10 0x55ce96802dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ce96767040 con 0x55ce968024b0 2024-04-26T18:06:01.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ce96702b60 con 0x55ce968419b0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ce96763000 con 0x55ce96803a10 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce96841470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce96841470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57554/0 (socket says 172.21.15.139:57554) 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 -- 172.21.15.139:0/3269834524 learned_addr learned my addr 172.21.15.139:0/3269834524 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e35eee640 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce96803a10 0x55ce96802dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e34eec640 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce96802890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 -- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce96803a10 msgr2=0x55ce96802dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce96803a10 0x55ce96802dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 -- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 msgr2=0x55ce96802890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce96802890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.870+0000 7f9e356ed640 1 -- 172.21.15.139:0/3269834524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce966f79c0 con 0x55ce968024b0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e356ed640 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce96841470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c082aa0 tx=0x7f9e2c079cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fde950d1cd0273 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e1affd640 1 -- 172.21.15.139:0/3269834524 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c07a360 con 0x55ce968024b0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e1affd640 1 -- 172.21.15.139:0/3269834524 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2c07e710 con 0x55ce968024b0 2024-04-26T18:06:01.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e1affd640 1 -- 172.21.15.139:0/3269834524 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c082fd0 con 0x55ce968024b0 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 -- 172.21.15.139:0/3269834524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 msgr2=0x55ce96841470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce96841470 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c082aa0 tx=0x7f9e2c079cc0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 -- 172.21.15.139:0/3269834524 shutdown_connections 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce96803a10 0x55ce96802dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce96802890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/3269834524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce96841470 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 -- 172.21.15.139:0/3269834524 >> 172.21.15.139:0/3269834524 conn(0x55ce967c9930 msgr2=0x55ce96846450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 -- 172.21.15.139:0/3269834524 shutdown_connections 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.871+0000 7f9e3a66d740 1 -- 172.21.15.139:0/3269834524 wait complete. 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.872+0000 7f9e3a66d740 1 -- start start 2024-04-26T18:06:01.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.872+0000 7f9e3a66d740 1 Processor -- start 2024-04-26T18:06:01.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce9683f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce96803a10 0x55ce968562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9682ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ce96800af0 con 0x55ce968024b0 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ce967004f0 con 0x55ce96803a10 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ce96804040 con 0x55ce968419b0 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 10 client.0 _ll_register_callbacks cb 0x55ce9675dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce9683f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce9683f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57570/0 (socket says 172.21.15.139:57570) 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 -- 172.21.15.139:0/972785618 learned_addr learned my addr 172.21.15.139:0/972785618 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e35eee640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9682ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e34eec640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce96803a10 0x55ce968562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 -- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 msgr2=0x55ce9682ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9682ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 -- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce96803a10 msgr2=0x55ce968562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce96803a10 0x55ce968562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 -- 172.21.15.139:0/972785618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce96478920 con 0x55ce968024b0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e356ed640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce9683f7c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0aac40 tx=0x7f9e2c006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854c75f9a87b1ae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e0ffff640 1 -- 172.21.15.139:0/972785618 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c082fd0 con 0x55ce968024b0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e0ffff640 1 -- 172.21.15.139:0/972785618 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f9e2c08ee00 con 0x55ce968024b0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e2c07e710 con 0x55ce968024b0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.873+0000 7f9e0ffff640 1 -- 172.21.15.139:0/972785618 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9e2c07a7d0 con 0x55ce968024b0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 10 client.5127 fetch_fsmap learned FSMap version 9 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ce96544d30 con 0x55ce968024b0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e0ffff640 1 -- 172.21.15.139:0/972785618 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e2c07e710 con 0x55ce968024b0 2024-04-26T18:06:01.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e0ffff640 1 -- 172.21.15.139:0/972785618 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f9e2c03a030 con 0x55ce968024b0 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 10 client.5127 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 10 client.5127 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 20 client.5127 populate_metadata read hostname 'smithi139' 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 0x55ce96829320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 4 client.5127 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce9673aa00 con 0x55ce9682d380 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e34eec640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 0x55ce96829320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e0ffff640 10 client.5127 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.874+0000 7f9e34eec640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 0x55ce96829320 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2fa3bd9a91fcba server_cookie=400d5d485a9a171c in_seq=0 out_seq=0 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e0ffff640 1 -- 172.21.15.139:0/972785618 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ce9673aa00 con 0x55ce9682d380 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e0ffff640 10 client.5127 handle_command_reply: tid=0 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 client.5127 shutdown 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e34eec640 1 -- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 msgr2=0x55ce96829320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-26T18:06:01.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e34eec640 1 -- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 msgr2=0x55ce96829320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e34eec640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 0x55ce96829320 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e34eec640 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 0x55ce96829320 unknown :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 msgr2=0x55ce9683f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce9683f7c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0aac40 tx=0x7f9e2c006ef0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 shutdown_connections 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce9682d380 0x55ce96829320 unknown :-1 s=BANNER_CONNECTING pgs=131 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9682ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce96803a10 0x55ce968562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/972785618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce968024b0 0x55ce9683f7c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e0ffff640 0 client.5127 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 >> 172.21.15.139:0/972785618 conn(0x55ce967c9930 msgr2=0x55ce9682bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 shutdown_connections 2024-04-26T18:06:01.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 1 -- 172.21.15.139:0/972785618 wait complete. 2024-04-26T18:06:01.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.875+0000 7f9e3a66d740 20 client.5127 trim_cache size 0 max 16384 2024-04-26T18:06:01.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.892+0000 7f9e3a66d740 1 Processor -- start 2024-04-26T18:06:01.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.892+0000 7f9e3a66d740 1 -- start start 2024-04-26T18:06:01.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968024b0 0x55ce96826530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce96826a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce9683e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30200630 con 0x55ce96803a10 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301ff510 con 0x55ce968419b0 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e301f2ae0 con 0x55ce968024b0 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce96826a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce96826a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57578/0 (socket says 172.21.15.139:57578) 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 -- 172.21.15.139:0/1798320927 learned_addr learned my addr 172.21.15.139:0/1798320927 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e356ed640 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968024b0 0x55ce96826530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e35eee640 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce9683e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 -- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968024b0 msgr2=0x55ce96826530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968024b0 0x55ce96826530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 -- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 msgr2=0x55ce9683e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce9683e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 -- 172.21.15.139:0/1798320927 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9682d1b0 con 0x55ce96803a10 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e356ed640 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968024b0 0x55ce96826530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e35eee640 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce9683e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e34eec640 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce96826a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005ac0 tx=0x7f9e2000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c880d711634f7db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e1a7fc640 1 -- 172.21.15.139:0/1798320927 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20026590 con 0x55ce96803a10 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e1a7fc640 1 -- 172.21.15.139:0/1798320927 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e20026730 con 0x55ce96803a10 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.893+0000 7f9e1a7fc640 1 -- 172.21.15.139:0/1798320927 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20013420 con 0x55ce96803a10 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1798320927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 msgr2=0x55ce96826a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce96826a70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005ac0 tx=0x7f9e2000f000 comp rx=0 tx=0).stop 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1798320927 shutdown_connections 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968419b0 0x55ce9683e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce96826a70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1798320927 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968024b0 0x55ce96826530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1798320927 >> 172.21.15.139:0/1798320927 conn(0x55ce967c9930 msgr2=0x55ce96841d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1798320927 shutdown_connections 2024-04-26T18:06:01.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.894+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1798320927 wait complete. 2024-04-26T18:06:01.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 -- start start 2024-04-26T18:06:01.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 Processor -- start 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968024b0 0x55ce96802c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce968509b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9684fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301442c0 con 0x55ce96803a10 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301fee70 con 0x55ce968024b0 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.895+0000 7f9e3a66d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9e301fe7a0 con 0x55ce968419b0 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e3a66d740 10 client.0 _ll_register_callbacks cb 0x7f9e20001350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce968509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce968509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57594/0 (socket says 172.21.15.139:57594) 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 -- 172.21.15.139:0/1359435838 learned_addr learned my addr 172.21.15.139:0/1359435838 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e35eee640 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9684fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e356ed640 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968024b0 0x55ce96802c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 -- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 msgr2=0x55ce9684fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9684fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 -- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968024b0 msgr2=0x55ce96802c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968024b0 0x55ce96802c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 -- 172.21.15.139:0/1359435838 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce96850ef0 con 0x55ce96803a10 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e34eec640 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce968509b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005ac0 tx=0x7f9e200010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a309776efcb124 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e0ffff640 1 -- 172.21.15.139:0/1359435838 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20037060 con 0x55ce96803a10 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e0ffff640 1 -- 172.21.15.139:0/1359435838 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f9e20014ab0 con 0x55ce96803a10 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e20026730 con 0x55ce96803a10 2024-04-26T18:06:01.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e0ffff640 1 -- 172.21.15.139:0/1359435838 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9e20014cb0 con 0x55ce96803a10 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e3a66d740 10 client.5133 fetch_fsmap learned FSMap version 9 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ce968668d0 con 0x55ce96803a10 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.896+0000 7f9e0ffff640 1 -- 172.21.15.139:0/1359435838 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e20026730 con 0x55ce96803a10 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e0ffff640 1 -- 172.21.15.139:0/1359435838 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f9e20038260 con 0x55ce96803a10 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 10 client.5133 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 10 client.5133 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 20 client.5133 populate_metadata read hostname 'smithi139' 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce96851930 0x55ce968b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 4 client.5133 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "290b9d6d", "release": true, "await": true}] 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "290b9d6d", "release": true, "await": true}) -- 0x55ce96801720 con 0x55ce96851930 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e356ed640 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce96851930 0x55ce968b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e0ffff640 10 client.5133 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e356ed640 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce96851930 0x55ce968b55f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd537cdd130a91fc server_cookie=67b2acf6682d6c8 in_seq=0 out_seq=0 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e0ffff640 1 -- 172.21.15.139:0/1359435838 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55ce96801720 con 0x55ce96851930 2024-04-26T18:06:01.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e0ffff640 10 client.5133 handle_command_reply: tid=0 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 1 client.5133 shutdown 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 msgr2=0x55ce968509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.897+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce968509b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005ac0 tx=0x7f9e200010f0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 shutdown_connections 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ce96851930 0x55ce968b55f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ce968419b0 0x55ce9684fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e0ffff640 0 client.5133 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce96803a10 0x55ce968509b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 --2- 172.21.15.139:0/1359435838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ce968024b0 0x55ce96802c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 >> 172.21.15.139:0/1359435838 conn(0x55ce967c9930 msgr2=0x55ce967fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 shutdown_connections 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 1 -- 172.21.15.139:0/1359435838 wait complete. 2024-04-26T18:06:01.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e3a66d740 20 client.5133 trim_cache size 0 max 16384 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 24, 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "290b9d6d": { 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 24, 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:06:01.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 89.7, 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:06:01.906 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:06:01.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9e1406c8f0 msgr2=0x7f9e1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9e1406c8f0 0x7f9e1406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e20007fd0 tx=0x7f9e20007920 comp rx=0 tx=0).stop 2024-04-26T18:06:01.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30072f20 msgr2=0x7f9e301e5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30072f20 0x7f9e301e5110 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0098c0 tx=0x7f9e2c0046c0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 shutdown_connections 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9e1406c8f0 0x7f9e1406edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9e30152bc0 0x7f9e30140eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9e300c4ec0 0x7f9e30140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 --2- 172.21.15.139:0/874433110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e30072f20 0x7f9e301e5110 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 >> 172.21.15.139:0/874433110 conn(0x7f9e3006ed70 msgr2=0x7f9e30145e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 shutdown_connections 2024-04-26T18:06:01.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:01.898+0000 7f9e37951640 1 -- 172.21.15.139:0/874433110 wait complete. 2024-04-26T18:06:01.909 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '290b9d6d', seconds elapsed: 37.2 2024-04-26T18:06:07.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:07.180 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:37.324 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:37.327 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:40.914 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 2% (265/12492) Updating files: 3% (375/12492) Updating files: 4% (500/12492) Updating files: 4% (511/12492) Updating files: 4% (513/12492) Updating files: 5% (625/12492) Updating files: 5% (627/12492) Updating files: 6% (750/12492) Updating files: 6% (827/12492) Updating files: 7% (875/12492) Updating files: 7% (910/12492) Updating files: 8% (1000/12492) Updating files: 8% (1045/12492) Updating files: 8% (1093/12492) Updating files: 9% (1125/12492) Updating files: 9% (1202/12492) Updating files: 10% (1250/12492) Updating files: 11% (1375/12492) Updating files: 12% (1500/12492) Updating files: 12% (1568/12492) Updating files: 12% (1583/12492) Updating files: 13% (1624/12492) Updating files: 13% (1650/12492) Updating files: 14% (1749/12492) Updating files: 14% (1813/12492) Updating files: 15% (1874/12492) Updating files: 15% (1989/12492) Updating files: 16% (1999/12492) Updating files: 16% (2096/12492) Updating files: 17% (2124/12492) Updating files: 17% (2204/12492) Updating files: 18% (2249/12492) Updating files: 18% (2312/12492) Updating files: 19% (2374/12492) Updating files: 19% (2468/12492) Updating files: 20% (2499/12492) Updating files: 21% (2624/12492) Updating files: 22% (2749/12492) Updating files: 22% (2764/12492) Updating files: 22% (2841/12492) Updating files: 23% (2874/12492) Updating files: 23% (2933/12492) Updating files: 24% (2999/12492) Updating files: 24% (3067/12492) Updating files: 25% (3123/12492) Updating files: 25% (3231/12492) Updating files: 26% (3248/12492) Updating files: 27% (3373/12492) Updating files: 27% (3382/12492) Updating files: 28% (3498/12492) Updating files: 28% (3520/12492) Updating files: 28% (3587/12492) Updating files: 29% (3623/12492) Updating files: 29% (3685/12492) Updating files: 30% (3748/12492) Updating files: 30% (3794/12492) Updating files: 31% (3873/12492) Updating files: 31% (3884/12492) Updating files: 31% (3929/12492) Updating files: 32% (3998/12492) Updating files: 32% (4045/12492) Updating files: 32% (4050/12492) Updating files: 33% (4123/12492) Updating files: 34% (4248/12492) Updating files: 34% (4260/12492) Updating files: 35% (4373/12492) Updating files: 35% (4445/12492) Updating files: 36% (4498/12492) Updating files: 36% (4510/12492) Updating files: 37% (4623/12492) Updating files: 38% (4747/12492) Updating files: 39% (4872/12492) Updating files: 40% (4997/12492) Updating files: 40% (5084/12492) Updating files: 41% (5122/12492) Updating files: 41% (5218/12492) Updating files: 42% (5247/12492) Updating files: 42% (5352/12492) Updating files: 43% (5372/12492) Updating files: 43% (5411/12492) Updating files: 44% (5497/12492) Updating files: 44% (5598/12492) Updating files: 45% (5622/12492) Updating files: 45% (5699/12492) Updating files: 46% (5747/12492) Updating files: 46% (5870/12492) Updating files: 47% (5872/12492) Updating files: 47% (5882/12492) Updating files: 47% (5957/12492) Updating files: 47% (5962/12492) Updating files: 48% (5997/12492) Updating files: 48% (6075/12492) Updating files: 49% (6122/12492) Updating files: 50% (6246/12492) Updating files: 51% (6371/12492) Updating files: 52% (6496/12492) Updating files: 52% (6522/12492) Updating files: 53% (6621/12492) Updating files: 53% (6649/12492) Updating files: 54% (6746/12492) Updating files: 55% (6871/12492) Updating files: 56% (6996/12492) Updating files: 56% (7059/12492) Updating files: 57% (7121/12492) Updating files: 58% (7246/12492) Updating files: 59% (7371/12492) Updating files: 59% (7408/12492) Updating files: 59% (7410/12492) Updating files: 59% (7453/12492) Updating files: 60% (7496/12492) Updating files: 60% (7534/12492) Updating files: 60% (7538/12492) Updating files: 60% (7610/12492) Updating files: 61% (7621/12492) Updating files: 62% (7746/12492) Updating files: 62% (7858/12492) Updating files: 63% (7870/12492) Updating files: 64% (7995/12492) Updating files: 64% (8028/12492) Updating files: 65% (8120/12492) Updating files: 65% (8186/12492) Updating files: 66% (8245/12492) Updating files: 66% (8316/12492) Updating files: 67% (8370/12492) Updating files: 67% (8427/12492) Updating files: 67% (8464/12492) Updating files: 68% (8495/12492) Updating files: 69% (8620/12492) Updating files: 69% (8704/12492) Updating files: 70% (8745/12492) Updating files: 70% (8752/12492) Updating files: 71% (8870/12492) Updating files: 71% (8887/12492) Updating files: 72% (8995/12492) Updating files: 72% (9010/12492) Updating files: 72% (9033/12492) Updating files: 72% (9104/12492) Updating files: 73% (9120/12492) Updating files: 73% (9170/12492) Updating files: 74% (9245/12492) Updating files: 74% (9359/12492) Updating files: 75% (9369/12492) Updating files: 75% (9491/12492) Updating files: 76% (9494/12492) Updating files: 77% (9619/12492) Updating files: 77% (9741/12492) Updating files: 78% (9744/12492) Updating files: 79% (9869/12492) Updating files: 79% (9898/12492) Updating files: 79% (9960/12492) Updating files: 80% (9994/12492) Updating files: 81% (10119/12492) Updating files: 81% (10131/12492) Updating files: 82% (10244/12492) Updating files: 82% (10267/12492) Updating files: 83% (10369/12492) Updating files: 84% (10494/12492) Updating files: 84% (10555/12492) Updating files: 84% (10618/12492) Updating files: 85% (10619/12492) Updating files: 86% (10744/12492) Updating files: 87% (10869/12492) Updating files: 87% (10933/12492) Updating files: 87% (10973/12492) Updating files: 88% (10993/12492) Updating files: 88% (11007/12492) Updating files: 88% (11009/12492) Updating files: 89% (11118/12492) Updating files: 90% (11243/12492) Updating files: 90% (11249/12492) Updating files: 90% (11362/12492) Updating files: 91% (11368/12492) Updating files: 91% (11403/12492) Updating files: 92% (11493/12492) Updating files: 92% (11615/12492) Updating files: 93% (11618/12492) Updating files: 93% (11707/12492) Updating files: 94% (11743/12492) Updating files: 94% (11772/12492) Updating files: 95% (11868/12492) Updating files: 95% (11881/12492) Updating files: 95% (11953/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 98% (12257/12492) Updating files: 99% (12368/12492) Updating files: 99% (12405/12492) Updating files: 99% (12490/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-26T18:06:42.107 INFO:tasks.workunit.client.0.smithi139.stderr:+ trap - EXIT 2024-04-26T18:06:42.107 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ceph 2024-04-26T18:06:42.107 INFO:tasks.workunit.client.0.smithi139.stderr:++ seq 1 90 2024-04-26T18:06:42.108 INFO:tasks.workunit.client.0.smithi139.stderr:+ versions='1 2024-04-26T18:06:42.108 INFO:tasks.workunit.client.0.smithi139.stderr:2 2024-04-26T18:06:42.108 INFO:tasks.workunit.client.0.smithi139.stderr:3 2024-04-26T18:06:42.108 INFO:tasks.workunit.client.0.smithi139.stderr:4 2024-04-26T18:06:42.108 INFO:tasks.workunit.client.0.smithi139.stderr:5 2024-04-26T18:06:42.108 INFO:tasks.workunit.client.0.smithi139.stderr:6 2024-04-26T18:06:42.108 INFO:tasks.workunit.client.0.smithi139.stderr:7 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:8 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:9 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:10 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:11 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:12 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:13 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:14 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:15 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:16 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:17 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:18 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:19 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:20 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:21 2024-04-26T18:06:42.109 INFO:tasks.workunit.client.0.smithi139.stderr:22 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:23 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:24 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:25 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:26 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:27 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:28 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:29 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:30 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:31 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:32 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:33 2024-04-26T18:06:42.110 INFO:tasks.workunit.client.0.smithi139.stderr:34 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:35 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:36 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:37 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:38 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:39 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:40 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:41 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:42 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:43 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:44 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:45 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:46 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:47 2024-04-26T18:06:42.111 INFO:tasks.workunit.client.0.smithi139.stderr:48 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:49 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:50 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:51 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:52 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:53 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:54 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:55 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:56 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:57 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:58 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:59 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:60 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:61 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:62 2024-04-26T18:06:42.112 INFO:tasks.workunit.client.0.smithi139.stderr:63 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:64 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:65 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:66 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:67 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:68 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:69 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:70 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:71 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:72 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:73 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:74 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:75 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:76 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:77 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:78 2024-04-26T18:06:42.113 INFO:tasks.workunit.client.0.smithi139.stderr:79 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:80 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:81 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:82 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:83 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:84 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:85 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:86 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:87 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:88 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:89 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:90' 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:06:42.114 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 1 -eq 48 ']' 2024-04-26T18:06:42.115 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.1 2024-04-26T18:06:42.115 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.1 2024-04-26T18:06:42.115 INFO:tasks.workunit.client.0.smithi139.stdout:v0.1 2024-04-26T18:06:42.115 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.1 2024-04-26T18:06:57.067 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:06:57.068 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.2 2024-04-26T18:06:57.068 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:06:57.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.178+0000 7f01ca90a640 1 Processor -- start 2024-04-26T18:06:57.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.178+0000 7f01ca90a640 1 -- start start 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01ca90a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f01c4153b10 0x7f01c40c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01ca90a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c40cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01ca90a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f01c40cd9a0 0x7f01c415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01ca90a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f01c406e8d0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01ca90a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f01c4073910 con 0x7f01c4153b10 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01ca90a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f01c40c7d30 con 0x7f01c406e240 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f01c40cd9a0 0x7f01c415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f01c40cd9a0 0x7f01c415ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51812/0 (socket says 172.21.15.139:51812) 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 -- 172.21.15.139:0/3533161785 learned_addr learned my addr 172.21.15.139:0/3533161785 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c37fe640 1 --2- 172.21.15.139:0/3533161785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c40cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c3fff640 1 --2- 172.21.15.139:0/3533161785 >> v2:172.21.15.143:3300/0 conn(0x7f01c4153b10 0x7f01c40c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 -- 172.21.15.139:0/3533161785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 msgr2=0x7f01c40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 --2- 172.21.15.139:0/3533161785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c40cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 -- 172.21.15.139:0/3533161785 >> v2:172.21.15.143:3300/0 conn(0x7f01c4153b10 msgr2=0x7f01c40c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 --2- 172.21.15.139:0/3533161785 >> v2:172.21.15.143:3300/0 conn(0x7f01c4153b10 0x7f01c40c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.179+0000 7f01c8ea7640 1 -- 172.21.15.139:0/3533161785 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c40c7ff0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.180+0000 7f01c8ea7640 1 --2- 172.21.15.139:0/3533161785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c415ce60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f01c40c7580 tx=0x7f01bc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad2c589fc0511d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.180+0000 7f01c2ffd640 1 -- 172.21.15.139:0/3533161785 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc036070 con 0x7f01c40cd9a0 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.180+0000 7f01c2ffd640 1 -- 172.21.15.139:0/3533161785 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01bc031600 con 0x7f01c40cd9a0 2024-04-26T18:06:57.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.180+0000 7f01c2ffd640 1 -- 172.21.15.139:0/3533161785 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0319d0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 -- 172.21.15.139:0/3533161785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 msgr2=0x7f01c415ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 --2- 172.21.15.139:0/3533161785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c415ce60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f01c40c7580 tx=0x7f01bc02a730 comp rx=0 tx=0).stop 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 -- 172.21.15.139:0/3533161785 shutdown_connections 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 --2- 172.21.15.139:0/3533161785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c415ce60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 --2- 172.21.15.139:0/3533161785 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c40cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 --2- 172.21.15.139:0/3533161785 >> v2:172.21.15.143:3300/0 conn(0x7f01c4153b10 0x7f01c40c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 -- 172.21.15.139:0/3533161785 >> 172.21.15.139:0/3533161785 conn(0x7f01c4068270 msgr2=0x7f01c4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 -- 172.21.15.139:0/3533161785 shutdown_connections 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.181+0000 7f01ca90a640 1 -- 172.21.15.139:0/3533161785 wait complete. 2024-04-26T18:06:57.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.182+0000 7f01ca90a640 1 Processor -- start 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.182+0000 7f01ca90a640 1 -- start start 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01ca90a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c41f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01ca90a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c4149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01ca90a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c4153b10 0x7f01c414cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01ca90a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f01c40735a0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01ca90a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f01c40732c0 con 0x7f01c4153b10 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01ca90a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f01c4153ef0 con 0x7f01c406e240 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c4149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c4149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51822/0 (socket says 172.21.15.139:51822) 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 -- 172.21.15.139:0/1463559437 learned_addr learned my addr 172.21.15.139:0/1463559437 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c3fff640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c41f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c8ea7640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c4153b10 0x7f01c414cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 -- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 msgr2=0x7f01c41f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c41f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 -- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c4153b10 msgr2=0x7f01c414cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c4153b10 0x7f01c414cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.183+0000 7f01c37fe640 1 -- 172.21.15.139:0/1463559437 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c415adf0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.184+0000 7f01c37fe640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c4149540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01b800e9b0 tx=0x7f01b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.184+0000 7f01c0ff9640 1 -- 172.21.15.139:0/1463559437 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8017070 con 0x7f01c40cd9a0 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.184+0000 7f01c0ff9640 1 -- 172.21.15.139:0/1463559437 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b800c9a0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.184+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c415a830 con 0x7f01c40cd9a0 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.184+0000 7f01c0ff9640 1 -- 172.21.15.139:0/1463559437 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b800cd90 con 0x7f01c40cd9a0 2024-04-26T18:06:57.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.184+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c41ef7c0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.185+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c4076d20 con 0x7f01c40cd9a0 2024-04-26T18:06:57.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.185+0000 7f01c0ff9640 1 -- 172.21.15.139:0/1463559437 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01b801a070 con 0x7f01c40cd9a0 2024-04-26T18:06:57.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.186+0000 7f01c0ff9640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f01b006c920 0x7f01b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.186+0000 7f01c0ff9640 1 -- 172.21.15.139:0/1463559437 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f01b808bdc0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.186+0000 7f01c3fff640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f01b006c920 0x7f01b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.186+0000 7f01c3fff640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f01b006c920 0x7f01b006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009a20 tx=0x7f01b4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.190+0000 7f01c0ff9640 1 -- 172.21.15.139:0/1463559437 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01b80597f0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.424+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01c406eab0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.424+0000 7f01c0ff9640 1 -- 172.21.15.139:0/1463559437 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f01b805daf0 con 0x7f01c40cd9a0 2024-04-26T18:06:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:06:57.425 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:06:57.425 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:06:57.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f01b006c920 msgr2=0x7f01b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f01b006c920 0x7f01b006ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009a20 tx=0x7f01b4009190 comp rx=0 tx=0).stop 2024-04-26T18:06:57.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 msgr2=0x7f01c4149540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c4149540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01b800e9b0 tx=0x7f01b800ee70 comp rx=0 tx=0).stop 2024-04-26T18:06:57.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 shutdown_connections 2024-04-26T18:06:57.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f01b006c920 0x7f01b006ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f01c4153b10 0x7f01c414cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01c40cd9a0 0x7f01c4149540 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 --2- 172.21.15.139:0/1463559437 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f01c406e240 0x7f01c41f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.426+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 >> 172.21.15.139:0/1463559437 conn(0x7f01c4068270 msgr2=0x7f01c406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:57.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.427+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 shutdown_connections 2024-04-26T18:06:57.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.427+0000 7f01ca90a640 1 -- 172.21.15.139:0/1463559437 wait complete. 2024-04-26T18:06:57.438 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0' 2024-04-26T18:06:57.438 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0 2024-04-26T18:06:57.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.550+0000 7f62bd9da640 1 Processor -- start 2024-04-26T18:06:57.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.550+0000 7f62bd9da640 1 -- start start 2024-04-26T18:06:57.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62bd9da640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62bd9da640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62b80c7d30 0x7f62b80cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62bd9da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b8156200 con 0x7f62b8155e20 2024-04-26T18:06:57.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62bd9da640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f62b80cd550 con 0x7f62b80c7d30 2024-04-26T18:06:57.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62bd9da640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f62b815c330 con 0x7f62b80c64b0 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62b80c7d30 0x7f62b80cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:57384/0 (socket says 172.21.15.139:57384) 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b6ffd640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f62b8155e20 0x7f62b815bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:34616/0 (socket says 172.21.15.139:34616) 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b77fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f62b80c7d30 0x7f62b80cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:59454/0 (socket says 172.21.15.139:59454) 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b67fc640 1 -- 172.21.15.139:0/1117348801 learned_addr learned my addr 172.21.15.139:0/1117348801 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b67fc640 1 -- 172.21.15.139:0/1117348801 >> v2:172.21.15.143:3300/0 conn(0x7f62b80c7d30 msgr2=0x7f62b80cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b67fc640 1 --2- 172.21.15.139:0/1117348801 >> v2:172.21.15.143:3300/0 conn(0x7f62b80c7d30 0x7f62b80cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b67fc640 1 -- 172.21.15.139:0/1117348801 >> v1:172.21.15.143:6789/0 conn(0x7f62b8155e20 legacy=0x7f62b815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.551+0000 7f62b67fc640 1 -- 172.21.15.139:0/1117348801 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b815c610 con 0x7f62b80c64b0 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.552+0000 7f62b67fc640 1 --2- 172.21.15.139:0/1117348801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80c77f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009870 tx=0x7f62a002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=789e5d7ae79eba86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.552+0000 7f62b5ffb640 1 -- 172.21.15.139:0/1117348801 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0037070 con 0x7f62b80c64b0 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.552+0000 7f62b5ffb640 1 -- 172.21.15.139:0/1117348801 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a002ae50 con 0x7f62b80c64b0 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.552+0000 7f62b5ffb640 1 -- 172.21.15.139:0/1117348801 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0032860 con 0x7f62b80c64b0 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 -- 172.21.15.139:0/1117348801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 msgr2=0x7f62b80c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 --2- 172.21.15.139:0/1117348801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80c77f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009870 tx=0x7f62a002a300 comp rx=0 tx=0).stop 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 -- 172.21.15.139:0/1117348801 shutdown_connections 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 --2- 172.21.15.139:0/1117348801 >> v2:172.21.15.143:3300/0 conn(0x7f62b80c7d30 0x7f62b80cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 --2- 172.21.15.139:0/1117348801 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80c77f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 -- 172.21.15.139:0/1117348801 >> 172.21.15.139:0/1117348801 conn(0x7f62b8072930 msgr2=0x7f62b8072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:57.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 -- 172.21.15.139:0/1117348801 shutdown_connections 2024-04-26T18:06:57.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.553+0000 7f62bd9da640 1 -- 172.21.15.139:0/1117348801 wait complete. 2024-04-26T18:06:57.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.554+0000 7f62bd9da640 1 Processor -- start 2024-04-26T18:06:57.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.554+0000 7f62bd9da640 1 -- start start 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62bd9da640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80d0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62bd9da640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80c7d30 0x7f62b814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62bd9da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62b8155e20 0x7f62b814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62bd9da640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f62b80c72d0 con 0x7f62b80c7d30 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62bd9da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f62b80c6ff0 con 0x7f62b8155e20 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62bd9da640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f62b80c68d0 con 0x7f62b80c64b0 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b6ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80c7d30 0x7f62b814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62b8155e20 0x7f62b814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b6ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:57390/0 (socket says 172.21.15.139:57390) 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b6ffd640 1 -- 172.21.15.139:0/585465079 learned_addr learned my addr 172.21.15.139:0/585465079 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b67fc640 1 -- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 msgr2=0x7f62b80d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b67fc640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b67fc640 1 -- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62b8155e20 msgr2=0x7f62b814f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b67fc640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62b8155e20 0x7f62b814f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b67fc640 1 -- 172.21.15.139:0/585465079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b81e1d90 con 0x7f62b80c7d30 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b77fe640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62b8155e20 0x7f62b814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62b67fc640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80c7d30 0x7f62b814ec20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f62b815c4b0 tx=0x7f62a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.555+0000 7f62affff640 1 -- 172.21.15.139:0/585465079 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0041020 con 0x7f62b80c7d30 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.556+0000 7f62affff640 1 -- 172.21.15.139:0/585465079 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a003c890 con 0x7f62b80c7d30 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.556+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b81e2070 con 0x7f62b80c7d30 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.556+0000 7f62affff640 1 -- 172.21.15.139:0/585465079 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0037040 con 0x7f62b80c7d30 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.556+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b80d08c0 con 0x7f62b80c7d30 2024-04-26T18:06:57.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.557+0000 7f62affff640 1 -- 172.21.15.139:0/585465079 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62a0044020 con 0x7f62b80c7d30 2024-04-26T18:06:57.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.557+0000 7f62affff640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f629806c920 0x7f629806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.558+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f629806c920 0x7f629806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.558+0000 7f62affff640 1 -- 172.21.15.139:0/585465079 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f62a00ac660 con 0x7f62b80c7d30 2024-04-26T18:06:57.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.558+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f629806c920 0x7f629806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62a8000f60 tx=0x7f62a8007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.558+0000 7f62c07c9740 1 Processor -- start 2024-04-26T18:06:57.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.558+0000 7f62c07c9740 1 -- start start 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62c07c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55777b21ed80 con 0x55777b2faae0 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55777b1bac20 con 0x55777b2bcb40 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55777b21ad40 con 0x55777b2bb5e0 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2bb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62b6ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2bb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51846/0 (socket says 172.21.15.139:51846) 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62b67fc640 1 -- 172.21.15.139:0/1718902237 learned_addr learned my addr 172.21.15.139:0/1718902237 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.559+0000 7f62b77fe640 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62b67fc640 1 -- 172.21.15.139:0/1718902237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 msgr2=0x55777b2fa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62b67fc640 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2fa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62b67fc640 1 -- 172.21.15.139:0/1718902237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 msgr2=0x55777b2bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62b67fc640 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2bbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62b67fc640 1 -- 172.21.15.139:0/1718902237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777affcd80 con 0x55777b2faae0 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62b67fc640 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2bb9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f62a0035040 tx=0x7f62a0079ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b004d9595cba3b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62ad7fa640 1 -- 172.21.15.139:0/1718902237 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a007e270 con 0x55777b2faae0 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62ad7fa640 1 -- 172.21.15.139:0/1718902237 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a002ae50 con 0x55777b2faae0 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.560+0000 7f62ad7fa640 1 -- 172.21.15.139:0/1718902237 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0082b30 con 0x55777b2faae0 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 -- 172.21.15.139:0/1718902237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 msgr2=0x55777b2bb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2bb9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f62a0035040 tx=0x7f62a0079ab0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 -- 172.21.15.139:0/1718902237 shutdown_connections 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2bbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2bb9c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 --2- 172.21.15.139:0/1718902237 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2fa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 -- 172.21.15.139:0/1718902237 >> 172.21.15.139:0/1718902237 conn(0x55777b282740 msgr2=0x55777b2ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:57.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 -- 172.21.15.139:0/1718902237 shutdown_connections 2024-04-26T18:06:57.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 -- 172.21.15.139:0/1718902237 wait complete. 2024-04-26T18:06:57.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 -- start start 2024-04-26T18:06:57.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.561+0000 7f62c07c9740 1 Processor -- start 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2f5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62c07c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55777b21ed80 con 0x55777b2faae0 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55777b1b8840 con 0x55777b2bcb40 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55777b2b9c20 con 0x55777b2bb5e0 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62c07c9740 10 client.0 _ll_register_callbacks cb 0x55777b1bc5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b6ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51854/0 (socket says 172.21.15.139:51854) 2024-04-26T18:06:57.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 -- 172.21.15.139:0/68019097 learned_addr learned my addr 172.21.15.139:0/68019097 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b6ffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:57402/0 (socket says 172.21.15.139:57402) 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 -- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 msgr2=0x55777b2f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 -- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 msgr2=0x55777b2f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.562+0000 7f62b77fe640 1 -- 172.21.15.139:0/68019097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55777b05d510 con 0x55777b2faae0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62b77fe640 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2f37f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007220 tx=0x7f62b000e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa7e378aff2324b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62967fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62967fc640 1 -- 172.21.15.139:0/68019097 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001a070 con 0x55777b2faae0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62967fc640 1 -- 172.21.15.139:0/68019097 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f62b001f660 con 0x55777b2faae0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a002ae50 con 0x55777b2faae0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62967fc640 1 -- 172.21.15.139:0/68019097 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f62b001f860 con 0x55777b2faae0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 10 client.5148 fetch_fsmap learned FSMap version 9 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55777aef0670 con 0x55777b2faae0 2024-04-26T18:06:57.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62967fc640 1 -- 172.21.15.139:0/68019097 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a002ae50 con 0x55777b2faae0 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62967fc640 1 -- 172.21.15.139:0/68019097 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f62b001fa00 con 0x55777b2faae0 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 10 client.5148 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 10 client.5148 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 20 client.5148 populate_metadata read hostname 'smithi139' 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b30f700 0x55777b30fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 4 client.5148 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55777b22c990 con 0x55777b30f700 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.563+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b30f700 0x55777b30fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.564+0000 7f62967fc640 10 client.5148 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.564+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b30f700 0x55777b30fae0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdb36f83c7f1e9ff server_cookie=34f9dcb5ac2ba840 in_seq=0 out_seq=0 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62967fc640 1 -- 172.21.15.139:0/68019097 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55777b22c990 con 0x55777b30f700 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62967fc640 10 client.5148 handle_command_reply: tid=0 2024-04-26T18:06:57.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 client.5148 shutdown 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 msgr2=0x55777b2f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2f37f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007220 tx=0x7f62b000e8c0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 shutdown_connections 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2f37f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bcb40 0x55777b2f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b30f700 0x55777b30fae0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 --2- 172.21.15.139:0/68019097 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62967fc640 0 client.5148 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 >> 172.21.15.139:0/68019097 conn(0x55777b282740 msgr2=0x55777b2bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 shutdown_connections 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 1 -- 172.21.15.139:0/68019097 wait complete. 2024-04-26T18:06:57.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.565+0000 7f62c07c9740 20 client.5148 trim_cache size 0 max 16384 2024-04-26T18:06:57.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.582+0000 7f62c07c9740 1 Processor -- start 2024-04-26T18:06:57.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.583+0000 7f62c07c9740 1 -- start start 2024-04-26T18:06:57.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.583+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bb5e0 0x55777b30c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.583+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bcb40 0x55777b2b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.583+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2b7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.583+0000 7f62c07c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55777b2b7db0 con 0x55777b2faae0 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.583+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f62b82009d0 con 0x55777b2bb5e0 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.583+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f62b81ff8b0 con 0x55777b2bcb40 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bcb40 0x55777b2b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2b7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51858/0 (socket says 172.21.15.139:51858) 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 -- 172.21.15.139:0/2417262810 learned_addr learned my addr 172.21.15.139:0/2417262810 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bb5e0 0x55777b30c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 -- 172.21.15.139:0/2417262810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bcb40 msgr2=0x55777b2b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bcb40 0x55777b2b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 -- 172.21.15.139:0/2417262810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bb5e0 msgr2=0x55777b30c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bb5e0 0x55777b30c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 -- 172.21.15.139:0/2417262810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777b2b8da0 con 0x55777b2faae0 2024-04-26T18:06:57.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62b77fe640 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2b7370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007220 tx=0x7f62b0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fac6ef4e4a7857 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62acff9640 1 -- 172.21.15.139:0/2417262810 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001a070 con 0x55777b2faae0 2024-04-26T18:06:57.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62acff9640 1 -- 172.21.15.139:0/2417262810 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b0007000 con 0x55777b2faae0 2024-04-26T18:06:57.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.584+0000 7f62acff9640 1 -- 172.21.15.139:0/2417262810 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001f6a0 con 0x55777b2faae0 2024-04-26T18:06:57.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 -- 172.21.15.139:0/2417262810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 msgr2=0x55777b2b7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:57.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2b7370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f62b0007220 tx=0x7f62b0011000 comp rx=0 tx=0).stop 2024-04-26T18:06:57.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 -- 172.21.15.139:0/2417262810 shutdown_connections 2024-04-26T18:06:57.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2faae0 0x55777b2b7370 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bcb40 0x55777b2b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 --2- 172.21.15.139:0/2417262810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2bb5e0 0x55777b30c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 -- 172.21.15.139:0/2417262810 >> 172.21.15.139:0/2417262810 conn(0x55777b282740 msgr2=0x55777b2f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 -- 172.21.15.139:0/2417262810 shutdown_connections 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 -- 172.21.15.139:0/2417262810 wait complete. 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.585+0000 7f62c07c9740 1 -- start start 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 1 Processor -- start 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2b9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2bcb40 0x55777b2b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2faae0 0x55777b36ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ff1e0 con 0x55777b2bcb40 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81f5ff0 con 0x55777b2faae0 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f62b81fe4a0 con 0x55777b2bb5e0 2024-04-26T18:06:57.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62c07c9740 10 client.0 _ll_register_callbacks cb 0x7f62b0003990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2bcb40 0x55777b2b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62b67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2bcb40 0x55777b2b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51868/0 (socket says 172.21.15.139:51868) 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62b67fc640 1 -- 172.21.15.139:0/147022840 learned_addr learned my addr 172.21.15.139:0/147022840 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.586+0000 7f62b77fe640 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2faae0 0x55777b36ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62b67fc640 1 -- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 msgr2=0x55777b2b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62b67fc640 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2b9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62b67fc640 1 -- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2faae0 msgr2=0x55777b36ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62b67fc640 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2faae0 0x55777b36ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62b67fc640 1 -- 172.21.15.139:0/147022840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55777b221220 con 0x55777b2bcb40 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62b67fc640 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2bcb40 0x55777b2b6dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f62a0079c70 tx=0x7f62a002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18788aacc1cef7c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62967fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62967fc640 1 -- 172.21.15.139:0/147022840 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a007e270 con 0x55777b2bcb40 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62967fc640 1 -- 172.21.15.139:0/147022840 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f62a007a1d0 con 0x55777b2bcb40 2024-04-26T18:06:57.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b0007000 con 0x55777b2bcb40 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62967fc640 1 -- 172.21.15.139:0/147022840 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f62a0082b30 con 0x55777b2bcb40 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 10 client.5154 fetch_fsmap learned FSMap version 9 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55777b2b7300 con 0x55777b2bcb40 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62967fc640 1 -- 172.21.15.139:0/147022840 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b0007000 con 0x55777b2bcb40 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62967fc640 1 -- 172.21.15.139:0/147022840 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f62a00826a0 con 0x55777b2bcb40 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 10 client.5154 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 10 client.5154 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 20 client.5154 populate_metadata read hostname 'smithi139' 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b306120 0x55777b3704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 4 client.5154 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}] 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}) -- 0x55777b226800 con 0x55777b306120 2024-04-26T18:06:57.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.587+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b306120 0x55777b3704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:57.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.588+0000 7f62967fc640 10 client.5154 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:06:57.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:06:57.588+0000 7f62b6ffd640 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b306120 0x55777b3704b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cbd1dc0f4e5b21a server_cookie=d6ef7564aa4e0b28 in_seq=0 out_seq=0 2024-04-26T18:07:07.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62967fc640 1 -- 172.21.15.139:0/147022840 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55777b226800 con 0x55777b306120 2024-04-26T18:07:07.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62967fc640 10 client.5154 handle_command_reply: tid=0 2024-04-26T18:07:07.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 client.5154 shutdown 2024-04-26T18:07:07.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2bcb40 msgr2=0x55777b2b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:07.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2bcb40 0x55777b2b6dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f62a0079c70 tx=0x7f62a002a300 comp rx=0 tx=0).stop 2024-04-26T18:07:07.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 shutdown_connections 2024-04-26T18:07:07.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55777b2faae0 0x55777b36ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55777b2bcb40 0x55777b2b6dc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55777b306120 0x55777b3704b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 --2- 172.21.15.139:0/147022840 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55777b2bb5e0 0x55777b2b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62967fc640 0 client.5154 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 >> 172.21.15.139:0/147022840 conn(0x55777b282740 msgr2=0x55777b2ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 shutdown_connections 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.008+0000 7f62c07c9740 1 -- 172.21.15.139:0/147022840 wait complete. 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62c07c9740 20 client.5154 trim_cache size 0 max 16384 2024-04-26T18:07:07.010 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 26, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "11cd847": { 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 26, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.2, 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:07:07.011 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:07.012 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f629806c920 msgr2=0x7f629806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f629806c920 0x7f629806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62a8000f60 tx=0x7f62a8007eb0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80c7d30 msgr2=0x7f62b814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80c7d30 0x7f62b814ec20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f62b815c4b0 tx=0x7f62a00046c0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 shutdown_connections 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f629806c920 0x7f629806ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f62b8155e20 0x7f62b814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80c7d30 0x7f62b814ec20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 --2- 172.21.15.139:0/585465079 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f62b80c64b0 0x7f62b80d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:07.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.009+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 >> 172.21.15.139:0/585465079 conn(0x7f62b8072930 msgr2=0x7f62b80cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:07.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.010+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 shutdown_connections 2024-04-26T18:07:07.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:07.010+0000 7f62bd9da640 1 -- 172.21.15.139:0/585465079 wait complete. 2024-04-26T18:07:07.025 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '11cd847', quiesce took 10.0 seconds. Will release after: 21.2 2024-04-26T18:07:07.518 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:07.521 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:28.226 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:07:28.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.336+0000 7fa56c693640 1 Processor -- start 2024-04-26T18:07:28.336 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.336+0000 7fa56c693640 1 -- start start 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa56c693640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa564150260 0x7fa5640c7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa56c693640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5640c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa56c693640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5640c8850 con 0x7fa5640cb3f0 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa56c693640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa5640c8620 con 0x7fa564150260 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa56c693640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa56415a350 con 0x7fa5640ce2f0 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa56a42f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa564150260 0x7fa5640c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa56ac30640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5640c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa569c2e640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7fa5640cb3f0 0x7fa5640cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:36768/0 (socket says 172.21.15.139:36768) 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.337+0000 7fa569c2e640 1 -- 172.21.15.139:0/3627917296 learned_addr learned my addr 172.21.15.139:0/3627917296 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:07:28.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56a42f640 1 -- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 msgr2=0x7fa5640c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56a42f640 1 --2- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5640c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56a42f640 1 -- 172.21.15.139:0/3627917296 >> v1:172.21.15.143:6789/0 conn(0x7fa5640cb3f0 legacy=0x7fa5640cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56a42f640 1 -- 172.21.15.139:0/3627917296 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56415a5f0 con 0x7fa564150260 2024-04-26T18:07:28.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56ac30640 1 --2- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5640c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:28.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56a42f640 1 --2- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa564150260 0x7fa5640c7330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5600097a0 tx=0x7fa56002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4a6b5dc0743f2ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56942d640 1 -- 172.21.15.139:0/3627917296 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560037070 con 0x7fa564150260 2024-04-26T18:07:28.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56942d640 1 -- 172.21.15.139:0/3627917296 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa560032440 con 0x7fa564150260 2024-04-26T18:07:28.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.338+0000 7fa56942d640 1 -- 172.21.15.139:0/3627917296 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560032810 con 0x7fa564150260 2024-04-26T18:07:28.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 -- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa564150260 msgr2=0x7fa5640c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 --2- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa564150260 0x7fa5640c7330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5600097a0 tx=0x7fa56002a210 comp rx=0 tx=0).stop 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 -- 172.21.15.139:0/3627917296 shutdown_connections 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 --2- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5640c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 --2- 172.21.15.139:0/3627917296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa564150260 0x7fa5640c7330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 -- 172.21.15.139:0/3627917296 >> 172.21.15.139:0/3627917296 conn(0x7fa56406e570 msgr2=0x7fa56406e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 -- 172.21.15.139:0/3627917296 shutdown_connections 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.339+0000 7fa56c693640 1 -- 172.21.15.139:0/3627917296 wait complete. 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.340+0000 7fa56c693640 1 Processor -- start 2024-04-26T18:07:28.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.340+0000 7fa56c693640 1 -- start start 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56c693640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5640cb3f0 0x7fa5641541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56c693640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5641498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56c693640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa564150260 0x7fa56414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56c693640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa564150640 con 0x7fa564150260 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56c693640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa564072e00 con 0x7fa5640cb3f0 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56c693640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5641507c0 con 0x7fa5640ce2f0 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56ac30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa564150260 0x7fa56414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56ac30640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa564150260 0x7fa56414cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53082/0 (socket says 172.21.15.139:53082) 2024-04-26T18:07:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56ac30640 1 -- 172.21.15.139:0/2162374081 learned_addr learned my addr 172.21.15.139:0/2162374081 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa56a42f640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5640cb3f0 0x7fa5641541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.341+0000 7fa569c2e640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5641498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56ac30640 1 -- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 msgr2=0x7fa5641498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56ac30640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5641498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56ac30640 1 -- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5640cb3f0 msgr2=0x7fa5641541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56ac30640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5640cb3f0 0x7fa5641541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56ac30640 1 -- 172.21.15.139:0/2162374081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa564154700 con 0x7fa564150260 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56ac30640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa564150260 0x7fa56414cb00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009f00 tx=0x7fa55c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa55affd640 1 -- 172.21.15.139:0/2162374081 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c018030 con 0x7fa564150260 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa55affd640 1 -- 172.21.15.139:0/2162374081 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c00ce50 con 0x7fa564150260 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa564155bc0 con 0x7fa564150260 2024-04-26T18:07:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa55affd640 1 -- 172.21.15.139:0/2162374081 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c003bb0 con 0x7fa564150260 2024-04-26T18:07:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.342+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5641558e0 con 0x7fa564150260 2024-04-26T18:07:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.343+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa564076d20 con 0x7fa564150260 2024-04-26T18:07:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.344+0000 7fa55affd640 1 -- 172.21.15.139:0/2162374081 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa55c005d10 con 0x7fa564150260 2024-04-26T18:07:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.344+0000 7fa55affd640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa54806c8f0 0x7fa54806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.344+0000 7fa55affd640 1 -- 172.21.15.139:0/2162374081 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa55c08c810 con 0x7fa564150260 2024-04-26T18:07:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.344+0000 7fa56a42f640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa54806c8f0 0x7fa54806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.345+0000 7fa56a42f640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa54806c8f0 0x7fa54806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa560034000 tx=0x7fa56002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.349+0000 7fa55affd640 1 -- 172.21.15.139:0/2162374081 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa55c022070 con 0x7fa564150260 2024-04-26T18:07:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.559+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa564073bb0 con 0x7fa564150260 2024-04-26T18:07:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.560+0000 7fa55affd640 1 -- 172.21.15.139:0/2162374081 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fa55c010040 con 0x7fa564150260 2024-04-26T18:07:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:07:28.560 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:07:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:07:28.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa54806c8f0 msgr2=0x7fa54806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa54806c8f0 0x7fa54806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa560034000 tx=0x7fa56002e000 comp rx=0 tx=0).stop 2024-04-26T18:07:28.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa564150260 msgr2=0x7fa56414cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa564150260 0x7fa56414cb00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009f00 tx=0x7fa55c00c490 comp rx=0 tx=0).stop 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 shutdown_connections 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa54806c8f0 0x7fa54806edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa564150260 0x7fa56414cb00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa5640ce2f0 0x7fa5641498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 --2- 172.21.15.139:0/2162374081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa5640cb3f0 0x7fa5641541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 >> 172.21.15.139:0/2162374081 conn(0x7fa56406e570 msgr2=0x7fa564158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 shutdown_connections 2024-04-26T18:07:28.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.562+0000 7fa56c693640 1 -- 172.21.15.139:0/2162374081 wait complete. 2024-04-26T18:07:28.573 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 11cd847 --release --await' 2024-04-26T18:07:28.574 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 11cd847 --release --await 2024-04-26T18:07:28.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.677+0000 7fcb26797640 1 Processor -- start 2024-04-26T18:07:28.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.677+0000 7fcb26797640 1 -- start start 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb26797640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fcb2015ce90 0x7fcb2015a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb26797640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb201599b0 con 0x7fcb200c6050 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb26797640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb200709e0 con 0x7fcb20153ab0 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb26797640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fcb2015d2c0 con 0x7fcb2015ce90 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb1f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcb200c6050 0x7fcb20162210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:44290/0 (socket says 172.21.15.139:44290) 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb1f7fe640 1 -- 172.21.15.139:0/2389473728 learned_addr learned my addr 172.21.15.139:0/2389473728 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb24d34640 1 --2- 172.21.15.139:0/2389473728 >> v2:172.21.15.143:3300/0 conn(0x7fcb2015ce90 0x7fcb2015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb1effd640 1 -- 172.21.15.139:0/2389473728 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551693127 0 0) 0x7fcb201599b0 con 0x7fcb200c6050 2024-04-26T18:07:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb1effd640 1 -- 172.21.15.139:0/2389473728 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb08003520 con 0x7fcb200c6050 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb1effd640 1 -- 172.21.15.139:0/2389473728 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604627878 0 0) 0x7fcb200709e0 con 0x7fcb20153ab0 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb1effd640 1 -- 172.21.15.139:0/2389473728 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb201599b0 con 0x7fcb20153ab0 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb24d34640 1 -- 172.21.15.139:0/2389473728 >> v1:172.21.15.143:6789/0 conn(0x7fcb20153ab0 legacy=0x7fcb200cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb24d34640 1 -- 172.21.15.139:0/2389473728 >> v1:172.21.15.139:6789/0 conn(0x7fcb200c6050 legacy=0x7fcb20162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.678+0000 7fcb24d34640 1 -- 172.21.15.139:0/2389473728 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb20070cc0 con 0x7fcb2015ce90 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.679+0000 7fcb24d34640 1 --2- 172.21.15.139:0/2389473728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb2015ce90 0x7fcb2015a450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009d90 tx=0x7fcb1802a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c665bf6c6a6136dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.679+0000 7fcb1effd640 1 -- 172.21.15.139:0/2389473728 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18037070 con 0x7fcb2015ce90 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.679+0000 7fcb1effd640 1 -- 172.21.15.139:0/2389473728 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb18007740 con 0x7fcb2015ce90 2024-04-26T18:07:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.679+0000 7fcb1effd640 1 -- 172.21.15.139:0/2389473728 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18007af0 con 0x7fcb2015ce90 2024-04-26T18:07:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.680+0000 7fcb26797640 1 -- 172.21.15.139:0/2389473728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb2015ce90 msgr2=0x7fcb2015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.680+0000 7fcb26797640 1 --2- 172.21.15.139:0/2389473728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb2015ce90 0x7fcb2015a450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009d90 tx=0x7fcb1802a780 comp rx=0 tx=0).stop 2024-04-26T18:07:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.680+0000 7fcb26797640 1 -- 172.21.15.139:0/2389473728 shutdown_connections 2024-04-26T18:07:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.680+0000 7fcb26797640 1 --2- 172.21.15.139:0/2389473728 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb2015ce90 0x7fcb2015a450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.680+0000 7fcb26797640 1 -- 172.21.15.139:0/2389473728 >> 172.21.15.139:0/2389473728 conn(0x7fcb20068090 msgr2=0x7fcb20068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.680+0000 7fcb26797640 1 -- 172.21.15.139:0/2389473728 shutdown_connections 2024-04-26T18:07:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.680+0000 7fcb26797640 1 -- 172.21.15.139:0/2389473728 wait complete. 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.681+0000 7fcb26797640 1 Processor -- start 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.681+0000 7fcb26797640 1 -- start start 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb200c6050 0x7fcb200c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb20153ab0 0x7fcb2015c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb2015ce90 0x7fcb201f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcb20159f30 con 0x7fcb2015ce90 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcb20070fa0 con 0x7fcb200c6050 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcb20070630 con 0x7fcb20153ab0 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb2015ce90 0x7fcb201f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb2015ce90 0x7fcb201f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53090/0 (socket says 172.21.15.139:53090) 2024-04-26T18:07:28.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 -- 172.21.15.139:0/1836509174 learned_addr learned my addr 172.21.15.139:0/1836509174 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb200c6050 0x7fcb200c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 -- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb20153ab0 msgr2=0x7fcb2015c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb20153ab0 0x7fcb2015c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb20153ab0 0x7fcb2015c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 -- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb200c6050 msgr2=0x7fcb200c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb200c6050 0x7fcb200c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 -- 172.21.15.139:0/1836509174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb201f2a00 con 0x7fcb2015ce90 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb200c6050 0x7fcb200c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb20153ab0 0x7fcb2015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb24d34640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb2015ce90 0x7fcb201f2ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009d90 tx=0x7fcb18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb1cff9640 1 -- 172.21.15.139:0/1836509174 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18042020 con 0x7fcb2015ce90 2024-04-26T18:07:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb1cff9640 1 -- 172.21.15.139:0/1836509174 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb18032870 con 0x7fcb2015ce90 2024-04-26T18:07:28.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb200c89a0 con 0x7fcb2015ce90 2024-04-26T18:07:28.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb1cff9640 1 -- 172.21.15.139:0/1836509174 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18037040 con 0x7fcb2015ce90 2024-04-26T18:07:28.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.682+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb200ce720 con 0x7fcb2015ce90 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.684+0000 7fcb1cff9640 1 -- 172.21.15.139:0/1836509174 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb18045020 con 0x7fcb2015ce90 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.684+0000 7fcb1cff9640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcb0c06c8f0 0x7fcb0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.684+0000 7fcb1cff9640 1 -- 172.21.15.139:0/1836509174 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fcb180acf60 con 0x7fcb2015ce90 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.684+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcb0c06c8f0 0x7fcb0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.685+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcb0c06c8f0 0x7fcb0c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb100016b0 tx=0x7fcb10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.685+0000 7fcb29584740 1 Processor -- start 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.685+0000 7fcb29584740 1 -- start start 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366e4b0 0x5577036ad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x55770366e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb29584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366fa10 0x55770366edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb29584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5577035d3040 con 0x55770366fa10 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55770356eb60 con 0x55770366e4b0 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5577035cf000 con 0x5577036ad9b0 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366fa10 0x55770366edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366fa10 0x55770366edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53106/0 (socket says 172.21.15.139:53106) 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 -- 172.21.15.139:0/3298577697 learned_addr learned my addr 172.21.15.139:0/3298577697 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366e4b0 0x5577036ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x55770366e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 -- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 msgr2=0x55770366e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x55770366e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 -- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366e4b0 msgr2=0x5577036ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366e4b0 0x5577036ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 -- 172.21.15.139:0/3298577697 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577035639c0 con 0x55770366fa10 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366e4b0 0x5577036ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.686+0000 7fcb24d34640 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366fa10 0x55770366edd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb18082f90 tx=0x7fcb18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b48bc3cdb5b6756 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb05ffb640 1 -- 172.21.15.139:0/3298577697 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1807a8e0 con 0x55770366fa10 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb05ffb640 1 -- 172.21.15.139:0/3298577697 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1807ec90 con 0x55770366fa10 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb05ffb640 1 -- 172.21.15.139:0/3298577697 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb180834c0 con 0x55770366fa10 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 -- 172.21.15.139:0/3298577697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366fa10 msgr2=0x55770366edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366fa10 0x55770366edd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb18082f90 tx=0x7fcb18009750 comp rx=0 tx=0).stop 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 -- 172.21.15.139:0/3298577697 shutdown_connections 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366fa10 0x55770366edd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x55770366e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 --2- 172.21.15.139:0/3298577697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366e4b0 0x5577036ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 -- 172.21.15.139:0/3298577697 >> 172.21.15.139:0/3298577697 conn(0x557703635930 msgr2=0x5577036b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 -- 172.21.15.139:0/3298577697 shutdown_connections 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.687+0000 7fcb29584740 1 -- 172.21.15.139:0/3298577697 wait complete. 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.688+0000 7fcb29584740 1 -- start start 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.688+0000 7fcb29584740 1 Processor -- start 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55770366fa10 0x5577036a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5577036ad9b0 0x5577036c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55770366caf0 con 0x55770366e4b0 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55770356c4f0 con 0x5577036ad9b0 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x557703670040 con 0x55770366fa10 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 10 client.0 _ll_register_callbacks cb 0x5577035c9c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53114/0 (socket says 172.21.15.139:53114) 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 -- 172.21.15.139:0/2658151901 learned_addr learned my addr 172.21.15.139:0/2658151901 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb24d34640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5577036ad9b0 0x5577036c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55770366fa10 0x5577036a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 -- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55770366fa10 msgr2=0x5577036a81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55770366fa10 0x5577036a81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 -- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5577036ad9b0 msgr2=0x5577036c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5577036ad9b0 0x5577036c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 -- 172.21.15.139:0/2658151901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577032e4920 con 0x55770366e4b0 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55770366fa10 0x5577036a81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb24d34640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5577036ad9b0 0x5577036c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036b3bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000de30 tx=0x7fcb10000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295de493011bf939 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcafeffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcafeffd640 1 -- 172.21.15.139:0/2658151901 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10026060 con 0x55770366e4b0 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcafeffd640 1 -- 172.21.15.139:0/2658151901 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fcb10005320 con 0x55770366e4b0 2024-04-26T18:07:28.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.689+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb1807ec90 con 0x55770366e4b0 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcafeffd640 1 -- 172.21.15.139:0/2658151901 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fcb1000de60 con 0x55770366e4b0 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 10 client.5169 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5577033b0d30 con 0x55770366e4b0 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcafeffd640 1 -- 172.21.15.139:0/2658151901 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1807ec90 con 0x55770366e4b0 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcafeffd640 1 -- 172.21.15.139:0/2658151901 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fcb100216b0 con 0x55770366e4b0 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 10 client.5169 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 10 client.5169 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 20 client.5169 populate_metadata read hostname 'smithi139' 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036b9a40 0x5577036b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 4 client.5169 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577035a6a00 con 0x5577036b9a40 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036b9a40 0x5577036b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcafeffd640 10 client.5169 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:28.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.690+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036b9a40 0x5577036b9ea0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8d7b1722e295b55 server_cookie=e65517fd9fe3662d in_seq=0 out_seq=0 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcafeffd640 1 -- 172.21.15.139:0/2658151901 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5577035a6a00 con 0x5577036b9a40 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcafeffd640 10 client.5169 handle_command_reply: tid=0 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 client.5169 shutdown 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 msgr2=0x5577036b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036b3bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000de30 tx=0x7fcb10000bc0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 shutdown_connections 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5577036ad9b0 0x5577036c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036b9a40 0x5577036b9ea0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55770366fa10 0x5577036a81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 --2- 172.21.15.139:0/2658151901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036b3bc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcafeffd640 0 client.5169 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 >> 172.21.15.139:0/2658151901 conn(0x557703635930 msgr2=0x5577036686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 shutdown_connections 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.691+0000 7fcb29584740 1 -- 172.21.15.139:0/2658151901 wait complete. 2024-04-26T18:07:28.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.692+0000 7fcb29584740 20 client.5169 trim_cache size 0 max 16384 2024-04-26T18:07:28.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.708+0000 7fcb29584740 1 Processor -- start 2024-04-26T18:07:28.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.708+0000 7fcb29584740 1 -- start start 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb29584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x557703695b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770366bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x55770366c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb29584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcb201fc250 con 0x55770366e4b0 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcb201fb130 con 0x55770366fa10 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2006de80 con 0x5577036ad9b0 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x557703695b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x557703695b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53118/0 (socket says 172.21.15.139:53118) 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 -- 172.21.15.139:0/91035792 learned_addr learned my addr 172.21.15.139:0/91035792 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 -- 172.21.15.139:0/91035792 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 msgr2=0x55770366c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/91035792 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x55770366c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 -- 172.21.15.139:0/91035792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 msgr2=0x55770366bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/91035792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770366bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.709+0000 7fcb1ffff640 1 -- 172.21.15.139:0/91035792 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577036c6900 con 0x55770366e4b0 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/91035792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x557703695b40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000d730 tx=0x7fcb1001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a875cbaef94dbeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb057fa640 1 -- 172.21.15.139:0/91035792 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10001c60 con 0x55770366e4b0 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb057fa640 1 -- 172.21.15.139:0/91035792 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb10005320 con 0x55770366e4b0 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb057fa640 1 -- 172.21.15.139:0/91035792 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10021460 con 0x55770366e4b0 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 -- 172.21.15.139:0/91035792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 msgr2=0x557703695b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 --2- 172.21.15.139:0/91035792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x557703695b40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000d730 tx=0x7fcb1001e000 comp rx=0 tx=0).stop 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 -- 172.21.15.139:0/91035792 shutdown_connections 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 --2- 172.21.15.139:0/91035792 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x55770366c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 --2- 172.21.15.139:0/91035792 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770366bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 --2- 172.21.15.139:0/91035792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x557703695b40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 -- 172.21.15.139:0/91035792 >> 172.21.15.139:0/91035792 conn(0x557703635930 msgr2=0x5577036b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 -- 172.21.15.139:0/91035792 shutdown_connections 2024-04-26T18:07:28.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.710+0000 7fcb29584740 1 -- 172.21.15.139:0/91035792 wait complete. 2024-04-26T18:07:28.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.711+0000 7fcb29584740 1 -- start start 2024-04-26T18:07:28.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.711+0000 7fcb29584740 1 Processor -- start 2024-04-26T18:07:28.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770372d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x557703726e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcb201f9d30 con 0x55770366e4b0 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcb201faa60 con 0x55770366fa10 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcb201fa390 con 0x5577036ad9b0 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 10 client.0 _ll_register_callbacks cb 0x7fcb1000da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53132/0 (socket says 172.21.15.139:53132) 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 -- 172.21.15.139:0/1882702394 learned_addr learned my addr 172.21.15.139:0/1882702394 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770372d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb24d34640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x557703726e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 -- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 msgr2=0x557703726e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x557703726e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 -- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 msgr2=0x55770372d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770372d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 -- 172.21.15.139:0/1882702394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577036a7230 con 0x55770366e4b0 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb24d34640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x557703726e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770372d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb1ffff640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036aee80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009010 tx=0x7fcb10012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ec25720f6de714 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcafeffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcafeffd640 1 -- 172.21.15.139:0/1882702394 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10039070 con 0x55770366e4b0 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcafeffd640 1 -- 172.21.15.139:0/1882702394 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fcb10021670 con 0x55770366e4b0 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.712+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb10005320 con 0x55770366e4b0 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcafeffd640 1 -- 172.21.15.139:0/1882702394 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fcb10044050 con 0x55770366e4b0 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 10 client.5175 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:28.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557703731450 con 0x55770366e4b0 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcafeffd640 1 -- 172.21.15.139:0/1882702394 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb10005320 con 0x55770366e4b0 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcafeffd640 1 -- 172.21.15.139:0/1882702394 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fcb10047020 con 0x55770366e4b0 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 10 client.5175 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 10 client.5175 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 20 client.5175 populate_metadata read hostname 'smithi139' 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036a9f30 0x557703727390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 4 client.5175 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "11cd847", "release": true, "await": true}] 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "11cd847", "release": true, "await": true}) -- 0x5577035e0c50 con 0x5577036a9f30 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036a9f30 0x557703727390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcafeffd640 10 client.5175 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:28.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.713+0000 7fcb1f7fe640 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036a9f30 0x557703727390 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4fec27a0f2b5bb3 server_cookie=6aaa021054347e47 in_seq=0 out_seq=0 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcafeffd640 1 -- 172.21.15.139:0/1882702394 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5577035e0c50 con 0x5577036a9f30 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcafeffd640 10 client.5175 handle_command_reply: tid=0 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 client.5175 shutdown 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 msgr2=0x5577036aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036aee80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009010 tx=0x7fcb10012000 comp rx=0 tx=0).stop 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 shutdown_connections 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5577036a9f30 0x557703727390 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5577036ad9b0 0x557703726e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55770366fa10 0x55770372d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcafeffd640 0 client.5175 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 --2- 172.21.15.139:0/1882702394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55770366e4b0 0x5577036aee80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 >> 172.21.15.139:0/1882702394 conn(0x557703635930 msgr2=0x55770366bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 shutdown_connections 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 1 -- 172.21.15.139:0/1882702394 wait complete. 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.714+0000 7fcb29584740 20 client.5175 trim_cache size 0 max 16384 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 28, 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stdout: "11cd847": { 2024-04-26T18:07:28.722 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 28, 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.2, 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:28.723 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:07:28.724 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:28.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:28.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:28.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:28.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:28.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:28.724 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcb0c06c8f0 msgr2=0x7fcb0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcb0c06c8f0 0x7fcb0c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb100016b0 tx=0x7fcb10009040 comp rx=0 tx=0).stop 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb2015ce90 msgr2=0x7fcb201f2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb2015ce90 0x7fcb201f2ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009d90 tx=0x7fcb18004a40 comp rx=0 tx=0).stop 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 shutdown_connections 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcb0c06c8f0 0x7fcb0c06edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb2015ce90 0x7fcb201f2ee0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcb20153ab0 0x7fcb2015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 --2- 172.21.15.139:0/1836509174 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcb200c6050 0x7fcb200c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 >> 172.21.15.139:0/1836509174 conn(0x7fcb20068090 msgr2=0x7fcb201e2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 shutdown_connections 2024-04-26T18:07:28.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.715+0000 7fcb26797640 1 -- 172.21.15.139:0/1836509174 wait complete. 2024-04-26T18:07:28.727 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '11cd847', seconds elapsed: 31.7 2024-04-26T18:07:28.727 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.2 2024-04-26T18:07:28.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:07:28.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.825+0000 7fc4e8c37640 1 Processor -- start 2024-04-26T18:07:28.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.825+0000 7fc4e8c37640 1 -- start start 2024-04-26T18:07:28.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.826+0000 7fc4e8c37640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc4e4153de0 0x7fc4e4070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.826+0000 7fc4e8c37640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e4159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.826+0000 7fc4e8c37640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4e4070990 con 0x7fc4e40c9cf0 2024-04-26T18:07:28.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.826+0000 7fc4e8c37640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc4e4070c70 con 0x7fc4e4153de0 2024-04-26T18:07:28.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.826+0000 7fc4e8c37640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e40ca670 con 0x7fc4e4159960 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.826+0000 7fc4e259c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc4e4153de0 0x7fc4e4070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e259c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc4e4153de0 0x7fc4e4070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53148/0 (socket says 172.21.15.139:53148) 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e259c640 1 -- 172.21.15.139:0/155567966 learned_addr learned my addr 172.21.15.139:0/155567966 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e1d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc4e40c9cf0 0x7fc4e40cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:44300/0 (socket says 172.21.15.139:44300) 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e2d9d640 1 --2- 172.21.15.139:0/155567966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e4159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e259c640 1 -- 172.21.15.139:0/155567966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 msgr2=0x7fc4e4159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e259c640 1 --2- 172.21.15.139:0/155567966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e4159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e259c640 1 -- 172.21.15.139:0/155567966 >> v1:172.21.15.139:6789/0 conn(0x7fc4e40c9cf0 legacy=0x7fc4e40cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e159a640 1 -- 172.21.15.139:0/155567966 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604772152 0 0) 0x7fc4e4070990 con 0x7fc4e40c9cf0 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.827+0000 7fc4e259c640 1 -- 172.21.15.139:0/155567966 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e40ca950 con 0x7fc4e4153de0 2024-04-26T18:07:28.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e259c640 1 --2- 172.21.15.139:0/155567966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e4070fc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009870 tx=0x7fc4d802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b51314911e6a0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e159a640 1 -- 172.21.15.139:0/155567966 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8037070 con 0x7fc4e4153de0 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e159a640 1 -- 172.21.15.139:0/155567966 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d802ae50 con 0x7fc4e4153de0 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e159a640 1 -- 172.21.15.139:0/155567966 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8032860 con 0x7fc4e4153de0 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 -- 172.21.15.139:0/155567966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 msgr2=0x7fc4e4070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/155567966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e4070fc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009870 tx=0x7fc4d802a300 comp rx=0 tx=0).stop 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 -- 172.21.15.139:0/155567966 shutdown_connections 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/155567966 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e4159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/155567966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e4070fc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 -- 172.21.15.139:0/155567966 >> 172.21.15.139:0/155567966 conn(0x7fc4e4076730 msgr2=0x7fc4e4068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 -- 172.21.15.139:0/155567966 shutdown_connections 2024-04-26T18:07:28.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.828+0000 7fc4e8c37640 1 -- 172.21.15.139:0/155567966 wait complete. 2024-04-26T18:07:28.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 Processor -- start 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 -- start start 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4e40c9cf0 0x7fc4e41f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e41f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e40726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e415a2f0 con 0x7fc4e4153de0 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e40caf10 con 0x7fc4e40c9cf0 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e8c37640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e40ca140 con 0x7fc4e4159960 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e41f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e41f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53150/0 (socket says 172.21.15.139:53150) 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e1d9b640 1 -- 172.21.15.139:0/3305028967 learned_addr learned my addr 172.21.15.139:0/3305028967 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:28.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e2d9d640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e40726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.830+0000 7fc4e259c640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4e40c9cf0 0x7fc4e41f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e1d9b640 1 -- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 msgr2=0x7fc4e40726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e1d9b640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e40726b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e1d9b640 1 -- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4e40c9cf0 msgr2=0x7fc4e41f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e1d9b640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4e40c9cf0 0x7fc4e41f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e1d9b640 1 -- 172.21.15.139:0/3305028967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e415b4c0 con 0x7fc4e4153de0 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e1d9b640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e41f1680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400c4d0 tx=0x7fc4d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4d2ffd640 1 -- 172.21.15.139:0/3305028967 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4018070 con 0x7fc4e4153de0 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4d2ffd640 1 -- 172.21.15.139:0/3305028967 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d4007500 con 0x7fc4e4153de0 2024-04-26T18:07:28.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e415b7a0 con 0x7fc4e4153de0 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4d2ffd640 1 -- 172.21.15.139:0/3305028967 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4004a20 con 0x7fc4e4153de0 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.831+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e41f4bf0 con 0x7fc4e4153de0 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.832+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e40c5c80 con 0x7fc4e4153de0 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.832+0000 7fc4d2ffd640 1 -- 172.21.15.139:0/3305028967 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4d401b070 con 0x7fc4e4153de0 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.833+0000 7fc4d2ffd640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4c406c8f0 0x7fc4c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.833+0000 7fc4e259c640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4c406c8f0 0x7fc4c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.833+0000 7fc4d2ffd640 1 -- 172.21.15.139:0/3305028967 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc4d408b280 con 0x7fc4e4153de0 2024-04-26T18:07:28.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.833+0000 7fc4e259c640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4c406c8f0 0x7fc4c406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8034000 tx=0x7fc4d802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:28.837+0000 7fc4d2ffd640 1 -- 172.21.15.139:0/3305028967 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4e40c5c80 con 0x7fc4e4153de0 2024-04-26T18:07:29.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.050+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4e4076d20 con 0x7fc4e4153de0 2024-04-26T18:07:29.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.051+0000 7fc4d2ffd640 1 -- 172.21.15.139:0/3305028967 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fc4d4058b90 con 0x7fc4e4153de0 2024-04-26T18:07:29.051 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:07:29.051 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:07:29.051 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:07:29.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4c406c8f0 msgr2=0x7fc4c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4c406c8f0 0x7fc4c406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8034000 tx=0x7fc4d802e000 comp rx=0 tx=0).stop 2024-04-26T18:07:29.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 msgr2=0x7fc4e41f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e41f1680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400c4d0 tx=0x7fc4d400c990 comp rx=0 tx=0).stop 2024-04-26T18:07:29.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 shutdown_connections 2024-04-26T18:07:29.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc4c406c8f0 0x7fc4c406edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc4e4159960 0x7fc4e40726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e4153de0 0x7fc4e41f1680 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 --2- 172.21.15.139:0/3305028967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc4e40c9cf0 0x7fc4e41f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 >> 172.21.15.139:0/3305028967 conn(0x7fc4e4076730 msgr2=0x7fc4e40cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:29.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 shutdown_connections 2024-04-26T18:07:29.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.053+0000 7fc4e8c37640 1 -- 172.21.15.139:0/3305028967 wait complete. 2024-04-26T18:07:29.064 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0' 2024-04-26T18:07:29.064 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0 2024-04-26T18:07:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.177+0000 7f7d9c9da640 1 Processor -- start 2024-04-26T18:07:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.177+0000 7f7d9c9da640 1 -- start start 2024-04-26T18:07:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d9c9da640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980cc380 0x7f7d980c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d9c9da640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7d980c7340 0x7f7d9815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d9c9da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d980ccb00 con 0x7f7d98153b40 2024-04-26T18:07:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d9c9da640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f7d980c9e90 con 0x7f7d980c7340 2024-04-26T18:07:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d9c9da640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7d980cb700 con 0x7f7d980cc380 2024-04-26T18:07:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d96d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7d980c7340 0x7f7d9815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d96d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7d980c7340 0x7f7d9815cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53166/0 (socket says 172.21.15.139:53166) 2024-04-26T18:07:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2176608382 learned_addr learned my addr 172.21.15.139:0/2176608382 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/2176608382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980cc380 0x7f7d980c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2176608382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980cc380 msgr2=0x7f7d980c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/2176608382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980cc380 0x7f7d980c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2176608382 >> v1:172.21.15.143:6789/0 conn(0x7f7d98153b40 legacy=0x7f7d980c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.178+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2176608382 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d980ccd70 con 0x7f7d980c7340 2024-04-26T18:07:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/2176608382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d980c7340 0x7f7d9815cfa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009e50 tx=0x7f7d9002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39f19ab162355fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d95d9b640 1 -- 172.21.15.139:0/2176608382 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90036070 con 0x7f7d980c7340 2024-04-26T18:07:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d95d9b640 1 -- 172.21.15.139:0/2176608382 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d90031600 con 0x7f7d980c7340 2024-04-26T18:07:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d95d9b640 1 -- 172.21.15.139:0/2176608382 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d900319d0 con 0x7f7d980c7340 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d9c9da640 1 -- 172.21.15.139:0/2176608382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d980c7340 msgr2=0x7f7d9815cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/2176608382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d980c7340 0x7f7d9815cfa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009e50 tx=0x7f7d9002a710 comp rx=0 tx=0).stop 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d9c9da640 1 -- 172.21.15.139:0/2176608382 shutdown_connections 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/2176608382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d980c7340 0x7f7d9815cfa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.179+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/2176608382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980cc380 0x7f7d980c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.180+0000 7f7d9c9da640 1 -- 172.21.15.139:0/2176608382 >> 172.21.15.139:0/2176608382 conn(0x7f7d9806c310 msgr2=0x7f7d9806c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.180+0000 7f7d9c9da640 1 -- 172.21.15.139:0/2176608382 shutdown_connections 2024-04-26T18:07:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.180+0000 7f7d9c9da640 1 -- 172.21.15.139:0/2176608382 wait complete. 2024-04-26T18:07:29.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.181+0000 7f7d9c9da640 1 Processor -- start 2024-04-26T18:07:29.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.181+0000 7f7d9c9da640 1 -- start start 2024-04-26T18:07:29.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980c7340 0x7f7d981e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d980cc380 0x7f7d9814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d98153b40 0x7f7d9815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d980cc7a0 con 0x7f7d98153b40 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7d980cd330 con 0x7f7d980cc380 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7d980cb9e0 con 0x7f7d980c7340 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d98153b40 0x7f7d9815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d98153b40 0x7f7d9815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53172/0 (socket says 172.21.15.139:53172) 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3187472849 learned_addr learned my addr 172.21.15.139:0/3187472849 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d980cc380 0x7f7d9814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9659c640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980c7340 0x7f7d981e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980c7340 msgr2=0x7f7d981e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980c7340 0x7f7d981e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d980cc380 msgr2=0x7f7d9814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d980cc380 0x7f7d9814ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3187472849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d981e4e60 con 0x7f7d98153b40 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d98153b40 0x7f7d9815bfc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009f70 tx=0x7f7d90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d8f7fe640 1 -- 172.21.15.139:0/3187472849 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9003f020 con 0x7f7d98153b40 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d8f7fe640 1 -- 172.21.15.139:0/3187472849 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d90037040 con 0x7f7d98153b40 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d981e5140 con 0x7f7d98153b40 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d8f7fe640 1 -- 172.21.15.139:0/3187472849 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90036070 con 0x7f7d98153b40 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.182+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d981e5700 con 0x7f7d98153b40 2024-04-26T18:07:29.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.184+0000 7f7d8f7fe640 1 -- 172.21.15.139:0/3187472849 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d90042020 con 0x7f7d98153b40 2024-04-26T18:07:29.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.184+0000 7f7d8f7fe640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7d7806c920 0x7f7d7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.184+0000 7f7d8f7fe640 1 -- 172.21.15.139:0/3187472849 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7d900ac210 con 0x7f7d98153b40 2024-04-26T18:07:29.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.184+0000 7f7d9659c640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7d7806c920 0x7f7d7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.185+0000 7f7d9659c640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7d7806c920 0x7f7d7806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d880016e0 tx=0x7f7d88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.185+0000 7f7d9f7c8740 1 Processor -- start 2024-04-26T18:07:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.185+0000 7f7d9f7c8740 1 -- start start 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5db7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dc5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5cdbd80 con 0x55e6a5d76280 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5c77c20 con 0x55e6a5d76660 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e6a5cd7d40 con 0x55e6a5d79b40 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5db7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5db7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53188/0 (socket says 172.21.15.139:53188) 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 -- 172.21.15.139:0/3310192275 learned_addr learned my addr 172.21.15.139:0/3310192275 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dc5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 -- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 msgr2=0x55e6a5db7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 -- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 msgr2=0x55e6a5dc5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dc5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.186+0000 7f7d9659c640 1 -- 172.21.15.139:0/3310192275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a5ab9d80 con 0x55e6a5d76280 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9659c640 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5db7930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7d88007bc0 tx=0x7f7d88012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7139137def7ad8ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d77fff640 1 -- 172.21.15.139:0/3310192275 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88026070 con 0x55e6a5d76280 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d77fff640 1 -- 172.21.15.139:0/3310192275 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88001d00 con 0x55e6a5d76280 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d77fff640 1 -- 172.21.15.139:0/3310192275 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d880069f0 con 0x55e6a5d76280 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3310192275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 msgr2=0x55e6a5db7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5db7930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7d88007bc0 tx=0x7f7d88012000 comp rx=0 tx=0).stop 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3310192275 shutdown_connections 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dc5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3310192275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5db7930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.187+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3310192275 >> 172.21.15.139:0/3310192275 conn(0x55e6a5d3f740 msgr2=0x55e6a5dbc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.188+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3310192275 shutdown_connections 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.188+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3310192275 wait complete. 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.188+0000 7f7d9f7c8740 1 -- start start 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.188+0000 7f7d9f7c8740 1 Processor -- start 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5d71fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5dbd370 con 0x55e6a5d76280 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5c75840 con 0x55e6a5d76660 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e6a5db3630 con 0x55e6a5d79b40 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9f7c8740 10 client.0 _ll_register_callbacks cb 0x55e6a5c795b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5d71fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5d71fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53200/0 (socket says 172.21.15.139:53200) 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 -- 172.21.15.139:0/2029915574 learned_addr learned my addr 172.21.15.139:0/2029915574 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 -- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 msgr2=0x55e6a5db3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 -- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 msgr2=0x55e6a5dccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.189+0000 7f7d9659c640 1 -- 172.21.15.139:0/2029915574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a5b1a510 con 0x55e6a5d76280 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9659c640 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5d71fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d88024040 tx=0x7f7d88000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0035d6099ece74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d757fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d757fa640 1 -- 172.21.15.139:0/2029915574 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88026040 con 0x55e6a5d76280 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d757fa640 1 -- 172.21.15.139:0/2029915574 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7d88020620 con 0x55e6a5d76280 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d88001d00 con 0x55e6a5d76280 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d757fa640 1 -- 172.21.15.139:0/2029915574 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7d88038050 con 0x55e6a5d76280 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 10 client.5196 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e6a59ad670 con 0x55e6a5d76280 2024-04-26T18:07:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d757fa640 1 -- 172.21.15.139:0/2029915574 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88001d00 con 0x55e6a5d76280 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d757fa640 1 -- 172.21.15.139:0/2029915574 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7d8803b020 con 0x55e6a5d76280 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 10 client.5196 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 10 client.5196 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 20 client.5196 populate_metadata read hostname 'smithi139' 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5dbb3b0 0x55e6a5dbb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 4 client.5196 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6a5ce9990 con 0x55e6a5dbb3b0 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.190+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5dbb3b0 0x55e6a5dbb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.191+0000 7f7d757fa640 10 client.5196 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.191+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5dbb3b0 0x55e6a5dbb7d0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=906ab8acdb5c48b0 server_cookie=9f52405024b237bd in_seq=0 out_seq=0 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d757fa640 1 -- 172.21.15.139:0/2029915574 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e6a5ce9990 con 0x55e6a5dbb3b0 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d757fa640 10 client.5196 handle_command_reply: tid=0 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d9f7c8740 1 client.5196 shutdown 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 msgr2=0x55e6a5d71fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5d71fa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d88024040 tx=0x7f7d88000ed0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 shutdown_connections 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5dbb3b0 0x55e6a5dbb7d0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.267+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d79b40 0x55e6a5db3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.268+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5dccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.268+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2029915574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d76280 0x55e6a5d71fa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.268+0000 7f7d757fa640 0 client.5196 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:29.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.268+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 >> 172.21.15.139:0/2029915574 conn(0x55e6a5d3f740 msgr2=0x55e6a5dbc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:29.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.268+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 shutdown_connections 2024-04-26T18:07:29.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.268+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2029915574 wait complete. 2024-04-26T18:07:29.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.268+0000 7f7d9f7c8740 20 client.5196 trim_cache size 0 max 16384 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.286+0000 7f7d9f7c8740 1 Processor -- start 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.286+0000 7f7d9f7c8740 1 -- start start 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.286+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76280 0x55e6a5dbca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76660 0x55e6a5db8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5db88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981fc3b0 con 0x55e6a5d79b40 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981fb290 con 0x55e6a5d76280 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7d980c6ab0 con 0x55e6a5d76660 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5db88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5db88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53206/0 (socket says 172.21.15.139:53206) 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3166213994 learned_addr learned my addr 172.21.15.139:0/3166213994 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:29.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d9659c640 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76280 0x55e6a5dbca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76660 0x55e6a5db8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76660 msgr2=0x55e6a5db8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76660 0x55e6a5db8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76280 msgr2=0x55e6a5dbca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76280 0x55e6a5dbca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 -- 172.21.15.139:0/3166213994 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a5d72310 con 0x55e6a5d79b40 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5db88c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7d9002a750 tx=0x7f7d9003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58b149a25c29084 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d777fe640 1 -- 172.21.15.139:0/3166213994 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d900a7070 con 0x55e6a5d79b40 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d777fe640 1 -- 172.21.15.139:0/3166213994 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d90079bb0 con 0x55e6a5d79b40 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.287+0000 7f7d777fe640 1 -- 172.21.15.139:0/3166213994 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9007deb0 con 0x55e6a5d79b40 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3166213994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 msgr2=0x55e6a5db88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5db88c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7d9002a750 tx=0x7f7d9003d040 comp rx=0 tx=0).stop 2024-04-26T18:07:29.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3166213994 shutdown_connections 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5db88c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76660 0x55e6a5db8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/3166213994 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76280 0x55e6a5dbca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3166213994 >> 172.21.15.139:0/3166213994 conn(0x55e6a5d3f740 msgr2=0x55e6a5db60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3166213994 shutdown_connections 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/3166213994 wait complete. 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.288+0000 7f7d9f7c8740 1 -- start start 2024-04-26T18:07:29.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 1 Processor -- start 2024-04-26T18:07:29.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76280 0x55e6a5dbbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5e31730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5e31c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981f9e20 con 0x55e6a5d79b40 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7d981fabc0 con 0x55e6a5d76660 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7d981fa4f0 con 0x55e6a5d76280 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d9f7c8740 10 client.0 _ll_register_callbacks cb 0x7f7d88024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5e31c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.289+0000 7f7d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5e31c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53216/0 (socket says 172.21.15.139:53216) 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2259951053 learned_addr learned my addr 172.21.15.139:0/2259951053 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9659c640 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76280 0x55e6a5dbbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d8dd9b640 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5e31730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76280 msgr2=0x55e6a5dbbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76280 0x55e6a5dbbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.294 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 msgr2=0x55e6a5e31730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5e31730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d96d9d640 1 -- 172.21.15.139:0/2259951053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a5d73d40 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d96d9d640 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5e31c70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7d90031780 tx=0x7f7d900ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b8824d660712ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d757fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d757fa640 1 -- 172.21.15.139:0/2259951053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9009e060 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d757fa640 1 -- 172.21.15.139:0/2259951053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7d90076220 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d90079bb0 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d757fa640 1 -- 172.21.15.139:0/2259951053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7d900a7040 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 10 client.5202 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e6a5de0170 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d757fa640 1 -- 172.21.15.139:0/2259951053 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d90079bb0 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d757fa640 1 -- 172.21.15.139:0/2259951053 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7d90082250 con 0x55e6a5d79b40 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 10 client.5202 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 10 client.5202 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:07:29.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 20 client.5202 populate_metadata read hostname 'smithi139' 2024-04-26T18:07:29.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5d9dfd0 0x55e6a5db9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:29.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 4 client.5202 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}] 2024-04-26T18:07:29.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.290+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}) -- 0x55e6a5da1300 con 0x55e6a5d9dfd0 2024-04-26T18:07:29.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.291+0000 7f7d9659c640 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5d9dfd0 0x55e6a5db9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:29.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.291+0000 7f7d9659c640 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5d9dfd0 0x55e6a5db9000 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=190823c666a94635 server_cookie=28b64aba0cef74d3 in_seq=0 out_seq=0 2024-04-26T18:07:29.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:29.291+0000 7f7d757fa640 10 client.5202 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:35.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d757fa640 1 -- 172.21.15.139:0/2259951053 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55e6a5da1300 con 0x55e6a5d9dfd0 2024-04-26T18:07:35.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d757fa640 10 client.5202 handle_command_reply: tid=0 2024-04-26T18:07:35.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 client.5202 shutdown 2024-04-26T18:07:35.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 msgr2=0x55e6a5e31c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:35.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5e31c70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7d90031780 tx=0x7f7d900ac040 comp rx=0 tx=0).stop 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 shutdown_connections 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e6a5d79b40 0x55e6a5e31c70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e6a5d76660 0x55e6a5e31730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e6a5d9dfd0 0x55e6a5db9000 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 --2- 172.21.15.139:0/2259951053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e6a5d76280 0x55e6a5dbbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d757fa640 0 client.5202 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 >> 172.21.15.139:0/2259951053 conn(0x55e6a5d3f740 msgr2=0x55e6a5db60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:35.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 shutdown_connections 2024-04-26T18:07:35.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 1 -- 172.21.15.139:0/2259951053 wait complete. 2024-04-26T18:07:35.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.589+0000 7f7d9f7c8740 20 client.5202 trim_cache size 0 max 16384 2024-04-26T18:07:35.591 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:07:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:07:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:07:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 30, 2024-04-26T18:07:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:07:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "40fa0f39": { 2024-04-26T18:07:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 30, 2024-04-26T18:07:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:07:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:07:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:07:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:07:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.2, 2024-04-26T18:07:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:07:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:07:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:07:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:07:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:35.596 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:07:35.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7d7806c920 msgr2=0x7f7d7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:35.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7d7806c920 0x7f7d7806ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7d880016e0 tx=0x7f7d88009040 comp rx=0 tx=0).stop 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d98153b40 msgr2=0x7f7d9815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d98153b40 0x7f7d9815bfc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009f70 tx=0x7f7d90004a40 comp rx=0 tx=0).stop 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 shutdown_connections 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7d7806c920 0x7f7d7806ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d98153b40 0x7f7d9815bfc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d980cc380 0x7f7d9814ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 --2- 172.21.15.139:0/3187472849 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7d980c7340 0x7f7d981e4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 >> 172.21.15.139:0/3187472849 conn(0x7f7d9806c310 msgr2=0x7f7d98075fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 shutdown_connections 2024-04-26T18:07:35.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:35.590+0000 7f7d9c9da640 1 -- 172.21.15.139:0/3187472849 wait complete. 2024-04-26T18:07:35.603 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '40fa0f39', quiesce took 6.9 seconds. Will release after: 21.2 2024-04-26T18:07:37.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:37.613 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:56.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:07:56.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.914+0000 7f91ee662640 1 Processor -- start 2024-04-26T18:07:56.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.914+0000 7f91ee662640 1 -- start start 2024-04-26T18:07:56.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91ee662640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f91e8153b10 0x7f91e80c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:56.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91ee662640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:56.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91ee662640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e815d830 con 0x7f91e806e240 2024-04-26T18:07:56.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91ee662640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f91e806e8d0 con 0x7f91e8153b10 2024-04-26T18:07:56.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91ee662640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f91e8073910 con 0x7f91e815ce60 2024-04-26T18:07:56.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91e7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f91e8153b10 0x7f91e80c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91e7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f91e8153b10 0x7f91e80c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54690/0 (socket says 172.21.15.139:54690) 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91e7fff640 1 -- 172.21.15.139:0/122393291 learned_addr learned my addr 172.21.15.139:0/122393291 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91ecbff640 1 --2- 172.21.15.139:0/122393291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91e7fff640 1 -- 172.21.15.139:0/122393291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 msgr2=0x7f91e815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91e7fff640 1 --2- 172.21.15.139:0/122393291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91e7fff640 1 -- 172.21.15.139:0/122393291 >> v1:172.21.15.143:6789/0 conn(0x7f91e806e240 legacy=0x7f91e80cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.915+0000 7f91e7fff640 1 -- 172.21.15.139:0/122393291 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e80c7d30 con 0x7f91e8153b10 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.916+0000 7f91e7fff640 1 --2- 172.21.15.139:0/122393291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e8153b10 0x7f91e80c96d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009870 tx=0x7f91d802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fabe932e0084cf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.916+0000 7f91e6ffd640 1 -- 172.21.15.139:0/122393291 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8037070 con 0x7f91e8153b10 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.916+0000 7f91e6ffd640 1 -- 172.21.15.139:0/122393291 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d802ae50 con 0x7f91e8153b10 2024-04-26T18:07:56.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.916+0000 7f91e6ffd640 1 -- 172.21.15.139:0/122393291 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8032860 con 0x7f91e8153b10 2024-04-26T18:07:56.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 -- 172.21.15.139:0/122393291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e8153b10 msgr2=0x7f91e80c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:56.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 --2- 172.21.15.139:0/122393291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e8153b10 0x7f91e80c96d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f91d8009870 tx=0x7f91d802a300 comp rx=0 tx=0).stop 2024-04-26T18:07:56.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 -- 172.21.15.139:0/122393291 shutdown_connections 2024-04-26T18:07:56.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 --2- 172.21.15.139:0/122393291 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:56.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 --2- 172.21.15.139:0/122393291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e8153b10 0x7f91e80c96d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 -- 172.21.15.139:0/122393291 >> 172.21.15.139:0/122393291 conn(0x7f91e8068270 msgr2=0x7f91e8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 -- 172.21.15.139:0/122393291 shutdown_connections 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.917+0000 7f91ee662640 1 -- 172.21.15.139:0/122393291 wait complete. 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.918+0000 7f91ee662640 1 Processor -- start 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.918+0000 7f91ee662640 1 -- start start 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91ee662640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e806e240 0x7f91e81f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91ee662640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e8153b10 0x7f91e81f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91ee662640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91ee662640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f91e80732c0 con 0x7f91e806e240 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91ee662640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f91e8072fe0 con 0x7f91e8153b10 2024-04-26T18:07:56.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91ee662640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f91e80735a0 con 0x7f91e815ce60 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e806e240 0x7f91e81f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e806e240 0x7f91e81f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54704/0 (socket says 172.21.15.139:54704) 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 -- 172.21.15.139:0/2845330241 learned_addr learned my addr 172.21.15.139:0/2845330241 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91ecbff640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e77fe640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e8153b10 0x7f91e81f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 -- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 msgr2=0x7f91e806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e806fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 -- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e8153b10 msgr2=0x7f91e81f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e8153b10 0x7f91e81f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.919+0000 7f91e7fff640 1 -- 172.21.15.139:0/2845330241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e814aa60 con 0x7f91e806e240 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.920+0000 7f91e7fff640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e806e240 0x7f91e81f3570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c00 tx=0x7f91d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:56.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.920+0000 7f91e4ff9640 1 -- 172.21.15.139:0/2845330241 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8041070 con 0x7f91e806e240 2024-04-26T18:07:56.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.920+0000 7f91e4ff9640 1 -- 172.21.15.139:0/2845330241 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d803c660 con 0x7f91e806e240 2024-04-26T18:07:56.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.920+0000 7f91e4ff9640 1 -- 172.21.15.139:0/2845330241 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8037040 con 0x7f91e806e240 2024-04-26T18:07:56.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.920+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e81f2a90 con 0x7f91e806e240 2024-04-26T18:07:56.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.920+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e806ef90 con 0x7f91e806e240 2024-04-26T18:07:56.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.921+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e8076d20 con 0x7f91e806e240 2024-04-26T18:07:56.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.921+0000 7f91e4ff9640 1 -- 172.21.15.139:0/2845330241 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91d8044070 con 0x7f91e806e240 2024-04-26T18:07:56.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.922+0000 7f91e4ff9640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f91d406c8f0 0x7f91d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:56.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.922+0000 7f91e4ff9640 1 -- 172.21.15.139:0/2845330241 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f91d80ac5b0 con 0x7f91e806e240 2024-04-26T18:07:56.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.922+0000 7f91e77fe640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f91d406c8f0 0x7f91d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:56.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.922+0000 7f91e77fe640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f91d406c8f0 0x7f91d406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91e81502d0 tx=0x7f91dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:56.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:56.926+0000 7f91e4ff9640 1 -- 172.21.15.139:0/2845330241 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91d8079fe0 con 0x7f91e806e240 2024-04-26T18:07:57.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.139+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91e8150300 con 0x7f91e806e240 2024-04-26T18:07:57.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.140+0000 7f91e4ff9640 1 -- 172.21.15.139:0/2845330241 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f91d807e2e0 con 0x7f91e806e240 2024-04-26T18:07:57.140 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:07:57.140 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:07:57.141 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:07:57.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f91d406c8f0 msgr2=0x7f91d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f91d406c8f0 0x7f91d406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f91e81502d0 tx=0x7f91dc009040 comp rx=0 tx=0).stop 2024-04-26T18:07:57.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e806e240 msgr2=0x7f91e81f3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e806e240 0x7f91e81f3570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f91d8000c00 tx=0x7f91d80046c0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 shutdown_connections 2024-04-26T18:07:57.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f91d406c8f0 0x7f91d406edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f91e815ce60 0x7f91e806fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f91e8153b10 0x7f91e81f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 --2- 172.21.15.139:0/2845330241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91e806e240 0x7f91e81f3570 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 >> 172.21.15.139:0/2845330241 conn(0x7f91e8068270 msgr2=0x7f91e8151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:57.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 shutdown_connections 2024-04-26T18:07:57.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.142+0000 7f91ee662640 1 -- 172.21.15.139:0/2845330241 wait complete. 2024-04-26T18:07:57.154 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 40fa0f39 --release --await' 2024-04-26T18:07:57.154 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 40fa0f39 --release --await 2024-04-26T18:07:57.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.259+0000 7f3a41a52640 1 Processor -- start 2024-04-26T18:07:57.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.259+0000 7f3a41a52640 1 -- start start 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.259+0000 7f3a41a52640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c1527f0 0x7f3a3c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a41a52640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a3c15fdf0 0x7f3a3c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a41a52640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c15cbc0 con 0x7f3a3c0d1860 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a41a52640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3c0c6780 con 0x7f3a3c15fdf0 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a41a52640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c15c040 con 0x7f3a3c1527f0 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a33fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f3a3c15fdf0 0x7f3a3c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a3b7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f3a3c0d1860 0x7f3a3c0cc0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:32956/0 (socket says 172.21.15.139:32956) 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a3b7fe640 1 -- 172.21.15.139:0/1043374404 learned_addr learned my addr 172.21.15.139:0/1043374404 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a3affd640 1 --2- 172.21.15.139:0/1043374404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c1527f0 0x7f3a3c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a33fff640 1 -- 172.21.15.139:0/1043374404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c1527f0 msgr2=0x7f3a3c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1043374404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c1527f0 0x7f3a3c15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a33fff640 1 -- 172.21.15.139:0/1043374404 >> v1:172.21.15.139:6789/0 conn(0x7f3a3c0d1860 legacy=0x7f3a3c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a3a7fc640 1 -- 172.21.15.139:0/1043374404 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812065914 0 0) 0x7f3a34001490 con 0x7f3a3c0d1860 2024-04-26T18:07:57.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.260+0000 7f3a33fff640 1 -- 172.21.15.139:0/1043374404 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c15c320 con 0x7f3a3c15fdf0 2024-04-26T18:07:57.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1043374404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c15fdf0 0x7f3a3c0d1320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009790 tx=0x7f3a2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9075d3b8116183 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:57.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a3a7fc640 1 -- 172.21.15.139:0/1043374404 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24037070 con 0x7f3a3c15fdf0 2024-04-26T18:07:57.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a3a7fc640 1 -- 172.21.15.139:0/1043374404 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24032440 con 0x7f3a3c15fdf0 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a3a7fc640 1 -- 172.21.15.139:0/1043374404 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24032810 con 0x7f3a3c15fdf0 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a41a52640 1 -- 172.21.15.139:0/1043374404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c15fdf0 msgr2=0x7f3a3c0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1043374404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c15fdf0 0x7f3a3c0d1320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009790 tx=0x7f3a2402a180 comp rx=0 tx=0).stop 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a41a52640 1 -- 172.21.15.139:0/1043374404 shutdown_connections 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1043374404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c15fdf0 0x7f3a3c0d1320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.261+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1043374404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c1527f0 0x7f3a3c15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.262+0000 7f3a41a52640 1 -- 172.21.15.139:0/1043374404 >> 172.21.15.139:0/1043374404 conn(0x7f3a3c076100 msgr2=0x7f3a3c073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.262+0000 7f3a41a52640 1 -- 172.21.15.139:0/1043374404 shutdown_connections 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.262+0000 7f3a41a52640 1 -- 172.21.15.139:0/1043374404 wait complete. 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 Processor -- start 2024-04-26T18:07:57.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 -- start start 2024-04-26T18:07:57.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c0d1860 0x7f3a3c1e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c1527f0 0x7f3a3c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a3c15fdf0 0x7f3a3c0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c0cdb00 con 0x7f3a3c1527f0 2024-04-26T18:07:57.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c15c8e0 con 0x7f3a3c15fdf0 2024-04-26T18:07:57.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a41a52640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c15bc70 con 0x7f3a3c0d1860 2024-04-26T18:07:57.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c1527f0 0x7f3a3c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c1527f0 0x7f3a3c0c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54722/0 (socket says 172.21.15.139:54722) 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.263+0000 7f3a33fff640 1 -- 172.21.15.139:0/1989523677 learned_addr learned my addr 172.21.15.139:0/1989523677 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a3affd640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c0d1860 0x7f3a3c1e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a3b7fe640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a3c15fdf0 0x7f3a3c0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a33fff640 1 -- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c0d1860 msgr2=0x7f3a3c1e87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c0d1860 0x7f3a3c1e87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a33fff640 1 -- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a3c15fdf0 msgr2=0x7f3a3c0ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a3c15fdf0 0x7f3a3c0ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a33fff640 1 -- 172.21.15.139:0/1989523677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c1f5750 con 0x7f3a3c1527f0 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a3affd640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c0d1860 0x7f3a3c1e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c1527f0 0x7f3a3c0c9e30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098b0 tx=0x7f3a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a38ff9640 1 -- 172.21.15.139:0/1989523677 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24037040 con 0x7f3a3c1527f0 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a38ff9640 1 -- 172.21.15.139:0/1989523677 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24005b90 con 0x7f3a3c1527f0 2024-04-26T18:07:57.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3c1f5a30 con 0x7f3a3c1527f0 2024-04-26T18:07:57.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a38ff9640 1 -- 172.21.15.139:0/1989523677 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24030770 con 0x7f3a3c1527f0 2024-04-26T18:07:57.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.264+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3c1f5ff0 con 0x7f3a3c1527f0 2024-04-26T18:07:57.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.266+0000 7f3a38ff9640 1 -- 172.21.15.139:0/1989523677 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a24030910 con 0x7f3a3c1527f0 2024-04-26T18:07:57.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.266+0000 7f3a38ff9640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a1c06c8f0 0x7f3a1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.266+0000 7f3a38ff9640 1 -- 172.21.15.139:0/1989523677 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f3a240ac9b0 con 0x7f3a3c1527f0 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.266+0000 7f3a3affd640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a1c06c8f0 0x7f3a1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.267+0000 7f3a3affd640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a1c06c8f0 0x7f3a1c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c006fd0 tx=0x7f3a2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.267+0000 7f3a4476b740 1 Processor -- start 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.267+0000 7f3a4476b740 1 -- start start 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2825d4b0 0x560f2829c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2829c9b0 0x560f2825d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2825ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a4476b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f281c2040 con 0x560f2829c9b0 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560f2815db60 con 0x560f2825ea10 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560f281be000 con 0x560f2825d4b0 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2829c9b0 0x560f2825d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2829c9b0 0x560f2825d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54732/0 (socket says 172.21.15.139:54732) 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 -- 172.21.15.139:0/1826059091 learned_addr learned my addr 172.21.15.139:0/1826059091 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 -- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2825d4b0 msgr2=0x560f2829c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2825d4b0 0x560f2829c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 -- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 msgr2=0x560f2825ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a3b7fe640 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2825ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2825ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 -- 172.21.15.139:0/1826059091 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f281529c0 con 0x560f2829c9b0 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a3b7fe640 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2825ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a33fff640 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2829c9b0 0x560f2825d890 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3a24076700 tx=0x7f3a24079c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d251377a5afd14d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.268+0000 7f3a317fa640 1 -- 172.21.15.139:0/1826059091 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2407a2a0 con 0x560f2829c9b0 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a317fa640 1 -- 172.21.15.139:0/1826059091 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2407e650 con 0x560f2829c9b0 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a317fa640 1 -- 172.21.15.139:0/1826059091 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24082e80 con 0x560f2829c9b0 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 -- 172.21.15.139:0/1826059091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2829c9b0 msgr2=0x560f2825d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2829c9b0 0x560f2825d890 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3a24076700 tx=0x7f3a24079c00 comp rx=0 tx=0).stop 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 -- 172.21.15.139:0/1826059091 shutdown_connections 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2825ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2829c9b0 0x560f2825d890 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 --2- 172.21.15.139:0/1826059091 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2825d4b0 0x560f2829c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 -- 172.21.15.139:0/1826059091 >> 172.21.15.139:0/1826059091 conn(0x560f28224930 msgr2=0x560f282a1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 -- 172.21.15.139:0/1826059091 shutdown_connections 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.269+0000 7f3a4476b740 1 -- 172.21.15.139:0/1826059091 wait complete. 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.270+0000 7f3a4476b740 1 -- start start 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.270+0000 7f3a4476b740 1 Processor -- start 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.270+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f2829a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.270+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f28287de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.270+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a4476b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560f2825baf0 con 0x560f2825d4b0 2024-04-26T18:07:57.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560f2815b4f0 con 0x560f2825ea10 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560f2825f040 con 0x560f2829c9b0 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a4476b740 10 client.0 _ll_register_callbacks cb 0x560f281b8c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f2829a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f2829a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54740/0 (socket says 172.21.15.139:54740) 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 -- 172.21.15.139:0/576798157 learned_addr learned my addr 172.21.15.139:0/576798157 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a33fff640 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f28287de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3b7fe640 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 -- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 msgr2=0x560f282b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 -- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 msgr2=0x560f28287de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f28287de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 -- 172.21.15.139:0/576798157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f27ed3920 con 0x560f2825d4b0 2024-04-26T18:07:57.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a3affd640 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f2829a9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00ea70 tx=0x7f3a2c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0ecc39a2c9cbc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/576798157 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00f040 con 0x560f2825d4b0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/576798157 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f3a2c003ca0 con 0x560f2825d4b0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a2407e650 con 0x560f2825d4b0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/576798157 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3a2c013430 con 0x560f2825d4b0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a4476b740 10 client.5223 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560f27f9fd30 con 0x560f2825d4b0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.271+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/576798157 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2407e650 con 0x560f2825d4b0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/576798157 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3a2c02a050 con 0x560f2825d4b0 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a4476b740 10 client.5223 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a4476b740 10 client.5223 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a4476b740 20 client.5223 populate_metadata read hostname 'smithi139' 2024-04-26T18:07:57.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a4476b740 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28284770 0x560f28284b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a4476b740 4 client.5223 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f28195a00 con 0x560f28284770 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a33fff640 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28284770 0x560f28284b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a33fff640 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28284770 0x560f28284b80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e101f9348d1b9f9d server_cookie=672b2024e3ebebc4 in_seq=0 out_seq=0 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.272+0000 7f3a1a7fc640 10 client.5223 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/576798157 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560f28195a00 con 0x560f28284770 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a1a7fc640 10 client.5223 handle_command_reply: tid=0 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 client.5223 shutdown 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 msgr2=0x560f2829a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f2829a9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00ea70 tx=0x7f3a2c00ee70 comp rx=0 tx=0).stop 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 shutdown_connections 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28284770 0x560f28284b80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a1a7fc640 0 client.5223 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:57.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f28287de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 --2- 172.21.15.139:0/576798157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f2829a9a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 >> 172.21.15.139:0/576798157 conn(0x560f28224930 msgr2=0x560f28285ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:57.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 shutdown_connections 2024-04-26T18:07:57.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 1 -- 172.21.15.139:0/576798157 wait complete. 2024-04-26T18:07:57.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.273+0000 7f3a4476b740 20 client.5223 trim_cache size 0 max 16384 2024-04-26T18:07:57.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.290+0000 7f3a4476b740 1 Processor -- start 2024-04-26T18:07:57.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.290+0000 7f3a4476b740 1 -- start start 2024-04-26T18:07:57.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28257020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f28286410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f28286950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a4476b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c200810 con 0x560f2825d4b0 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c1ff6f0 con 0x560f2825ea10 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c0b7000 con 0x560f2829c9b0 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28257020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28257020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54750/0 (socket says 172.21.15.139:54750) 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 -- 172.21.15.139:0/941923209 learned_addr learned my addr 172.21.15.139:0/941923209 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 -- 172.21.15.139:0/941923209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 msgr2=0x560f28286950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 --2- 172.21.15.139:0/941923209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f28286950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 -- 172.21.15.139:0/941923209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 msgr2=0x560f28286410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 --2- 172.21.15.139:0/941923209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f28286410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.292 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 -- 172.21.15.139:0/941923209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f2829af00 con 0x560f2825d4b0 2024-04-26T18:07:57.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.291+0000 7f3a3affd640 1 --2- 172.21.15.139:0/941923209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28257020 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e5f0 tx=0x7f3a2c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f6a444a75b3fd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:57.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a30ff9640 1 -- 172.21.15.139:0/941923209 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c003ca0 con 0x560f2825d4b0 2024-04-26T18:07:57.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a30ff9640 1 -- 172.21.15.139:0/941923209 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0135d0 con 0x560f2825d4b0 2024-04-26T18:07:57.293 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a30ff9640 1 -- 172.21.15.139:0/941923209 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c003e60 con 0x560f2825d4b0 2024-04-26T18:07:57.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 -- 172.21.15.139:0/941923209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 msgr2=0x560f28257020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 --2- 172.21.15.139:0/941923209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28257020 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e5f0 tx=0x7f3a2c01d000 comp rx=0 tx=0).stop 2024-04-26T18:07:57.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 -- 172.21.15.139:0/941923209 shutdown_connections 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 --2- 172.21.15.139:0/941923209 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f28286950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 --2- 172.21.15.139:0/941923209 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f28286410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 --2- 172.21.15.139:0/941923209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28257020 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 -- 172.21.15.139:0/941923209 >> 172.21.15.139:0/941923209 conn(0x560f28224930 msgr2=0x560f28297aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 -- 172.21.15.139:0/941923209 shutdown_connections 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.292+0000 7f3a4476b740 1 -- 172.21.15.139:0/941923209 wait complete. 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.293+0000 7f3a4476b740 1 -- start start 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.293+0000 7f3a4476b740 1 Processor -- start 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28259240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2829fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282a0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c1fe340 con 0x560f2825d4b0 2024-04-26T18:07:57.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c1ff020 con 0x560f2825ea10 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c1fe980 con 0x560f2829c9b0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 10 client.0 _ll_register_callbacks cb 0x7f3a2c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28259240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28259240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54764/0 (socket says 172.21.15.139:54764) 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 -- 172.21.15.139:0/3686653606 learned_addr learned my addr 172.21.15.139:0/3686653606 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3b7fe640 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 -- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 msgr2=0x560f282a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 -- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 msgr2=0x560f2829fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a33fff640 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2829fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2829fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 -- 172.21.15.139:0/3686653606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f28280d90 con 0x560f2825d4b0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a3affd640 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28259240 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e540 tx=0x7f3a2c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf25262a63482cc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a1a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:07:57.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/3686653606 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0043d0 con 0x560f2825d4b0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/3686653606 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f3a2c013dc0 con 0x560f2825d4b0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a2c0135d0 con 0x560f2825d4b0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.294+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/3686653606 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3a2c043050 con 0x560f2825d4b0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 10 client.5229 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560f28258aa0 con 0x560f2825d4b0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/3686653606 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0135d0 con 0x560f2825d4b0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/3686653606 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3a2c046020 con 0x560f2825d4b0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 10 client.5229 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 10 client.5229 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 20 client.5229 populate_metadata read hostname 'smithi139' 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28300fe0 0x560f283013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 4 client.5229 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "40fa0f39", "release": true, "await": true}] 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "40fa0f39", "release": true, "await": true}) -- 0x560f281cfc50 con 0x560f28300fe0 2024-04-26T18:07:57.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a33fff640 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28300fe0 0x560f283013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a1a7fc640 10 client.5229 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.295+0000 7f3a33fff640 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28300fe0 0x560f283013c0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=609995be04072e41 server_cookie=759ae9204417565 in_seq=0 out_seq=0 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a1a7fc640 1 -- 172.21.15.139:0/3686653606 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x560f281cfc50 con 0x560f28300fe0 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a1a7fc640 10 client.5229 handle_command_reply: tid=0 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 client.5229 shutdown 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 msgr2=0x560f28259240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28259240 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00e540 tx=0x7f3a2c014000 comp rx=0 tx=0).stop 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 shutdown_connections 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560f28300fe0 0x560f283013c0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560f2829c9b0 0x560f282a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560f2825ea10 0x560f2829fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 --2- 172.21.15.139:0/3686653606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560f2825d4b0 0x560f28259240 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a1a7fc640 0 client.5229 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 >> 172.21.15.139:0/3686653606 conn(0x560f28224930 msgr2=0x560f2829b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:57.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 shutdown_connections 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 1 -- 172.21.15.139:0/3686653606 wait complete. 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a4476b740 20 client.5229 trim_cache size 0 max 16384 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 32, 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "40fa0f39": { 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 32, 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:07:57.302 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.2, 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:57.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:57.304 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:57.304 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:07:57.304 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a1c06c8f0 msgr2=0x7f3a1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a1c06c8f0 0x7f3a1c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c006fd0 tx=0x7f3a2c008040 comp rx=0 tx=0).stop 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c1527f0 msgr2=0x7f3a3c0c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c1527f0 0x7f3a3c0c9e30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098b0 tx=0x7f3a240046c0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 shutdown_connections 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f3a1c06c8f0 0x7f3a1c06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3a3c15fdf0 0x7f3a3c0ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a3c1527f0 0x7f3a3c0c9e30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 --2- 172.21.15.139:0/1989523677 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f3a3c0d1860 0x7f3a3c1e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 >> 172.21.15.139:0/1989523677 conn(0x7f3a3c076100 msgr2=0x7f3a3c0cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 shutdown_connections 2024-04-26T18:07:57.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:07:57.296+0000 7f3a41a52640 1 -- 172.21.15.139:0/1989523677 wait complete. 2024-04-26T18:07:57.307 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '40fa0f39', seconds elapsed: 28.6 2024-04-26T18:08:07.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:08:07.802 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:08:37.953 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:08:37.957 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:08.075 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:08.078 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:16.051 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-04-26T18:09:16.052 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:09:16.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.225+0000 7fcaafc07640 1 Processor -- start 2024-04-26T18:09:16.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.225+0000 7fcaafc07640 1 -- start start 2024-04-26T18:09:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaafc07640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaafc07640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcaa8156180 0x7fcaa80d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaafc07640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa815f2a0 con 0x7fcaa80cd840 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaafc07640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa815cbc0 con 0x7fcaa8156180 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaafc07640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa80cc730 con 0x7fcaa8155da0 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaad1a2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fcaa8156180 0x7fcaa80d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaae1a4640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcaa80cd840 0x7fcaa80c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60324/0 (socket says 172.21.15.139:60324) 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.226+0000 7fcaae1a4640 1 -- 172.21.15.139:0/351011692 learned_addr learned my addr 172.21.15.139:0/351011692 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.227+0000 7fcaad9a3640 1 --2- 172.21.15.139:0/351011692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.227+0000 7fcaad1a2640 1 -- 172.21.15.139:0/351011692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 msgr2=0x7fcaa815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.227+0000 7fcaad1a2640 1 --2- 172.21.15.139:0/351011692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.227+0000 7fcaad1a2640 1 -- 172.21.15.139:0/351011692 >> v1:172.21.15.139:6789/0 conn(0x7fcaa80cd840 legacy=0x7fcaa80c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.227+0000 7fcaac9a1640 1 -- 172.21.15.139:0/351011692 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4078228586 0 0) 0x7fcaa815f2a0 con 0x7fcaa80cd840 2024-04-26T18:09:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.227+0000 7fcaad1a2640 1 -- 172.21.15.139:0/351011692 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa815f580 con 0x7fcaa8156180 2024-04-26T18:09:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.227+0000 7fcaad1a2640 1 --2- 172.21.15.139:0/351011692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8156180 0x7fcaa80d12c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fca980097a0 tx=0x7fca9802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b769c365a39276d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaac9a1640 1 -- 172.21.15.139:0/351011692 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98037070 con 0x7fcaa8156180 2024-04-26T18:09:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaac9a1640 1 -- 172.21.15.139:0/351011692 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9802ae50 con 0x7fcaa8156180 2024-04-26T18:09:16.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaac9a1640 1 -- 172.21.15.139:0/351011692 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98032660 con 0x7fcaa8156180 2024-04-26T18:09:16.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 -- 172.21.15.139:0/351011692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8156180 msgr2=0x7fcaa80d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 --2- 172.21.15.139:0/351011692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8156180 0x7fcaa80d12c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fca980097a0 tx=0x7fca9802a100 comp rx=0 tx=0).stop 2024-04-26T18:09:16.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 -- 172.21.15.139:0/351011692 shutdown_connections 2024-04-26T18:09:16.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 --2- 172.21.15.139:0/351011692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa8156180 0x7fcaa80d12c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 --2- 172.21.15.139:0/351011692 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 -- 172.21.15.139:0/351011692 >> 172.21.15.139:0/351011692 conn(0x7fcaa8068090 msgr2=0x7fcaa80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 -- 172.21.15.139:0/351011692 shutdown_connections 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.228+0000 7fcaafc07640 1 -- 172.21.15.139:0/351011692 wait complete. 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.229+0000 7fcaafc07640 1 Processor -- start 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.229+0000 7fcaafc07640 1 -- start start 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaafc07640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaa80cd840 0x7fcaa814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaafc07640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaafc07640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa815d2a0 0x7fcaa81f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaafc07640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa80c69b0 con 0x7fcaa815d2a0 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaafc07640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa815fb40 con 0x7fcaa80cd840 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaafc07640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa80c6b30 con 0x7fcaa8155da0 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa815d2a0 0x7fcaa81f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa815d2a0 0x7fcaa81f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48396/0 (socket says 172.21.15.139:48396) 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 -- 172.21.15.139:0/1728755657 learned_addr learned my addr 172.21.15.139:0/1728755657 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaad9a3640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaa80cd840 0x7fcaa814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaad1a2640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 -- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 msgr2=0x7fcaa815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 -- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaa80cd840 msgr2=0x7fcaa814b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaa80cd840 0x7fcaa814b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 -- 172.21.15.139:0/1728755657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa80d02b0 con 0x7fcaa815d2a0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.230+0000 7fcaae1a4640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa815d2a0 0x7fcaa81f4880 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c700 tx=0x7fcaa000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.231+0000 7fca9e7fc640 1 -- 172.21.15.139:0/1728755657 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0018070 con 0x7fcaa815d2a0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.231+0000 7fca9e7fc640 1 -- 172.21.15.139:0/1728755657 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa000ce10 con 0x7fcaa815d2a0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.231+0000 7fca9e7fc640 1 -- 172.21.15.139:0/1728755657 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaa000a880 con 0x7fcaa815d2a0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.231+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa80d0590 con 0x7fcaa815d2a0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.231+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa80d0b50 con 0x7fcaa815d2a0 2024-04-26T18:09:16.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.232+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa80c6280 con 0x7fcaa815d2a0 2024-04-26T18:09:16.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.232+0000 7fca9e7fc640 1 -- 172.21.15.139:0/1728755657 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcaa000aa20 con 0x7fcaa815d2a0 2024-04-26T18:09:16.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.233+0000 7fca9e7fc640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca8c06c8f0 0x7fca8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.233+0000 7fca9e7fc640 1 -- 172.21.15.139:0/1728755657 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fcaa008b380 con 0x7fcaa815d2a0 2024-04-26T18:09:16.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.233+0000 7fcaad9a3640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca8c06c8f0 0x7fca8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.233+0000 7fcaad9a3640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca8c06c8f0 0x7fca8c06edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40079a0 tx=0x7fcaa4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.237+0000 7fca9e7fc640 1 -- 172.21.15.139:0/1728755657 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcaa80c6280 con 0x7fcaa815d2a0 2024-04-26T18:09:16.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.447+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcaa8076d20 con 0x7fcaa815d2a0 2024-04-26T18:09:16.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.448+0000 7fca9e7fc640 1 -- 172.21.15.139:0/1728755657 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fcaa005f020 con 0x7fcaa815d2a0 2024-04-26T18:09:16.448 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:09:16.448 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:09:16.448 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:09:16.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca8c06c8f0 msgr2=0x7fca8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca8c06c8f0 0x7fca8c06edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40079a0 tx=0x7fcaa4008040 comp rx=0 tx=0).stop 2024-04-26T18:09:16.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa815d2a0 msgr2=0x7fcaa81f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa815d2a0 0x7fcaa81f4880 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000c700 tx=0x7fcaa000cbc0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 shutdown_connections 2024-04-26T18:09:16.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fca8c06c8f0 0x7fca8c06edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcaa815d2a0 0x7fcaa81f4880 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcaa8155da0 0x7fcaa815cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 --2- 172.21.15.139:0/1728755657 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcaa80cd840 0x7fcaa814b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 >> 172.21.15.139:0/1728755657 conn(0x7fcaa8068090 msgr2=0x7fcaa8068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 shutdown_connections 2024-04-26T18:09:16.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.450+0000 7fcaafc07640 1 -- 172.21.15.139:0/1728755657 wait complete. 2024-04-26T18:09:16.461 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 86.4 --await-for 42.0' 2024-04-26T18:09:16.461 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 86.4 --await-for 42.0 2024-04-26T18:09:16.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.568+0000 7f17fc338640 1 Processor -- start 2024-04-26T18:09:16.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.568+0000 7f17fc338640 1 -- start start 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17fc338640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f17f415c680 0x7f17f4073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17fc338640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f4073870 con 0x7f17f40cedc0 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17fc338640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f4073b10 con 0x7f17f4155c80 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17fc338640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f17f40cca30 con 0x7f17f415c680 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17f98d3640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f17f40cedc0 0x7f17f415bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60338/0 (socket says 172.21.15.139:60338) 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17f98d3640 1 -- 172.21.15.139:0/984209498 learned_addr learned my addr 172.21.15.139:0/984209498 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/984209498 >> v2:172.21.15.143:3300/0 conn(0x7f17f415c680 0x7f17f4073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.569+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288127320 0 0) 0x7f17f4073870 con 0x7f17f40cedc0 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e0003520 con 0x7f17f40cedc0 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668825109 0 0) 0x7f17f4073b10 con 0x7f17f4155c80 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17f4073870 con 0x7f17f4155c80 2024-04-26T18:09:16.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17fa8d5640 1 -- 172.21.15.139:0/984209498 >> v1:172.21.15.143:6789/0 conn(0x7f17f4155c80 legacy=0x7f17f40cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17fa8d5640 1 -- 172.21.15.139:0/984209498 >> v1:172.21.15.139:6789/0 conn(0x7f17f40cedc0 legacy=0x7f17f415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 818754393 0 0) 0x7f17e0003520 con 0x7f17f40cedc0 2024-04-26T18:09:16.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17fa8d5640 1 -- 172.21.15.139:0/984209498 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40ccd10 con 0x7f17f415c680 2024-04-26T18:09:16.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.570+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/984209498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f4073280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0097a0 tx=0x7f17ec02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e293ba1316eefb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec037070 con 0x7f17f415c680 2024-04-26T18:09:16.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec02ace0 con 0x7f17f415c680 2024-04-26T18:09:16.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17f90d2640 1 -- 172.21.15.139:0/984209498 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4001670 con 0x7f17f415c680 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17fc338640 1 -- 172.21.15.139:0/984209498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 msgr2=0x7f17f4073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17fc338640 1 --2- 172.21.15.139:0/984209498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f4073280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0097a0 tx=0x7f17ec02a250 comp rx=0 tx=0).stop 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17fc338640 1 -- 172.21.15.139:0/984209498 shutdown_connections 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17fc338640 1 --2- 172.21.15.139:0/984209498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f4073280 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17fc338640 1 -- 172.21.15.139:0/984209498 >> 172.21.15.139:0/984209498 conn(0x7f17f406ef00 msgr2=0x7f17f406f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17fc338640 1 -- 172.21.15.139:0/984209498 shutdown_connections 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.571+0000 7f17fc338640 1 -- 172.21.15.139:0/984209498 wait complete. 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.572+0000 7f17fc338640 1 Processor -- start 2024-04-26T18:09:16.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.572+0000 7f17fc338640 1 -- start start 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fc338640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f40cedc0 0x7f17f4153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fc338640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17f4155c80 0x7f17f414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fc338640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f41513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fc338640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40cd5b0 con 0x7f17f40cedc0 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fc338640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40cd2d0 con 0x7f17f415c680 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fc338640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17f4156060 con 0x7f17f4155c80 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f40cedc0 0x7f17f4153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f40cedc0 0x7f17f4153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48402/0 (socket says 172.21.15.139:48402) 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2336669633 learned_addr learned my addr 172.21.15.139:0/2336669633 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:16.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f41513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17f4155c80 0x7f17f414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17f4155c80 msgr2=0x7f17f414f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17f4155c80 0x7f17f414f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 msgr2=0x7f17f41513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f41513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2336669633 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f41538b0 con 0x7f17f40cedc0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.573+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f41513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.574+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f40cedc0 0x7f17f4153370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c7d0 tx=0x7f17f000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.574+0000 7f17eaffd640 1 -- 172.21.15.139:0/2336669633 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0003b70 con 0x7f17f40cedc0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.574+0000 7f17eaffd640 1 -- 172.21.15.139:0/2336669633 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0003d10 con 0x7f17f40cedc0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.574+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f40cb9e0 con 0x7f17f40cedc0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.574+0000 7f17eaffd640 1 -- 172.21.15.139:0/2336669633 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f000aa30 con 0x7f17f40cedc0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.574+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f414ff20 con 0x7f17f40cedc0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.575+0000 7f17eaffd640 1 -- 172.21.15.139:0/2336669633 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17f000abd0 con 0x7f17f40cedc0 2024-04-26T18:09:16.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.575+0000 7f17eaffd640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17d806c920 0x7f17d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.576+0000 7f17eaffd640 1 -- 172.21.15.139:0/2336669633 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f17f008bd40 con 0x7f17f40cedc0 2024-04-26T18:09:16.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.576+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17d806c920 0x7f17d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.576+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17d806c920 0x7f17d806ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17f4153120 tx=0x7f17e4001690 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.577+0000 7f17ff053740 1 Processor -- start 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.577+0000 7f17ff053740 1 -- start start 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17ff053740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770beb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bacf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17ff053740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555770b0fd80 con 0x555770bac5e0 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x555770aabc20 con 0x555770bebae0 2024-04-26T18:09:16.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x555770b0bd40 con 0x555770badb40 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17fa0d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770beb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17fa8d5640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bacf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:48916/0 (socket says 172.21.15.139:48916) 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17fa0d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770beb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48418/0 (socket says 172.21.15.139:48418) 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 -- 172.21.15.139:0/2961890199 learned_addr learned my addr 172.21.15.139:0/2961890199 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 -- 172.21.15.139:0/2961890199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 msgr2=0x555770bacf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2961890199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bacf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 -- 172.21.15.139:0/2961890199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 msgr2=0x555770beb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2961890199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770beb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 -- 172.21.15.139:0/2961890199 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557708edd80 con 0x555770bebae0 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2961890199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bac9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17e4005880 tx=0x7f17e4012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a69a2324088c4c7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17d7fff640 1 -- 172.21.15.139:0/2961890199 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4025070 con 0x555770bebae0 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17d7fff640 1 -- 172.21.15.139:0/2961890199 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e401b050 con 0x555770bebae0 2024-04-26T18:09:16.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.578+0000 7f17d7fff640 1 -- 172.21.15.139:0/2961890199 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4014e20 con 0x555770bebae0 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 -- 172.21.15.139:0/2961890199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 msgr2=0x555770bac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 --2- 172.21.15.139:0/2961890199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bac9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17e4005880 tx=0x7f17e4012000 comp rx=0 tx=0).stop 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 -- 172.21.15.139:0/2961890199 shutdown_connections 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 --2- 172.21.15.139:0/2961890199 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bacf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 --2- 172.21.15.139:0/2961890199 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bac9c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 --2- 172.21.15.139:0/2961890199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770beb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 -- 172.21.15.139:0/2961890199 >> 172.21.15.139:0/2961890199 conn(0x555770b73740 msgr2=0x555770bf0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 -- 172.21.15.139:0/2961890199 shutdown_connections 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.579+0000 7f17ff053740 1 -- 172.21.15.139:0/2961890199 wait complete. 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.580+0000 7f17ff053740 1 -- start start 2024-04-26T18:09:16.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.580+0000 7f17ff053740 1 Processor -- start 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770c00730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770be5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17ff053740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17ff053740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555770baac20 con 0x555770bebae0 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x555770aa9840 con 0x555770bac5e0 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x555770bae170 con 0x555770badb40 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17ff053740 10 client.0 _ll_register_callbacks cb 0x555770aad5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa0d4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770c00730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48434/0 (socket says 172.21.15.139:48434) 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 -- 172.21.15.139:0/3314064574 learned_addr learned my addr 172.21.15.139:0/3314064574 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17f98d3640 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770be5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 -- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 msgr2=0x555770be5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770be5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 -- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 msgr2=0x555770c00730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770c00730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 -- 172.21.15.139:0/3314064574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577094e510 con 0x555770bebae0 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770c00730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be8aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0098c0 tx=0x7f17ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3fa7f6495d3186 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.581+0000 7f17d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:09:16.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17d57fa640 1 -- 172.21.15.139:0/3314064574 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec037040 con 0x555770bebae0 2024-04-26T18:09:16.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17d57fa640 1 -- 172.21.15.139:0/3314064574 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f17ec03f440 con 0x555770bebae0 2024-04-26T18:09:16.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e401b050 con 0x555770bebae0 2024-04-26T18:09:16.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17d57fa640 1 -- 172.21.15.139:0/3314064574 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f17ec02ace0 con 0x555770bebae0 2024-04-26T18:09:16.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 10 client.5250 fetch_fsmap learned FSMap version 9 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5557707e1670 con 0x555770bebae0 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17d57fa640 1 -- 172.21.15.139:0/3314064574 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e401b050 con 0x555770bebae0 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17d57fa640 1 -- 172.21.15.139:0/3314064574 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f17ec03f640 con 0x555770bebae0 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 10 client.5250 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 10 client.5250 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 20 client.5250 populate_metadata read hostname 'smithi139' 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770be45c0 0x555770be94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 4 client.5250 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555770b1d990 con 0x555770be45c0 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.582+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770be45c0 0x555770be94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17d57fa640 10 client.5250 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770be45c0 0x555770be94b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b721a58e27748fbb server_cookie=7c96b73d23573852 in_seq=0 out_seq=0 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17d57fa640 1 -- 172.21.15.139:0/3314064574 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555770b1d990 con 0x555770be45c0 2024-04-26T18:09:16.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17d57fa640 10 client.5250 handle_command_reply: tid=0 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 client.5250 shutdown 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 msgr2=0x555770be8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be8aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0098c0 tx=0x7f17ec004730 comp rx=0 tx=0).stop 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 shutdown_connections 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be8aa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770be45c0 0x555770be94b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770be5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 --2- 172.21.15.139:0/3314064574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770c00730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17d57fa640 0 client.5250 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 >> 172.21.15.139:0/3314064574 conn(0x555770b73740 msgr2=0x555770bad250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 shutdown_connections 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.583+0000 7f17ff053740 1 -- 172.21.15.139:0/3314064574 wait complete. 2024-04-26T18:09:16.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.584+0000 7f17ff053740 20 client.5250 trim_cache size 0 max 16384 2024-04-26T18:09:16.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.600+0000 7f17ff053740 1 Processor -- start 2024-04-26T18:09:16.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17ff053740 1 -- start start 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770be6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770be6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17ff053740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17ff053740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555770beae10 con 0x555770bebae0 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4200580 con 0x555770bac5e0 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17f41ff460 con 0x555770badb40 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17fa8d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17fa8d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48450/0 (socket says 172.21.15.139:48450) 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17fa8d5640 1 -- 172.21.15.139:0/1934360922 learned_addr learned my addr 172.21.15.139:0/1934360922 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17fa8d5640 1 -- 172.21.15.139:0/1934360922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 msgr2=0x555770be6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.601+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/1934360922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770be6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17fa8d5640 1 -- 172.21.15.139:0/1934360922 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 msgr2=0x555770be6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/1934360922 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770be6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17fa8d5640 1 -- 172.21.15.139:0/1934360922 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555770c00aa0 con 0x555770bebae0 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/1934360922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be9a40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x555770be3f50 tx=0x7f17ec040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80ff00c7c7526d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17d77fe640 1 -- 172.21.15.139:0/1934360922 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec05a070 con 0x555770bebae0 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17d77fe640 1 -- 172.21.15.139:0/1934360922 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec038040 con 0x555770bebae0 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17d77fe640 1 -- 172.21.15.139:0/1934360922 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec02ace0 con 0x555770bebae0 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 -- 172.21.15.139:0/1934360922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 msgr2=0x555770be9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 --2- 172.21.15.139:0/1934360922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be9a40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x555770be3f50 tx=0x7f17ec040000 comp rx=0 tx=0).stop 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 -- 172.21.15.139:0/1934360922 shutdown_connections 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 --2- 172.21.15.139:0/1934360922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bebae0 0x555770be9a40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 --2- 172.21.15.139:0/1934360922 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770be6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 --2- 172.21.15.139:0/1934360922 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bac5e0 0x555770be6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 -- 172.21.15.139:0/1934360922 >> 172.21.15.139:0/1934360922 conn(0x555770b73740 msgr2=0x555770bd4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 -- 172.21.15.139:0/1934360922 shutdown_connections 2024-04-26T18:09:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.602+0000 7f17ff053740 1 -- 172.21.15.139:0/1934360922 wait complete. 2024-04-26T18:09:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.603+0000 7f17ff053740 1 -- start start 2024-04-26T18:09:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.603+0000 7f17ff053740 1 Processor -- start 2024-04-26T18:09:16.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17ff053740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770be8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17ff053740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bcd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17ff053740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41fed90 con 0x555770bac5e0 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f17f41f5b60 con 0x555770bebae0 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17ff053740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17f41fe020 con 0x555770badb40 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17ff053740 10 client.0 _ll_register_callbacks cb 0x7f17e0003880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770be8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770be8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48464/0 (socket says 172.21.15.139:48464) 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2476560425 learned_addr learned my addr 172.21.15.139:0/2476560425 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa8d5640 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bcd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 msgr2=0x555770bea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 msgr2=0x555770bcd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bcd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 -- 172.21.15.139:0/2476560425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555770be9820 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17fa0d4640 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770be8760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f17f0059670 tx=0x7f17f0059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d046432028e30f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.604+0000 7f17d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17d57fa640 1 -- 172.21.15.139:0/2476560425 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0055d50 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17d57fa640 1 -- 172.21.15.139:0/2476560425 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f17f005eb70 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17ec038040 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17d57fa640 1 -- 172.21.15.139:0/2476560425 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f17f0055ef0 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 10 client.5256 fetch_fsmap learned FSMap version 9 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x555770be41d0 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17d57fa640 1 -- 172.21.15.139:0/2476560425 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec038040 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17d57fa640 1 -- 172.21.15.139:0/2476560425 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f17f0058b30 con 0x555770bac5e0 2024-04-26T18:09:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 10 client.5256 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 10 client.5256 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 20 client.5256 populate_metadata read hostname 'smithi139' 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770bff020 0x555770c697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 4 client.5256 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.4, "await_for": 42.0}] 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.4, "await_for": 42.0}) -- 0x555770b17800 con 0x555770bff020 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770bff020 0x555770c697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17d57fa640 10 client.5256 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:16.605+0000 7f17f98d3640 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770bff020 0x555770c697b0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92bcd31b0a9e38dd server_cookie=fbc42660a65a8f6d in_seq=0 out_seq=0 2024-04-26T18:09:20.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.597+0000 7f17d57fa640 1 -- 172.21.15.139:0/2476560425 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x555770b17800 con 0x555770bff020 2024-04-26T18:09:20.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.597+0000 7f17d57fa640 10 client.5256 handle_command_reply: tid=0 2024-04-26T18:09:20.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.597+0000 7f17ff053740 1 client.5256 shutdown 2024-04-26T18:09:20.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.597+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 msgr2=0x555770be8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.597+0000 7f17ff053740 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770be8760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f17f0059670 tx=0x7f17f0059040 comp rx=0 tx=0).stop 2024-04-26T18:09:20.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 shutdown_connections 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555770bebae0 0x555770bcd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x555770bff020 0x555770c697b0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x555770badb40 0x555770bea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 --2- 172.21.15.139:0/2476560425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555770bac5e0 0x555770be8760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17d57fa640 0 client.5256 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 >> 172.21.15.139:0/2476560425 conn(0x555770b73740 msgr2=0x555770be6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 shutdown_connections 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 1 -- 172.21.15.139:0/2476560425 wait complete. 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.598+0000 7f17ff053740 20 client.5256 trim_cache size 0 max 16384 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:09:20.599 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 34, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "4b9460ef": { 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 34, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 86.4, 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:09:20.600 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:20.601 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17d806c920 msgr2=0x7f17d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17d806c920 0x7f17d806ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f17f4153120 tx=0x7f17e4001690 comp rx=0 tx=0).stop 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f40cedc0 msgr2=0x7f17f4153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f40cedc0 0x7f17f4153370 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c7d0 tx=0x7f17f000cc90 comp rx=0 tx=0).stop 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 shutdown_connections 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f17d806c920 0x7f17d806ede0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17f415c680 0x7f17f41513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17f4155c80 0x7f17f414f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 --2- 172.21.15.139:0/2336669633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17f40cedc0 0x7f17f4153370 secure :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c7d0 tx=0x7f17f000cc90 comp rx=0 tx=0).stop 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 >> 172.21.15.139:0/2336669633 conn(0x7f17f406ef00 msgr2=0x7f17f4159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 shutdown_connections 2024-04-26T18:09:20.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:20.599+0000 7f17fc338640 1 -- 172.21.15.139:0/2336669633 wait complete. 2024-04-26T18:09:20.613 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4b9460ef', quiesce took 4.6 seconds. Will release after: 26.4 2024-04-26T18:09:38.340 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:38.344 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:47.014 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:09:47.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.124+0000 7f56add46640 1 Processor -- start 2024-04-26T18:09:47.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.124+0000 7f56add46640 1 -- start start 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56add46640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f56a80cb210 0x7f56a8155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56add46640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56a80c8a30 0x7f56a8156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56add46640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a80c95b0 con 0x7f56a80cae30 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56add46640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f56a8071b90 con 0x7f56a80c8a30 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56add46640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f56a8070d10 con 0x7f56a80cb210 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56a80c8a30 0x7f56a8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56a80c8a30 0x7f56a8156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48562/0 (socket says 172.21.15.139:48562) 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a7fff640 1 -- 172.21.15.139:0/208419364 learned_addr learned my addr 172.21.15.139:0/208419364 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a6ffd640 1 --2- 172.21.15.139:0/208419364 >> v2:172.21.15.143:3300/0 conn(0x7f56a80cb210 0x7f56a8155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a7fff640 1 -- 172.21.15.139:0/208419364 >> v2:172.21.15.143:3300/0 conn(0x7f56a80cb210 msgr2=0x7f56a8155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a7fff640 1 --2- 172.21.15.139:0/208419364 >> v2:172.21.15.143:3300/0 conn(0x7f56a80cb210 0x7f56a8155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a7fff640 1 -- 172.21.15.139:0/208419364 >> v1:172.21.15.143:6789/0 conn(0x7f56a80cae30 legacy=0x7f56a8071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.125+0000 7f56a7fff640 1 -- 172.21.15.139:0/208419364 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a80c9820 con 0x7f56a80c8a30 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.126+0000 7f56a7fff640 1 --2- 172.21.15.139:0/208419364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80c8a30 0x7f56a8156250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f56a80cab90 tx=0x7f56a002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2329699c5b3cf07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.126+0000 7f56a67fc640 1 -- 172.21.15.139:0/208419364 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0036070 con 0x7f56a80c8a30 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.126+0000 7f56a67fc640 1 -- 172.21.15.139:0/208419364 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a0031600 con 0x7f56a80c8a30 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.126+0000 7f56a67fc640 1 -- 172.21.15.139:0/208419364 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a00319d0 con 0x7f56a80c8a30 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 -- 172.21.15.139:0/208419364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80c8a30 msgr2=0x7f56a8156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 --2- 172.21.15.139:0/208419364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80c8a30 0x7f56a8156250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f56a80cab90 tx=0x7f56a002a730 comp rx=0 tx=0).stop 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 -- 172.21.15.139:0/208419364 shutdown_connections 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 --2- 172.21.15.139:0/208419364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80c8a30 0x7f56a8156250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 --2- 172.21.15.139:0/208419364 >> v2:172.21.15.143:3300/0 conn(0x7f56a80cb210 0x7f56a8155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 -- 172.21.15.139:0/208419364 >> 172.21.15.139:0/208419364 conn(0x7f56a8068090 msgr2=0x7f56a8068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 -- 172.21.15.139:0/208419364 shutdown_connections 2024-04-26T18:09:47.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.127+0000 7f56add46640 1 -- 172.21.15.139:0/208419364 wait complete. 2024-04-26T18:09:47.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.128+0000 7f56add46640 1 Processor -- start 2024-04-26T18:09:47.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.128+0000 7f56add46640 1 -- start start 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56add46640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56a80c8a30 0x7f56a81f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56add46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56a80cae30 0x7f56a81f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56add46640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80cb210 0x7f56a814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56add46640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56a8070f60 con 0x7f56a80cb210 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56add46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f56a80c9de0 con 0x7f56a80cae30 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56add46640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f56a815f340 con 0x7f56a80c8a30 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80cb210 0x7f56a814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80cb210 0x7f56a814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48572/0 (socket says 172.21.15.139:48572) 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 -- 172.21.15.139:0/2476632715 learned_addr learned my addr 172.21.15.139:0/2476632715 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a6ffd640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56a80cae30 0x7f56a81f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a77fe640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56a80c8a30 0x7f56a81f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 -- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56a80c8a30 msgr2=0x7f56a81f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56a80c8a30 0x7f56a81f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 -- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56a80cae30 msgr2=0x7f56a81f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56a80cae30 0x7f56a81f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 -- 172.21.15.139:0/2476632715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a80cd320 con 0x7f56a80cb210 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a6ffd640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56a80cae30 0x7f56a81f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f56a7fff640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80cb210 0x7f56a814e8e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009f40 tx=0x7f56a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.129+0000 7f568ffff640 1 -- 172.21.15.139:0/2476632715 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0036050 con 0x7f56a80cb210 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.130+0000 7f568ffff640 1 -- 172.21.15.139:0/2476632715 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a0042070 con 0x7f56a80cb210 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.130+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a80cd600 con 0x7f56a80cb210 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.130+0000 7f568ffff640 1 -- 172.21.15.139:0/2476632715 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0009510 con 0x7f56a80cb210 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.130+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a80cdbc0 con 0x7f56a80cb210 2024-04-26T18:09:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.131+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a80ce2c0 con 0x7f56a80cb210 2024-04-26T18:09:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.131+0000 7f568ffff640 1 -- 172.21.15.139:0/2476632715 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56a0007bf0 con 0x7f56a80cb210 2024-04-26T18:09:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.132+0000 7f568ffff640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f569406c8f0 0x7f569406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.132+0000 7f56a77fe640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f569406c8f0 0x7f569406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.132+0000 7f568ffff640 1 -- 172.21.15.139:0/2476632715 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f56a00accb0 con 0x7f56a80cb210 2024-04-26T18:09:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.132+0000 7f56a77fe640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f569406c8f0 0x7f569406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5698001640 tx=0x7f5698009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.136+0000 7f568ffff640 1 -- 172.21.15.139:0/2476632715 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56a0045360 con 0x7f56a80cb210 2024-04-26T18:09:47.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.347+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56a8076d20 con 0x7f56a80cb210 2024-04-26T18:09:47.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.347+0000 7f568ffff640 1 -- 172.21.15.139:0/2476632715 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f56a007ad30 con 0x7f56a80cb210 2024-04-26T18:09:47.347 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:09:47.347 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:09:47.348 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:09:47.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f569406c8f0 msgr2=0x7f569406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f569406c8f0 0x7f569406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5698001640 tx=0x7f5698009040 comp rx=0 tx=0).stop 2024-04-26T18:09:47.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80cb210 msgr2=0x7f56a814e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80cb210 0x7f56a814e8e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009f40 tx=0x7f56a0004a40 comp rx=0 tx=0).stop 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 shutdown_connections 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f569406c8f0 0x7f569406edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56a80cb210 0x7f56a814e8e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56a80cae30 0x7f56a81f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 --2- 172.21.15.139:0/2476632715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56a80c8a30 0x7f56a81f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 >> 172.21.15.139:0/2476632715 conn(0x7f56a8068090 msgr2=0x7f56a815d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 shutdown_connections 2024-04-26T18:09:47.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.349+0000 7f56add46640 1 -- 172.21.15.139:0/2476632715 wait complete. 2024-04-26T18:09:47.360 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 4b9460ef --release --await' 2024-04-26T18:09:47.360 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 4b9460ef --release --await 2024-04-26T18:09:47.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.463+0000 7f0239fe2640 1 Processor -- start 2024-04-26T18:09:47.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.463+0000 7f0239fe2640 1 -- start start 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0239fe2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02340737e0 0x7f02340745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0239fe2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f02340ca530 0x7f02340ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0239fe2640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02340c8f10 con 0x7f0234153d10 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0239fe2640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f02341540f0 con 0x7f02340ca530 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0239fe2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0234072f20 con 0x7f02340737e0 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0233fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f02340ca530 0x7f02340ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0233fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f02340ca530 0x7f02340ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48574/0 (socket says 172.21.15.139:48574) 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0233fff640 1 -- 172.21.15.139:0/1191517063 learned_addr learned my addr 172.21.15.139:0/1191517063 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0232ffd640 1 --2- 172.21.15.139:0/1191517063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02340737e0 0x7f02340745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0233fff640 1 -- 172.21.15.139:0/1191517063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02340737e0 msgr2=0x7f02340745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0233fff640 1 --2- 172.21.15.139:0/1191517063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02340737e0 0x7f02340745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.464+0000 7f0233fff640 1 -- 172.21.15.139:0/1191517063 >> v1:172.21.15.143:6789/0 conn(0x7f0234153d10 legacy=0x7f023406cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.465+0000 7f0233fff640 1 -- 172.21.15.139:0/1191517063 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02340c8a30 con 0x7f02340ca530 2024-04-26T18:09:47.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.465+0000 7f0233fff640 1 --2- 172.21.15.139:0/1191517063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340ca530 0x7f02340ce2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f022c009e50 tx=0x7f022c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237c061d38fb4314 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.465+0000 7f02327fc640 1 -- 172.21.15.139:0/1191517063 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c036070 con 0x7f02340ca530 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.465+0000 7f02327fc640 1 -- 172.21.15.139:0/1191517063 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022c031600 con 0x7f02340ca530 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.465+0000 7f02327fc640 1 -- 172.21.15.139:0/1191517063 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c0319d0 con 0x7f02340ca530 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 -- 172.21.15.139:0/1191517063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340ca530 msgr2=0x7f02340ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1191517063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340ca530 0x7f02340ce2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f022c009e50 tx=0x7f022c02a710 comp rx=0 tx=0).stop 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 -- 172.21.15.139:0/1191517063 shutdown_connections 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1191517063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340ca530 0x7f02340ce2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1191517063 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f02340737e0 0x7f02340745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 -- 172.21.15.139:0/1191517063 >> 172.21.15.139:0/1191517063 conn(0x7f023406ed70 msgr2=0x7f023406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 -- 172.21.15.139:0/1191517063 shutdown_connections 2024-04-26T18:09:47.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.466+0000 7f0239fe2640 1 -- 172.21.15.139:0/1191517063 wait complete. 2024-04-26T18:09:47.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.467+0000 7f0239fe2640 1 Processor -- start 2024-04-26T18:09:47.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.467+0000 7f0239fe2640 1 -- start start 2024-04-26T18:09:47.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f0239fe2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340737e0 0x7f02340c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f0239fe2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02340ca530 0x7f023414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f0239fe2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0234153d10 0x7f02341f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f0239fe2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f02340cb6a0 con 0x7f02340737e0 2024-04-26T18:09:47.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f0239fe2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f02340731c0 con 0x7f02340ca530 2024-04-26T18:09:47.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f0239fe2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f02340cb980 con 0x7f0234153d10 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340737e0 0x7f02340c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340737e0 0x7f02340c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48580/0 (socket says 172.21.15.139:48580) 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 -- 172.21.15.139:0/1573979848 learned_addr learned my addr 172.21.15.139:0/1573979848 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 -- 172.21.15.139:0/1573979848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0234153d10 msgr2=0x7f02341f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0234153d10 0x7f02341f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 -- 172.21.15.139:0/1573979848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02340ca530 msgr2=0x7f023414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02340ca530 0x7f023414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 -- 172.21.15.139:0/1573979848 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02341f3c40 con 0x7f02340737e0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f02337fe640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340737e0 0x7f02340c5730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f022400c3f0 tx=0x7f022400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.468+0000 7f021bfff640 1 -- 172.21.15.139:0/1573979848 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02240052d0 con 0x7f02340737e0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.469+0000 7f021bfff640 1 -- 172.21.15.139:0/1573979848 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0224005490 con 0x7f02340737e0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.469+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02340c5e50 con 0x7f02340737e0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.469+0000 7f021bfff640 1 -- 172.21.15.139:0/1573979848 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224007260 con 0x7f02340737e0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.469+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02341efb20 con 0x7f02340737e0 2024-04-26T18:09:47.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.470+0000 7f021bfff640 1 -- 172.21.15.139:0/1573979848 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0224007400 con 0x7f02340737e0 2024-04-26T18:09:47.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.471+0000 7f021bfff640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f022006c8f0 0x7f022006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.471+0000 7f021bfff640 1 -- 172.21.15.139:0/1573979848 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f022408b430 con 0x7f02340737e0 2024-04-26T18:09:47.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.471+0000 7f0232ffd640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f022006c8f0 0x7f022006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.471+0000 7f0232ffd640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f022006c8f0 0x7f022006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0228006a90 tx=0x7f0228006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 Processor -- start 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 -- start start 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad66a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad62b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad62bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5646ad590040 con 0x5646ad66a9b0 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5646ad52bb60 con 0x5646ad62ca10 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5646ad58c000 con 0x5646ad62b4b0 2024-04-26T18:09:47.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.472+0000 7f0232ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad62b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad62b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48582/0 (socket says 172.21.15.139:48582) 2024-04-26T18:09:47.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 -- 172.21.15.139:0/3923362751 learned_addr learned my addr 172.21.15.139:0/3923362751 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0233fff640 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad62bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f02337fe640 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad66a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 -- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 msgr2=0x5646ad66a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad66a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 -- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 msgr2=0x5646ad62bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad62bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 -- 172.21.15.139:0/3923362751 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646ad5209c0 con 0x5646ad66a9b0 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f0232ffd640 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad62b890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f022800eb80 tx=0x7f0228011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653b44ee176966e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f02197fa640 1 -- 172.21.15.139:0/3923362751 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022801b040 con 0x5646ad66a9b0 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f02197fa640 1 -- 172.21.15.139:0/3923362751 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0228024070 con 0x5646ad66a9b0 2024-04-26T18:09:47.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.473+0000 7f02197fa640 1 -- 172.21.15.139:0/3923362751 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228015cc0 con 0x5646ad66a9b0 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 -- 172.21.15.139:0/3923362751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 msgr2=0x5646ad62b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad62b890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f022800eb80 tx=0x7f0228011000 comp rx=0 tx=0).stop 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 -- 172.21.15.139:0/3923362751 shutdown_connections 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad62bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad62b890 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 --2- 172.21.15.139:0/3923362751 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad66a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 -- 172.21.15.139:0/3923362751 >> 172.21.15.139:0/3923362751 conn(0x5646ad5f2930 msgr2=0x5646ad66f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 -- 172.21.15.139:0/3923362751 shutdown_connections 2024-04-26T18:09:47.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 -- 172.21.15.139:0/3923362751 wait complete. 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 -- start start 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.474+0000 7f023cdce740 1 Processor -- start 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad668be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f023cdce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62ca10 0x5646ad67f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad66a9b0 0x5646ad655960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f023cdce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5646ad629af0 con 0x5646ad62ca10 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5646ad5294f0 con 0x5646ad66a9b0 2024-04-26T18:09:47.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5646ad62d040 con 0x5646ad62b4b0 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f023cdce740 10 client.0 _ll_register_callbacks cb 0x5646ad586c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62ca10 0x5646ad67f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62ca10 0x5646ad67f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48588/0 (socket says 172.21.15.139:48588) 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 -- 172.21.15.139:0/2911212033 learned_addr learned my addr 172.21.15.139:0/2911212033 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0233fff640 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad66a9b0 0x5646ad655960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f02337fe640 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad668be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 -- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 msgr2=0x5646ad668be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad668be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 -- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad66a9b0 msgr2=0x5646ad655960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad66a9b0 0x5646ad655960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.475+0000 7f0232ffd640 1 -- 172.21.15.139:0/2911212033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646ad2a1920 con 0x5646ad62ca10 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f0232ffd640 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62ca10 0x5646ad67f240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5646ad66ba50 tx=0x7f0228009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d00bc4522a4dcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f02127fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f02127fc640 1 -- 172.21.15.139:0/2911212033 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228013a20 con 0x5646ad62ca10 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f02127fc640 1 -- 172.21.15.139:0/2911212033 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f0228013bc0 con 0x5646ad62ca10 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0228024070 con 0x5646ad62ca10 2024-04-26T18:09:47.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f02127fc640 1 -- 172.21.15.139:0/2911212033 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0228013dc0 con 0x5646ad62ca10 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 10 client.5274 fetch_fsmap learned FSMap version 9 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5646ad36dd30 con 0x5646ad62ca10 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f02127fc640 1 -- 172.21.15.139:0/2911212033 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0228024070 con 0x5646ad62ca10 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f02127fc640 1 -- 172.21.15.139:0/2911212033 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f022803f080 con 0x5646ad62ca10 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 10 client.5274 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 10 client.5274 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 20 client.5274 populate_metadata read hostname 'smithi139' 2024-04-26T18:09:47.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6695a0 0x5646ad6522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 4 client.5274 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.476+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646ad563a00 con 0x5646ad6695a0 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.477+0000 7f02337fe640 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6695a0 0x5646ad6522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.477+0000 7f02127fc640 10 client.5274 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.477+0000 7f02337fe640 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6695a0 0x5646ad6522b0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e612dad82775d77 server_cookie=54934e17538bf6a5 in_seq=0 out_seq=0 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f02127fc640 1 -- 172.21.15.139:0/2911212033 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5646ad563a00 con 0x5646ad6695a0 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f02127fc640 10 client.5274 handle_command_reply: tid=0 2024-04-26T18:09:47.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 client.5274 shutdown 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62ca10 msgr2=0x5646ad67f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62ca10 0x5646ad67f240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5646ad66ba50 tx=0x7f0228009190 comp rx=0 tx=0).stop 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 shutdown_connections 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad66a9b0 0x5646ad655960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62ca10 0x5646ad67f240 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6695a0 0x5646ad6522b0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 --2- 172.21.15.139:0/2911212033 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad668be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f02127fc640 0 client.5274 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 >> 172.21.15.139:0/2911212033 conn(0x5646ad5f2930 msgr2=0x5646ad6256c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 shutdown_connections 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 1 -- 172.21.15.139:0/2911212033 wait complete. 2024-04-26T18:09:47.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.478+0000 7f023cdce740 20 client.5274 trim_cache size 0 max 16384 2024-04-26T18:09:47.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.495+0000 7f023cdce740 1 Processor -- start 2024-04-26T18:09:47.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.495+0000 7f023cdce740 1 -- start start 2024-04-26T18:09:47.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f023cdce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62b4b0 0x5646ad6e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad64f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad66a9b0 0x5646ad64fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f023cdce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f02341fe6c0 con 0x5646ad62b4b0 2024-04-26T18:09:47.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f02341fd5a0 con 0x5646ad62ca10 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f02341fbb90 con 0x5646ad66a9b0 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62b4b0 0x5646ad6e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62b4b0 0x5646ad6e1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48590/0 (socket says 172.21.15.139:48590) 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 -- 172.21.15.139:0/1421230577 learned_addr learned my addr 172.21.15.139:0/1421230577 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 -- 172.21.15.139:0/1421230577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad66a9b0 msgr2=0x5646ad64fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 --2- 172.21.15.139:0/1421230577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad66a9b0 0x5646ad64fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 -- 172.21.15.139:0/1421230577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 msgr2=0x5646ad64f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 --2- 172.21.15.139:0/1421230577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad64f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 -- 172.21.15.139:0/1421230577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646ad66f8f0 con 0x5646ad62b4b0 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f02337fe640 1 --2- 172.21.15.139:0/1421230577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62b4b0 0x5646ad6e1a00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f022400c3c0 tx=0x7f0224000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8cbe62101ee3b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f0218ff9640 1 -- 172.21.15.139:0/1421230577 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224087070 con 0x5646ad62b4b0 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f0218ff9640 1 -- 172.21.15.139:0/1421230577 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0224056dc0 con 0x5646ad62b4b0 2024-04-26T18:09:47.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.496+0000 7f0218ff9640 1 -- 172.21.15.139:0/1421230577 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224055390 con 0x5646ad62b4b0 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 -- 172.21.15.139:0/1421230577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62b4b0 msgr2=0x5646ad6e1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 --2- 172.21.15.139:0/1421230577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62b4b0 0x5646ad6e1a00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f022400c3c0 tx=0x7f0224000ed0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 -- 172.21.15.139:0/1421230577 shutdown_connections 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 --2- 172.21.15.139:0/1421230577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad66a9b0 0x5646ad64fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 --2- 172.21.15.139:0/1421230577 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad64f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 --2- 172.21.15.139:0/1421230577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad62b4b0 0x5646ad6e1a00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 -- 172.21.15.139:0/1421230577 >> 172.21.15.139:0/1421230577 conn(0x5646ad5f2930 msgr2=0x5646ad6290b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 -- 172.21.15.139:0/1421230577 shutdown_connections 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 -- 172.21.15.139:0/1421230577 wait complete. 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.497+0000 7f023cdce740 1 -- start start 2024-04-26T18:09:47.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 1 Processor -- start 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad68ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad6ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad6ede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f02341fc150 con 0x5646ad66a9b0 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f02341fced0 con 0x5646ad62ca10 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f02341fc800 con 0x5646ad62b4b0 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f023cdce740 10 client.0 _ll_register_callbacks cb 0x7f022800ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:47.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f0233fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad6ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f0233fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad6ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48596/0 (socket says 172.21.15.139:48596) 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f0233fff640 1 -- 172.21.15.139:0/3299194896 learned_addr learned my addr 172.21.15.139:0/3299194896 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f02337fe640 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad68ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.498+0000 7f0232ffd640 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad6ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f0233fff640 1 -- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 msgr2=0x5646ad68ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f0233fff640 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad68ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f0233fff640 1 -- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 msgr2=0x5646ad6ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f0233fff640 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad6ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f0233fff640 1 -- 172.21.15.139:0/3299194896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646ad6a7e30 con 0x5646ad66a9b0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f0233fff640 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad6ede20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f022c009f70 tx=0x7f022c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87752fc19f5228ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f02127fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f02127fc640 1 -- 172.21.15.139:0/3299194896 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c043070 con 0x5646ad66a9b0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f02127fc640 1 -- 172.21.15.139:0/3299194896 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f022c03d870 con 0x5646ad66a9b0 2024-04-26T18:09:47.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0224056dc0 con 0x5646ad66a9b0 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f02127fc640 1 -- 172.21.15.139:0/3299194896 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f022c04d050 con 0x5646ad66a9b0 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 10 client.5280 fetch_fsmap learned FSMap version 9 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5646ad653ee0 con 0x5646ad66a9b0 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f02127fc640 1 -- 172.21.15.139:0/3299194896 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0224056dc0 con 0x5646ad66a9b0 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f02127fc640 1 -- 172.21.15.139:0/3299194896 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f022c050020 con 0x5646ad66a9b0 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 10 client.5280 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 10 client.5280 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 20 client.5280 populate_metadata read hostname 'smithi139' 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6ee360 0x5646ad6dfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 4 client.5280 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4b9460ef", "release": true, "await": true}] 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.499+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4b9460ef", "release": true, "await": true}) -- 0x5646ad59dc50 con 0x5646ad6ee360 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f02337fe640 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6ee360 0x5646ad6dfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:47.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f02127fc640 10 client.5280 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f02337fe640 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6ee360 0x5646ad6dfc00 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2530d308bc56c38 server_cookie=cd78acf9a5690fdf in_seq=0 out_seq=0 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f02127fc640 1 -- 172.21.15.139:0/3299194896 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5646ad59dc50 con 0x5646ad6ee360 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f02127fc640 10 client.5280 handle_command_reply: tid=0 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 client.5280 shutdown 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 msgr2=0x5646ad6ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad6ede20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f022c009f70 tx=0x7f022c009c20 comp rx=0 tx=0).stop 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 shutdown_connections 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646ad66a9b0 0x5646ad6ede20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5646ad62ca10 0x5646ad6ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5646ad6ee360 0x5646ad6dfc00 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 --2- 172.21.15.139:0/3299194896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5646ad62b4b0 0x5646ad68ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f02127fc640 0 client.5280 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 >> 172.21.15.139:0/3299194896 conn(0x5646ad5f2930 msgr2=0x5646ad64f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.500+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 shutdown_connections 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f023cdce740 1 -- 172.21.15.139:0/3299194896 wait complete. 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f023cdce740 20 client.5280 trim_cache size 0 max 16384 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 36, 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "4b9460ef": { 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 36, 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:09:47.508 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 86.4, 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:09:47.509 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:09:47.510 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:09:47.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f022006c8f0 msgr2=0x7f022006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f022006c8f0 0x7f022006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0228006a90 tx=0x7f0228006a20 comp rx=0 tx=0).stop 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340737e0 msgr2=0x7f02340c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340737e0 0x7f02340c5730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f022400c3f0 tx=0x7f022400c8b0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 shutdown_connections 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f022006c8f0 0x7f022006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0234153d10 0x7f02341f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f02340ca530 0x7f023414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 --2- 172.21.15.139:0/1573979848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02340737e0 0x7f02340c5730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 >> 172.21.15.139:0/1573979848 conn(0x7f023406ed70 msgr2=0x7f023406cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:47.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 shutdown_connections 2024-04-26T18:09:47.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:09:47.501+0000 7f0239fe2640 1 -- 172.21.15.139:0/1573979848 wait complete. 2024-04-26T18:09:47.513 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4b9460ef', seconds elapsed: 31.5 2024-04-26T18:10:08.411 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:10:08.414 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:10:36.542 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 34.4 2024-04-26T18:10:36.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:10:36.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.694+0000 7efe711a6640 1 Processor -- start 2024-04-26T18:10:36.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.694+0000 7efe711a6640 1 -- start start 2024-04-26T18:10:36.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.696+0000 7efe711a6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe640dd670 0x7efe640e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:36.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.696+0000 7efe711a6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efe6404cac0 0x7efe6404cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:36.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.696+0000 7efe711a6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe6400edf0 con 0x7efe64050770 2024-04-26T18:10:36.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.696+0000 7efe711a6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7efe640e42f0 con 0x7efe6404cac0 2024-04-26T18:10:36.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.696+0000 7efe711a6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efe6404d470 con 0x7efe640dd670 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe6b7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7efe64050770 0x7efe640071b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:34868/0 (socket says 172.21.15.139:34868) 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe6b7fe640 1 -- 172.21.15.139:0/2129965813 learned_addr learned my addr 172.21.15.139:0/2129965813 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe709a5640 1 --2- 172.21.15.139:0/2129965813 >> v2:172.21.15.143:3300/0 conn(0x7efe6404cac0 0x7efe6404cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe6bfff640 1 --2- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe640dd670 0x7efe640e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe6affd640 1 -- 172.21.15.139:0/2129965813 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477446214 0 0) 0x7efe6c0515b0 con 0x7efe64050770 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe6affd640 1 -- 172.21.15.139:0/2129965813 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe5c003520 con 0x7efe64050770 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe709a5640 1 -- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe640dd670 msgr2=0x7efe640e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe709a5640 1 --2- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe640dd670 0x7efe640e3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe709a5640 1 -- 172.21.15.139:0/2129965813 >> v1:172.21.15.143:6789/0 conn(0x7efe64050770 legacy=0x7efe640071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.697+0000 7efe709a5640 1 -- 172.21.15.139:0/2129965813 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe640dda50 con 0x7efe6404cac0 2024-04-26T18:10:36.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.699+0000 7efe709a5640 1 --2- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe6404cac0 0x7efe6404cf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe600097a0 tx=0x7efe6002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff33df41504168b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:36.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.700+0000 7efe6affd640 1 -- 172.21.15.139:0/2129965813 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60037070 con 0x7efe6404cac0 2024-04-26T18:10:36.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.700+0000 7efe6affd640 1 -- 172.21.15.139:0/2129965813 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60032440 con 0x7efe6404cac0 2024-04-26T18:10:36.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.700+0000 7efe6affd640 1 -- 172.21.15.139:0/2129965813 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60032810 con 0x7efe6404cac0 2024-04-26T18:10:36.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.701+0000 7efe711a6640 1 -- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe6404cac0 msgr2=0x7efe6404cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:36.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.701+0000 7efe711a6640 1 --2- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe6404cac0 0x7efe6404cf30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe600097a0 tx=0x7efe6002a210 comp rx=0 tx=0).stop 2024-04-26T18:10:36.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.702+0000 7efe711a6640 1 -- 172.21.15.139:0/2129965813 shutdown_connections 2024-04-26T18:10:36.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.702+0000 7efe711a6640 1 --2- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe6404cac0 0x7efe6404cf30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.702+0000 7efe711a6640 1 --2- 172.21.15.139:0/2129965813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe640dd670 0x7efe640e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.702+0000 7efe711a6640 1 -- 172.21.15.139:0/2129965813 >> 172.21.15.139:0/2129965813 conn(0x7efe6400e160 msgr2=0x7efe6400e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:36.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.702+0000 7efe711a6640 1 -- 172.21.15.139:0/2129965813 shutdown_connections 2024-04-26T18:10:36.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.702+0000 7efe711a6640 1 -- 172.21.15.139:0/2129965813 wait complete. 2024-04-26T18:10:36.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.704+0000 7efe711a6640 1 Processor -- start 2024-04-26T18:10:36.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.704+0000 7efe711a6640 1 -- start start 2024-04-26T18:10:36.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.705+0000 7efe711a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe6404cac0 0x7efe640e2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.705+0000 7efe711a6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe64050770 0x7efe640536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.705+0000 7efe711a6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640dd670 0x7efe640e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe711a6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efe6404f770 con 0x7efe6404cac0 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe711a6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efe6404f490 con 0x7efe640dd670 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe711a6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efe6404fa50 con 0x7efe64050770 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe6404cac0 0x7efe640e2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe6404cac0 0x7efe640e2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35512/0 (socket says 172.21.15.139:35512) 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe6bfff640 1 -- 172.21.15.139:0/3951837366 learned_addr learned my addr 172.21.15.139:0/3951837366 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe6bfff640 1 -- 172.21.15.139:0/3951837366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe64050770 msgr2=0x7efe640536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.706+0000 7efe6bfff640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe64050770 0x7efe640536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe6bfff640 1 -- 172.21.15.139:0/3951837366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640dd670 msgr2=0x7efe640e5e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe6bfff640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640dd670 0x7efe640e5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe6bfff640 1 -- 172.21.15.139:0/3951837366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe640e1cf0 con 0x7efe6404cac0 2024-04-26T18:10:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe6bfff640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe6404cac0 0x7efe640e2d10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efe5800e8a0 tx=0x7efe5800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe68ff9640 1 -- 172.21.15.139:0/3951837366 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe58017070 con 0x7efe6404cac0 2024-04-26T18:10:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe68ff9640 1 -- 172.21.15.139:0/3951837366 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5800c940 con 0x7efe6404cac0 2024-04-26T18:10:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe68ff9640 1 -- 172.21.15.139:0/3951837366 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5800cd30 con 0x7efe6404cac0 2024-04-26T18:10:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.707+0000 7efe711a6640 1 -- 172.21.15.139:0/3951837366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe640e1f90 con 0x7efe6404cac0 2024-04-26T18:10:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.708+0000 7efe711a6640 1 -- 172.21.15.139:0/3951837366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe640e2550 con 0x7efe6404cac0 2024-04-26T18:10:36.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.710+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6404eb60 con 0x7efe6404cac0 2024-04-26T18:10:36.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.714+0000 7efe68ff9640 1 -- 172.21.15.139:0/3951837366 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe5801a070 con 0x7efe6404cac0 2024-04-26T18:10:36.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.715+0000 7efe68ff9640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efe5006c9f0 0x7efe5006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:36.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.715+0000 7efe68ff9640 1 -- 172.21.15.139:0/3951837366 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efe5808c620 con 0x7efe6404cac0 2024-04-26T18:10:36.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.716+0000 7efe6b7fe640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efe5006c9f0 0x7efe5006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:36.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.716+0000 7efe6b7fe640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efe5006c9f0 0x7efe5006eeb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe6c02e060 tx=0x7efe6c075700 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:36.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.719+0000 7efe68ff9640 1 -- 172.21.15.139:0/3951837366 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe6404eb60 con 0x7efe6404cac0 2024-04-26T18:10:36.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.955+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe640057e0 con 0x7efe6404cac0 2024-04-26T18:10:36.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.955+0000 7efe68ff9640 1 -- 172.21.15.139:0/3951837366 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7efe5805a560 con 0x7efe6404cac0 2024-04-26T18:10:36.954 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:10:36.954 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:10:36.955 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:10:36.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efe5006c9f0 msgr2=0x7efe5006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:36.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efe5006c9f0 0x7efe5006eeb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe6c02e060 tx=0x7efe6c075700 comp rx=0 tx=0).stop 2024-04-26T18:10:36.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe6404cac0 msgr2=0x7efe640e2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe6404cac0 0x7efe640e2d10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efe5800e8a0 tx=0x7efe5800ed60 comp rx=0 tx=0).stop 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 shutdown_connections 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efe5006c9f0 0x7efe5006eeb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe640dd670 0x7efe640e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efe64050770 0x7efe640536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 --2- 172.21.15.139:0/3951837366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe6404cac0 0x7efe640e2d10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 >> 172.21.15.139:0/3951837366 conn(0x7efe6400e160 msgr2=0x7efe64039d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 shutdown_connections 2024-04-26T18:10:36.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:36.957+0000 7efe567fc640 1 -- 172.21.15.139:0/3951837366 wait complete. 2024-04-26T18:10:36.967 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 94.4 --await-for 42.0' 2024-04-26T18:10:36.967 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 94.4 --await-for 42.0 2024-04-26T18:10:37.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.074+0000 7f7194264640 1 Processor -- start 2024-04-26T18:10:37.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7194264640 1 -- start start 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7194264640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f718c0c6210 0x7f718c071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7194264640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0ca8c0 0x7f718c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7194264640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f718c0ca490 con 0x7f718c071ad0 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7194264640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f718c0cbfa0 con 0x7f718c0c6210 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7194264640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f718c0cb2b0 con 0x7f718c0ca8c0 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7192000640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f718c071ad0 0x7f718c0c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:37770/0 (socket says 172.21.15.139:37770) 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f7192000640 1 -- 172.21.15.139:0/1923358633 learned_addr learned my addr 172.21.15.139:0/1923358633 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.075+0000 7f71917ff640 1 --2- 172.21.15.139:0/1923358633 >> v2:172.21.15.139:3300/0 conn(0x7f718c0c6210 0x7f718c071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.076+0000 7f7192801640 1 --2- 172.21.15.139:0/1923358633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0ca8c0 0x7f718c0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.076+0000 7f71917ff640 1 -- 172.21.15.139:0/1923358633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0ca8c0 msgr2=0x7f718c0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.076+0000 7f71917ff640 1 --2- 172.21.15.139:0/1923358633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0ca8c0 0x7f718c0cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.076+0000 7f71917ff640 1 -- 172.21.15.139:0/1923358633 >> v1:172.21.15.139:6789/0 conn(0x7f718c071ad0 legacy=0x7f718c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:37.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.076+0000 7f71917ff640 1 -- 172.21.15.139:0/1923358633 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718c0cb8e0 con 0x7f718c0c6210 2024-04-26T18:10:37.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.076+0000 7f7190ffe640 1 -- 172.21.15.139:0/1923358633 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164819940 0 0) 0x7f718c0ca490 con 0x7f718c071ad0 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f71917ff640 1 --2- 172.21.15.139:0/1923358633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c0c6210 0x7f718c071eb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f71800097a0 tx=0x7f718002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316b1c5318755efb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7190ffe640 1 -- 172.21.15.139:0/1923358633 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180037070 con 0x7f718c0c6210 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7190ffe640 1 -- 172.21.15.139:0/1923358633 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180032440 con 0x7f718c0c6210 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7190ffe640 1 -- 172.21.15.139:0/1923358633 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180032810 con 0x7f718c0c6210 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7194264640 1 -- 172.21.15.139:0/1923358633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c0c6210 msgr2=0x7f718c071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7194264640 1 --2- 172.21.15.139:0/1923358633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c0c6210 0x7f718c071eb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f71800097a0 tx=0x7f718002a180 comp rx=0 tx=0).stop 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7194264640 1 -- 172.21.15.139:0/1923358633 shutdown_connections 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7194264640 1 --2- 172.21.15.139:0/1923358633 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0ca8c0 0x7f718c0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7194264640 1 --2- 172.21.15.139:0/1923358633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c0c6210 0x7f718c071eb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.077+0000 7f7194264640 1 -- 172.21.15.139:0/1923358633 >> 172.21.15.139:0/1923358633 conn(0x7f718c0746d0 msgr2=0x7f718c076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.078+0000 7f7194264640 1 -- 172.21.15.139:0/1923358633 shutdown_connections 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.078+0000 7f7194264640 1 -- 172.21.15.139:0/1923358633 wait complete. 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 Processor -- start 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 -- start start 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c071ad0 0x7f718c0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0c6210 0x7f718c154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f718c0ca8c0 0x7f718c1f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f718c0cc4d0 con 0x7f718c071ad0 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f718c0cc1f0 con 0x7f718c0ca8c0 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7194264640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f718c0cc7b0 con 0x7f718c0c6210 2024-04-26T18:10:37.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7192000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c071ad0 0x7f718c0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7192000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c071ad0 0x7f718c0cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35522/0 (socket says 172.21.15.139:35522) 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.079+0000 7f7192000640 1 -- 172.21.15.139:0/158224546 learned_addr learned my addr 172.21.15.139:0/158224546 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f71917ff640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0c6210 0x7f718c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7192801640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f718c0ca8c0 0x7f718c1f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7192000640 1 -- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0c6210 msgr2=0x7f718c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7192000640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0c6210 0x7f718c154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7192000640 1 -- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f718c0ca8c0 msgr2=0x7f718c1f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7192000640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f718c0ca8c0 0x7f718c1f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7192000640 1 -- 172.21.15.139:0/158224546 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718c1f5730 con 0x7f718c071ad0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7192000640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c071ad0 0x7f718c0cd720 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c8c0 tx=0x7f717c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f718a7fc640 1 -- 172.21.15.139:0/158224546 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c018070 con 0x7f718c071ad0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f718a7fc640 1 -- 172.21.15.139:0/158224546 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717c00a640 con 0x7f718c071ad0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718c1f5a10 con 0x7f718c071ad0 2024-04-26T18:10:37.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f718a7fc640 1 -- 172.21.15.139:0/158224546 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c00aa30 con 0x7f718c071ad0 2024-04-26T18:10:37.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.080+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f718c1f5fd0 con 0x7f718c071ad0 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.081+0000 7f718a7fc640 1 -- 172.21.15.139:0/158224546 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f717c01b070 con 0x7f718c071ad0 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.082+0000 7f718a7fc640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f717806c8f0 0x7f717806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.082+0000 7f718a7fc640 1 -- 172.21.15.139:0/158224546 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f717c08b6f0 con 0x7f718c071ad0 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.082+0000 7f71917ff640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f717806c8f0 0x7f717806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.082+0000 7f71917ff640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f717806c8f0 0x7f717806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7180034000 tx=0x7f718002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.083+0000 7f7196f7d740 1 Processor -- start 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.083+0000 7f7196f7d740 1 -- start start 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722a95e0 0x5627722e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722aab40 0x5627722a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7196f7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56277220cd80 con 0x5627722e8ae0 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5627721a8c20 con 0x5627722a95e0 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562772208d40 con 0x5627722aab40 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35536/0 (socket says 172.21.15.139:35536) 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 -- 172.21.15.139:0/1277889970 learned_addr learned my addr 172.21.15.139:0/1277889970 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7192801640 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722aab40 0x5627722a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7192000640 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722a95e0 0x5627722e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 -- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722aab40 msgr2=0x5627722a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722aab40 0x5627722a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 -- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722a95e0 msgr2=0x5627722e85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722a95e0 0x5627722e85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 -- 172.21.15.139:0/1277889970 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562771fead80 con 0x5627722e8ae0 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f7192000640 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722a95e0 0x5627722e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71917ff640 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a99c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7180009890 tx=0x7f718002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf573d7393d91cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71737fe640 1 -- 172.21.15.139:0/1277889970 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180037050 con 0x5627722e8ae0 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71737fe640 1 -- 172.21.15.139:0/1277889970 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180038040 con 0x5627722e8ae0 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.084+0000 7f71737fe640 1 -- 172.21.15.139:0/1277889970 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71800044a0 con 0x5627722e8ae0 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 -- 172.21.15.139:0/1277889970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 msgr2=0x5627722a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a99c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7180009890 tx=0x7f718002c000 comp rx=0 tx=0).stop 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 -- 172.21.15.139:0/1277889970 shutdown_connections 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722aab40 0x5627722a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a99c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1277889970 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722a95e0 0x5627722e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 -- 172.21.15.139:0/1277889970 >> 172.21.15.139:0/1277889970 conn(0x562772270740 msgr2=0x5627722ed580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 -- 172.21.15.139:0/1277889970 shutdown_connections 2024-04-26T18:10:37.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.085+0000 7f7196f7d740 1 -- 172.21.15.139:0/1277889970 wait complete. 2024-04-26T18:10:37.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.086+0000 7f7196f7d740 1 -- start start 2024-04-26T18:10:37.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.086+0000 7f7196f7d740 1 Processor -- start 2024-04-26T18:10:37.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722a95e0 0x5627722fd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722fc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722e8ae0 0x5627722d3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5627722a7c20 con 0x5627722a95e0 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5627721a6840 con 0x5627722aab40 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5627722ab170 con 0x5627722e8ae0 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 10 client.0 _ll_register_callbacks cb 0x5627721aa5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722a95e0 0x5627722fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722a95e0 0x5627722fd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35552/0 (socket says 172.21.15.139:35552) 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 -- 172.21.15.139:0/946403 learned_addr learned my addr 172.21.15.139:0/946403 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192801640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722e8ae0 0x5627722d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f71917ff640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722fc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 -- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722e8ae0 msgr2=0x5627722d3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722e8ae0 0x5627722d3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 -- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 msgr2=0x5627722fc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722fc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 -- 172.21.15.139:0/946403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56277204b510 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f71917ff640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192801640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722e8ae0 0x5627722d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7192000640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722a95e0 0x5627722fd160 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f717c00cfd0 tx=0x7f717c058f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7142f3780261ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7170ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7170ff9640 1 -- 172.21.15.139:0/946403 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c061930 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7170ff9640 1 -- 172.21.15.139:0/946403 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f717c0583a0 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7180038040 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7170ff9640 1 -- 172.21.15.139:0/946403 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f717c061bc0 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 10 client.5298 fetch_fsmap learned FSMap version 9 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.087+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562771ede670 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7170ff9640 1 -- 172.21.15.139:0/946403 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180038040 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7170ff9640 1 -- 172.21.15.139:0/946403 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f717c05c070 con 0x5627722a95e0 2024-04-26T18:10:37.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7196f7d740 10 client.5298 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7196f7d740 10 client.5298 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7196f7d740 20 client.5298 populate_metadata read hostname 'smithi139' 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7196f7d740 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722d0680 0x5627722d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7196f7d740 4 client.5298 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56277221a990 con 0x5627722d0680 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f71917ff640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722d0680 0x5627722d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f7170ff9640 10 client.5298 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:10:37.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.088+0000 7f71917ff640 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722d0680 0x5627722d0ab0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6966c04e0c4e2fd server_cookie=b4b47b73175a4eca in_seq=0 out_seq=0 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7170ff9640 1 -- 172.21.15.139:0/946403 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56277221a990 con 0x5627722d0680 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7170ff9640 10 client.5298 handle_command_reply: tid=0 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 client.5298 shutdown 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722a95e0 msgr2=0x5627722fd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722a95e0 0x5627722fd160 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f717c00cfd0 tx=0x7f717c058f50 comp rx=0 tx=0).stop 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 shutdown_connections 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722d0680 0x5627722d0ab0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722e8ae0 0x5627722d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7170ff9640 0 client.5298 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 --2- 172.21.15.139:0/946403 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722a95e0 0x5627722fd160 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 >> 172.21.15.139:0/946403 conn(0x562772270740 msgr2=0x5627722ed960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 shutdown_connections 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 1 -- 172.21.15.139:0/946403 wait complete. 2024-04-26T18:10:37.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.089+0000 7f7196f7d740 20 client.5298 trim_cache size 0 max 16384 2024-04-26T18:10:37.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.106+0000 7f7196f7d740 1 Processor -- start 2024-04-26T18:10:37.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.106+0000 7f7196f7d740 1 -- start start 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x5627722e0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7196f7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f718c200700 con 0x5627722e8ae0 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1ff5e0 con 0x5627722aab40 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f718c1483d0 con 0x5627722a95e0 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35562/0 (socket says 172.21.15.139:35562) 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 -- 172.21.15.139:0/2824338644 learned_addr learned my addr 172.21.15.139:0/2824338644 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f71917ff640 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192000640 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x5627722e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 -- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 msgr2=0x5627722e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x5627722e0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 -- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 msgr2=0x5627722a6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722a6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 -- 172.21.15.139:0/2824338644 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56277220f220 con 0x5627722e8ae0 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192000640 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x5627722e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f71917ff640 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.107+0000 7f7192801640 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a72e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7184009ac0 tx=0x7f7184009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada9668de2750e5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7172ffd640 1 -- 172.21.15.139:0/2824338644 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184016d50 con 0x5627722e8ae0 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7172ffd640 1 -- 172.21.15.139:0/2824338644 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718401b070 con 0x5627722e8ae0 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7172ffd640 1 -- 172.21.15.139:0/2824338644 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184004270 con 0x5627722e8ae0 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 -- 172.21.15.139:0/2824338644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 msgr2=0x5627722a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a72e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7184009ac0 tx=0x7f7184009190 comp rx=0 tx=0).stop 2024-04-26T18:10:37.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 -- 172.21.15.139:0/2824338644 shutdown_connections 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722e8ae0 0x5627722a72e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722aab40 0x5627722a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 --2- 172.21.15.139:0/2824338644 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x5627722e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 -- 172.21.15.139:0/2824338644 >> 172.21.15.139:0/2824338644 conn(0x562772270740 msgr2=0x56277229f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 -- 172.21.15.139:0/2824338644 shutdown_connections 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.108+0000 7f7196f7d740 1 -- 172.21.15.139:0/2824338644 wait complete. 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.109+0000 7f7196f7d740 1 -- start start 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.109+0000 7f7196f7d740 1 Processor -- start 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x562772303a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722aab40 0x562772363b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722e8ae0 0x56277235d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f718c13e310 con 0x5627722aab40 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1fef40 con 0x5627722e8ae0 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f718c1fe870 con 0x5627722a95e0 2024-04-26T18:10:37.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 10 client.0 _ll_register_callbacks cb 0x7f717c055240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722aab40 0x562772363b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722aab40 0x562772363b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35568/0 (socket says 172.21.15.139:35568) 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 -- 172.21.15.139:0/1141280252 learned_addr learned my addr 172.21.15.139:0/1141280252 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7192000640 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x562772303a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7192801640 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722e8ae0 0x56277235d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 -- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 msgr2=0x562772303a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x562772303a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 -- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722e8ae0 msgr2=0x56277235d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722e8ae0 0x56277235d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 -- 172.21.15.139:0/1141280252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627722cde30 con 0x5627722aab40 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f71917ff640 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722aab40 0x562772363b60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7180009560 tx=0x7f718003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5b701cfad00072 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7170ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:10:37.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7170ff9640 1 -- 172.21.15.139:0/1141280252 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180037040 con 0x5627722aab40 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7170ff9640 1 -- 172.21.15.139:0/1141280252 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7180058230 con 0x5627722aab40 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f718401b070 con 0x5627722aab40 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7170ff9640 1 -- 172.21.15.139:0/1141280252 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7180062050 con 0x5627722aab40 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 10 client.5304 fetch_fsmap learned FSMap version 9 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.110+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56277230cde0 con 0x5627722aab40 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7170ff9640 1 -- 172.21.15.139:0/1141280252 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718401b070 con 0x5627722aab40 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7170ff9640 1 -- 172.21.15.139:0/1141280252 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7180065020 con 0x5627722aab40 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7196f7d740 10 client.5304 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7196f7d740 10 client.5304 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7196f7d740 20 client.5304 populate_metadata read hostname 'smithi139' 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722e7b20 0x56277235dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7196f7d740 4 client.5304 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 94.4, "await_for": 42.0}] 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 94.4, "await_for": 42.0}) -- 0x562772214800 con 0x5627722e7b20 2024-04-26T18:10:37.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7192000640 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722e7b20 0x56277235dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:37.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7170ff9640 10 client.5304 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:10:37.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:37.111+0000 7f7192000640 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722e7b20 0x56277235dd50 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8387961de704cf7c server_cookie=e5f5d527c52691ef in_seq=0 out_seq=0 2024-04-26T18:10:38.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:10:38.886 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:10:40.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7170ff9640 1 -- 172.21.15.139:0/1141280252 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x562772214800 con 0x5627722e7b20 2024-04-26T18:10:40.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7170ff9640 10 client.5304 handle_command_reply: tid=0 2024-04-26T18:10:40.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 client.5304 shutdown 2024-04-26T18:10:40.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722aab40 msgr2=0x562772363b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:40.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722aab40 0x562772363b60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7180009560 tx=0x7f718003c000 comp rx=0 tx=0).stop 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 shutdown_connections 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5627722e8ae0 0x56277235d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5627722aab40 0x562772363b60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5627722e7b20 0x56277235dd50 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 --2- 172.21.15.139:0/1141280252 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5627722a95e0 0x562772303a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7170ff9640 0 client.5304 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.628+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 >> 172.21.15.139:0/1141280252 conn(0x562772270740 msgr2=0x5627722e3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.629+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 shutdown_connections 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.629+0000 7f7196f7d740 1 -- 172.21.15.139:0/1141280252 wait complete. 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.629+0000 7f7196f7d740 20 client.5304 trim_cache size 0 max 16384 2024-04-26T18:10:40.630 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 38, 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "df0d7dbe": { 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 38, 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:10:40.631 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 94.4, 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:10:40.632 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:10:40.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.629+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f717806c8f0 msgr2=0x7f717806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:40.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.629+0000 7f7194264640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f717806c8f0 0x7f717806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7180034000 tx=0x7f718002e000 comp rx=0 tx=0).stop 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.629+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c071ad0 msgr2=0x7f718c0cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.629+0000 7f7194264640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c071ad0 0x7f718c0cd720 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c8c0 tx=0x7f717c00cd80 comp rx=0 tx=0).stop 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 shutdown_connections 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f717806c8f0 0x7f717806edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f718c0ca8c0 0x7f718c1f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f718c0c6210 0x7f718c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 --2- 172.21.15.139:0/158224546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f718c071ad0 0x7f718c0cd720 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 >> 172.21.15.139:0/158224546 conn(0x7f718c0746d0 msgr2=0x7f718c149f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 shutdown_connections 2024-04-26T18:10:40.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:10:40.630+0000 7f7194264640 1 -- 172.21.15.139:0/158224546 wait complete. 2024-04-26T18:10:40.642 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'df0d7dbe', quiesce took 4.1 seconds. Will release after: 34.4 2024-04-26T18:11:08.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:11:08.942 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:11:15.044 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:11:15.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.153+0000 7f16b915f640 1 Processor -- start 2024-04-26T18:11:15.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.153+0000 7f16b915f640 1 -- start start 2024-04-26T18:11:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b915f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16b40cae30 0x7f16b4071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b915f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cb210 0x7f16b4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b915f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f16b40c8a30 0x7f16b4156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b915f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f16b4070d10 con 0x7f16b40cae30 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b915f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f16b40c95b0 con 0x7f16b40c8a30 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b915f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16b40c9820 con 0x7f16b40cb210 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16b40cae30 0x7f16b4071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16b40cae30 0x7f16b4071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42068/0 (socket says 172.21.15.139:42068) 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 -- 172.21.15.139:0/848041198 learned_addr learned my addr 172.21.15.139:0/848041198 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b359e640 1 --2- 172.21.15.139:0/848041198 >> v2:172.21.15.143:3300/0 conn(0x7f16b40c8a30 0x7f16b4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b259c640 1 --2- 172.21.15.139:0/848041198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cb210 0x7f16b4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 -- 172.21.15.139:0/848041198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cb210 msgr2=0x7f16b4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 --2- 172.21.15.139:0/848041198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cb210 0x7f16b4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 -- 172.21.15.139:0/848041198 >> v2:172.21.15.143:3300/0 conn(0x7f16b40c8a30 msgr2=0x7f16b4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 --2- 172.21.15.139:0/848041198 >> v2:172.21.15.143:3300/0 conn(0x7f16b40c8a30 0x7f16b4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b2d9d640 1 -- 172.21.15.139:0/848041198 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b40c9b00 con 0x7f16b40cae30 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.154+0000 7f16b359e640 1 --2- 172.21.15.139:0/848041198 >> v2:172.21.15.143:3300/0 conn(0x7f16b40c8a30 0x7f16b4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.155+0000 7f16b2d9d640 1 --2- 172.21.15.139:0/848041198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cae30 0x7f16b4071480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f16b40cf1c0 tx=0x7f16a402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d292115d9d1f4602 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.155+0000 7f16b1d9b640 1 -- 172.21.15.139:0/848041198 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4036070 con 0x7f16b40cae30 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.155+0000 7f16b1d9b640 1 -- 172.21.15.139:0/848041198 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a4031600 con 0x7f16b40cae30 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.155+0000 7f16b1d9b640 1 -- 172.21.15.139:0/848041198 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a40319d0 con 0x7f16b40cae30 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 -- 172.21.15.139:0/848041198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cae30 msgr2=0x7f16b4071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 --2- 172.21.15.139:0/848041198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cae30 0x7f16b4071480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f16b40cf1c0 tx=0x7f16a402a6a0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 -- 172.21.15.139:0/848041198 shutdown_connections 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 --2- 172.21.15.139:0/848041198 >> v2:172.21.15.143:3300/0 conn(0x7f16b40c8a30 0x7f16b4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 --2- 172.21.15.139:0/848041198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cb210 0x7f16b4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 --2- 172.21.15.139:0/848041198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cae30 0x7f16b4071480 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 -- 172.21.15.139:0/848041198 >> 172.21.15.139:0/848041198 conn(0x7f16b4068090 msgr2=0x7f16b4068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 -- 172.21.15.139:0/848041198 shutdown_connections 2024-04-26T18:11:15.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.156+0000 7f16b915f640 1 -- 172.21.15.139:0/848041198 wait complete. 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.157+0000 7f16b915f640 1 Processor -- start 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.157+0000 7f16b915f640 1 -- start start 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b915f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16b40c8a30 0x7f16b41f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b915f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cae30 0x7f16b40ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b915f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cb210 0x7f16b41583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b915f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16b415f340 con 0x7f16b40cb210 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b915f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16b4070f60 con 0x7f16b40c8a30 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b915f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16b40719c0 con 0x7f16b40cae30 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cb210 0x7f16b41583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cb210 0x7f16b41583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42084/0 (socket says 172.21.15.139:42084) 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 -- 172.21.15.139:0/821704564 learned_addr learned my addr 172.21.15.139:0/821704564 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b2d9d640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16b40c8a30 0x7f16b41f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b259c640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cae30 0x7f16b40ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 -- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cae30 msgr2=0x7f16b40ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cae30 0x7f16b40ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 -- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16b40c8a30 msgr2=0x7f16b41f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16b40c8a30 0x7f16b41f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.158+0000 7f16b359e640 1 -- 172.21.15.139:0/821704564 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b41f2390 con 0x7f16b40cb210 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.159+0000 7f16b359e640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cb210 0x7f16b41583a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00d530 tx=0x7f16ac00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.159+0000 7f169b7fe640 1 -- 172.21.15.139:0/821704564 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac004030 con 0x7f16b40cb210 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.159+0000 7f169b7fe640 1 -- 172.21.15.139:0/821704564 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac0041d0 con 0x7f16b40cb210 2024-04-26T18:11:15.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.159+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b40c1910 con 0x7f16b40cb210 2024-04-26T18:11:15.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.159+0000 7f169b7fe640 1 -- 172.21.15.139:0/821704564 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac014620 con 0x7f16b40cb210 2024-04-26T18:11:15.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.159+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b41570f0 con 0x7f16b40cb210 2024-04-26T18:11:15.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.160+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b4076d20 con 0x7f16b40cb210 2024-04-26T18:11:15.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.160+0000 7f169b7fe640 1 -- 172.21.15.139:0/821704564 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f16ac0147c0 con 0x7f16b40cb210 2024-04-26T18:11:15.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.161+0000 7f169b7fe640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16a006c8f0 0x7f16a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.161+0000 7f16b2d9d640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16a006c8f0 0x7f16a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.161+0000 7f169b7fe640 1 -- 172.21.15.139:0/821704564 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f16ac08c580 con 0x7f16b40cb210 2024-04-26T18:11:15.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.161+0000 7f16b2d9d640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16a006c8f0 0x7f16a006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16a4033000 tx=0x7f16a4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.165+0000 7f169b7fe640 1 -- 172.21.15.139:0/821704564 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f16ac05a600 con 0x7f16b40cb210 2024-04-26T18:11:15.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.378+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16b40c7260 con 0x7f16b40cb210 2024-04-26T18:11:15.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.378+0000 7f169b7fe640 1 -- 172.21.15.139:0/821704564 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f16ac059f00 con 0x7f16b40cb210 2024-04-26T18:11:15.378 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:11:15.379 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:11:15.379 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:11:15.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16a006c8f0 msgr2=0x7f16a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16a006c8f0 0x7f16a006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16a4033000 tx=0x7f16a4009000 comp rx=0 tx=0).stop 2024-04-26T18:11:15.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cb210 msgr2=0x7f16b41583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cb210 0x7f16b41583a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00d530 tx=0x7f16ac00d9f0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 shutdown_connections 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16a006c8f0 0x7f16a006edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16b40cb210 0x7f16b41583a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16b40cae30 0x7f16b40ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 --2- 172.21.15.139:0/821704564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16b40c8a30 0x7f16b41f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 >> 172.21.15.139:0/821704564 conn(0x7f16b4068090 msgr2=0x7f16b415d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 shutdown_connections 2024-04-26T18:11:15.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.380+0000 7f16b915f640 1 -- 172.21.15.139:0/821704564 wait complete. 2024-04-26T18:11:15.391 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id df0d7dbe --release --await' 2024-04-26T18:11:15.391 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id df0d7dbe --release --await 2024-04-26T18:11:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.494+0000 7f16de4c8640 1 Processor -- start 2024-04-26T18:11:15.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.494+0000 7f16de4c8640 1 -- start start 2024-04-26T18:11:15.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16de4c8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16d8070230 0x7f16d80ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16de4c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f16d80c9c80 0x7f16d80c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16de4c8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d8158960 con 0x7f16d80c8b10 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16de4c8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f16d8159830 con 0x7f16d8070230 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16de4c8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f16d8158c20 con 0x7f16d80c9c80 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d77fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16d8070230 0x7f16d80ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d77fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f16d8070230 0x7f16d80ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42094/0 (socket says 172.21.15.139:42094) 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d7fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f16d80c8b10 0x7f16d806fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42136/0 (socket says 172.21.15.139:42136) 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d77fe640 1 -- 172.21.15.139:0/558604333 learned_addr learned my addr 172.21.15.139:0/558604333 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16dca65640 1 --2- 172.21.15.139:0/558604333 >> v2:172.21.15.143:3300/0 conn(0x7f16d80c9c80 0x7f16d80c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d77fe640 1 -- 172.21.15.139:0/558604333 >> v2:172.21.15.143:3300/0 conn(0x7f16d80c9c80 msgr2=0x7f16d80c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d77fe640 1 --2- 172.21.15.139:0/558604333 >> v2:172.21.15.143:3300/0 conn(0x7f16d80c9c80 0x7f16d80c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d77fe640 1 -- 172.21.15.139:0/558604333 >> v1:172.21.15.139:6789/0 conn(0x7f16d80c8b10 legacy=0x7f16d806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d77fe640 1 -- 172.21.15.139:0/558604333 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d8158f00 con 0x7f16d8070230 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.495+0000 7f16d6ffd640 1 -- 172.21.15.139:0/558604333 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503223528 0 0) 0x7f16d8158960 con 0x7f16d80c8b10 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.496+0000 7f16d77fe640 1 --2- 172.21.15.139:0/558604333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d8070230 0x7f16d80ca460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f16d80caeb0 tx=0x7f16cc02c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2d1dd64750d703 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.496+0000 7f16d6ffd640 1 -- 172.21.15.139:0/558604333 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc035070 con 0x7f16d8070230 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.496+0000 7f16d6ffd640 1 -- 172.21.15.139:0/558604333 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16cc031830 con 0x7f16d8070230 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.496+0000 7f16d6ffd640 1 -- 172.21.15.139:0/558604333 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc031c00 con 0x7f16d8070230 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 -- 172.21.15.139:0/558604333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d8070230 msgr2=0x7f16d80ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 --2- 172.21.15.139:0/558604333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d8070230 0x7f16d80ca460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f16d80caeb0 tx=0x7f16cc02c9d0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 -- 172.21.15.139:0/558604333 shutdown_connections 2024-04-26T18:11:15.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 --2- 172.21.15.139:0/558604333 >> v2:172.21.15.143:3300/0 conn(0x7f16d80c9c80 0x7f16d80c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 --2- 172.21.15.139:0/558604333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d8070230 0x7f16d80ca460 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 -- 172.21.15.139:0/558604333 >> 172.21.15.139:0/558604333 conn(0x7f16d806dd40 msgr2=0x7f16d806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 -- 172.21.15.139:0/558604333 shutdown_connections 2024-04-26T18:11:15.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.497+0000 7f16de4c8640 1 -- 172.21.15.139:0/558604333 wait complete. 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.498+0000 7f16de4c8640 1 Processor -- start 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.498+0000 7f16de4c8640 1 -- start start 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16d8070230 0x7f16d81f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16d80c8b10 0x7f16d80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d80c9c80 0x7f16d80cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16d80c2020 con 0x7f16d80c9c80 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81594c0 con 0x7f16d80c8b10 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16d80cdd30 con 0x7f16d8070230 2024-04-26T18:11:15.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d80c9c80 0x7f16d80cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d80c9c80 0x7f16d80cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42108/0 (socket says 172.21.15.139:42108) 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 -- 172.21.15.139:0/987742435 learned_addr learned my addr 172.21.15.139:0/987742435 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16d7fff640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16d8070230 0x7f16d81f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16d77fe640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16d80c8b10 0x7f16d80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 -- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16d8070230 msgr2=0x7f16d81f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16d8070230 0x7f16d81f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 -- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16d80c8b10 msgr2=0x7f16d80cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16d80c8b10 0x7f16d80cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 -- 172.21.15.139:0/987742435 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d81e49c0 con 0x7f16d80c9c80 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16dca65640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d80c9c80 0x7f16d80cc5c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f16d0007e30 tx=0x7f16d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16d4ff9640 1 -- 172.21.15.139:0/987742435 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0014620 con 0x7f16d80c9c80 2024-04-26T18:11:15.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16d4ff9640 1 -- 172.21.15.139:0/987742435 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d0019070 con 0x7f16d80c9c80 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16d4ff9640 1 -- 172.21.15.139:0/987742435 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0014a00 con 0x7f16d80c9c80 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d81e4c60 con 0x7f16d80c9c80 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.499+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d81f1b10 con 0x7f16d80c9c80 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.501+0000 7f16d4ff9640 1 -- 172.21.15.139:0/987742435 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f16d0014ba0 con 0x7f16d80c9c80 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.501+0000 7f16d4ff9640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16c406c8f0 0x7f16c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.501+0000 7f16d4ff9640 1 -- 172.21.15.139:0/987742435 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f16d008c7a0 con 0x7f16d80c9c80 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.501+0000 7f16d7fff640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16c406c8f0 0x7f16c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.502+0000 7f16d7fff640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16c406c8f0 0x7f16c406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f16c8007fd0 tx=0x7f16c8007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.502+0000 7f16e11e3740 1 Processor -- start 2024-04-26T18:11:15.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.502+0000 7f16e11e3740 1 -- start start 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c464470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c425890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c425dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16e11e3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d84c38a040 con 0x55d84c426a10 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d84c325b60 con 0x55d84c4254b0 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d84c386000 con 0x55d84c4649b0 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c425dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c425dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42122/0 (socket says 172.21.15.139:42122) 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 -- 172.21.15.139:0/3267776491 learned_addr learned my addr 172.21.15.139:0/3267776491 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16d77fe640 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c425890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16d7fff640 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c464470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 -- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 msgr2=0x55d84c425890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c425890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 -- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 msgr2=0x55d84c464470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c464470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 -- 172.21.15.139:0/3267776491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d84c31a9c0 con 0x55d84c426a10 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.503+0000 7f16dca65640 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c425dd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f16d0062740 tx=0x7f16d0059ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55ec1964a7774c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16bdffb640 1 -- 172.21.15.139:0/3267776491 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0062c70 con 0x55d84c426a10 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16bdffb640 1 -- 172.21.15.139:0/3267776491 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d00583b0 con 0x55d84c426a10 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16bdffb640 1 -- 172.21.15.139:0/3267776491 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0059500 con 0x55d84c426a10 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 -- 172.21.15.139:0/3267776491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 msgr2=0x55d84c425dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c425dd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f16d0062740 tx=0x7f16d0059ad0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 -- 172.21.15.139:0/3267776491 shutdown_connections 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c425dd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c425890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 --2- 172.21.15.139:0/3267776491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c464470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 -- 172.21.15.139:0/3267776491 >> 172.21.15.139:0/3267776491 conn(0x55d84c3ec930 msgr2=0x55d84c469450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 -- 172.21.15.139:0/3267776491 shutdown_connections 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.504+0000 7f16e11e3740 1 -- 172.21.15.139:0/3267776491 wait complete. 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.505+0000 7f16e11e3740 1 -- start start 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.505+0000 7f16e11e3740 1 Processor -- start 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c425c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c4619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c475ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d84c423af0 con 0x55d84c426a10 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d84c3234f0 con 0x55d84c4254b0 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d84c427040 con 0x55d84c4649b0 2024-04-26T18:11:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 10 client.0 _ll_register_callbacks cb 0x55d84c380c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c4619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c4619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42124/0 (socket says 172.21.15.139:42124) 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 -- 172.21.15.139:0/593019521 learned_addr learned my addr 172.21.15.139:0/593019521 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d7fff640 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c425c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16dca65640 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c475ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 -- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 msgr2=0x55d84c475ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c475ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 -- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 msgr2=0x55d84c425c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c425c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 -- 172.21.15.139:0/593019521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d84c09b920 con 0x55d84c426a10 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16d77fe640 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c4619d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00bc00 tx=0x7f16cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e55484c28a6ceda server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:11:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16b6ffd640 1 -- 172.21.15.139:0/593019521 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc049060 con 0x55d84c426a10 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16b6ffd640 1 -- 172.21.15.139:0/593019521 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f16cc031d70 con 0x55d84c426a10 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.506+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16d00583b0 con 0x55d84c426a10 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16b6ffd640 1 -- 172.21.15.139:0/593019521 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f16cc04f050 con 0x55d84c426a10 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 10 client.5325 fetch_fsmap learned FSMap version 9 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d84c167d30 con 0x55d84c426a10 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16b6ffd640 1 -- 172.21.15.139:0/593019521 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d00583b0 con 0x55d84c426a10 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16b6ffd640 1 -- 172.21.15.139:0/593019521 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f16cc052020 con 0x55d84c426a10 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 10 client.5325 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 10 client.5325 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 20 client.5325 populate_metadata read hostname 'smithi139' 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c45c630 0x55d84c44d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 4 client.5325 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:11:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d84c35da00 con 0x55d84c45c630 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16d7fff640 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c45c630 0x55d84c44d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16b6ffd640 10 client.5325 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.507+0000 7f16d7fff640 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c45c630 0x55d84c44d120 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9dcea0905a1b190 server_cookie=49894b0483144ed4 in_seq=0 out_seq=0 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16b6ffd640 1 -- 172.21.15.139:0/593019521 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d84c35da00 con 0x55d84c45c630 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16b6ffd640 10 client.5325 handle_command_reply: tid=0 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16e11e3740 1 client.5325 shutdown 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 msgr2=0x55d84c4619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16e11e3740 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c4619d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00bc00 tx=0x7f16cc004730 comp rx=0 tx=0).stop 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 shutdown_connections 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16e11e3740 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c45c630 0x55d84c44d120 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16e11e3740 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c475ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.508+0000 7f16e11e3740 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c4619d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.509+0000 7f16e11e3740 1 --2- 172.21.15.139:0/593019521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c425c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.509+0000 7f16b6ffd640 0 client.5325 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:11:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.509+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 >> 172.21.15.139:0/593019521 conn(0x55d84c3ec930 msgr2=0x55d84c44de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.509+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 shutdown_connections 2024-04-26T18:11:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.509+0000 7f16e11e3740 1 -- 172.21.15.139:0/593019521 wait complete. 2024-04-26T18:11:15.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.509+0000 7f16e11e3740 20 client.5325 trim_cache size 0 max 16384 2024-04-26T18:11:15.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.525+0000 7f16e11e3740 1 Processor -- start 2024-04-26T18:11:15.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.525+0000 7f16e11e3740 1 -- start start 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c44dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c44e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c489140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16e11e3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16d8200870 con 0x55d84c426a10 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81ff750 con 0x55d84c4254b0 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16d81fdd20 con 0x55d84c4649b0 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16d77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c44e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16d77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c44e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42138/0 (socket says 172.21.15.139:42138) 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16d77fe640 1 -- 172.21.15.139:0/2027035632 learned_addr learned my addr 172.21.15.139:0/2027035632 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16d77fe640 1 -- 172.21.15.139:0/2027035632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 msgr2=0x55d84c489140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16d7fff640 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c44dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16d77fe640 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c489140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.526+0000 7f16d77fe640 1 -- 172.21.15.139:0/2027035632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 msgr2=0x55d84c44dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16d77fe640 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c44dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16d77fe640 1 -- 172.21.15.139:0/2027035632 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d84c422c70 con 0x55d84c426a10 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16d77fe640 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c44e230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00bbd0 tx=0x7f16cc03c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba979e0985e7dca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16bd7fa640 1 -- 172.21.15.139:0/2027035632 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc058070 con 0x55d84c426a10 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16bd7fa640 1 -- 172.21.15.139:0/2027035632 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16cc031630 con 0x55d84c426a10 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16bd7fa640 1 -- 172.21.15.139:0/2027035632 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc035040 con 0x55d84c426a10 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 -- 172.21.15.139:0/2027035632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 msgr2=0x55d84c44e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c44e230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00bbd0 tx=0x7f16cc03c070 comp rx=0 tx=0).stop 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 -- 172.21.15.139:0/2027035632 shutdown_connections 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c4649b0 0x55d84c489140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c426a10 0x55d84c44e230 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 --2- 172.21.15.139:0/2027035632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4254b0 0x55d84c44dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 -- 172.21.15.139:0/2027035632 >> 172.21.15.139:0/2027035632 conn(0x55d84c3ec930 msgr2=0x55d84c44d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 -- 172.21.15.139:0/2027035632 shutdown_connections 2024-04-26T18:11:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.527+0000 7f16e11e3740 1 -- 172.21.15.139:0/2027035632 wait complete. 2024-04-26T18:11:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.528+0000 7f16e11e3740 1 -- start start 2024-04-26T18:11:15.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.528+0000 7f16e11e3740 1 Processor -- start 2024-04-26T18:11:15.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c4254b0 0x55d84c47f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c426a10 0x55d84c4d94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16e11e3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4649b0 0x55d84c4d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16e11e3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81fe340 con 0x55d84c4254b0 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16d81ff080 con 0x55d84c4649b0 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16e11e3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16d81fe9b0 con 0x55d84c426a10 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16e11e3740 10 client.0 _ll_register_callbacks cb 0x7f16cc006cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c4254b0 0x55d84c47f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c4254b0 0x55d84c47f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42150/0 (socket says 172.21.15.139:42150) 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 -- 172.21.15.139:0/562897524 learned_addr learned my addr 172.21.15.139:0/562897524 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16dca65640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4649b0 0x55d84c4d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d77fe640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c426a10 0x55d84c4d94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 -- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c426a10 msgr2=0x55d84c4d94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c426a10 0x55d84c4d94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 -- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4649b0 msgr2=0x55d84c4d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4649b0 0x55d84c4d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 -- 172.21.15.139:0/562897524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d84c4629a0 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d77fe640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c426a10 0x55d84c4d94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16d7fff640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c4254b0 0x55d84c47f1f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f16c8000f60 tx=0x7f16c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eec4de79c30d9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.529+0000 7f16b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16b6ffd640 1 -- 172.21.15.139:0/562897524 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8001d10 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16b6ffd640 1 -- 172.21.15.139:0/562897524 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f16c8010040 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16cc031630 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16b6ffd640 1 -- 172.21.15.139:0/562897524 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f16c8033050 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 10 client.5331 fetch_fsmap learned FSMap version 9 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d84c47ebc0 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16b6ffd640 1 -- 172.21.15.139:0/562897524 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16cc031630 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16b6ffd640 1 -- 172.21.15.139:0/562897524 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f16c8036020 con 0x55d84c4254b0 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 10 client.5331 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:11:15.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 10 client.5331 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 20 client.5331 populate_metadata read hostname 'smithi139' 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c489260 0x55d84c45a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 4 client.5331 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "df0d7dbe", "release": true, "await": true}] 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "df0d7dbe", "release": true, "await": true}) -- 0x55d84c397c50 con 0x55d84c489260 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.530+0000 7f16d77fe640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c489260 0x55d84c45a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16d77fe640 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c489260 0x55d84c45a450 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a198a2f9d4e76e server_cookie=b9c5be9ee3b742b5 in_seq=0 out_seq=0 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16b6ffd640 10 client.5331 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16b6ffd640 1 -- 172.21.15.139:0/562897524 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55d84c397c50 con 0x55d84c489260 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16b6ffd640 10 client.5331 handle_command_reply: tid=0 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 client.5331 shutdown 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c4254b0 msgr2=0x55d84c47f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c4254b0 0x55d84c47f1f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f16c8000f60 tx=0x7f16c8012000 comp rx=0 tx=0).stop 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 shutdown_connections 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d84c4649b0 0x55d84c4d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d84c489260 0x55d84c45a450 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d84c426a10 0x55d84c4d94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 --2- 172.21.15.139:0/562897524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d84c4254b0 0x55d84c47f1f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16b6ffd640 0 client.5331 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 >> 172.21.15.139:0/562897524 conn(0x55d84c3ec930 msgr2=0x55d84c44dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 shutdown_connections 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 1 -- 172.21.15.139:0/562897524 wait complete. 2024-04-26T18:11:15.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.531+0000 7f16e11e3740 20 client.5331 trim_cache size 0 max 16384 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 40, 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "df0d7dbe": { 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 40, 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:11:15.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 94.4, 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:11:15.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:11:15.541 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:11:15.541 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:11:15.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16c406c8f0 msgr2=0x7f16c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16c406c8f0 0x7f16c406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f16c8007fd0 tx=0x7f16c8007de0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d80c9c80 msgr2=0x7f16d80cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:15.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d80c9c80 0x7f16d80cc5c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f16d0007e30 tx=0x7f16d000e4b0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 shutdown_connections 2024-04-26T18:11:15.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f16c406c8f0 0x7f16c406edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d80c9c80 0x7f16d80cc5c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16d80c8b10 0x7f16d80cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 --2- 172.21.15.139:0/987742435 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16d8070230 0x7f16d81f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:15.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 >> 172.21.15.139:0/987742435 conn(0x7f16d806dd40 msgr2=0x7f16d806e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:15.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 shutdown_connections 2024-04-26T18:11:15.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:11:15.532+0000 7f16de4c8640 1 -- 172.21.15.139:0/987742435 wait complete. 2024-04-26T18:11:15.543 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'df0d7dbe', seconds elapsed: 39.0 2024-04-26T18:11:39.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:11:39.013 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:12:06.590 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 0% (81/13282) Updating files: 1% (133/13282) Updating files: 2% (266/13282) Updating files: 2% (301/13282) Updating files: 3% (399/13282) Updating files: 3% (425/13282) Updating files: 3% (435/13282) Updating files: 3% (512/13282) Updating files: 4% (532/13282) Updating files: 4% (602/13282) Updating files: 4% (614/13282) Updating files: 4% (635/13282) Updating files: 5% (665/13282) Updating files: 5% (688/13282) Updating files: 5% (701/13282) Updating files: 5% (774/13282) Updating files: 6% (797/13282) Updating files: 6% (881/13282) Updating files: 7% (930/13282) Updating files: 7% (963/13282) Updating files: 7% (994/13282) Updating files: 7% (1036/13282) Updating files: 8% (1063/13282) Updating files: 8% (1158/13282) Updating files: 8% (1159/13282) Updating files: 8% (1165/13282) Updating files: 8% (1173/13282) Updating files: 9% (1196/13282) Updating files: 9% (1250/13282) Updating files: 9% (1328/13282) Updating files: 10% (1329/13282) Updating files: 10% (1354/13282) Updating files: 10% (1457/13282) Updating files: 11% (1462/13282) Updating files: 11% (1552/13282) Updating files: 12% (1594/13282) Updating files: 12% (1685/13282) Updating files: 13% (1727/13282) Updating files: 13% (1736/13282) Updating files: 13% (1745/13282) Updating files: 13% (1812/13282) Updating files: 14% (1860/13282) Updating files: 14% (1938/13282) Updating files: 14% (1960/13282) Updating files: 15% (1993/13282) Updating files: 15% (2019/13282) Updating files: 15% (2085/13282) Updating files: 16% (2126/13282) Updating files: 16% (2186/13282) Updating files: 17% (2258/13282) Updating files: 17% (2303/13282) Updating files: 18% (2391/13282) Updating files: 18% (2427/13282) Updating files: 18% (2437/13282) Updating files: 18% (2484/13282) Updating files: 19% (2524/13282) Updating files: 19% (2535/13282) Updating files: 19% (2586/13282) Updating files: 20% (2657/13282) Updating files: 20% (2700/13282) Updating files: 20% (2755/13282) Updating files: 21% (2790/13282) Updating files: 21% (2829/13282) Updating files: 21% (2921/13282) Updating files: 22% (2923/13282) Updating files: 22% (3047/13282) Updating files: 23% (3055/13282) Updating files: 23% (3113/13282) Updating files: 24% (3188/13282) Updating files: 24% (3207/13282) Updating files: 24% (3278/13282) Updating files: 25% (3321/13282) Updating files: 25% (3419/13282) Updating files: 26% (3454/13282) Updating files: 26% (3479/13282) Updating files: 27% (3587/13282) Updating files: 27% (3603/13282) Updating files: 27% (3668/13282) Updating files: 27% (3698/13282) Updating files: 28% (3719/13282) Updating files: 28% (3750/13282) Updating files: 28% (3770/13282) Updating files: 28% (3812/13282) Updating files: 28% (3833/13282) Updating files: 29% (3852/13282) Updating files: 29% (3919/13282) Updating files: 30% (3985/13282) Updating files: 30% (4030/13282) Updating files: 30% (4048/13282) Updating files: 31% (4118/13282) Updating files: 31% (4164/13282) Updating files: 31% (4217/13282) Updating files: 31% (4235/13282) Updating files: 32% (4251/13282) Updating files: 32% (4326/13282) Updating files: 32% (4344/13282) Updating files: 33% (4384/13282) Updating files: 33% (4421/13282) Updating files: 33% (4437/13282) Updating files: 33% (4495/13282) Updating files: 34% (4516/13282) Updating files: 34% (4557/13282) Updating files: 34% (4593/13282) Updating files: 34% (4618/13282) Updating files: 35% (4649/13282) Updating files: 36% (4782/13282) Updating files: 36% (4802/13282) Updating files: 36% (4882/13282) Updating files: 37% (4915/13282) Updating files: 37% (4958/13282) Updating files: 38% (5048/13282) Updating files: 38% (5051/13282) Updating files: 38% (5082/13282) Updating files: 38% (5131/13282) Updating files: 39% (5180/13282) Updating files: 39% (5183/13282) Updating files: 39% (5197/13282) Updating files: 39% (5311/13282) Updating files: 40% (5313/13282) Updating files: 40% (5344/13282) Updating files: 40% (5361/13282) Updating files: 40% (5366/13282) Updating files: 40% (5419/13282) Updating files: 40% (5443/13282) Updating files: 41% (5446/13282) Updating files: 41% (5449/13282) Updating files: 41% (5505/13282) Updating files: 42% (5579/13282) Updating files: 42% (5656/13282) Updating files: 43% (5712/13282) Updating files: 43% (5721/13282) Updating files: 43% (5811/13282) Updating files: 44% (5845/13282) Updating files: 44% (5915/13282) Updating files: 44% (5971/13282) Updating files: 45% (5977/13282) Updating files: 45% (6019/13282) Updating files: 45% (6066/13282) Updating files: 46% (6110/13282) Updating files: 46% (6129/13282) Updating files: 47% (6243/13282) Updating files: 47% (6248/13282) Updating files: 47% (6355/13282) Updating files: 48% (6376/13282) Updating files: 48% (6395/13282) Updating files: 48% (6396/13282) Updating files: 48% (6406/13282) Updating files: 48% (6502/13282) Updating files: 49% (6509/13282) Updating files: 49% (6573/13282) Updating files: 50% (6641/13282) Updating files: 50% (6670/13282) Updating files: 50% (6714/13282) Updating files: 51% (6774/13282) Updating files: 51% (6818/13282) Updating files: 52% (6907/13282) Updating files: 52% (6917/13282) Updating files: 52% (6988/13282) Updating files: 53% (7040/13282) Updating files: 54% (7173/13282) Updating files: 54% (7245/13282) Updating files: 55% (7306/13282) Updating files: 55% (7309/13282) Updating files: 55% (7409/13282) Updating files: 56% (7438/13282) Updating files: 56% (7567/13282) Updating files: 57% (7571/13282) Updating files: 57% (7615/13282) Updating files: 57% (7621/13282) Updating files: 57% (7624/13282) Updating files: 58% (7704/13282) Updating files: 58% (7719/13282) Updating files: 59% (7837/13282) Updating files: 59% (7941/13282) Updating files: 59% (7964/13282) Updating files: 60% (7970/13282) Updating files: 60% (8055/13282) Updating files: 61% (8103/13282) Updating files: 61% (8146/13282) Updating files: 61% (8203/13282) Updating files: 62% (8235/13282) Updating files: 62% (8355/13282) Updating files: 63% (8368/13282) Updating files: 63% (8408/13282) Updating files: 63% (8425/13282) Updating files: 63% (8444/13282) Updating files: 63% (8468/13282) Updating files: 64% (8501/13282) Updating files: 64% (8528/13282) Updating files: 64% (8608/13282) Updating files: 65% (8634/13282) Updating files: 65% (8651/13282) Updating files: 65% (8656/13282) Updating files: 65% (8724/13282) Updating files: 66% (8767/13282) Updating files: 66% (8813/13282) Updating files: 66% (8841/13282) Updating files: 66% (8860/13282) Updating files: 67% (8899/13282) Updating files: 67% (8963/13282) Updating files: 67% (9017/13282) Updating files: 68% (9032/13282) Updating files: 68% (9046/13282) Updating files: 68% (9078/13282) Updating files: 68% (9103/13282) Updating files: 68% (9130/13282) Updating files: 68% (9136/13282) Updating files: 69% (9165/13282) Updating files: 69% (9176/13282) Updating files: 69% (9203/13282) Updating files: 69% (9224/13282) Updating files: 69% (9263/13282) Updating files: 69% (9292/13282) Updating files: 70% (9298/13282) Updating files: 70% (9300/13282) Updating files: 70% (9306/13282) Updating files: 70% (9360/13282) Updating files: 71% (9431/13282) Updating files: 71% (9525/13282) Updating files: 72% (9564/13282) Updating files: 72% (9635/13282) Updating files: 72% (9669/13282) Updating files: 72% (9677/13282) Updating files: 73% (9696/13282) Updating files: 73% (9712/13282) Updating files: 73% (9722/13282) Updating files: 73% (9774/13282) Updating files: 74% (9829/13282) Updating files: 74% (9835/13282) Updating files: 74% (9920/13282) Updating files: 74% (9952/13282) Updating files: 75% (9962/13282) Updating files: 75% (9978/13282) Updating files: 75% (10018/13282) Updating files: 75% (10067/13282) Updating files: 76% (10095/13282) Updating files: 77% (10228/13282) Updating files: 77% (10285/13282) Updating files: 78% (10360/13282) Updating files: 78% (10435/13282) Updating files: 79% (10493/13282) Updating files: 80% (10626/13282) Updating files: 80% (10628/13282) Updating files: 80% (10640/13282) Updating files: 80% (10698/13282) Updating files: 81% (10759/13282) Updating files: 81% (10846/13282) Updating files: 81% (10879/13282) Updating files: 82% (10892/13282) Updating files: 82% (11012/13282) Updating files: 83% (11025/13282) Updating files: 83% (11059/13282) Updating files: 83% (11134/13282) Updating files: 83% (11155/13282) Updating files: 84% (11157/13282) Updating files: 85% (11290/13282) Updating files: 85% (11313/13282) Updating files: 85% (11370/13282) Updating files: 85% (11404/13282) Updating files: 86% (11423/13282) Updating files: 86% (11489/13282) Updating files: 86% (11543/13282) Updating files: 87% (11556/13282) Updating files: 88% (11689/13282) Updating files: 88% (11707/13282) Updating files: 88% (11737/13282) Updating files: 89% (11821/13282) Updating files: 89% (11823/13282) Updating files: 89% (11849/13282) Updating files: 89% (11876/13282) Updating files: 89% (11901/13282) Updating files: 90% (11954/13282) Updating files: 90% (12000/13282) Updating files: 90% (12041/13282) Updating files: 90% (12050/13282) Updating files: 91% (12087/13282) Updating files: 91% (12165/13282) Updating files: 91% (12167/13282) Updating files: 92% (12220/13282) Updating files: 92% (12232/13282) Updating files: 92% (12294/13282) Updating files: 92% (12296/13282) Updating files: 92% (12345/13282) Updating files: 93% (12353/13282) Updating files: 93% (12375/13282) Updating files: 94% (12486/13282) Updating files: 94% (12615/13282) Updating files: 95% (12618/13282) Updating files: 96% (12751/13282) Updating files: 96% (12797/13282) Updating files: 97% (12884/13282) Updating files: 97% (12954/13282) Updating files: 98% (13017/13282) Updating files: 98% (13065/13282) Updating files: 98% (13136/13282) Updating files: 99% (13150/13282) Updating files: 99% (13154/13282) Updating files: 99% (13177/13282) Updating files: 99% (13237/13282) Updating files: 100% (13282/13282) Updating files: 100% (13282/13282), done. 2024-04-26T18:12:06.645 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2024-04-26T18:12:06.666 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.1 2024-04-26T18:12:06.681 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:12:06.681 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 2 -eq 48 ']' 2024-04-26T18:12:06.682 INFO:tasks.workunit.client.0.smithi139.stdout:v0.2 2024-04-26T18:12:06.682 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.2 2024-04-26T18:12:06.682 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.2 2024-04-26T18:12:06.682 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.2 2024-04-26T18:12:08.535 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 67% (150/222) Updating files: 68% (151/222) Updating files: 69% (154/222) Updating files: 70% (156/222) Updating files: 71% (158/222) Updating files: 72% (160/222) Updating files: 73% (163/222) Updating files: 74% (165/222) Updating files: 75% (167/222) Updating files: 76% (169/222) Updating files: 77% (171/222) Updating files: 78% (174/222) Updating files: 79% (176/222) Updating files: 80% (178/222) Updating files: 81% (180/222) Updating files: 82% (183/222) Updating files: 83% (185/222) Updating files: 84% (187/222) Updating files: 85% (189/222) Updating files: 86% (191/222) Updating files: 87% (194/222) Updating files: 88% (196/222) Updating files: 89% (198/222) Updating files: 90% (200/222) Updating files: 91% (203/222) Updating files: 92% (205/222) Updating files: 93% (207/222) Updating files: 94% (209/222) Updating files: 95% (211/222) Updating files: 96% (214/222) Updating files: 97% (216/222) Updating files: 98% (218/222) Updating files: 99% (220/222) Updating files: 100% (222/222) Updating files: 100% (222/222), done. 2024-04-26T18:12:08.567 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 2b5f76f48e9 readme 2024-04-26T18:12:08.569 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.2 2024-04-26T18:12:09.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:12:09.160 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:12:09.536 INFO:tasks.workunit.client.0.smithi139.stdout:v0.3 2024-04-26T18:12:09.536 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:12:09.537 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 3 -eq 48 ']' 2024-04-26T18:12:09.537 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.3 2024-04-26T18:12:09.537 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.3 2024-04-26T18:12:09.537 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.3 2024-04-26T18:12:15.751 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 10% (32/295) Updating files: 11% (33/295) Updating files: 12% (36/295) Updating files: 12% (38/295) Updating files: 13% (39/295) Updating files: 14% (42/295) Updating files: 15% (45/295) Updating files: 16% (48/295) Updating files: 17% (51/295) Updating files: 17% (53/295) Updating files: 18% (54/295) Updating files: 19% (57/295) Updating files: 20% (59/295) Updating files: 21% (62/295) Updating files: 22% (65/295) Updating files: 23% (68/295) Updating files: 24% (71/295) Updating files: 25% (74/295) Updating files: 26% (77/295) Updating files: 27% (80/295) Updating files: 28% (83/295) Updating files: 29% (86/295) Updating files: 30% (89/295) Updating files: 31% (92/295) Updating files: 32% (95/295) Updating files: 33% (98/295) Updating files: 34% (101/295) Updating files: 35% (104/295) Updating files: 36% (107/295) Updating files: 37% (110/295) Updating files: 38% (113/295) Updating files: 39% (116/295) Updating files: 40% (118/295) Updating files: 41% (121/295) Updating files: 42% (124/295) Updating files: 43% (127/295) Updating files: 44% (130/295) Updating files: 45% (133/295) Updating files: 46% (136/295) Updating files: 47% (139/295) Updating files: 48% (142/295) Updating files: 49% (145/295) Updating files: 50% (148/295) Updating files: 51% (151/295) Updating files: 52% (154/295) Updating files: 52% (156/295) Updating files: 53% (157/295) Updating files: 54% (160/295) Updating files: 55% (163/295) Updating files: 56% (166/295) Updating files: 57% (169/295) Updating files: 58% (172/295) Updating files: 59% (175/295) Updating files: 60% (177/295) Updating files: 61% (180/295) Updating files: 62% (183/295) Updating files: 63% (186/295) Updating files: 64% (189/295) Updating files: 65% (192/295) Updating files: 66% (195/295) Updating files: 67% (198/295) Updating files: 68% (201/295) Updating files: 69% (204/295) Updating files: 70% (207/295) Updating files: 71% (210/295) Updating files: 72% (213/295) Updating files: 73% (216/295) Updating files: 74% (219/295) Updating files: 75% (222/295) Updating files: 76% (225/295) Updating files: 77% (228/295) Updating files: 78% (231/295) Updating files: 79% (234/295) Updating files: 80% (236/295) Updating files: 80% (237/295) Updating files: 81% (239/295) Updating files: 82% (242/295) Updating files: 83% (245/295) Updating files: 84% (248/295) Updating files: 85% (251/295) Updating files: 86% (254/295) Updating files: 87% (257/295) Updating files: 88% (260/295) Updating files: 89% (263/295) Updating files: 90% (266/295) Updating files: 91% (269/295) Updating files: 92% (272/295) Updating files: 93% (275/295) Updating files: 94% (278/295) Updating files: 95% (281/295) Updating files: 96% (284/295) Updating files: 97% (287/295) Updating files: 98% (290/295) Updating files: 99% (293/295) Updating files: 100% (295/295) Updating files: 100% (295/295), done. 2024-04-26T18:12:16.790 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 2e986fe9ddf include ceph.spec in configure.ac 2024-04-26T18:12:16.793 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.3 2024-04-26T18:12:16.807 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:12:16.808 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 4 -eq 48 ']' 2024-04-26T18:12:16.808 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.4 2024-04-26T18:12:16.808 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.4 2024-04-26T18:12:16.808 INFO:tasks.workunit.client.0.smithi139.stdout:v0.4 2024-04-26T18:12:16.808 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.4 2024-04-26T18:12:18.737 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 55% (136/247) Updating files: 56% (139/247) Updating files: 57% (141/247) Updating files: 58% (144/247) Updating files: 59% (146/247) Updating files: 60% (149/247) Updating files: 61% (151/247) Updating files: 62% (154/247) Updating files: 63% (156/247) Updating files: 64% (159/247) Updating files: 65% (161/247) Updating files: 66% (164/247) Updating files: 67% (166/247) Updating files: 68% (168/247) Updating files: 69% (171/247) Updating files: 70% (173/247) Updating files: 71% (176/247) Updating files: 72% (178/247) Updating files: 73% (181/247) Updating files: 74% (183/247) Updating files: 75% (186/247) Updating files: 76% (188/247) Updating files: 77% (191/247) Updating files: 78% (193/247) Updating files: 79% (196/247) Updating files: 80% (198/247) Updating files: 81% (201/247) Updating files: 82% (203/247) Updating files: 83% (206/247) Updating files: 84% (208/247) Updating files: 85% (210/247) Updating files: 86% (213/247) Updating files: 87% (215/247) Updating files: 88% (218/247) Updating files: 89% (220/247) Updating files: 90% (223/247) Updating files: 91% (225/247) Updating files: 92% (228/247) Updating files: 93% (230/247) Updating files: 94% (233/247) Updating files: 95% (235/247) Updating files: 96% (238/247) Updating files: 97% (240/247) Updating files: 98% (243/247) Updating files: 99% (245/247) Updating files: 100% (247/247) Updating files: 100% (247/247), done. 2024-04-26T18:12:18.759 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 13b1bf7c492 kclient: initializing kaddr (merge fix) 2024-04-26T18:12:18.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.4 2024-04-26T18:12:19.065 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:12:19.066 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 5 -eq 48 ']' 2024-04-26T18:12:19.066 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.5 2024-04-26T18:12:19.066 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.5 2024-04-26T18:12:19.066 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.5 2024-04-26T18:12:19.066 INFO:tasks.workunit.client.0.smithi139.stdout:v0.5 2024-04-26T18:12:19.430 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-04-26T18:12:19.431 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:12:19.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.529+0000 7fd25e178640 1 Processor -- start 2024-04-26T18:12:19.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.529+0000 7fd25e178640 1 -- start start 2024-04-26T18:12:19.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd25e178640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd25806ca20 0x7fd258167410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd25e178640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25815f490 con 0x7fd2580cf240 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd25e178640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25815f770 con 0x7fd2580cf620 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd25e178640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fd258160010 con 0x7fd25806ca20 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd257fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd25806ca20 0x7fd258167410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd257fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd25806ca20 0x7fd258167410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48032/0 (socket says 172.21.15.139:48032) 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd257fff640 1 -- 172.21.15.139:0/3770918016 learned_addr learned my addr 172.21.15.139:0/3770918016 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd2577fe640 1 --1- 172.21.15.139:0/3770918016 >> v1:172.21.15.139:6789/0 conn(0x7fd2580cf240 0x7fd25815c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35528/0 (socket says 172.21.15.139:35528) 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd257fff640 1 -- 172.21.15.139:0/3770918016 >> v1:172.21.15.143:6789/0 conn(0x7fd2580cf620 legacy=0x7fd25806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd257fff640 1 -- 172.21.15.139:0/3770918016 >> v1:172.21.15.139:6789/0 conn(0x7fd2580cf240 legacy=0x7fd25815c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.530+0000 7fd257fff640 1 -- 172.21.15.139:0/3770918016 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25815fa50 con 0x7fd25806ca20 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.531+0000 7fd257fff640 1 --2- 172.21.15.139:0/3770918016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd25806ca20 0x7fd258167410 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd258160190 tx=0x7fd25002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871a1165e4728f9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.531+0000 7fd2567fc640 1 -- 172.21.15.139:0/3770918016 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd250036070 con 0x7fd25806ca20 2024-04-26T18:12:19.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.531+0000 7fd2567fc640 1 -- 172.21.15.139:0/3770918016 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd250031600 con 0x7fd25806ca20 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.531+0000 7fd2567fc640 1 -- 172.21.15.139:0/3770918016 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2500319d0 con 0x7fd25806ca20 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.531+0000 7fd25e178640 1 -- 172.21.15.139:0/3770918016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd25806ca20 msgr2=0x7fd258167410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.531+0000 7fd25e178640 1 --2- 172.21.15.139:0/3770918016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd25806ca20 0x7fd258167410 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd258160190 tx=0x7fd25002a7a0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.532+0000 7fd25e178640 1 -- 172.21.15.139:0/3770918016 shutdown_connections 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.532+0000 7fd25e178640 1 --2- 172.21.15.139:0/3770918016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd25806ca20 0x7fd258167410 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.532+0000 7fd25e178640 1 -- 172.21.15.139:0/3770918016 >> 172.21.15.139:0/3770918016 conn(0x7fd258076730 msgr2=0x7fd258068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.532+0000 7fd25e178640 1 -- 172.21.15.139:0/3770918016 shutdown_connections 2024-04-26T18:12:19.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.532+0000 7fd25e178640 1 -- 172.21.15.139:0/3770918016 wait complete. 2024-04-26T18:12:19.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 Processor -- start 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 -- start start 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25806ca20 0x7fd25815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2580cf240 0x7fd258158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2580cf620 0x7fd2581f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd25806e2a0 con 0x7fd2580cf620 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd25815bcb0 con 0x7fd25806ca20 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.533+0000 7fd25e178640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd2580cfa20 con 0x7fd2580cf240 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2580cf620 0x7fd2581f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2580cf620 0x7fd2581f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48034/0 (socket says 172.21.15.139:48034) 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 -- 172.21.15.139:0/1071360873 learned_addr learned my addr 172.21.15.139:0/1071360873 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd256ffd640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2580cf240 0x7fd258158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd2577fe640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25806ca20 0x7fd25815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 -- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2580cf240 msgr2=0x7fd258158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2580cf240 0x7fd258158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 -- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25806ca20 msgr2=0x7fd25815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25806ca20 0x7fd25815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 -- 172.21.15.139:0/1071360873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2581591f0 con 0x7fd2580cf620 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd257fff640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2580cf620 0x7fd2581f55b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd25002ad90 tx=0x7fd250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd23ffff640 1 -- 172.21.15.139:0/1071360873 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd250036050 con 0x7fd2580cf620 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd23ffff640 1 -- 172.21.15.139:0/1071360873 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd250042070 con 0x7fd2580cf620 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2581564e0 con 0x7fd2580cf620 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd23ffff640 1 -- 172.21.15.139:0/1071360873 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd250009510 con 0x7fd2580cf620 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.534+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd258156a60 con 0x7fd2580cf620 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.535+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd258076d20 con 0x7fd2580cf620 2024-04-26T18:12:19.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.536+0000 7fd23ffff640 1 -- 172.21.15.139:0/1071360873 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd250007bd0 con 0x7fd2580cf620 2024-04-26T18:12:19.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.536+0000 7fd23ffff640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd24406c8f0 0x7fd24406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.536+0000 7fd23ffff640 1 -- 172.21.15.139:0/1071360873 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fd2500acdd0 con 0x7fd2580cf620 2024-04-26T18:12:19.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.536+0000 7fd2577fe640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd24406c8f0 0x7fd24406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.537+0000 7fd2577fe640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd24406c8f0 0x7fd24406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd248000f60 tx=0x7fd248000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.542+0000 7fd23ffff640 1 -- 172.21.15.139:0/1071360873 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd25007a6f0 con 0x7fd2580cf620 2024-04-26T18:12:19.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.767+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2580715e0 con 0x7fd2580cf620 2024-04-26T18:12:19.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.767+0000 7fd23ffff640 1 -- 172.21.15.139:0/1071360873 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fd25007e9f0 con 0x7fd2580cf620 2024-04-26T18:12:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:12:19.768 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:12:19.768 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:12:19.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd24406c8f0 msgr2=0x7fd24406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd24406c8f0 0x7fd24406edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd248000f60 tx=0x7fd248000ed0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2580cf620 msgr2=0x7fd2581f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2580cf620 0x7fd2581f55b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd25002ad90 tx=0x7fd250004a40 comp rx=0 tx=0).stop 2024-04-26T18:12:19.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 shutdown_connections 2024-04-26T18:12:19.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd24406c8f0 0x7fd24406edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2580cf620 0x7fd2581f55b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2580cf240 0x7fd258158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 --2- 172.21.15.139:0/1071360873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd25806ca20 0x7fd25815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 >> 172.21.15.139:0/1071360873 conn(0x7fd258076730 msgr2=0x7fd258148e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:19.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 shutdown_connections 2024-04-26T18:12:19.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.770+0000 7fd25e178640 1 -- 172.21.15.139:0/1071360873 wait complete. 2024-04-26T18:12:19.781 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-04-26T18:12:19.781 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-04-26T18:12:19.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.888+0000 7f17392c8640 1 Processor -- start 2024-04-26T18:12:19.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.888+0000 7f17392c8640 1 -- start start 2024-04-26T18:12:19.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17392c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1734156250 0x7f17340cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17392c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340c9d80 0x7f1734070100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17392c8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f17340cbf30 0x7f1734070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17392c8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f1734156630 con 0x7f17340cbf30 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17392c8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f17340cb100 con 0x7f1734156250 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17392c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17340cb360 con 0x7f17340c9d80 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17337fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f17340cbf30 0x7f1734070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17337fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f17340cbf30 0x7f1734070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48040/0 (socket says 172.21.15.139:48040) 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.889+0000 7f17337fe640 1 -- 172.21.15.139:0/3905920105 learned_addr learned my addr 172.21.15.139:0/3905920105 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3905920105 >> v2:172.21.15.143:3300/0 conn(0x7f1734156250 0x7f17340cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f17327fc640 1 --2- 172.21.15.139:0/3905920105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340c9d80 0x7f1734070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f17337fe640 1 -- 172.21.15.139:0/3905920105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340c9d80 msgr2=0x7f1734070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f17337fe640 1 --2- 172.21.15.139:0/3905920105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340c9d80 0x7f1734070100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f17337fe640 1 -- 172.21.15.139:0/3905920105 >> v2:172.21.15.143:3300/0 conn(0x7f1734156250 msgr2=0x7f17340cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f17337fe640 1 --2- 172.21.15.139:0/3905920105 >> v2:172.21.15.143:3300/0 conn(0x7f1734156250 0x7f17340cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f17337fe640 1 -- 172.21.15.139:0/3905920105 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17340cbb90 con 0x7f17340cbf30 2024-04-26T18:12:19.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3905920105 >> v2:172.21.15.143:3300/0 conn(0x7f1734156250 0x7f17340cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:19.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f17337fe640 1 --2- 172.21.15.139:0/3905920105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17340cbf30 0x7f1734070640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f17340cf3a0 tx=0x7f172402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d230ef15cdbc33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f1731ffb640 1 -- 172.21.15.139:0/3905920105 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724036070 con 0x7f17340cbf30 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f1731ffb640 1 -- 172.21.15.139:0/3905920105 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724031600 con 0x7f17340cbf30 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.890+0000 7f1731ffb640 1 -- 172.21.15.139:0/3905920105 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17240319d0 con 0x7f17340cbf30 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 -- 172.21.15.139:0/3905920105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17340cbf30 msgr2=0x7f1734070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 --2- 172.21.15.139:0/3905920105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17340cbf30 0x7f1734070640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f17340cf3a0 tx=0x7f172402a6c0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 -- 172.21.15.139:0/3905920105 shutdown_connections 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 --2- 172.21.15.139:0/3905920105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17340cbf30 0x7f1734070640 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 --2- 172.21.15.139:0/3905920105 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340c9d80 0x7f1734070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 --2- 172.21.15.139:0/3905920105 >> v2:172.21.15.143:3300/0 conn(0x7f1734156250 0x7f17340cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 -- 172.21.15.139:0/3905920105 >> 172.21.15.139:0/3905920105 conn(0x7f17340746d0 msgr2=0x7f1734076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 -- 172.21.15.139:0/3905920105 shutdown_connections 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.891+0000 7f17392c8640 1 -- 172.21.15.139:0/3905920105 wait complete. 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.892+0000 7f17392c8640 1 Processor -- start 2024-04-26T18:12:19.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.892+0000 7f17392c8640 1 -- start start 2024-04-26T18:12:19.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17392c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17340c9d80 0x7f17341f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17392c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340cbf30 0x7f17341f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17392c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1734156250 0x7f1734152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17392c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f17340ca6a0 con 0x7f1734156250 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17392c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f17340cb8b0 con 0x7f17340c9d80 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17392c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f173406e2d0 con 0x7f17340cbf30 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17337fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1734156250 0x7f1734152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17337fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1734156250 0x7f1734152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48056/0 (socket says 172.21.15.139:48056) 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17337fe640 1 -- 172.21.15.139:0/2447631108 learned_addr learned my addr 172.21.15.139:0/2447631108 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f1732ffd640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17340c9d80 0x7f17341f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17327fc640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340cbf30 0x7f17341f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17337fe640 1 -- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340cbf30 msgr2=0x7f17341f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17337fe640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340cbf30 0x7f17341f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17337fe640 1 -- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17340c9d80 msgr2=0x7f17341f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.893+0000 7f17337fe640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17340c9d80 0x7f17341f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.894+0000 7f17337fe640 1 -- 172.21.15.139:0/2447631108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1734158500 con 0x7f1734156250 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.894+0000 7f17337fe640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1734156250 0x7f1734152510 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1724009e50 tx=0x7f1724004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.894+0000 7f172b7fe640 1 -- 172.21.15.139:0/2447631108 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724041020 con 0x7f1734156250 2024-04-26T18:12:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.894+0000 7f172b7fe640 1 -- 172.21.15.139:0/2447631108 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724007800 con 0x7f1734156250 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.894+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17341587e0 con 0x7f1734156250 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.894+0000 7f172b7fe640 1 -- 172.21.15.139:0/2447631108 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724036040 con 0x7f1734156250 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.894+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17341f1860 con 0x7f1734156250 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.896+0000 7f172b7fe640 1 -- 172.21.15.139:0/2447631108 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1724044020 con 0x7f1734156250 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.896+0000 7f172b7fe640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f171406c920 0x7f171406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.896+0000 7f172b7fe640 1 -- 172.21.15.139:0/2447631108 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f17240ac880 con 0x7f1734156250 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.896+0000 7f1732ffd640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f171406c920 0x7f171406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.896+0000 7f1732ffd640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f171406c920 0x7f171406ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f172c006fd0 tx=0x7f172c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.897+0000 7f173bfe6740 1 Processor -- start 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.897+0000 7f173bfe6740 1 -- start start 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f2d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72f2dae0 0x563f72eee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72eeef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f173bfe6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563f72e51d80 con 0x563f72f2dae0 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563f72dedc20 con 0x563f72eefb40 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563f72e4dd40 con 0x563f72eee5e0 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72f2dae0 0x563f72eee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72f2dae0 0x563f72eee9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48068/0 (socket says 172.21.15.139:48068) 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 -- 172.21.15.139:0/1156704336 learned_addr learned my addr 172.21.15.139:0/1156704336 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17337fe640 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72eeef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f1732ffd640 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f2d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 -- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 msgr2=0x563f72f2d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f2d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 -- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 msgr2=0x563f72eeef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72eeef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 -- 172.21.15.139:0/1156704336 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f72c2fd80 con 0x563f72f2dae0 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f17327fc640 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72f2dae0 0x563f72eee9c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f171c004500 tx=0x7f171c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4483608f089f5e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f1728ff9640 1 -- 172.21.15.139:0/1156704336 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c018020 con 0x563f72f2dae0 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f1728ff9640 1 -- 172.21.15.139:0/1156704336 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c00b870 con 0x563f72f2dae0 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.898+0000 7f1728ff9640 1 -- 172.21.15.139:0/1156704336 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c00bc20 con 0x563f72f2dae0 2024-04-26T18:12:19.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 -- 172.21.15.139:0/1156704336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72f2dae0 msgr2=0x563f72eee9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72f2dae0 0x563f72eee9c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f171c004500 tx=0x7f171c0039e0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 -- 172.21.15.139:0/1156704336 shutdown_connections 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72eeef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72f2dae0 0x563f72eee9c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1156704336 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f2d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 -- 172.21.15.139:0/1156704336 >> 172.21.15.139:0/1156704336 conn(0x563f72eb5740 msgr2=0x563f72f32580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 -- 172.21.15.139:0/1156704336 shutdown_connections 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.899+0000 7f173bfe6740 1 -- 172.21.15.139:0/1156704336 wait complete. 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 -- start start 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 Processor -- start 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eefb40 0x563f72f15550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72f15a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563f72eecc20 con 0x563f72eefb40 2024-04-26T18:12:19.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x563f72deb840 con 0x563f72f2dae0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x563f72ef0170 con 0x563f72eee5e0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f173bfe6740 10 client.0 _ll_register_callbacks cb 0x563f72def5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.900+0000 7f17327fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eefb40 0x563f72f15550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eefb40 0x563f72f15550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48078/0 (socket says 172.21.15.139:48078) 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 -- 172.21.15.139:0/3719584819 learned_addr learned my addr 172.21.15.139:0/3719584819 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17337fe640 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72f15a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 -- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 msgr2=0x563f72f428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 -- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 msgr2=0x563f72f15a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72f15a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 -- 172.21.15.139:0/3719584819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f72c90510 con 0x563f72eefb40 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f17327fc640 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eefb40 0x563f72f15550 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f171c017040 tx=0x7f171c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7da4339b5a8126 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f1711ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:12:19.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f1711ffb640 1 -- 172.21.15.139:0/3719584819 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c018070 con 0x563f72eefb40 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f1711ffb640 1 -- 172.21.15.139:0/3719584819 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f171c014830 con 0x563f72eefb40 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f171c00b870 con 0x563f72eefb40 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f1711ffb640 1 -- 172.21.15.139:0/3719584819 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f171c02e050 con 0x563f72eefb40 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f173bfe6740 10 client.5352 fetch_fsmap learned FSMap version 9 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563f72b23670 con 0x563f72eefb40 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f1711ffb640 1 -- 172.21.15.139:0/3719584819 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171c00b870 con 0x563f72eefb40 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f1711ffb640 1 -- 172.21.15.139:0/3719584819 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f171c031020 con 0x563f72eefb40 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.901+0000 7f173bfe6740 10 client.5352 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f173bfe6740 10 client.5352 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f173bfe6740 20 client.5352 populate_metadata read hostname 'smithi139' 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72f26380 0x563f72f15fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f173bfe6740 4 client.5352 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f72e5f990 con 0x563f72f26380 2024-04-26T18:12:19.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72f26380 0x563f72f15fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f1711ffb640 10 client.5352 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.902+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72f26380 0x563f72f15fd0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3bde9daa39434d0 server_cookie=4797feb6f94895ef in_seq=0 out_seq=0 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f1711ffb640 1 -- 172.21.15.139:0/3719584819 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563f72e5f990 con 0x563f72f26380 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f1711ffb640 10 client.5352 handle_command_reply: tid=0 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 client.5352 shutdown 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eefb40 msgr2=0x563f72f15550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eefb40 0x563f72f15550 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f171c017040 tx=0x7f171c004730 comp rx=0 tx=0).stop 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 shutdown_connections 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72f15a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eefb40 0x563f72f15550 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72f26380 0x563f72f15fd0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3719584819 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f1711ffb640 0 client.5352 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:19.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 >> 172.21.15.139:0/3719584819 conn(0x563f72eb5740 msgr2=0x563f72eef250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:19.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 shutdown_connections 2024-04-26T18:12:19.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 1 -- 172.21.15.139:0/3719584819 wait complete. 2024-04-26T18:12:19.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.903+0000 7f173bfe6740 20 client.5352 trim_cache size 0 max 16384 2024-04-26T18:12:19.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.920+0000 7f173bfe6740 1 Processor -- start 2024-04-26T18:12:19.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.920+0000 7f173bfe6740 1 -- start start 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eefb40 0x563f72f9fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72fa0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f173bfe6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1734200780 con 0x563f72eee5e0 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f17341ff660 con 0x563f72f2dae0 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17341fdbc0 con 0x563f72eefb40 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48094/0 (socket says 172.21.15.139:48094) 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 -- 172.21.15.139:0/1890069416 learned_addr learned my addr 172.21.15.139:0/1890069416 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f17327fc640 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eefb40 0x563f72f9fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f17337fe640 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72fa0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 -- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eefb40 msgr2=0x563f72f9fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eefb40 0x563f72f9fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 -- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 msgr2=0x563f72fa0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72fa0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 -- 172.21.15.139:0/1890069416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f72f2d910 con 0x563f72eee5e0 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f17327fc640 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eefb40 0x563f72f9fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1732ffd640 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72f428d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x563f72f28cb0 tx=0x7f172c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56260fa9e105e41b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1713fff640 1 -- 172.21.15.139:0/1890069416 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c030070 con 0x563f72eee5e0 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1713fff640 1 -- 172.21.15.139:0/1890069416 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c01d040 con 0x563f72eee5e0 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.921+0000 7f1713fff640 1 -- 172.21.15.139:0/1890069416 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c01c040 con 0x563f72eee5e0 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 -- 172.21.15.139:0/1890069416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 msgr2=0x563f72f428d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72f428d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x563f72f28cb0 tx=0x7f172c004610 comp rx=0 tx=0).stop 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 -- 172.21.15.139:0/1890069416 shutdown_connections 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72f2dae0 0x563f72fa0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72eefb40 0x563f72f9fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 --2- 172.21.15.139:0/1890069416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72f428d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 -- 172.21.15.139:0/1890069416 >> 172.21.15.139:0/1890069416 conn(0x563f72eb5740 msgr2=0x563f72f530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 -- 172.21.15.139:0/1890069416 shutdown_connections 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 -- 172.21.15.139:0/1890069416 wait complete. 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 -- start start 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.922+0000 7f173bfe6740 1 Processor -- start 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72eeedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72f2f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f173bfe6740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72f2dae0 0x563f72fa5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f173bfe6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f17341fe210 con 0x563f72eee5e0 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f17341fef90 con 0x563f72eefb40 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f173bfe6740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f17341fe8c0 con 0x563f72f2dae0 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f173bfe6740 10 client.0 _ll_register_callbacks cb 0x7f1724009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72eeedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72eeedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48096/0 (socket says 172.21.15.139:48096) 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 -- 172.21.15.139:0/3251346844 learned_addr learned my addr 172.21.15.139:0/3251346844 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f17327fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72f2f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f17337fe640 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72f2dae0 0x563f72fa5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 -- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72f2dae0 msgr2=0x563f72fa5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72f2dae0 0x563f72fa5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 -- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 msgr2=0x563f72f2f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72f2f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.923+0000 7f1732ffd640 1 -- 172.21.15.139:0/3251346844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f72eea1e0 con 0x563f72eee5e0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f1732ffd640 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72eeedc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f172c003e70 tx=0x7f172c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f9a6d26e89b3a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f1711ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f1711ffb640 1 -- 172.21.15.139:0/3251346844 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c030070 con 0x563f72eee5e0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f1711ffb640 1 -- 172.21.15.139:0/3251346844 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f172c018a10 con 0x563f72eee5e0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f172c01d040 con 0x563f72eee5e0 2024-04-26T18:12:19.928 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f1711ffb640 1 -- 172.21.15.139:0/3251346844 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f172c01c070 con 0x563f72eee5e0 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 10 client.5358 fetch_fsmap learned FSMap version 9 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563f72eebda0 con 0x563f72eee5e0 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f1711ffb640 1 -- 172.21.15.139:0/3251346844 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c01d040 con 0x563f72eee5e0 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f1711ffb640 1 -- 172.21.15.139:0/3251346844 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f172c005990 con 0x563f72eee5e0 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 10 client.5358 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 10 client.5358 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 20 client.5358 populate_metadata read hostname 'smithi139' 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72fa63f0 0x563f72f3ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 4 client.5358 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x563f72e59800 con 0x563f72fa63f0 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.924+0000 7f17327fc640 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72fa63f0 0x563f72f3ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.925+0000 7f1711ffb640 10 client.5358 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:19.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:19.925+0000 7f17327fc640 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72fa63f0 0x563f72f3ba50 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe69257e5898692a server_cookie=bb52f1d217bb6bb0 in_seq=0 out_seq=0 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f1711ffb640 1 -- 172.21.15.139:0/3251346844 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x563f72e59800 con 0x563f72fa63f0 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f1711ffb640 10 client.5358 handle_command_reply: tid=0 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 client.5358 shutdown 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 msgr2=0x563f72eeedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72eeedc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f172c003e70 tx=0x7f172c004730 comp rx=0 tx=0).stop 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 shutdown_connections 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x563f72fa63f0 0x563f72f3ba50 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x563f72f2dae0 0x563f72fa5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x563f72eefb40 0x563f72f2f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 --2- 172.21.15.139:0/3251346844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f72eee5e0 0x563f72eeedc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f1711ffb640 0 client.5358 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 >> 172.21.15.139:0/3251346844 conn(0x563f72eb5740 msgr2=0x563f72f52e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 shutdown_connections 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 1 -- 172.21.15.139:0/3251346844 wait complete. 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.762+0000 7f173bfe6740 20 client.5358 trim_cache size 0 max 16384 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:12:22.764 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 42, 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "e83567ff": { 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 42, 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 70.0, 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:12:22.765 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:22.766 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f171406c920 msgr2=0x7f171406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f171406c920 0x7f171406ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f172c006fd0 tx=0x7f172c008040 comp rx=0 tx=0).stop 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1734156250 msgr2=0x7f1734152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1734156250 0x7f1734152510 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1724009e50 tx=0x7f1724004a40 comp rx=0 tx=0).stop 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 shutdown_connections 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f171406c920 0x7f171406ede0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1734156250 0x7f1734152510 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f17340cbf30 0x7f17341f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 --2- 172.21.15.139:0/2447631108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f17340c9d80 0x7f17341f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:22.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 >> 172.21.15.139:0/2447631108 conn(0x7f17340746d0 msgr2=0x7f17340cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:22.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 shutdown_connections 2024-04-26T18:12:22.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:22.763+0000 7f17392c8640 1 -- 172.21.15.139:0/2447631108 wait complete. 2024-04-26T18:12:22.774 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e83567ff', quiesce took 3.3 seconds. Will release after: 10 2024-04-26T18:12:32.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:12:32.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.883+0000 7f895eeb8640 1 Processor -- start 2024-04-26T18:12:32.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.883+0000 7f895eeb8640 1 -- start start 2024-04-26T18:12:32.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f895eeb8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8958152cb0 0x7f895815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f895eeb8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89580736a0 con 0x7f89580c7c20 2024-04-26T18:12:32.887 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f895eeb8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89580c62e0 con 0x7f89580c89f0 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f895eeb8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8958073940 con 0x7f8958152cb0 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f895d455640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f89580c7c20 0x7f89581630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:48596/0 (socket says 172.21.15.139:48596) 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f895d455640 1 -- 172.21.15.139:0/842681778 learned_addr learned my addr 172.21.15.139:0/842681778 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f895cc54640 1 --2- 172.21.15.139:0/842681778 >> v2:172.21.15.143:3300/0 conn(0x7f8958152cb0 0x7f895815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982864738 0 0) 0x7f89580736a0 con 0x7f89580c7c20 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8940003520 con 0x7f89580c7c20 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922252536 0 0) 0x7f89580c62e0 con 0x7f89580c89f0 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.884+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89580736a0 con 0x7f89580c89f0 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 145482493 0 0) 0x7f8940003520 con 0x7f89580c7c20 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 >> v2:172.21.15.143:3300/0 conn(0x7f8958152cb0 msgr2=0x7f895815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 --2- 172.21.15.139:0/842681778 >> v2:172.21.15.143:3300/0 conn(0x7f8958152cb0 0x7f895815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 >> v1:172.21.15.143:6789/0 conn(0x7f89580c89f0 legacy=0x7f89580cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89580c48c0 con 0x7f89580c7c20 2024-04-26T18:12:32.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f89500019f0 con 0x7f89580c7c20 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 >> v1:172.21.15.139:6789/0 conn(0x7f89580c7c20 legacy=0x7f89581630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940003b40 0x7f8940003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8940004800 0x7f8940004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89400051c0 0x7f894000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8958073940 con 0x7f8940004800 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f894000e1c0 con 0x7f8940003b40 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f894000e3c0 con 0x7f89400051c0 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f895cc54640 1 --2- 172.21.15.139:0/842681778 >> v2:172.21.15.143:3300/0 conn(0x7f8958152cb0 0x7f895815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f8957fff640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8940004800 0x7f8940004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f895d455640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89400051c0 0x7f894000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f895cc54640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940003b40 0x7f8940003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f8957fff640 1 -- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89400051c0 msgr2=0x7f894000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f8957fff640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89400051c0 0x7f894000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f8957fff640 1 -- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940003b40 msgr2=0x7f8940003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:32.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f8957fff640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940003b40 0x7f8940003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f8957fff640 1 -- 172.21.15.139:0/842681778 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8940003520 con 0x7f8940004800 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f895d455640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89400051c0 0x7f894000dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.885+0000 7f895d455640 1 -- 172.21.15.139:0/842681778 reap_dead start 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f8957fff640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8940004800 0x7f8940004c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f894c0018a0 tx=0x7f8940005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b957d49e05331afa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c0014f0 con 0x7f8940004800 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c0052d0 con 0x7f8940004800 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f89577fe640 1 -- 172.21.15.139:0/842681778 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c02ac30 con 0x7f8940004800 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f895eeb8640 1 -- 172.21.15.139:0/842681778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8940004800 msgr2=0x7f8940004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f895eeb8640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8940004800 0x7f8940004c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f894c0018a0 tx=0x7f8940005830 comp rx=0 tx=0).stop 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f895eeb8640 1 -- 172.21.15.139:0/842681778 shutdown_connections 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.886+0000 7f895eeb8640 1 --2- 172.21.15.139:0/842681778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8940004800 0x7f8940004c80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.887+0000 7f895eeb8640 1 -- 172.21.15.139:0/842681778 >> 172.21.15.139:0/842681778 conn(0x7f8958068270 msgr2=0x7f8958068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.887+0000 7f895eeb8640 1 -- 172.21.15.139:0/842681778 shutdown_connections 2024-04-26T18:12:32.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.887+0000 7f895eeb8640 1 -- 172.21.15.139:0/842681778 wait complete. 2024-04-26T18:12:32.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.888+0000 7f895eeb8640 1 Processor -- start 2024-04-26T18:12:32.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.888+0000 7f895eeb8640 1 -- start start 2024-04-26T18:12:32.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940004800 0x7f8958146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89581e28e0 0x7f89581edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89581e2fd0 0x7f89581ee460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f89580c4d20 con 0x7f89581e2fd0 2024-04-26T18:12:32.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f89580c4ba0 con 0x7f8940004800 2024-04-26T18:12:32.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f89580c84a0 con 0x7f89581e28e0 2024-04-26T18:12:32.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89581e2fd0 0x7f89581ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89581e2fd0 0x7f89581ee460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55234/0 (socket says 172.21.15.139:55234) 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 -- 172.21.15.139:0/3951244350 learned_addr learned my addr 172.21.15.139:0/3951244350 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895cc54640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940004800 0x7f8958146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f8957fff640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89581e28e0 0x7f89581edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 -- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89581e28e0 msgr2=0x7f89581edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89581e28e0 0x7f89581edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 -- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940004800 msgr2=0x7f8958146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940004800 0x7f8958146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 -- 172.21.15.139:0/3951244350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89581496e0 con 0x7f89581e2fd0 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f8957fff640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89581e28e0 0x7f89581edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895d455640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89581e2fd0 0x7f89581ee460 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f895806ded0 tx=0x7f895000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f89557fa640 1 -- 172.21.15.139:0/3951244350 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895000ecc0 con 0x7f89581e2fd0 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f89557fa640 1 -- 172.21.15.139:0/3951244350 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895000ee80 con 0x7f89581e2fd0 2024-04-26T18:12:32.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895815b6d0 con 0x7f89581e2fd0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f89557fa640 1 -- 172.21.15.139:0/3951244350 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950014670 con 0x7f89581e2fd0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.889+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8958148e40 con 0x7f89581e2fd0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.890+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89581e36b0 con 0x7f89581e2fd0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.891+0000 7f89557fa640 1 -- 172.21.15.139:0/3951244350 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8950014810 con 0x7f89581e2fd0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.891+0000 7f89557fa640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f894406c920 0x7f894406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.891+0000 7f89557fa640 1 -- 172.21.15.139:0/3951244350 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f895008bb60 con 0x7f89581e2fd0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.891+0000 7f895cc54640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f894406c920 0x7f894406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.892+0000 7f895cc54640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f894406c920 0x7f894406ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8948009ce0 tx=0x7f8948009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:32.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:32.896+0000 7f89557fa640 1 -- 172.21.15.139:0/3951244350 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8950059500 con 0x7f89581e2fd0 2024-04-26T18:12:33.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.112+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89581ed880 con 0x7f89581e2fd0 2024-04-26T18:12:33.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.113+0000 7f89557fa640 1 -- 172.21.15.139:0/3951244350 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f895005d800 con 0x7f89581e2fd0 2024-04-26T18:12:33.113 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:12:33.113 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:12:33.113 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f894406c920 msgr2=0x7f894406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f894406c920 0x7f894406ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8948009ce0 tx=0x7f8948009190 comp rx=0 tx=0).stop 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89581e2fd0 msgr2=0x7f89581ee460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89581e2fd0 0x7f89581ee460 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f895806ded0 tx=0x7f895000e530 comp rx=0 tx=0).stop 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 shutdown_connections 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f894406c920 0x7f894406ede0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89581e2fd0 0x7f89581ee460 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f89581e28e0 0x7f89581edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 --2- 172.21.15.139:0/3951244350 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8940004800 0x7f8958146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 >> 172.21.15.139:0/3951244350 conn(0x7f8958068270 msgr2=0x7f89580c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:33.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 shutdown_connections 2024-04-26T18:12:33.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.115+0000 7f895eeb8640 1 -- 172.21.15.139:0/3951244350 wait complete. 2024-04-26T18:12:33.125 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id e83567ff --release --await' 2024-04-26T18:12:33.126 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id e83567ff --release --await 2024-04-26T18:12:33.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.230+0000 7f750aa72640 1 Processor -- start 2024-04-26T18:12:33.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.230+0000 7f750aa72640 1 -- start start 2024-04-26T18:12:33.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.230+0000 7f750aa72640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f75040c8b10 0x7f75040ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.230+0000 7f750aa72640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75040c9c80 0x7f75040c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.230+0000 7f750aa72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7504158960 con 0x7f750406fb20 2024-04-26T18:12:33.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.230+0000 7f750aa72640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f7504159830 con 0x7f75040c9c80 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.230+0000 7f750aa72640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7504158c20 con 0x7f75040c8b10 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f7503fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75040c9c80 0x7f75040c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f7503fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f75040c9c80 0x7f75040c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55244/0 (socket says 172.21.15.139:55244) 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f7503fff640 1 -- 172.21.15.139:0/4092702663 learned_addr learned my addr 172.21.15.139:0/4092702663 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f750880e640 1 --2- 172.21.15.139:0/4092702663 >> v2:172.21.15.143:3300/0 conn(0x7f75040c8b10 0x7f75040ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f7503fff640 1 -- 172.21.15.139:0/4092702663 >> v2:172.21.15.143:3300/0 conn(0x7f75040c8b10 msgr2=0x7f75040ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f7503fff640 1 --2- 172.21.15.139:0/4092702663 >> v2:172.21.15.143:3300/0 conn(0x7f75040c8b10 0x7f75040ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f7503fff640 1 -- 172.21.15.139:0/4092702663 >> v1:172.21.15.143:6789/0 conn(0x7f750406fb20 legacy=0x7f750406ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.231+0000 7f7503fff640 1 -- 172.21.15.139:0/4092702663 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7504158f00 con 0x7f75040c9c80 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f7503fff640 1 --2- 172.21.15.139:0/4092702663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75040c9c80 0x7f75040c8ef0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f75040c9690 tx=0x7f74f402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75808940bda06a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f75037fe640 1 -- 172.21.15.139:0/4092702663 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4037070 con 0x7f75040c9c80 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f75037fe640 1 -- 172.21.15.139:0/4092702663 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f402ae50 con 0x7f75040c9c80 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f75037fe640 1 -- 172.21.15.139:0/4092702663 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4032860 con 0x7f75040c9c80 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 -- 172.21.15.139:0/4092702663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75040c9c80 msgr2=0x7f75040c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 --2- 172.21.15.139:0/4092702663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75040c9c80 0x7f75040c8ef0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f75040c9690 tx=0x7f74f402a300 comp rx=0 tx=0).stop 2024-04-26T18:12:33.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 -- 172.21.15.139:0/4092702663 shutdown_connections 2024-04-26T18:12:33.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 --2- 172.21.15.139:0/4092702663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75040c9c80 0x7f75040c8ef0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 --2- 172.21.15.139:0/4092702663 >> v2:172.21.15.143:3300/0 conn(0x7f75040c8b10 0x7f75040ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 -- 172.21.15.139:0/4092702663 >> 172.21.15.139:0/4092702663 conn(0x7f750406dd40 msgr2=0x7f750406e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:33.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 -- 172.21.15.139:0/4092702663 shutdown_connections 2024-04-26T18:12:33.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.232+0000 7f750aa72640 1 -- 172.21.15.139:0/4092702663 wait complete. 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.233+0000 7f750aa72640 1 Processor -- start 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.233+0000 7f750aa72640 1 -- start start 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750aa72640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750406fb20 0x7f7504164f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750aa72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75040c8b10 0x7f7504165770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750aa72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75040c9c80 0x7f750415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750aa72640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f75040c2020 con 0x7f750406fb20 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750aa72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75041594c0 con 0x7f75040c8b10 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750aa72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75040cdd30 con 0x7f75040c9c80 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750406fb20 0x7f7504164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750406fb20 0x7f7504164f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55258/0 (socket says 172.21.15.139:55258) 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750880e640 1 -- 172.21.15.139:0/2127094716 learned_addr learned my addr 172.21.15.139:0/2127094716 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:33.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f7503fff640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75040c8b10 0x7f7504165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.234+0000 7f750900f640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75040c9c80 0x7f750415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750880e640 1 -- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75040c9c80 msgr2=0x7f750415b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750880e640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75040c9c80 0x7f750415b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750880e640 1 -- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75040c8b10 msgr2=0x7f7504165770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750880e640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75040c8b10 0x7f7504165770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750880e640 1 -- 172.21.15.139:0/2127094716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7504165e00 con 0x7f750406fb20 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750880e640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750406fb20 0x7f7504164f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f74fc007e70 tx=0x7f74fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f75017fa640 1 -- 172.21.15.139:0/2127094716 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc014620 con 0x7f750406fb20 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f75017fa640 1 -- 172.21.15.139:0/2127094716 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc019070 con 0x7f750406fb20 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75041660e0 con 0x7f750406fb20 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f75017fa640 1 -- 172.21.15.139:0/2127094716 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc014a00 con 0x7f750406fb20 2024-04-26T18:12:33.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.235+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7504164770 con 0x7f750406fb20 2024-04-26T18:12:33.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.237+0000 7f75017fa640 1 -- 172.21.15.139:0/2127094716 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74fc014ba0 con 0x7f750406fb20 2024-04-26T18:12:33.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.237+0000 7f75017fa640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f74e406c920 0x7f74e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.237+0000 7f75017fa640 1 -- 172.21.15.139:0/2127094716 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f74fc08c720 con 0x7f750406fb20 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.237+0000 7f7503fff640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f74e406c920 0x7f74e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.237+0000 7f7503fff640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f74e406c920 0x7f74e406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74f4034000 tx=0x7f74f402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 Processor -- start 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 -- start start 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c68204b0 0x5558c685f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c685f9b0 0x5558c6820890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6820dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5558c6785040 con 0x5558c685f9b0 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5558c6720b60 con 0x5558c6821a10 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.238+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5558c6781000 con 0x5558c68204b0 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c685f9b0 0x5558c6820890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c685f9b0 0x5558c6820890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55274/0 (socket says 172.21.15.139:55274) 2024-04-26T18:12:33.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 -- 172.21.15.139:0/321585486 learned_addr learned my addr 172.21.15.139:0/321585486 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f750900f640 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6820dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 -- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c68204b0 msgr2=0x5558c685f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c68204b0 0x5558c685f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 -- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 msgr2=0x5558c6820dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6820dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 -- 172.21.15.139:0/321585486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c67159c0 con 0x5558c685f9b0 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f750900f640 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6820dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f7503fff640 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c685f9b0 0x5558c6820890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f74f402a340 tx=0x7f74f402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eec9c6e047224d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f74fa7fc640 1 -- 172.21.15.139:0/321585486 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f404e070 con 0x5558c685f9b0 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f74fa7fc640 1 -- 172.21.15.139:0/321585486 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f402ae50 con 0x5558c685f9b0 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.239+0000 7f74fa7fc640 1 -- 172.21.15.139:0/321585486 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4037040 con 0x5558c685f9b0 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 -- 172.21.15.139:0/321585486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c685f9b0 msgr2=0x5558c6820890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c685f9b0 0x5558c6820890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f74f402a340 tx=0x7f74f402c000 comp rx=0 tx=0).stop 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 -- 172.21.15.139:0/321585486 shutdown_connections 2024-04-26T18:12:33.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6820dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c685f9b0 0x5558c6820890 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 --2- 172.21.15.139:0/321585486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c68204b0 0x5558c685f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 -- 172.21.15.139:0/321585486 >> 172.21.15.139:0/321585486 conn(0x5558c67e7930 msgr2=0x5558c6864450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:33.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 -- 172.21.15.139:0/321585486 shutdown_connections 2024-04-26T18:12:33.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 -- 172.21.15.139:0/321585486 wait complete. 2024-04-26T18:12:33.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.240+0000 7f750d78f740 1 -- start start 2024-04-26T18:12:33.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 1 Processor -- start 2024-04-26T18:12:33.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c6820c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c6870fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c684b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5558c681eaf0 con 0x5558c68204b0 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5558c671e4f0 con 0x5558c685f9b0 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5558c6822040 con 0x5558c6821a10 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750d78f740 10 client.0 _ll_register_callbacks cb 0x5558c677bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c6820c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c6820c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55278/0 (socket says 172.21.15.139:55278) 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.241+0000 7f750880e640 1 -- 172.21.15.139:0/4212994525 learned_addr learned my addr 172.21.15.139:0/4212994525 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f7503fff640 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c6870fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750900f640 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c684b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750880e640 1 -- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 msgr2=0x5558c6870fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750880e640 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c6870fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750880e640 1 -- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 msgr2=0x5558c684b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750880e640 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c684b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750880e640 1 -- 172.21.15.139:0/4212994525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558c6496920 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750880e640 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c6820c90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00c040 tx=0x7f74fc05e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844fc50f10e7f699 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f74e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f74e37fe640 1 -- 172.21.15.139:0/4212994525 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc085020 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f74e37fe640 1 -- 172.21.15.139:0/4212994525 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f74fc062960 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f402ae50 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f74e37fe640 1 -- 172.21.15.139:0/4212994525 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f74fc0583f0 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 10 client.5376 fetch_fsmap learned FSMap version 9 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5558c6562d30 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f74e37fe640 1 -- 172.21.15.139:0/4212994525 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f402ae50 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f74e37fe640 1 -- 172.21.15.139:0/4212994525 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f74fc059480 con 0x5558c68204b0 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 10 client.5376 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:12:33.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 10 client.5376 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 20 client.5376 populate_metadata read hostname 'smithi139' 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6847870 0x5558c6847c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 4 client.5376 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.242+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558c6758a00 con 0x5558c6847870 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.243+0000 7f7503fff640 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6847870 0x5558c6847c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.243+0000 7f7503fff640 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6847870 0x5558c6847c80 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa62036d08199779 server_cookie=61ab9fbc0e5b0cc6 in_seq=0 out_seq=0 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.243+0000 7f74e37fe640 10 client.5376 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f74e37fe640 1 -- 172.21.15.139:0/4212994525 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5558c6758a00 con 0x5558c6847870 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f74e37fe640 10 client.5376 handle_command_reply: tid=0 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 client.5376 shutdown 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 msgr2=0x5558c6820c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c6820c90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00c040 tx=0x7f74fc05e3f0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 shutdown_connections 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c684b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6847870 0x5558c6847c80 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c6870fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 --2- 172.21.15.139:0/4212994525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c6820c90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f74e37fe640 0 client.5376 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 >> 172.21.15.139:0/4212994525 conn(0x5558c67e7930 msgr2=0x5558c6848ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 shutdown_connections 2024-04-26T18:12:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 1 -- 172.21.15.139:0/4212994525 wait complete. 2024-04-26T18:12:33.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.244+0000 7f750d78f740 20 client.5376 trim_cache size 0 max 16384 2024-04-26T18:12:33.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.261+0000 7f750d78f740 1 Processor -- start 2024-04-26T18:12:33.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.261+0000 7f750d78f740 1 -- start start 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750d78f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c685d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6847c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c685f9b0 0x5558c6848190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750d78f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f75042008c0 con 0x5558c68204b0 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75041ff7a0 con 0x5558c6821a10 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7504141c40 con 0x5558c685f9b0 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c685d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c685d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55292/0 (socket says 172.21.15.139:55292) 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 -- 172.21.15.139:0/813575932 learned_addr learned my addr 172.21.15.139:0/813575932 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750900f640 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c685f9b0 0x5558c6848190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f7503fff640 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6847c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 -- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c685f9b0 msgr2=0x5558c6848190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c685f9b0 0x5558c6848190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 -- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 msgr2=0x5558c6847c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6847c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.262+0000 7f750880e640 1 -- 172.21.15.139:0/813575932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558c685dc80 con 0x5558c68204b0 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750880e640 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c685d030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f74fc08ca40 tx=0x7f74fc08c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8b406fac3c0b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f74f9ffb640 1 -- 172.21.15.139:0/813575932 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc085040 con 0x5558c68204b0 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f74f9ffb640 1 -- 172.21.15.139:0/813575932 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc07f070 con 0x5558c68204b0 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f74f9ffb640 1 -- 172.21.15.139:0/813575932 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc062bf0 con 0x5558c68204b0 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 -- 172.21.15.139:0/813575932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 msgr2=0x5558c685d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c685d030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f74fc08ca40 tx=0x7f74fc08c000 comp rx=0 tx=0).stop 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 -- 172.21.15.139:0/813575932 shutdown_connections 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c685f9b0 0x5558c6848190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c6821a10 0x5558c6847c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 --2- 172.21.15.139:0/813575932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c685d030 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 -- 172.21.15.139:0/813575932 >> 172.21.15.139:0/813575932 conn(0x5558c67e7930 msgr2=0x5558c68414a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 -- 172.21.15.139:0/813575932 shutdown_connections 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.263+0000 7f750d78f740 1 -- 172.21.15.139:0/813575932 wait complete. 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.264+0000 7f750d78f740 1 -- start start 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.264+0000 7f750d78f740 1 Processor -- start 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c68404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c68d4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c68d46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f75041fe480 con 0x5558c68204b0 2024-04-26T18:12:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f75041ff0f0 con 0x5558c685f9b0 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f75041fea40 con 0x5558c6821a10 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 10 client.0 _ll_register_callbacks cb 0x7f74fc0562d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c68404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c68404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:55298/0 (socket says 172.21.15.139:55298) 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 -- 172.21.15.139:0/1493258151 learned_addr learned my addr 172.21.15.139:0/1493258151 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750900f640 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c68d46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f7503fff640 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c68d4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 -- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 msgr2=0x5558c68d4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c68d4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 -- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 msgr2=0x5558c68d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c68d46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 -- 172.21.15.139:0/1493258151 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558c684ad50 con 0x5558c68204b0 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750880e640 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c68404d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f74fc059fc0 tx=0x7f74fc016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5c5263ceda6552 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f74e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f74e37fe640 1 -- 172.21.15.139:0/1493258151 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc067060 con 0x5558c68204b0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f74e37fe640 1 -- 172.21.15.139:0/1493258151 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f74fc062960 con 0x5558c68204b0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.265+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74fc07f070 con 0x5558c68204b0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f74e37fe640 1 -- 172.21.15.139:0/1493258151 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f74fc06d050 con 0x5558c68204b0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 10 client.5382 fetch_fsmap learned FSMap version 9 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5558c6884a70 con 0x5558c68204b0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f74e37fe640 1 -- 172.21.15.139:0/1493258151 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc07f070 con 0x5558c68204b0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f74e37fe640 1 -- 172.21.15.139:0/1493258151 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f74fc055d80 con 0x5558c68204b0 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 10 client.5382 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 10 client.5382 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 20 client.5382 populate_metadata read hostname 'smithi139' 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6860ce0 0x5558c68dd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 4 client.5382 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e83567ff", "release": true, "await": true}] 2024-04-26T18:12:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e83567ff", "release": true, "await": true}) -- 0x5558c6792c50 con 0x5558c6860ce0 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f7503fff640 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6860ce0 0x5558c68dd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f74e37fe640 10 client.5382 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.266+0000 7f7503fff640 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6860ce0 0x5558c68dd930 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65040bc0c5309701 server_cookie=44c8c58a1f20050b in_seq=0 out_seq=0 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f74e37fe640 1 -- 172.21.15.139:0/1493258151 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5558c6792c50 con 0x5558c6860ce0 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f74e37fe640 10 client.5382 handle_command_reply: tid=0 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 client.5382 shutdown 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 msgr2=0x5558c68404d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c68404d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f74fc059fc0 tx=0x7f74fc016040 comp rx=0 tx=0).stop 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 shutdown_connections 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5558c685f9b0 0x5558c68d46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5558c6860ce0 0x5558c68dd930 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5558c6821a10 0x5558c68d4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 --2- 172.21.15.139:0/1493258151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5558c68204b0 0x5558c68404d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 >> 172.21.15.139:0/1493258151 conn(0x5558c67e7930 msgr2=0x5558c6841290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f74e37fe640 0 client.5382 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 shutdown_connections 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 1 -- 172.21.15.139:0/1493258151 wait complete. 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750d78f740 20 client.5382 trim_cache size 0 max 16384 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 44, 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:12:33.274 INFO:teuthology.orchestra.run.smithi139.stdout: "e83567ff": { 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 44, 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 70.0, 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:12:33.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:12:33.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:33.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:33.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:33.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:33.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:33.276 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f74e406c920 msgr2=0x7f74e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750aa72640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f74e406c920 0x7f74e406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74f4034000 tx=0x7f74f402e000 comp rx=0 tx=0).stop 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750406fb20 msgr2=0x7f7504164f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.267+0000 7f750aa72640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750406fb20 0x7f7504164f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f74fc007e70 tx=0x7f74fc00e4b0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 shutdown_connections 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f74e406c920 0x7f74e406ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f75040c9c80 0x7f750415b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f75040c8b10 0x7f7504165770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 --2- 172.21.15.139:0/2127094716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f750406fb20 0x7f7504164f70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:33.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 >> 172.21.15.139:0/2127094716 conn(0x7f750406dd40 msgr2=0x7f7504071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:33.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 shutdown_connections 2024-04-26T18:12:33.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:33.268+0000 7f750aa72640 1 -- 172.21.15.139:0/2127094716 wait complete. 2024-04-26T18:12:33.279 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e83567ff', seconds elapsed: 13.8 2024-04-26T18:12:33.779 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 67% (166/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 75% (186/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-26T18:12:34.089 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 1dd420957f9 journal: detect size of raw block devices properly 2024-04-26T18:12:34.122 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.5 2024-04-26T18:12:34.684 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:12:34.684 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 6 -eq 48 ']' 2024-04-26T18:12:34.685 INFO:tasks.workunit.client.0.smithi139.stdout:v0.6 2024-04-26T18:12:34.685 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.6 2024-04-26T18:12:34.685 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.6 2024-04-26T18:12:34.685 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.6 2024-04-26T18:12:39.301 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:12:39.304 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:12:43.568 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 62% (143/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 89% (204/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-04-26T18:12:43.598 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at a4c752df713 v0.6 2024-04-26T18:12:43.600 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.6 2024-04-26T18:12:44.482 INFO:tasks.workunit.client.0.smithi139.stdout:v0.7 2024-04-26T18:12:44.483 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:12:44.483 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 7 -eq 48 ']' 2024-04-26T18:12:44.483 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.7 2024-04-26T18:12:44.483 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.7 2024-04-26T18:12:44.483 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.7 2024-04-26T18:12:51.851 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.6 2024-04-26T18:12:51.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:12:51.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.994+0000 7f073744e640 1 Processor -- start 2024-04-26T18:12:51.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.994+0000 7f073744e640 1 -- start start 2024-04-26T18:12:51.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.995+0000 7f073744e640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0728046300 0x7f0728007d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:51.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.995+0000 7f073744e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f072804bc30 0x7f07280470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:51.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.996+0000 7f073744e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0728006ff0 con 0x7f07280dd6c0 2024-04-26T18:12:51.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.996+0000 7f073744e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f07280ddaa0 con 0x7f072804bc30 2024-04-26T18:12:51.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.996+0000 7f073744e640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f07280078e0 con 0x7f0728046300 2024-04-26T18:12:51.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.996+0000 7f0736c4d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f072804bc30 0x7f07280470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:51.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.996+0000 7f0736c4d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f072804bc30 0x7f07280470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44502/0 (socket says 172.21.15.139:44502) 2024-04-26T18:12:51.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.996+0000 7f0736c4d640 1 -- 172.21.15.139:0/2497454940 learned_addr learned my addr 172.21.15.139:0/2497454940 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:51.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.996+0000 7f0735c4b640 1 --2- 172.21.15.139:0/2497454940 >> v2:172.21.15.143:3300/0 conn(0x7f0728046300 0x7f0728007d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:51.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.997+0000 7f0736c4d640 1 -- 172.21.15.139:0/2497454940 >> v2:172.21.15.143:3300/0 conn(0x7f0728046300 msgr2=0x7f0728007d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:51.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.997+0000 7f0736c4d640 1 --2- 172.21.15.139:0/2497454940 >> v2:172.21.15.143:3300/0 conn(0x7f0728046300 0x7f0728007d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:51.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.997+0000 7f0736c4d640 1 -- 172.21.15.139:0/2497454940 >> v1:172.21.15.139:6789/0 conn(0x7f07280dd6c0 legacy=0x7f0728047bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:51.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.997+0000 7f0736c4d640 1 -- 172.21.15.139:0/2497454940 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072804c060 con 0x7f072804bc30 2024-04-26T18:12:51.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.998+0000 7f0736c4d640 1 --2- 172.21.15.139:0/2497454940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f072804bc30 0x7f07280470b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f073006b1d0 tx=0x7f07300a7930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97cd0d39cf3f6cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:51.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.998+0000 7f073544a640 1 -- 172.21.15.139:0/2497454940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07300b1020 con 0x7f072804bc30 2024-04-26T18:12:51.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.999+0000 7f073544a640 1 -- 172.21.15.139:0/2497454940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07300ad8f0 con 0x7f072804bc30 2024-04-26T18:12:51.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:51.999+0000 7f073544a640 1 -- 172.21.15.139:0/2497454940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07300add80 con 0x7f072804bc30 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 -- 172.21.15.139:0/2497454940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f072804bc30 msgr2=0x7f07280470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 --2- 172.21.15.139:0/2497454940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f072804bc30 0x7f07280470b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f073006b1d0 tx=0x7f07300a7930 comp rx=0 tx=0).stop 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 -- 172.21.15.139:0/2497454940 shutdown_connections 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 --2- 172.21.15.139:0/2497454940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f072804bc30 0x7f07280470b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 --2- 172.21.15.139:0/2497454940 >> v2:172.21.15.143:3300/0 conn(0x7f0728046300 0x7f0728007d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 -- 172.21.15.139:0/2497454940 >> 172.21.15.139:0/2497454940 conn(0x7f072804dd30 msgr2=0x7f072804e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 -- 172.21.15.139:0/2497454940 shutdown_connections 2024-04-26T18:12:51.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.000+0000 7f073744e640 1 -- 172.21.15.139:0/2497454940 wait complete. 2024-04-26T18:12:52.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.002+0000 7f073744e640 1 Processor -- start 2024-04-26T18:12:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.002+0000 7f073744e640 1 -- start start 2024-04-26T18:12:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f073744e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0728046300 0x7f072817d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f073744e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f072804bc30 0x7f0728034fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f073744e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07280dd6c0 0x7f072816d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f073744e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0728007570 con 0x7f0728046300 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f073744e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0728007290 con 0x7f07280dd6c0 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f073744e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f07280e4190 con 0x7f072804bc30 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f0735c4b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f072804bc30 0x7f0728034fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f073644c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0728046300 0x7f072817d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f0735c4b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f072804bc30 0x7f0728034fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:57896/0 (socket says 172.21.15.139:57896) 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.003+0000 7f0735c4b640 1 -- 172.21.15.139:0/3192091670 learned_addr learned my addr 172.21.15.139:0/3192091670 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.004+0000 7f0735c4b640 1 -- 172.21.15.139:0/3192091670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07280dd6c0 msgr2=0x7f072816d000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.004+0000 7f0735c4b640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07280dd6c0 0x7f072816d000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.004+0000 7f0735c4b640 1 -- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0728046300 msgr2=0x7f072817d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.004+0000 7f0735c4b640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0728046300 0x7f072817d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.004+0000 7f0735c4b640 1 -- 172.21.15.139:0/3192091670 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0728034740 con 0x7f072804bc30 2024-04-26T18:12:52.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.004+0000 7f073644c640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0728046300 0x7f072817d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:12:52.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.005+0000 7f0735c4b640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f072804bc30 0x7f0728034fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f072000d5f0 tx=0x7f072000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.005+0000 7f0726ffd640 1 -- 172.21.15.139:0/3192091670 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07200125f0 con 0x7f072804bc30 2024-04-26T18:12:52.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.005+0000 7f0726ffd640 1 -- 172.21.15.139:0/3192091670 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0720019070 con 0x7f072804bc30 2024-04-26T18:12:52.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.005+0000 7f0726ffd640 1 -- 172.21.15.139:0/3192091670 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07200129d0 con 0x7f072804bc30 2024-04-26T18:12:52.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.005+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0728034a20 con 0x7f072804bc30 2024-04-26T18:12:52.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.006+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f072817c940 con 0x7f072804bc30 2024-04-26T18:12:52.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.008+0000 7f0726ffd640 1 -- 172.21.15.139:0/3192091670 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0720012b70 con 0x7f072804bc30 2024-04-26T18:12:52.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.008+0000 7f0726ffd640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f071406c9c0 0x7f071406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.009+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0718005290 con 0x7f072804bc30 2024-04-26T18:12:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.010+0000 7f073644c640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f071406c9c0 0x7f071406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.010+0000 7f0726ffd640 1 -- 172.21.15.139:0/3192091670 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f072008c180 con 0x7f072804bc30 2024-04-26T18:12:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.011+0000 7f073644c640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f071406c9c0 0x7f071406ee80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f072c000f60 tx=0x7f072c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.019+0000 7f0726ffd640 1 -- 172.21.15.139:0/3192091670 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f072005a1e0 con 0x7f072804bc30 2024-04-26T18:12:52.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.233+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0718005580 con 0x7f072804bc30 2024-04-26T18:12:52.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.234+0000 7f0726ffd640 1 -- 172.21.15.139:0/3192091670 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f0720059ae0 con 0x7f072804bc30 2024-04-26T18:12:52.233 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:12:52.233 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:12:52.234 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f071406c9c0 msgr2=0x7f071406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f071406c9c0 0x7f071406ee80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f072c000f60 tx=0x7f072c009040 comp rx=0 tx=0).stop 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f072804bc30 msgr2=0x7f0728034fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f072804bc30 0x7f0728034fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f072000d5f0 tx=0x7f072000dab0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 shutdown_connections 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f071406c9c0 0x7f071406ee80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f07280dd6c0 0x7f072816d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f072804bc30 0x7f0728034fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 --2- 172.21.15.139:0/3192091670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0728046300 0x7f072817d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 >> 172.21.15.139:0/3192091670 conn(0x7f072804dd30 msgr2=0x7f072804d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 shutdown_connections 2024-04-26T18:12:52.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.236+0000 7f073744e640 1 -- 172.21.15.139:0/3192091670 wait complete. 2024-04-26T18:12:52.246 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 92.6 --await-for 42.0' 2024-04-26T18:12:52.246 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 92.6 --await-for 42.0 2024-04-26T18:12:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.356+0000 7f254232b640 1 Processor -- start 2024-04-26T18:12:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.356+0000 7f254232b640 1 -- start start 2024-04-26T18:12:52.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f254232b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f254232b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f253c15c2a0 0x7f253c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f254232b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c15f5f0 con 0x7f253c0cf260 2024-04-26T18:12:52.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f254232b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f253c160170 con 0x7f253c15c2a0 2024-04-26T18:12:52.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f254232b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f253c15be10 con 0x7f253c0d14b0 2024-04-26T18:12:52.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f253bfff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f25408c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f253c15c2a0 0x7f253c15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f253b7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f253c0cf260 0x7f253c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:49628/0 (socket says 172.21.15.139:49628) 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f253bfff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0d1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:57900/0 (socket says 172.21.15.139:57900) 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f253b7fe640 1 -- 172.21.15.139:0/2870221617 learned_addr learned my addr 172.21.15.139:0/2870221617 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f253affd640 1 -- 172.21.15.139:0/2870221617 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132353609 0 0) 0x7f253c15f5f0 con 0x7f253c0cf260 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f253affd640 1 -- 172.21.15.139:0/2870221617 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2524003520 con 0x7f253c0cf260 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f25408c8640 1 -- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 msgr2=0x7f253c0d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f25408c8640 1 --2- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f25408c8640 1 -- 172.21.15.139:0/2870221617 >> v1:172.21.15.143:6789/0 conn(0x7f253c0cf260 legacy=0x7f253c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f25408c8640 1 -- 172.21.15.139:0/2870221617 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c15f8d0 con 0x7f253c15c2a0 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.357+0000 7f253bfff640 1 --2- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.358+0000 7f25408c8640 1 --2- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 0x7f253c15c750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2534009d90 tx=0x7f253402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73986de56a4df3a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.358+0000 7f253affd640 1 -- 172.21.15.139:0/2870221617 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534007740 con 0x7f253c15c2a0 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.358+0000 7f253affd640 1 -- 172.21.15.139:0/2870221617 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25340078e0 con 0x7f253c15c2a0 2024-04-26T18:12:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.358+0000 7f253affd640 1 -- 172.21.15.139:0/2870221617 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534007c90 con 0x7f253c15c2a0 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 -- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 msgr2=0x7f253c15c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 --2- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 0x7f253c15c750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2534009d90 tx=0x7f253402a6f0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 -- 172.21.15.139:0/2870221617 shutdown_connections 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 --2- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 0x7f253c15c750 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 --2- 172.21.15.139:0/2870221617 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 -- 172.21.15.139:0/2870221617 >> 172.21.15.139:0/2870221617 conn(0x7f253c073c70 msgr2=0x7f253c074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 -- 172.21.15.139:0/2870221617 shutdown_connections 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.359+0000 7f254232b640 1 -- 172.21.15.139:0/2870221617 wait complete. 2024-04-26T18:12:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.360+0000 7f254232b640 1 Processor -- start 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.360+0000 7f254232b640 1 -- start start 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f254232b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253c0cf260 0x7f253c14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f254232b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f254232b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 0x7f253c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f254232b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f253c15f1d0 con 0x7f253c0cf260 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f254232b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f253c15fe90 con 0x7f253c15c2a0 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f254232b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f253c15f350 con 0x7f253c0d14b0 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253c0cf260 0x7f253c14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253c0cf260 0x7f253c14fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44524/0 (socket says 172.21.15.139:44524) 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 -- 172.21.15.139:0/848679108 learned_addr learned my addr 172.21.15.139:0/848679108 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f25408c8640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 0x7f253c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253b7fe640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 -- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 msgr2=0x7f253c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 -- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 msgr2=0x7f253c0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 0x7f253c0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 -- 172.21.15.139:0/848679108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c0cadd0 con 0x7f253c0cf260 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f253bfff640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253c0cf260 0x7f253c14fc10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e990 tx=0x7f252c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f2538ff9640 1 -- 172.21.15.139:0/848679108 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c017070 con 0x7f253c0cf260 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f2538ff9640 1 -- 172.21.15.139:0/848679108 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252c00c9e0 con 0x7f253c0cf260 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.361+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c0cb0b0 con 0x7f253c0cf260 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.362+0000 7f2538ff9640 1 -- 172.21.15.139:0/848679108 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c00cdb0 con 0x7f253c0cf260 2024-04-26T18:12:52.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.362+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c0ccbb0 con 0x7f253c0cf260 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.363+0000 7f2538ff9640 1 -- 172.21.15.139:0/848679108 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f252c01a070 con 0x7f253c0cf260 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.364+0000 7f2538ff9640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f252806c920 0x7f252806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.364+0000 7f2538ff9640 1 -- 172.21.15.139:0/848679108 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f252c08bcb0 con 0x7f253c0cf260 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.364+0000 7f253b7fe640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f252806c920 0x7f252806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.364+0000 7f253b7fe640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f252806c920 0x7f252806ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f253c073540 tx=0x7f2530009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 Processor -- start 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 -- start start 2024-04-26T18:12:52.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bbe65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bba79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bba7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a43bb0ad80 con 0x55a43bba75e0 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a43baa6c20 con 0x55a43bba8b40 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a43bb06d40 con 0x55a43bbe6ae0 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.365+0000 7f253bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bbe65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bbe65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44530/0 (socket says 172.21.15.139:44530) 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 -- 172.21.15.139:0/3765550363 learned_addr learned my addr 172.21.15.139:0/3765550363 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253b7fe640 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bba79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f25408c8640 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bba7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 -- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 msgr2=0x55a43bba79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bba79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 -- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 msgr2=0x55a43bba7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bba7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 -- 172.21.15.139:0/3765550363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a43b8e8d80 con 0x55a43bba75e0 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f253bfff640 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bbe65a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f252c089da0 tx=0x7f252c0595e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca5642cea1361a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f2521ffb640 1 -- 172.21.15.139:0/3765550363 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c021040 con 0x55a43bba75e0 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f2521ffb640 1 -- 172.21.15.139:0/3765550363 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252c057780 con 0x55a43bba75e0 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.366+0000 7f2521ffb640 1 -- 172.21.15.139:0/3765550363 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c055d50 con 0x55a43bba75e0 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 -- 172.21.15.139:0/3765550363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 msgr2=0x55a43bbe65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bbe65a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f252c089da0 tx=0x7f252c0595e0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 -- 172.21.15.139:0/3765550363 shutdown_connections 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bba7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bba79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 --2- 172.21.15.139:0/3765550363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bbe65a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 -- 172.21.15.139:0/3765550363 >> 172.21.15.139:0/3765550363 conn(0x55a43bb6e740 msgr2=0x55a43bbeb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 -- 172.21.15.139:0/3765550363 shutdown_connections 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 -- 172.21.15.139:0/3765550363 wait complete. 2024-04-26T18:12:52.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.367+0000 7f2545049740 1 -- start start 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 1 Processor -- start 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbe4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bba8b40 0x55a43bbd24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bbe6ae0 0x55a43bbdf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a43bba5c20 con 0x55a43bbe6ae0 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a43baa4840 con 0x55a43bba75e0 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a43bba9170 con 0x55a43bba8b40 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f2545049740 10 client.0 _ll_register_callbacks cb 0x55a43baa85b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.368+0000 7f25408c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bbe6ae0 0x55a43bbdf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bbe6ae0 0x55a43bbdf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44538/0 (socket says 172.21.15.139:44538) 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 -- 172.21.15.139:0/2644404391 learned_addr learned my addr 172.21.15.139:0/2644404391 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f253b7fe640 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bba8b40 0x55a43bbd24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f253bfff640 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbe4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 -- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bba8b40 msgr2=0x55a43bbd24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bba8b40 0x55a43bbd24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 -- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 msgr2=0x55a43bbe4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbe4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 -- 172.21.15.139:0/2644404391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a43b949510 con 0x55a43bbe6ae0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f25408c8640 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bbe6ae0 0x55a43bbdf420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f253402ace0 tx=0x7f2534004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c9a8d389b2c36d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f251affd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f251affd640 1 -- 172.21.15.139:0/2644404391 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534009450 con 0x55a43bbe6ae0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f251affd640 1 -- 172.21.15.139:0/2644404391 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f253403c420 con 0x55a43bbe6ae0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f252c057780 con 0x55a43bbe6ae0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f251affd640 1 -- 172.21.15.139:0/2644404391 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2534050050 con 0x55a43bbe6ae0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f2545049740 10 client.5400 fetch_fsmap learned FSMap version 9 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a43b7dc670 con 0x55a43bbe6ae0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f251affd640 1 -- 172.21.15.139:0/2644404391 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252c057780 con 0x55a43bbe6ae0 2024-04-26T18:12:52.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f251affd640 1 -- 172.21.15.139:0/2644404391 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2534053020 con 0x55a43bbe6ae0 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f2545049740 10 client.5400 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f2545049740 10 client.5400 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.369+0000 7f2545049740 20 client.5400 populate_metadata read hostname 'smithi139' 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.370+0000 7f2545049740 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbced80 0x55a43bbcf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.370+0000 7f2545049740 4 client.5400 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.370+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a43bb18990 con 0x55a43bbced80 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.370+0000 7f253bfff640 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbced80 0x55a43bbcf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.370+0000 7f251affd640 10 client.5400 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.370+0000 7f253bfff640 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbced80 0x55a43bbcf190 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb1b7c8406ad4d74 server_cookie=ddf6cbbb739b4ade in_seq=0 out_seq=0 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f251affd640 1 -- 172.21.15.139:0/2644404391 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a43bb18990 con 0x55a43bbced80 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f251affd640 10 client.5400 handle_command_reply: tid=0 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 client.5400 shutdown 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bbe6ae0 msgr2=0x55a43bbdf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bbe6ae0 0x55a43bbdf420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f253402ace0 tx=0x7f2534004ab0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 shutdown_connections 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bbe6ae0 0x55a43bbdf420 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbced80 0x55a43bbcf190 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bba8b40 0x55a43bbd24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 --2- 172.21.15.139:0/2644404391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbe4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f251affd640 0 client.5400 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 >> 172.21.15.139:0/2644404391 conn(0x55a43bb6e740 msgr2=0x55a43bba8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 shutdown_connections 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 1 -- 172.21.15.139:0/2644404391 wait complete. 2024-04-26T18:12:52.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.371+0000 7f2545049740 20 client.5400 trim_cache size 0 max 16384 2024-04-26T18:12:52.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.388+0000 7f2545049740 1 Processor -- start 2024-04-26T18:12:52.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.388+0000 7f2545049740 1 -- start start 2024-04-26T18:12:52.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbf8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f2545049740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba8b40 0x55a43bbe1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbe1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f2545049740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f253c200810 con 0x55a43bba8b40 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f253c1ff6f0 con 0x55a43bba75e0 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f253c1fdc30 con 0x55a43bbe6ae0 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba8b40 0x55a43bbe1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba8b40 0x55a43bbe1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44546/0 (socket says 172.21.15.139:44546) 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 -- 172.21.15.139:0/1735707439 learned_addr learned my addr 172.21.15.139:0/1735707439 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253bfff640 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbf8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f25408c8640 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbe1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 -- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 msgr2=0x55a43bbe1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbe1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 -- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 msgr2=0x55a43bbf8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbf8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 -- 172.21.15.139:0/1735707439 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a43bbdf790 con 0x55a43bba8b40 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253bfff640 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbf8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f25408c8640 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbe1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f253b7fe640 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba8b40 0x55a43bbe1670 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f253000fab0 tx=0x7f2530012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78533fe961efc17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f25217fa640 1 -- 172.21.15.139:0/1735707439 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530015d70 con 0x55a43bba8b40 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f25217fa640 1 -- 172.21.15.139:0/1735707439 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2530028070 con 0x55a43bba8b40 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.389+0000 7f25217fa640 1 -- 172.21.15.139:0/1735707439 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530023470 con 0x55a43bba8b40 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 -- 172.21.15.139:0/1735707439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba8b40 msgr2=0x55a43bbe1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba8b40 0x55a43bbe1670 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f253000fab0 tx=0x7f2530012000 comp rx=0 tx=0).stop 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 -- 172.21.15.139:0/1735707439 shutdown_connections 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbe1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba8b40 0x55a43bbe1670 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 --2- 172.21.15.139:0/1735707439 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba75e0 0x55a43bbf8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 -- 172.21.15.139:0/1735707439 >> 172.21.15.139:0/1735707439 conn(0x55a43bb6e740 msgr2=0x55a43bba0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:52.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 -- 172.21.15.139:0/1735707439 shutdown_connections 2024-04-26T18:12:52.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.390+0000 7f2545049740 1 -- 172.21.15.139:0/1735707439 wait complete. 2024-04-26T18:12:52.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 -- start start 2024-04-26T18:12:52.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 Processor -- start 2024-04-26T18:12:52.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bc5c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bc62ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbf4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f253c1fe280 con 0x55a43bba75e0 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f253c1ff020 con 0x55a43bba8b40 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f253c1fe950 con 0x55a43bbe6ae0 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.391+0000 7f2545049740 10 client.0 _ll_register_callbacks cb 0x7f2534009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bc5c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bc5c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44552/0 (socket says 172.21.15.139:44552) 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 -- 172.21.15.139:0/318426841 learned_addr learned my addr 172.21.15.139:0/318426841 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253b7fe640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bc62ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f25408c8640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbf4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 -- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 msgr2=0x55a43bbf4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbf4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 -- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 msgr2=0x55a43bc62ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bc62ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 -- 172.21.15.139:0/318426841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a43bc011a0 con 0x55a43bba75e0 2024-04-26T18:12:52.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253b7fe640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bc62ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f253bfff640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bc5c410 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e960 tx=0x7f252c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be39fcc8a920bd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f251affd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f251affd640 1 -- 172.21.15.139:0/318426841 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c021040 con 0x55a43bba75e0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f251affd640 1 -- 172.21.15.139:0/318426841 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f252c05eb70 con 0x55a43bba75e0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2530028070 con 0x55a43bba75e0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f251affd640 1 -- 172.21.15.139:0/318426841 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f252c055980 con 0x55a43bba75e0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f2545049740 10 client.5406 fetch_fsmap learned FSMap version 9 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a43bbce6a0 con 0x55a43bba75e0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f251affd640 1 -- 172.21.15.139:0/318426841 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2530028070 con 0x55a43bba75e0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f251affd640 1 -- 172.21.15.139:0/318426841 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f252c024060 con 0x55a43bba75e0 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.392+0000 7f2545049740 10 client.5406 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f2545049740 10 client.5406 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f2545049740 20 client.5406 populate_metadata read hostname 'smithi139' 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f2545049740 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbf4c50 0x55a43bba1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:52.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f2545049740 4 client.5406 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 92.6, "await_for": 42.0}] 2024-04-26T18:12:52.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 92.6, "await_for": 42.0}) -- 0x55a43bb12800 con 0x55a43bbf4c50 2024-04-26T18:12:52.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f253b7fe640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbf4c50 0x55a43bba1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:52.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f253b7fe640 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbf4c50 0x55a43bba1bc0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3117dee667f717c9 server_cookie=756b278dc638d9bc in_seq=0 out_seq=0 2024-04-26T18:12:52.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:52.393+0000 7f251affd640 10 client.5406 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f251affd640 1 -- 172.21.15.139:0/318426841 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55a43bb12800 con 0x55a43bbf4c50 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f251affd640 10 client.5406 handle_command_reply: tid=0 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 client.5406 shutdown 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 msgr2=0x55a43bc5c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bc5c410 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e960 tx=0x7f252c000bc0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 shutdown_connections 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a43bbf4c50 0x55a43bba1bc0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a43bbe6ae0 0x55a43bbf4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a43bba8b40 0x55a43bc62ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f251affd640 0 client.5406 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 --2- 172.21.15.139:0/318426841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a43bba75e0 0x55a43bc5c410 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 >> 172.21.15.139:0/318426841 conn(0x55a43bb6e740 msgr2=0x55a43bbeba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 shutdown_connections 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 1 -- 172.21.15.139:0/318426841 wait complete. 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.039+0000 7f2545049740 20 client.5406 trim_cache size 0 max 16384 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 46, 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stdout: "86c9c22": { 2024-04-26T18:12:55.041 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 46, 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 92.6, 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:12:55.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:12:55.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:55.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:55.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:55.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:55.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:12:55.043 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:12:55.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f252806c920 msgr2=0x7f252806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:55.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f252806c920 0x7f252806ede0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f253c073540 tx=0x7f2530009040 comp rx=0 tx=0).stop 2024-04-26T18:12:55.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253c0cf260 msgr2=0x7f253c14fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:55.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253c0cf260 0x7f253c14fc10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e990 tx=0x7f252c00ee50 comp rx=0 tx=0).stop 2024-04-26T18:12:55.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 shutdown_connections 2024-04-26T18:12:55.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f252806c920 0x7f252806ede0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f253c15c2a0 0x7f253c0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f253c0d14b0 0x7f253c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 --2- 172.21.15.139:0/848679108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f253c0cf260 0x7f253c14fc10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:55.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 >> 172.21.15.139:0/848679108 conn(0x7f253c073c70 msgr2=0x7f253c0b6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:55.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 shutdown_connections 2024-04-26T18:12:55.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:12:55.040+0000 7f254232b640 1 -- 172.21.15.139:0/848679108 wait complete. 2024-04-26T18:12:55.052 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '86c9c22', quiesce took 3.2 seconds. Will release after: 32.6 2024-04-26T18:13:09.481 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:13:09.485 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:13:27.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:13:27.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.763+0000 7f7299b46640 1 Processor -- start 2024-04-26T18:13:27.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.763+0000 7f7299b46640 1 -- start start 2024-04-26T18:13:27.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.763+0000 7f7299b46640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f72940c89f0 0x7f729415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.763+0000 7f7299b46640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72940736a0 con 0x7f7294152cb0 2024-04-26T18:13:27.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.763+0000 7f7299b46640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72940c62e0 con 0x7f72940c7c20 2024-04-26T18:13:27.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.763+0000 7f7299b46640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7294073940 con 0x7f72940c89f0 2024-04-26T18:13:27.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72937fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7294152cb0 0x7f72940cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40960/0 (socket says 172.21.15.139:40960) 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72937fe640 1 -- 172.21.15.139:0/3681262662 learned_addr learned my addr 172.21.15.139:0/3681262662 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679261712 0 0) 0x7f72940736a0 con 0x7f7294152cb0 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f727c003520 con 0x7f7294152cb0 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f7292ffd640 1 --2- 172.21.15.139:0/3681262662 >> v2:172.21.15.143:3300/0 conn(0x7f72940c89f0 0x7f729415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3013868645 0 0) 0x7f727c003520 con 0x7f7294152cb0 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 >> v2:172.21.15.143:3300/0 conn(0x7f72940c89f0 msgr2=0x7f729415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 --2- 172.21.15.139:0/3681262662 >> v2:172.21.15.143:3300/0 conn(0x7f72940c89f0 0x7f729415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 >> v1:172.21.15.143:6789/0 conn(0x7f72940c7c20 legacy=0x7f72941630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72940c48c0 con 0x7f7294152cb0 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f7284001670 con 0x7f7294152cb0 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 >> v1:172.21.15.139:6789/0 conn(0x7f7294152cb0 legacy=0x7f72940cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f727c0039b0 0x7f727c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c004800 0x7f727c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f727c0051c0 0x7f727c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7294073940 con 0x7f727c0051c0 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f727c00c070 con 0x7f727c004800 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f727c00c270 con 0x7f727c0039b0 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f7293fff640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f727c0051c0 0x7f727c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f72937fe640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f727c0039b0 0x7f727c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.764+0000 7f7292ffd640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c004800 0x7f727c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f7293fff640 1 -- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f727c0039b0 msgr2=0x7f727c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f7293fff640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f727c0039b0 0x7f727c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f7293fff640 1 -- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c004800 msgr2=0x7f727c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f7293fff640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c004800 0x7f727c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f7293fff640 1 -- 172.21.15.139:0/3681262662 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c003520 con 0x7f727c0051c0 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f7293fff640 1 -- 172.21.15.139:0/3681262662 reap_dead start 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f7293fff640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f727c0051c0 0x7f727c00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f728c001e50 tx=0x7f727c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221c9bc17ff9b0b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:27.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c001a70 con 0x7f727c0051c0 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c003970 con 0x7f727c0051c0 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.765+0000 7f72927fc640 1 -- 172.21.15.139:0/3681262662 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c003d60 con 0x7f727c0051c0 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.766+0000 7f7299b46640 1 -- 172.21.15.139:0/3681262662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f727c0051c0 msgr2=0x7f727c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.766+0000 7f7299b46640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f727c0051c0 0x7f727c00b9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f728c001e50 tx=0x7f727c005830 comp rx=0 tx=0).stop 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.766+0000 7f7299b46640 1 -- 172.21.15.139:0/3681262662 shutdown_connections 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.766+0000 7f7299b46640 1 --2- 172.21.15.139:0/3681262662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f727c0051c0 0x7f727c00b9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.766+0000 7f7299b46640 1 -- 172.21.15.139:0/3681262662 >> 172.21.15.139:0/3681262662 conn(0x7f7294068270 msgr2=0x7f7294068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.766+0000 7f7299b46640 1 -- 172.21.15.139:0/3681262662 shutdown_connections 2024-04-26T18:13:27.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.766+0000 7f7299b46640 1 -- 172.21.15.139:0/3681262662 wait complete. 2024-04-26T18:13:27.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.767+0000 7f7299b46640 1 Processor -- start 2024-04-26T18:13:27.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7299b46640 1 -- start start 2024-04-26T18:13:27.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7299b46640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c0051c0 0x7f72941ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7299b46640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7294159920 0x7f729414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7299b46640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7294144270 0x7f7294145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7299b46640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72940c4d20 con 0x7f7294159920 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7299b46640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f72940c4ba0 con 0x7f727c0051c0 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7299b46640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f72940c84a0 con 0x7f7294144270 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7292ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7294159920 0x7f729414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7292ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7294159920 0x7f729414d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60472/0 (socket says 172.21.15.139:60472) 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7292ffd640 1 -- 172.21.15.139:0/1584395915 learned_addr learned my addr 172.21.15.139:0/1584395915 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f7293fff640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7294144270 0x7f7294145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.768+0000 7f72937fe640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c0051c0 0x7f72941ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7292ffd640 1 -- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7294144270 msgr2=0x7f7294145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7292ffd640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7294144270 0x7f7294145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7292ffd640 1 -- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c0051c0 msgr2=0x7f72941ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7292ffd640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c0051c0 0x7f72941ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7292ffd640 1 -- 172.21.15.139:0/1584395915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729414d8c0 con 0x7f7294159920 2024-04-26T18:13:27.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7293fff640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7294144270 0x7f7294145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7292ffd640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7294159920 0x7f729414d380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7288011940 tx=0x7f7288011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f727bfff640 1 -- 172.21.15.139:0/1584395915 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728800f9d0 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f727bfff640 1 -- 172.21.15.139:0/1584395915 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728800fb70 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f727bfff640 1 -- 172.21.15.139:0/1584395915 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288014440 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72941ee730 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.769+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72941eecd0 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.770+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7294076d20 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.770+0000 7f727bfff640 1 -- 172.21.15.139:0/1584395915 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7288012040 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.771+0000 7f727bfff640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f728006c8f0 0x7f728006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.771+0000 7f727bfff640 1 -- 172.21.15.139:0/1584395915 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f728808c490 con 0x7f7294159920 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.771+0000 7f72937fe640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f728006c8f0 0x7f728006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:27.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.771+0000 7f72937fe640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f728006c8f0 0x7f728006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7284001eb0 tx=0x7f72840015b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:27.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.775+0000 7f727bfff640 1 -- 172.21.15.139:0/1584395915 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7288019030 con 0x7f7294159920 2024-04-26T18:13:27.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.985+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7294073480 con 0x7f7294159920 2024-04-26T18:13:27.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.986+0000 7f727bfff640 1 -- 172.21.15.139:0/1584395915 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f728805a480 con 0x7f7294159920 2024-04-26T18:13:27.986 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:13:27.986 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:13:27.986 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:13:27.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f728006c8f0 msgr2=0x7f728006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:27.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f728006c8f0 0x7f728006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7284001eb0 tx=0x7f72840015b0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7294159920 msgr2=0x7f729414d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:27.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7294159920 0x7f729414d380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7288011940 tx=0x7f7288011d40 comp rx=0 tx=0).stop 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 shutdown_connections 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f728006c8f0 0x7f728006edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7294144270 0x7f7294145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7294159920 0x7f729414d380 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 --2- 172.21.15.139:0/1584395915 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f727c0051c0 0x7f72941ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 >> 172.21.15.139:0/1584395915 conn(0x7f7294068270 msgr2=0x7f72940729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 shutdown_connections 2024-04-26T18:13:27.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:27.988+0000 7f7299b46640 1 -- 172.21.15.139:0/1584395915 wait complete. 2024-04-26T18:13:27.999 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 86c9c22 --release --await' 2024-04-26T18:13:27.999 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 86c9c22 --release --await 2024-04-26T18:13:28.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.102+0000 7efe02e93640 1 Processor -- start 2024-04-26T18:13:28.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.102+0000 7efe02e93640 1 -- start start 2024-04-26T18:13:28.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efe02e93640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efe02e93640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc156250 con 0x7efdfc155e70 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efe02e93640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc15bac0 con 0x7efdfc0cf630 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efe02e93640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc15c670 con 0x7efdfc0c9be0 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efe00c2f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7efdfc155e70 0x7efdfc0c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40962/0 (socket says 172.21.15.139:40962) 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efe00c2f640 1 -- 172.21.15.139:0/3040185879 learned_addr learned my addr 172.21.15.139:0/3040185879 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf3fff640 1 --2- 172.21.15.139:0/3040185879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788935959 0 0) 0x7efdf8001110 con 0x7efdfc155e70 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde4003520 con 0x7efdfc155e70 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863277797 0 0) 0x7efdf4001490 con 0x7efdfc0cf630 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf8001110 con 0x7efdfc0cf630 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 866058623 0 0) 0x7efde4003520 con 0x7efdfc155e70 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf3fff640 1 -- 172.21.15.139:0/3040185879 >> v1:172.21.15.143:6789/0 conn(0x7efdfc0cf630 legacy=0x7efdfc166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf3fff640 1 -- 172.21.15.139:0/3040185879 >> v1:172.21.15.139:6789/0 conn(0x7efdfc155e70 legacy=0x7efdfc0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.103+0000 7efdf3fff640 1 -- 172.21.15.139:0/3040185879 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc070ac0 con 0x7efdfc0c9be0 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.104+0000 7efdf3fff640 1 --2- 172.21.15.139:0/3040185879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc0cf0f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097d0 tx=0x7efdec02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4979e9289f8e712c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.104+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec037070 con 0x7efdfc0c9be0 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.104+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec02acc0 con 0x7efdfc0c9be0 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.104+0000 7efdf37fe640 1 -- 172.21.15.139:0/3040185879 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8001840 con 0x7efdfc0c9be0 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.105+0000 7efe02e93640 1 -- 172.21.15.139:0/3040185879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 msgr2=0x7efdfc0cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.105+0000 7efe02e93640 1 --2- 172.21.15.139:0/3040185879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc0cf0f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097d0 tx=0x7efdec02a230 comp rx=0 tx=0).stop 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.105+0000 7efe02e93640 1 -- 172.21.15.139:0/3040185879 shutdown_connections 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.105+0000 7efe02e93640 1 --2- 172.21.15.139:0/3040185879 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc0cf0f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.105+0000 7efe02e93640 1 -- 172.21.15.139:0/3040185879 >> 172.21.15.139:0/3040185879 conn(0x7efdfc068090 msgr2=0x7efdfc068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:28.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.105+0000 7efe02e93640 1 -- 172.21.15.139:0/3040185879 shutdown_connections 2024-04-26T18:13:28.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.105+0000 7efe02e93640 1 -- 172.21.15.139:0/3040185879 wait complete. 2024-04-26T18:13:28.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.106+0000 7efe02e93640 1 Processor -- start 2024-04-26T18:13:28.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.106+0000 7efe02e93640 1 -- start start 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe02e93640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe02e93640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efdfc0cf630 0x7efdfc15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe02e93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdfc155e70 0x7efdfc0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe02e93640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc15c300 con 0x7efdfc155e70 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe02e93640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc15c020 con 0x7efdfc0cf630 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe02e93640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc070e90 con 0x7efdfc0c9be0 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdfc155e70 0x7efdfc0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdfc155e70 0x7efdfc0c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60488/0 (socket says 172.21.15.139:60488) 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 -- 172.21.15.139:0/1170164167 learned_addr learned my addr 172.21.15.139:0/1170164167 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efdfc0cf630 0x7efdfc15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 -- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 msgr2=0x7efdfc1f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc1f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 -- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efdfc0cf630 msgr2=0x7efdfc15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efdfc0cf630 0x7efdfc15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 -- 172.21.15.139:0/1170164167 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc0c6dc0 con 0x7efdfc155e70 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc1f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efdfc0cf630 0x7efdfc15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe01430640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdfc155e70 0x7efdfc0c8600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efdf4001630 tx=0x7efdf400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efdf17fa640 1 -- 172.21.15.139:0/1170164167 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4003b70 con 0x7efdfc155e70 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efdf17fa640 1 -- 172.21.15.139:0/1170164167 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf4003d10 con 0x7efdfc155e70 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efdf17fa640 1 -- 172.21.15.139:0/1170164167 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf400a9f0 con 0x7efdfc155e70 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.107+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc1f5200 con 0x7efdfc155e70 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.108+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc1f57c0 con 0x7efdfc155e70 2024-04-26T18:13:28.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.109+0000 7efdf17fa640 1 -- 172.21.15.139:0/1170164167 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efdf400ab90 con 0x7efdfc155e70 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.109+0000 7efdf17fa640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efde806c8f0 0x7efde806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.109+0000 7efdf17fa640 1 -- 172.21.15.139:0/1170164167 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efdf408be50 con 0x7efdfc155e70 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.109+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efde806c8f0 0x7efde806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.110+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efde806c8f0 0x7efde806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efdf80013b0 tx=0x7efdf8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.110+0000 7efe05bad740 1 Processor -- start 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.110+0000 7efe05bad740 1 -- start start 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d653717470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe05bad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6536d8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d9a10 0x55d6536d8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe05bad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d65363d040 con 0x55d6537179b0 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d6535d8b60 con 0x55d6536d9a10 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d653639000 con 0x55d6536d84b0 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6536d8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6536d8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60500/0 (socket says 172.21.15.139:60500) 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 -- 172.21.15.139:0/1915460090 learned_addr learned my addr 172.21.15.139:0/1915460090 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d653717470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 -- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 msgr2=0x55d653717470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe01430640 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d9a10 0x55d6536d8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d653717470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 -- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d9a10 msgr2=0x55d6536d8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d9a10 0x55d6536d8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 -- 172.21.15.139:0/1915460090 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6535cd9c0 con 0x55d6537179b0 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efe01430640 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d9a10 0x55d6536d8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6536d8890 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efdec000c00 tx=0x7efdec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e1f481c96f9b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.111+0000 7efde27fc640 1 -- 172.21.15.139:0/1915460090 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec037040 con 0x55d6537179b0 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efde27fc640 1 -- 172.21.15.139:0/1915460090 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec02acc0 con 0x55d6537179b0 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efde27fc640 1 -- 172.21.15.139:0/1915460090 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec004420 con 0x55d6537179b0 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 -- 172.21.15.139:0/1915460090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 msgr2=0x55d6536d8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6536d8890 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efdec000c00 tx=0x7efdec02c000 comp rx=0 tx=0).stop 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 -- 172.21.15.139:0/1915460090 shutdown_connections 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d9a10 0x55d6536d8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6536d8890 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 --2- 172.21.15.139:0/1915460090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d653717470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 -- 172.21.15.139:0/1915460090 >> 172.21.15.139:0/1915460090 conn(0x55d65369f930 msgr2=0x55d65371c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 -- 172.21.15.139:0/1915460090 shutdown_connections 2024-04-26T18:13:28.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.112+0000 7efe05bad740 1 -- 172.21.15.139:0/1915460090 wait complete. 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.113+0000 7efe05bad740 1 -- start start 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.113+0000 7efe05bad740 1 Processor -- start 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d65372c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d6537156c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d653702b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d6536d6af0 con 0x55d6537179b0 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d6535d64f0 con 0x55d6536d84b0 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d6536da040 con 0x55d6536d9a10 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 10 client.0 _ll_register_callbacks cb 0x55d653633c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d653702b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d653702b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60504/0 (socket says 172.21.15.139:60504) 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 -- 172.21.15.139:0/2554134121 learned_addr learned my addr 172.21.15.139:0/2554134121 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe00c2f640 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d65372c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efdf3fff640 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d6537156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 -- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 msgr2=0x55d6537156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d6537156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 -- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 msgr2=0x55d65372c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d65372c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 -- 172.21.15.139:0/2554134121 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d65334e920 con 0x55d6537179b0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe01430640 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d653702b40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efdf4061e80 tx=0x7efdf4059ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5e52b1639725b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efddb7fe640 1 -- 172.21.15.139:0/2554134121 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf40623b0 con 0x55d6537179b0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efddb7fe640 1 -- 172.21.15.139:0/2554134121 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efdf4055e40 con 0x55d6537179b0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdec02acc0 con 0x55d6537179b0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efddb7fe640 1 -- 172.21.15.139:0/2554134121 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7efdf4058c20 con 0x55d6537179b0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 10 client.5424 fetch_fsmap learned FSMap version 9 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.114+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d65341ad30 con 0x55d6537179b0 2024-04-26T18:13:28.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efddb7fe640 1 -- 172.21.15.139:0/2554134121 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec02acc0 con 0x55d6537179b0 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efddb7fe640 1 -- 172.21.15.139:0/2554134121 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7efdf4058dc0 con 0x55d6537179b0 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe05bad740 10 client.5424 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe05bad740 10 client.5424 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe05bad740 20 client.5424 populate_metadata read hostname 'smithi139' 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe05bad740 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d653701e50 0x55d6536ff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe05bad740 4 client.5424 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d653610a00 con 0x55d653701e50 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe00c2f640 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d653701e50 0x55d6536ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efe00c2f640 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d653701e50 0x55d6536ff800 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bbf4319649fcffc server_cookie=70b427fbc48b3eb2 in_seq=0 out_seq=0 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.115+0000 7efddb7fe640 10 client.5424 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efddb7fe640 1 -- 172.21.15.139:0/2554134121 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d653610a00 con 0x55d653701e50 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efddb7fe640 10 client.5424 handle_command_reply: tid=0 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 client.5424 shutdown 2024-04-26T18:13:28.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 msgr2=0x55d653702b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d653702b40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efdf4061e80 tx=0x7efdf4059ed0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 shutdown_connections 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d653702b40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d653701e50 0x55d6536ff800 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d6537156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 --2- 172.21.15.139:0/2554134121 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d65372c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 >> 172.21.15.139:0/2554134121 conn(0x55d65369f930 msgr2=0x55d6536d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efddb7fe640 0 client.5424 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.116+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 shutdown_connections 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.117+0000 7efe05bad740 1 -- 172.21.15.139:0/2554134121 wait complete. 2024-04-26T18:13:28.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.117+0000 7efe05bad740 20 client.5424 trim_cache size 0 max 16384 2024-04-26T18:13:28.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 Processor -- start 2024-04-26T18:13:28.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 -- start start 2024-04-26T18:13:28.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d6536d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d653727c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6537281a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc200860 con 0x55d6537179b0 2024-04-26T18:13:28.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1ff740 con 0x55d6536d84b0 2024-04-26T18:13:28.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc0cb0a0 con 0x55d6536d9a10 2024-04-26T18:13:28.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.134+0000 7efe01430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6537281a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6537281a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60510/0 (socket says 172.21.15.139:60510) 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 -- 172.21.15.139:0/2348172764 learned_addr learned my addr 172.21.15.139:0/2348172764 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe00c2f640 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d6536d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efdf3fff640 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d653727c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 -- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 msgr2=0x55d653727c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d653727c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 -- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 msgr2=0x55d6536d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d6536d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 -- 172.21.15.139:0/2348172764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d65372c640 con 0x55d6537179b0 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efdf3fff640 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d653727c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe00c2f640 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d6536d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efe01430640 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6537281a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efdf40594d0 tx=0x7efdf4005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e733596e1f114c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efde1ffb640 1 -- 172.21.15.139:0/2348172764 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf40623b0 con 0x55d6537179b0 2024-04-26T18:13:28.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efde1ffb640 1 -- 172.21.15.139:0/2348172764 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf4057ad0 con 0x55d6537179b0 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.135+0000 7efde1ffb640 1 -- 172.21.15.139:0/2348172764 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4059130 con 0x55d6537179b0 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 -- 172.21.15.139:0/2348172764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 msgr2=0x55d6537281a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6537281a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efdf40594d0 tx=0x7efdf4005050 comp rx=0 tx=0).stop 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 -- 172.21.15.139:0/2348172764 shutdown_connections 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6537179b0 0x55d6537281a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d9a10 0x55d653727c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 --2- 172.21.15.139:0/2348172764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6536d84b0 0x55d6536d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 -- 172.21.15.139:0/2348172764 >> 172.21.15.139:0/2348172764 conn(0x55d65369f930 msgr2=0x55d653712650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 -- 172.21.15.139:0/2348172764 shutdown_connections 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 -- 172.21.15.139:0/2348172764 wait complete. 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 -- start start 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.136+0000 7efe05bad740 1 Processor -- start 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d6536fbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe05bad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6536d9a10 0x55d6537008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe05bad740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6537179b0 0x55d65378c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe05bad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1fe2d0 con 0x55d6536d9a10 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1ff070 con 0x55d6537179b0 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe05bad740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc1fe9a0 con 0x55d6536d84b0 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe05bad740 10 client.0 _ll_register_callbacks cb 0x7efdf4055a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6536d9a10 0x55d6537008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6536d9a10 0x55d6537008c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60522/0 (socket says 172.21.15.139:60522) 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 -- 172.21.15.139:0/1336989967 learned_addr learned my addr 172.21.15.139:0/1336989967 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d6536fbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efe01430640 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6537179b0 0x55d65378c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 -- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 msgr2=0x55d6536fbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d6536fbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 -- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6537179b0 msgr2=0x55d65378c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:28.143 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6537179b0 0x55d65378c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.137+0000 7efdf3fff640 1 -- 172.21.15.139:0/1336989967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d653713c50 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efdf3fff640 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6536d9a10 0x55d6537008c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efdec02a820 tx=0x7efdec02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b32abe14a9b77d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efddb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efddb7fe640 1 -- 172.21.15.139:0/1336989967 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec04c060 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efddb7fe640 1 -- 172.21.15.139:0/1336989967 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efdec003a20 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdf4057ad0 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efddb7fe640 1 -- 172.21.15.139:0/1336989967 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7efdec052050 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 10 client.5430 fetch_fsmap learned FSMap version 9 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d65372a830 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efddb7fe640 1 -- 172.21.15.139:0/1336989967 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf4057ad0 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efddb7fe640 1 -- 172.21.15.139:0/1336989967 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7efdec055020 con 0x55d6536d9a10 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 10 client.5430 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 10 client.5430 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:13:28.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 20 client.5430 populate_metadata read hostname 'smithi139' 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d65373c750 0x55d65378c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 4 client.5430 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "86c9c22", "release": true, "await": true}] 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "86c9c22", "release": true, "await": true}) -- 0x55d65364ac50 con 0x55d65373c750 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.138+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d65373c750 0x55d65378c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efddb7fe640 10 client.5430 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe00c2f640 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d65373c750 0x55d65378c750 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd3fe35c65d2dd8d server_cookie=6fab3c78e77320c4 in_seq=0 out_seq=0 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efddb7fe640 1 -- 172.21.15.139:0/1336989967 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55d65364ac50 con 0x55d65373c750 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efddb7fe640 10 client.5430 handle_command_reply: tid=0 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 client.5430 shutdown 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6536d9a10 msgr2=0x55d6537008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6536d9a10 0x55d6537008c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efdec02a820 tx=0x7efdec02c070 comp rx=0 tx=0).stop 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 shutdown_connections 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d6537179b0 0x55d65378c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6536d9a10 0x55d6537008c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.145 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d65373c750 0x55d65378c750 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 --2- 172.21.15.139:0/1336989967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d6536d84b0 0x55d6536fbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efddb7fe640 0 client.5430 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 >> 172.21.15.139:0/1336989967 conn(0x55d65369f930 msgr2=0x55d6536ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 shutdown_connections 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 1 -- 172.21.15.139:0/1336989967 wait complete. 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.139+0000 7efe05bad740 20 client.5430 trim_cache size 0 max 16384 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:13:28.146 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 48, 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "86c9c22": { 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 48, 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 92.6, 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:13:28.147 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:13:28.148 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efde806c8f0 msgr2=0x7efde806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efde806c8f0 0x7efde806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efdf80013b0 tx=0x7efdf8009040 comp rx=0 tx=0).stop 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdfc155e70 msgr2=0x7efdfc0c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdfc155e70 0x7efdfc0c8600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efdf4001630 tx=0x7efdf400ccd0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 shutdown_connections 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efde806c8f0 0x7efde806edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdfc155e70 0x7efdfc0c8600 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efdfc0cf630 0x7efdfc15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 --2- 172.21.15.139:0/1170164167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efdfc0c9be0 0x7efdfc1f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 >> 172.21.15.139:0/1170164167 conn(0x7efdfc068090 msgr2=0x7efdfc15b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:28.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 shutdown_connections 2024-04-26T18:13:28.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:13:28.140+0000 7efe02e93640 1 -- 172.21.15.139:0/1170164167 wait complete. 2024-04-26T18:13:28.151 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '86c9c22', seconds elapsed: 36.3 2024-04-26T18:13:29.654 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 29% (60/201) Updating files: 30% (61/201) Updating files: 31% (63/201) Updating files: 32% (65/201) Updating files: 33% (67/201) Updating files: 34% (69/201) Updating files: 35% (71/201) Updating files: 36% (73/201) Updating files: 37% (75/201) Updating files: 38% (77/201) Updating files: 39% (79/201) Updating files: 40% (81/201) Updating files: 41% (83/201) Updating files: 42% (85/201) Updating files: 43% (87/201) Updating files: 44% (89/201) Updating files: 45% (91/201) Updating files: 46% (93/201) Updating files: 47% (95/201) Updating files: 48% (97/201) Updating files: 49% (99/201) Updating files: 50% (101/201) Updating files: 51% (103/201) Updating files: 52% (105/201) Updating files: 53% (107/201) Updating files: 54% (109/201) Updating files: 55% (111/201) Updating files: 56% (113/201) Updating files: 57% (115/201) Updating files: 58% (117/201) Updating files: 59% (119/201) Updating files: 60% (121/201) Updating files: 61% (123/201) Updating files: 62% (125/201) Updating files: 63% (127/201) Updating files: 64% (129/201) Updating files: 65% (131/201) Updating files: 66% (133/201) Updating files: 67% (135/201) Updating files: 68% (137/201) Updating files: 69% (139/201) Updating files: 70% (141/201) Updating files: 71% (143/201) Updating files: 72% (145/201) Updating files: 73% (147/201) Updating files: 74% (149/201) Updating files: 75% (151/201) Updating files: 76% (153/201) Updating files: 77% (155/201) Updating files: 78% (157/201) Updating files: 79% (159/201) Updating files: 80% (161/201) Updating files: 81% (163/201) Updating files: 82% (165/201) Updating files: 83% (167/201) Updating files: 84% (169/201) Updating files: 85% (171/201) Updating files: 86% (173/201) Updating files: 87% (175/201) Updating files: 88% (177/201) Updating files: 89% (179/201) Updating files: 90% (181/201) Updating files: 90% (182/201) Updating files: 91% (183/201) Updating files: 92% (185/201) Updating files: 93% (187/201) Updating files: 94% (189/201) Updating files: 95% (191/201) Updating files: 96% (193/201) Updating files: 97% (195/201) Updating files: 98% (197/201) Updating files: 99% (199/201) Updating files: 100% (201/201) Updating files: 100% (201/201), done. 2024-04-26T18:13:30.550 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at c46e1b320c6 mkcephfs: btrfsctl -a between mkfs and mount 2024-04-26T18:13:30.570 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.7 2024-04-26T18:13:30.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:13:30.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 8 -eq 48 ']' 2024-04-26T18:13:30.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.8 2024-04-26T18:13:30.581 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.8 2024-04-26T18:13:30.582 INFO:tasks.workunit.client.0.smithi139.stdout:v0.8 2024-04-26T18:13:30.582 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.8 2024-04-26T18:13:38.038 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 30% (68/225) Updating files: 31% (70/225) Updating files: 32% (72/225) Updating files: 33% (75/225) Updating files: 34% (77/225) Updating files: 35% (79/225) Updating files: 36% (81/225) Updating files: 37% (84/225) Updating files: 38% (86/225) Updating files: 39% (88/225) Updating files: 40% (90/225) Updating files: 41% (93/225) Updating files: 42% (95/225) Updating files: 43% (97/225) Updating files: 44% (99/225) Updating files: 45% (102/225) Updating files: 46% (104/225) Updating files: 47% (106/225) Updating files: 48% (108/225) Updating files: 49% (111/225) Updating files: 50% (113/225) Updating files: 51% (115/225) Updating files: 52% (117/225) Updating files: 53% (120/225) Updating files: 54% (122/225) Updating files: 55% (124/225) Updating files: 56% (126/225) Updating files: 57% (129/225) Updating files: 58% (131/225) Updating files: 59% (133/225) Updating files: 60% (135/225) Updating files: 61% (138/225) Updating files: 62% (140/225) Updating files: 63% (142/225) Updating files: 64% (144/225) Updating files: 65% (147/225) Updating files: 66% (149/225) Updating files: 67% (151/225) Updating files: 68% (153/225) Updating files: 69% (156/225) Updating files: 70% (158/225) Updating files: 71% (160/225) Updating files: 72% (162/225) Updating files: 73% (165/225) Updating files: 74% (167/225) Updating files: 75% (169/225) Updating files: 76% (171/225) Updating files: 77% (174/225) Updating files: 78% (176/225) Updating files: 79% (178/225) Updating files: 80% (180/225) Updating files: 81% (183/225) Updating files: 82% (185/225) Updating files: 83% (187/225) Updating files: 84% (189/225) Updating files: 85% (192/225) Updating files: 86% (194/225) Updating files: 87% (196/225) Updating files: 88% (198/225) Updating files: 89% (201/225) Updating files: 90% (203/225) Updating files: 91% (205/225) Updating files: 92% (207/225) Updating files: 93% (210/225) Updating files: 94% (212/225) Updating files: 95% (214/225) Updating files: 96% (216/225) Updating files: 97% (219/225) Updating files: 98% (221/225) Updating files: 99% (223/225) Updating files: 100% (225/225) Updating files: 100% (225/225), done. 2024-04-26T18:13:38.065 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 284161c00ab kclient: kill dput/d_drop debug cruft 2024-04-26T18:13:38.067 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.8 2024-04-26T18:13:38.494 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:13:38.494 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 9 -eq 48 ']' 2024-04-26T18:13:38.494 INFO:tasks.workunit.client.0.smithi139.stdout:v0.9 2024-04-26T18:13:38.495 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.9 2024-04-26T18:13:38.495 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.9 2024-04-26T18:13:38.495 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.9 2024-04-26T18:13:39.572 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:13:39.575 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:13:40.393 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 70% (137/193) Updating files: 71% (138/193) Updating files: 72% (139/193) Updating files: 73% (141/193) Updating files: 74% (143/193) Updating files: 75% (145/193) Updating files: 76% (147/193) Updating files: 77% (149/193) Updating files: 78% (151/193) Updating files: 79% (153/193) Updating files: 80% (155/193) Updating files: 81% (157/193) Updating files: 82% (159/193) Updating files: 83% (161/193) Updating files: 84% (163/193) Updating files: 85% (165/193) Updating files: 86% (166/193) Updating files: 87% (168/193) Updating files: 88% (170/193) Updating files: 89% (172/193) Updating files: 90% (174/193) Updating files: 91% (176/193) Updating files: 92% (178/193) Updating files: 93% (180/193) Updating files: 94% (182/193) Updating files: 95% (184/193) Updating files: 96% (186/193) Updating files: 97% (188/193) Updating files: 98% (190/193) Updating files: 99% (192/193) Updating files: 100% (193/193) Updating files: 100% (193/193), done. 2024-04-26T18:13:40.414 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 41481853924 kclient: strip out kernel version compatibility cruft 2024-04-26T18:13:40.417 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.9 2024-04-26T18:13:41.506 INFO:tasks.workunit.client.0.smithi139.stdout:v0.10 2024-04-26T18:13:41.506 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:13:41.506 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 10 -eq 48 ']' 2024-04-26T18:13:41.506 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.10 2024-04-26T18:13:41.506 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.10 2024-04-26T18:13:41.507 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.10 2024-04-26T18:13:57.701 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 4% (8/164) Updating files: 5% (9/164) Updating files: 6% (10/164) Updating files: 7% (12/164) Updating files: 8% (14/164) Updating files: 9% (15/164) Updating files: 10% (17/164) Updating files: 11% (19/164) Updating files: 12% (20/164) Updating files: 13% (22/164) Updating files: 14% (23/164) Updating files: 15% (25/164) Updating files: 16% (27/164) Updating files: 17% (28/164) Updating files: 18% (30/164) Updating files: 19% (32/164) Updating files: 20% (33/164) Updating files: 21% (35/164) Updating files: 22% (37/164) Updating files: 23% (38/164) Updating files: 24% (40/164) Updating files: 25% (41/164) Updating files: 26% (43/164) Updating files: 27% (45/164) Updating files: 28% (46/164) Updating files: 29% (48/164) Updating files: 30% (50/164) Updating files: 31% (51/164) Updating files: 32% (53/164) Updating files: 33% (55/164) Updating files: 34% (56/164) Updating files: 35% (58/164) Updating files: 36% (60/164) Updating files: 37% (61/164) Updating files: 38% (63/164) Updating files: 39% (64/164) Updating files: 40% (66/164) Updating files: 41% (68/164) Updating files: 42% (69/164) Updating files: 43% (71/164) Updating files: 44% (73/164) Updating files: 45% (74/164) Updating files: 46% (76/164) Updating files: 47% (78/164) Updating files: 48% (79/164) Updating files: 49% (81/164) Updating files: 50% (82/164) Updating files: 51% (84/164) Updating files: 52% (86/164) Updating files: 53% (87/164) Updating files: 54% (89/164) Updating files: 55% (91/164) Updating files: 56% (92/164) Updating files: 56% (93/164) Updating files: 57% (94/164) Updating files: 58% (96/164) Updating files: 59% (97/164) Updating files: 60% (99/164) Updating files: 61% (101/164) Updating files: 62% (102/164) Updating files: 63% (104/164) Updating files: 64% (105/164) Updating files: 65% (107/164) Updating files: 66% (109/164) Updating files: 67% (110/164) Updating files: 68% (112/164) Updating files: 69% (114/164) Updating files: 70% (115/164) Updating files: 71% (117/164) Updating files: 72% (119/164) Updating files: 73% (120/164) Updating files: 74% (122/164) Updating files: 75% (123/164) Updating files: 76% (125/164) Updating files: 77% (127/164) Updating files: 78% (128/164) Updating files: 79% (130/164) Updating files: 80% (132/164) Updating files: 81% (133/164) Updating files: 82% (135/164) Updating files: 83% (137/164) Updating files: 84% (138/164) Updating files: 85% (140/164) Updating files: 86% (142/164) Updating files: 87% (143/164) Updating files: 88% (145/164) Updating files: 89% (146/164) Updating files: 90% (148/164) Updating files: 91% (150/164) Updating files: 92% (151/164) Updating files: 93% (153/164) Updating files: 94% (155/164) Updating files: 95% (156/164) Updating files: 96% (158/164) Updating files: 97% (160/164) Updating files: 98% (161/164) Updating files: 99% (163/164) Updating files: 100% (164/164) Updating files: 100% (164/164), done. 2024-04-26T18:13:57.732 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 007313fe844 v0.10 2024-04-26T18:13:57.735 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.10 2024-04-26T18:13:57.844 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:13:57.844 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 11 -eq 48 ']' 2024-04-26T18:13:57.844 INFO:tasks.workunit.client.0.smithi139.stdout:v0.11 2024-04-26T18:13:57.845 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.11 2024-04-26T18:13:57.845 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.11 2024-04-26T18:13:57.845 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.11 2024-04-26T18:13:58.955 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 9fa6f5e7d09 v0.11 2024-04-26T18:13:58.956 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.11 2024-04-26T18:13:59.488 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:13:59.488 INFO:tasks.workunit.client.0.smithi139.stdout:v0.12 2024-04-26T18:13:59.488 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 12 -eq 48 ']' 2024-04-26T18:13:59.488 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.12 2024-04-26T18:13:59.488 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.12 2024-04-26T18:13:59.488 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.12 2024-04-26T18:14:01.105 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at f524150822a v0.12 2024-04-26T18:14:01.107 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.12 2024-04-26T18:14:01.152 INFO:tasks.workunit.client.0.smithi139.stdout:v0.13 2024-04-26T18:14:01.153 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:14:01.153 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 13 -eq 48 ']' 2024-04-26T18:14:01.153 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.13 2024-04-26T18:14:01.153 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.13 2024-04-26T18:14:01.153 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.13 2024-04-26T18:14:02.414 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 86% (115/133) Updating files: 87% (116/133) Updating files: 88% (118/133) Updating files: 89% (119/133) Updating files: 90% (120/133) Updating files: 91% (122/133) Updating files: 92% (123/133) Updating files: 93% (124/133) Updating files: 94% (126/133) Updating files: 95% (127/133) Updating files: 96% (128/133) Updating files: 97% (130/133) Updating files: 98% (131/133) Updating files: 99% (132/133) Updating files: 100% (133/133) Updating files: 100% (133/133), done. 2024-04-26T18:14:02.437 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 2b32297267d v0.13 2024-04-26T18:14:02.439 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.13 2024-04-26T18:14:03.775 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:14:03.775 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 14 -eq 48 ']' 2024-04-26T18:14:03.775 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.14 2024-04-26T18:14:03.776 INFO:tasks.workunit.client.0.smithi139.stdout:v0.14 2024-04-26T18:14:03.776 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.14 2024-04-26T18:14:03.776 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.14 2024-04-26T18:14:09.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:14:09.657 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:14:21.807 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 3% (6/151) Updating files: 4% (7/151) Updating files: 5% (8/151) Updating files: 6% (10/151) Updating files: 7% (11/151) Updating files: 8% (13/151) Updating files: 9% (14/151) Updating files: 10% (16/151) Updating files: 11% (17/151) Updating files: 12% (19/151) Updating files: 13% (20/151) Updating files: 14% (22/151) Updating files: 15% (23/151) Updating files: 16% (25/151) Updating files: 17% (26/151) Updating files: 18% (28/151) Updating files: 19% (29/151) Updating files: 20% (31/151) Updating files: 21% (32/151) Updating files: 22% (34/151) Updating files: 23% (35/151) Updating files: 24% (37/151) Updating files: 25% (38/151) Updating files: 26% (40/151) Updating files: 27% (41/151) Updating files: 28% (43/151) Updating files: 29% (44/151) Updating files: 30% (46/151) Updating files: 31% (47/151) Updating files: 32% (49/151) Updating files: 33% (50/151) Updating files: 34% (52/151) Updating files: 35% (53/151) Updating files: 36% (55/151) Updating files: 37% (56/151) Updating files: 38% (58/151) Updating files: 39% (59/151) Updating files: 40% (61/151) Updating files: 41% (62/151) Updating files: 42% (64/151) Updating files: 43% (65/151) Updating files: 44% (67/151) Updating files: 45% (68/151) Updating files: 46% (70/151) Updating files: 47% (71/151) Updating files: 48% (73/151) Updating files: 49% (74/151) Updating files: 50% (76/151) Updating files: 51% (78/151) Updating files: 52% (79/151) Updating files: 53% (81/151) Updating files: 54% (82/151) Updating files: 55% (84/151) Updating files: 56% (85/151) Updating files: 57% (87/151) Updating files: 58% (88/151) Updating files: 59% (90/151) Updating files: 60% (91/151) Updating files: 61% (93/151) Updating files: 62% (94/151) Updating files: 63% (96/151) Updating files: 64% (97/151) Updating files: 65% (99/151) Updating files: 66% (100/151) Updating files: 67% (102/151) Updating files: 68% (103/151) Updating files: 69% (105/151) Updating files: 70% (106/151) Updating files: 71% (108/151) Updating files: 72% (109/151) Updating files: 73% (111/151) Updating files: 74% (112/151) Updating files: 75% (114/151) Updating files: 76% (115/151) Updating files: 77% (117/151) Updating files: 78% (118/151) Updating files: 79% (120/151) Updating files: 80% (121/151) Updating files: 81% (123/151) Updating files: 82% (124/151) Updating files: 83% (126/151) Updating files: 84% (127/151) Updating files: 85% (129/151) Updating files: 86% (130/151) Updating files: 87% (132/151) Updating files: 88% (133/151) Updating files: 89% (135/151) Updating files: 90% (136/151) Updating files: 91% (138/151) Updating files: 92% (139/151) Updating files: 93% (141/151) Updating files: 94% (142/151) Updating files: 95% (144/151) Updating files: 96% (145/151) Updating files: 97% (147/151) Updating files: 98% (148/151) Updating files: 99% (150/151) Updating files: 100% (151/151) Updating files: 100% (151/151), done. 2024-04-26T18:14:22.535 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 1ec1e8d6fb6 v0.14 2024-04-26T18:14:22.537 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.14 2024-04-26T18:14:22.552 INFO:tasks.workunit.client.0.smithi139.stdout:v0.15 2024-04-26T18:14:22.553 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:14:22.553 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 15 -eq 48 ']' 2024-04-26T18:14:22.553 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.15 2024-04-26T18:14:22.553 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.15 2024-04-26T18:14:22.553 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.15 2024-04-26T18:14:24.536 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 94% (106/112) Updating files: 95% (107/112) Updating files: 96% (108/112) Updating files: 97% (109/112) Updating files: 98% (110/112) Updating files: 99% (111/112) Updating files: 100% (112/112) Updating files: 100% (112/112), done. 2024-04-26T18:14:24.566 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at ab3c421eb95 v0.15 2024-04-26T18:14:24.567 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.15 2024-04-26T18:14:24.602 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:14:24.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 16 -eq 48 ']' 2024-04-26T18:14:24.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.16 2024-04-26T18:14:24.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.16 2024-04-26T18:14:24.603 INFO:tasks.workunit.client.0.smithi139.stdout:v0.16 2024-04-26T18:14:24.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.16 2024-04-26T18:14:28.694 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.0 2024-04-26T18:14:28.695 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:14:28.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.807+0000 7f8bcb2f8640 1 Processor -- start 2024-04-26T18:14:28.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.807+0000 7f8bcb2f8640 1 -- start start 2024-04-26T18:14:28.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.807+0000 7f8bcb2f8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8bc41521f0 0x7f8bc4158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:28.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bcb2f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc40c9bb0 0x7f8bc40ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:28.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bcb2f8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc40ca540 con 0x7f8bc4072f00 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bcb2f8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc415c5a0 con 0x7f8bc41521f0 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bcb2f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc415c110 con 0x7f8bc40c9bb0 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9895640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc40c9bb0 0x7f8bc40ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9094640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8bc41521f0 0x7f8bc4158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9895640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc40c9bb0 0x7f8bc40ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:46794/0 (socket says 172.21.15.139:46794) 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9094640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8bc41521f0 0x7f8bc4158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:35278/0 (socket says 172.21.15.139:35278) 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9895640 1 -- 172.21.15.139:0/3937057263 learned_addr learned my addr 172.21.15.139:0/3937057263 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc8893640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8bc4072f00 0x7f8bc40c7ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:39820/0 (socket says 172.21.15.139:39820) 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9895640 1 -- 172.21.15.139:0/3937057263 >> v2:172.21.15.143:3300/0 conn(0x7f8bc41521f0 msgr2=0x7f8bc4158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9895640 1 --2- 172.21.15.139:0/3937057263 >> v2:172.21.15.143:3300/0 conn(0x7f8bc41521f0 0x7f8bc4158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9895640 1 -- 172.21.15.139:0/3937057263 >> v1:172.21.15.143:6789/0 conn(0x7f8bc4072f00 legacy=0x7f8bc40c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:28.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9895640 1 -- 172.21.15.139:0/3937057263 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc40725c0 con 0x7f8bc40c9bb0 2024-04-26T18:14:28.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.808+0000 7f8bc9094640 1 --2- 172.21.15.139:0/3937057263 >> v2:172.21.15.143:3300/0 conn(0x7f8bc41521f0 0x7f8bc4158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:14:28.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.809+0000 7f8bc9895640 1 --2- 172.21.15.139:0/3937057263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc40c9bb0 0x7f8bc40ca000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00d150 tx=0x7f8bbc02c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67799ca12451aad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:28.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.809+0000 7f8bbbfff640 1 -- 172.21.15.139:0/3937057263 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc009600 con 0x7f8bc40c9bb0 2024-04-26T18:14:28.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.809+0000 7f8bbbfff640 1 -- 172.21.15.139:0/3937057263 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc037070 con 0x7f8bc40c9bb0 2024-04-26T18:14:28.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.809+0000 7f8bbbfff640 1 -- 172.21.15.139:0/3937057263 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0099c0 con 0x7f8bc40c9bb0 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/3937057263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc40c9bb0 msgr2=0x7f8bc40ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/3937057263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc40c9bb0 0x7f8bc40ca000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00d150 tx=0x7f8bbc02c930 comp rx=0 tx=0).stop 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/3937057263 shutdown_connections 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/3937057263 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc40c9bb0 0x7f8bc40ca000 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/3937057263 >> v2:172.21.15.143:3300/0 conn(0x7f8bc41521f0 0x7f8bc4158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/3937057263 >> 172.21.15.139:0/3937057263 conn(0x7f8bc4068270 msgr2=0x7f8bc4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/3937057263 shutdown_connections 2024-04-26T18:14:28.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.810+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/3937057263 wait complete. 2024-04-26T18:14:28.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.811+0000 7f8bcb2f8640 1 Processor -- start 2024-04-26T18:14:28.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.811+0000 7f8bcb2f8640 1 -- start start 2024-04-26T18:14:28.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bcb2f8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bc4072f00 0x7f8bc4159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:28.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bcb2f8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc40c9bb0 0x7f8bc4143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:28.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bcb2f8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc41521f0 0x7f8bc4144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:28.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bcb2f8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc415bda0 con 0x7f8bc4072f00 2024-04-26T18:14:28.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bcb2f8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc415bac0 con 0x7f8bc40c9bb0 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bcb2f8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc40c85d0 con 0x7f8bc41521f0 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bc4072f00 0x7f8bc4159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bc4072f00 0x7f8bc4159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33230/0 (socket says 172.21.15.139:33230) 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 -- 172.21.15.139:0/2953500483 learned_addr learned my addr 172.21.15.139:0/2953500483 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc8893640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc40c9bb0 0x7f8bc4143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9895640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc41521f0 0x7f8bc4144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 -- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc41521f0 msgr2=0x7f8bc4144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc41521f0 0x7f8bc4144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 -- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc40c9bb0 msgr2=0x7f8bc4143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc40c9bb0 0x7f8bc4143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:28.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9094640 1 -- 172.21.15.139:0/2953500483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc4144fe0 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.812+0000 7f8bc9895640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc41521f0 0x7f8bc4144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.813+0000 7f8bc9094640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bc4072f00 0x7f8bc4159410 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000ebe0 tx=0x7f8bc000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.813+0000 7f8bb9ffb640 1 -- 172.21.15.139:0/2953500483 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0017070 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.813+0000 7f8bb9ffb640 1 -- 172.21.15.139:0/2953500483 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc000cc30 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.813+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc415b150 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.813+0000 7f8bb9ffb640 1 -- 172.21.15.139:0/2953500483 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0013470 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.813+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc4145250 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.814+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bc4076d20 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.814+0000 7f8bb9ffb640 1 -- 172.21.15.139:0/2953500483 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8bc001a070 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.815+0000 7f8bb9ffb640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8ba806c8f0 0x7f8ba806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.815+0000 7f8bb9ffb640 1 -- 172.21.15.139:0/2953500483 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8bc008bfc0 con 0x7f8bc4072f00 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.815+0000 7f8bc8893640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8ba806c8f0 0x7f8ba806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:28.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.815+0000 7f8bc8893640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8ba806c8f0 0x7f8ba806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4150b90 tx=0x7f8bb4007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:28.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:28.819+0000 7f8bb9ffb640 1 -- 172.21.15.139:0/2953500483 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8bc0059f10 con 0x7f8bc4072f00 2024-04-26T18:14:29.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.033+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bc4072ce0 con 0x7f8bc4072f00 2024-04-26T18:14:29.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.034+0000 7f8bb9ffb640 1 -- 172.21.15.139:0/2953500483 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f8bc0059810 con 0x7f8bc4072f00 2024-04-26T18:14:29.034 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:14:29.035 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:14:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:14:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8ba806c8f0 msgr2=0x7f8ba806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8ba806c8f0 0x7f8ba806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4150b90 tx=0x7f8bb4007ce0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bc4072f00 msgr2=0x7f8bc4159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bc4072f00 0x7f8bc4159410 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000ebe0 tx=0x7f8bc000c520 comp rx=0 tx=0).stop 2024-04-26T18:14:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 shutdown_connections 2024-04-26T18:14:29.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8ba806c8f0 0x7f8ba806edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8bc41521f0 0x7f8bc4144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8bc40c9bb0 0x7f8bc4143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 --2- 172.21.15.139:0/2953500483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bc4072f00 0x7f8bc4159410 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 >> 172.21.15.139:0/2953500483 conn(0x7f8bc4068270 msgr2=0x7f8bc41460d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 shutdown_connections 2024-04-26T18:14:29.039 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.036+0000 7f8bcb2f8640 1 -- 172.21.15.139:0/2953500483 wait complete. 2024-04-26T18:14:29.050 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 86.0 --await-for 42.0' 2024-04-26T18:14:29.051 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 86.0 --await-for 42.0 2024-04-26T18:14:29.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.157+0000 7f39b4aa0640 1 Processor -- start 2024-04-26T18:14:29.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.157+0000 7f39b4aa0640 1 -- start start 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39b4aa0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f39b0155f60 0x7f39b00c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39b4aa0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f39b00cd520 0x7f39b015bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39b4aa0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39b015c450 con 0x7f39b00c63a0 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39b4aa0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f39b015c730 con 0x7f39b00cd520 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39b4aa0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f39b015ca10 con 0x7f39b0155f60 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39add9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f39b00cd520 0x7f39b015bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39add9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f39b00cd520 0x7f39b015bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33238/0 (socket says 172.21.15.139:33238) 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39add9b640 1 -- 172.21.15.139:0/1775732599 learned_addr learned my addr 172.21.15.139:0/1775732599 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39ae59c640 1 --2- 172.21.15.139:0/1775732599 >> v2:172.21.15.143:3300/0 conn(0x7f39b0155f60 0x7f39b00c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39add9b640 1 -- 172.21.15.139:0/1775732599 >> v2:172.21.15.143:3300/0 conn(0x7f39b0155f60 msgr2=0x7f39b00c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39add9b640 1 --2- 172.21.15.139:0/1775732599 >> v2:172.21.15.143:3300/0 conn(0x7f39b0155f60 0x7f39b00c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39add9b640 1 -- 172.21.15.139:0/1775732599 >> v1:172.21.15.143:6789/0 conn(0x7f39b00c63a0 legacy=0x7f39b00cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39add9b640 1 -- 172.21.15.139:0/1775732599 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b00c6ed0 con 0x7f39b00cd520 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.158+0000 7f39ae59c640 1 --2- 172.21.15.139:0/1775732599 >> v2:172.21.15.143:3300/0 conn(0x7f39b0155f60 0x7f39b00c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.159+0000 7f39add9b640 1 --2- 172.21.15.139:0/1775732599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b00cd520 0x7f39b015bac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f39b0073650 tx=0x7f39a402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54d6ffbc8b3be21 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.159+0000 7f39ad59a640 1 -- 172.21.15.139:0/1775732599 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4037070 con 0x7f39b00cd520 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.159+0000 7f39ad59a640 1 -- 172.21.15.139:0/1775732599 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a402ae50 con 0x7f39b00cd520 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.159+0000 7f39ad59a640 1 -- 172.21.15.139:0/1775732599 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4032860 con 0x7f39b00cd520 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 -- 172.21.15.139:0/1775732599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b00cd520 msgr2=0x7f39b015bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/1775732599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b00cd520 0x7f39b015bac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f39b0073650 tx=0x7f39a402a300 comp rx=0 tx=0).stop 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 -- 172.21.15.139:0/1775732599 shutdown_connections 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/1775732599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b00cd520 0x7f39b015bac0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/1775732599 >> v2:172.21.15.143:3300/0 conn(0x7f39b0155f60 0x7f39b00c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 -- 172.21.15.139:0/1775732599 >> 172.21.15.139:0/1775732599 conn(0x7f39b0072930 msgr2=0x7f39b0072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 -- 172.21.15.139:0/1775732599 shutdown_connections 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.160+0000 7f39b4aa0640 1 -- 172.21.15.139:0/1775732599 wait complete. 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.161+0000 7f39b4aa0640 1 Processor -- start 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.161+0000 7f39b4aa0640 1 -- start start 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39b4aa0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39b00c63a0 0x7f39b00cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39b4aa0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39b00cd520 0x7f39b01f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39b4aa0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b0155f60 0x7f39b0159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39b4aa0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f39b00c7ef0 con 0x7f39b0155f60 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39b4aa0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f39b00c7490 con 0x7f39b00cd520 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39b4aa0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f39b00c6ab0 con 0x7f39b00c63a0 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b0155f60 0x7f39b0159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b0155f60 0x7f39b0159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33250/0 (socket says 172.21.15.139:33250) 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 -- 172.21.15.139:0/2333083810 learned_addr learned my addr 172.21.15.139:0/2333083810 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39add9b640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39b00cd520 0x7f39b01f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39ae59c640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39b00c63a0 0x7f39b00cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 -- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39b00c63a0 msgr2=0x7f39b00cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39b00c63a0 0x7f39b00cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 -- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39b00cd520 msgr2=0x7f39b01f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39b00cd520 0x7f39b01f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.162+0000 7f39aed9d640 1 -- 172.21.15.139:0/2333083810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b01563b0 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.163+0000 7f39aed9d640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b0155f60 0x7f39b0159700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c400 tx=0x7f39a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.163+0000 7f399effd640 1 -- 172.21.15.139:0/2333083810 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8017070 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.163+0000 7f399effd640 1 -- 172.21.15.139:0/2333083810 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a80052d0 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.163+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b0156650 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.163+0000 7f399effd640 1 -- 172.21.15.139:0/2333083810 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8003810 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.163+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b015b970 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.165+0000 7f399effd640 1 -- 172.21.15.139:0/2333083810 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39a801a070 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.165+0000 7f399effd640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.165+0000 7f399effd640 1 -- 172.21.15.139:0/2333083810 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f39a808b2b0 con 0x7f39b0155f60 2024-04-26T18:14:29.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.165+0000 7f39ae59c640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.166+0000 7f39ae59c640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f399006c8f0 0x7f399006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fd0 tx=0x7f39a0009870 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.166+0000 7f39b77bf740 1 Processor -- start 2024-04-26T18:14:29.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.166+0000 7f39b77bf740 1 -- start start 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60b5e0 0x56023c64a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c60b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60cb40 0x56023c60bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39b77bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56023c56ed80 con 0x56023c64aae0 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x56023c50ac20 con 0x56023c60cb40 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x56023c56ad40 con 0x56023c60b5e0 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c60b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c60b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33266/0 (socket says 172.21.15.139:33266) 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 -- 172.21.15.139:0/3383601557 learned_addr learned my addr 172.21.15.139:0/3383601557 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:29.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39ae59c640 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60b5e0 0x56023c64a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 -- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60b5e0 msgr2=0x56023c64a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39aed9d640 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60cb40 0x56023c60bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60b5e0 0x56023c64a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 -- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60cb40 msgr2=0x56023c60bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60cb40 0x56023c60bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 -- 172.21.15.139:0/3383601557 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56023c34cd80 con 0x56023c64aae0 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f39add9b640 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c60b9c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f39a4035040 tx=0x7f39a402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835e650d47012f0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f398ffff640 1 -- 172.21.15.139:0/3383601557 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4037040 con 0x56023c64aae0 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f398ffff640 1 -- 172.21.15.139:0/3383601557 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a402ae50 con 0x56023c64aae0 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.167+0000 7f398ffff640 1 -- 172.21.15.139:0/3383601557 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40329e0 con 0x56023c64aae0 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 -- 172.21.15.139:0/3383601557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 msgr2=0x56023c60b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c60b9c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f39a4035040 tx=0x7f39a402c000 comp rx=0 tx=0).stop 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 -- 172.21.15.139:0/3383601557 shutdown_connections 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60cb40 0x56023c60bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c60b9c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 --2- 172.21.15.139:0/3383601557 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60b5e0 0x56023c64a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 -- 172.21.15.139:0/3383601557 >> 172.21.15.139:0/3383601557 conn(0x56023c5d2740 msgr2=0x56023c64f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 -- 172.21.15.139:0/3383601557 shutdown_connections 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.168+0000 7f39b77bf740 1 -- 172.21.15.139:0/3383601557 wait complete. 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.169+0000 7f39b77bf740 1 -- start start 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.169+0000 7f39b77bf740 1 Processor -- start 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c648860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60cb40 0x56023c65f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c64aae0 0x56023c632d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56023c609c20 con 0x56023c60cb40 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x56023c508840 con 0x56023c60b5e0 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x56023c60d170 con 0x56023c64aae0 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 10 client.0 _ll_register_callbacks cb 0x56023c50c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60cb40 0x56023c65f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60cb40 0x56023c65f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33276/0 (socket says 172.21.15.139:33276) 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 -- 172.21.15.139:0/1217442702 learned_addr learned my addr 172.21.15.139:0/1217442702 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39aed9d640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c64aae0 0x56023c632d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39ae59c640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c648860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 -- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c64aae0 msgr2=0x56023c632d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c64aae0 0x56023c632d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 -- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 msgr2=0x56023c648860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c648860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 -- 172.21.15.139:0/1217442702 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56023c3ad510 con 0x56023c60cb40 2024-04-26T18:14:29.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39ae59c640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c648860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39add9b640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60cb40 0x56023c65f6b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009960 tx=0x7f39a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf5b0eff893581a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f398d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f398d7fa640 1 -- 172.21.15.139:0/1217442702 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4037070 con 0x56023c60cb40 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f398d7fa640 1 -- 172.21.15.139:0/1217442702 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f39a4003610 con 0x56023c60cb40 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39a402ae50 con 0x56023c60cb40 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f398d7fa640 1 -- 172.21.15.139:0/1217442702 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f39a4057050 con 0x56023c60cb40 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 10 client.5445 fetch_fsmap learned FSMap version 9 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56023c240670 con 0x56023c60cb40 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.170+0000 7f398d7fa640 1 -- 172.21.15.139:0/1217442702 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a402ae50 con 0x56023c60cb40 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f398d7fa640 1 -- 172.21.15.139:0/1217442702 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f39a405a020 con 0x56023c60cb40 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39b77bf740 10 client.5445 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39b77bf740 10 client.5445 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39b77bf740 20 client.5445 populate_metadata read hostname 'smithi139' 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39b77bf740 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c6332c0 0x56023c65bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39b77bf740 4 client.5445 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56023c57c990 con 0x56023c6332c0 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39ae59c640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c6332c0 0x56023c65bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f398d7fa640 10 client.5445 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.171+0000 7f39ae59c640 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c6332c0 0x56023c65bcc0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cbbc8ed461bb768 server_cookie=157269a7bf23da37 in_seq=0 out_seq=0 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f398d7fa640 1 -- 172.21.15.139:0/1217442702 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56023c57c990 con 0x56023c6332c0 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f398d7fa640 10 client.5445 handle_command_reply: tid=0 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 client.5445 shutdown 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60cb40 msgr2=0x56023c65f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60cb40 0x56023c65f6b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009960 tx=0x7f39a4004730 comp rx=0 tx=0).stop 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 shutdown_connections 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c6332c0 0x56023c65bcc0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c64aae0 0x56023c632d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f398d7fa640 0 client.5445 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60cb40 0x56023c65f6b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 --2- 172.21.15.139:0/1217442702 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c648860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 >> 172.21.15.139:0/1217442702 conn(0x56023c5d2740 msgr2=0x56023c60b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 shutdown_connections 2024-04-26T18:14:29.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 1 -- 172.21.15.139:0/1217442702 wait complete. 2024-04-26T18:14:29.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.172+0000 7f39b77bf740 20 client.5445 trim_cache size 0 max 16384 2024-04-26T18:14:29.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.189+0000 7f39b77bf740 1 Processor -- start 2024-04-26T18:14:29.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.189+0000 7f39b77bf740 1 -- start start 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60b5e0 0x56023c60bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c644300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c64aae0 0x56023c644840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39b77bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f39b02006c0 con 0x56023c60b5e0 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f39b01ff5a0 con 0x56023c64aae0 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f39b01fdc00 con 0x56023c60cb40 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60b5e0 0x56023c60bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60b5e0 0x56023c60bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33282/0 (socket says 172.21.15.139:33282) 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 -- 172.21.15.139:0/270953817 learned_addr learned my addr 172.21.15.139:0/270953817 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39add9b640 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c644300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 -- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 msgr2=0x56023c644300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39aed9d640 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c64aae0 0x56023c644840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c644300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 -- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c64aae0 msgr2=0x56023c644840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c64aae0 0x56023c644840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 -- 172.21.15.139:0/270953817 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56023c571220 con 0x56023c60b5e0 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39add9b640 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c644300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39aed9d640 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c64aae0 0x56023c644840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.190+0000 7f39ae59c640 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60b5e0 0x56023c60bbb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x56023c648fb0 tx=0x7f39a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e45662e835b1eb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f398f7fe640 1 -- 172.21.15.139:0/270953817 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a00262d0 con 0x56023c60b5e0 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f398f7fe640 1 -- 172.21.15.139:0/270953817 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a002b070 con 0x56023c60b5e0 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f398f7fe640 1 -- 172.21.15.139:0/270953817 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0026670 con 0x56023c60b5e0 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 -- 172.21.15.139:0/270953817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60b5e0 msgr2=0x56023c60bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60b5e0 0x56023c60bbb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x56023c648fb0 tx=0x7f39a0016000 comp rx=0 tx=0).stop 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 -- 172.21.15.139:0/270953817 shutdown_connections 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c64aae0 0x56023c644840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c644300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 --2- 172.21.15.139:0/270953817 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c60b5e0 0x56023c60bbb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 -- 172.21.15.139:0/270953817 >> 172.21.15.139:0/270953817 conn(0x56023c5d2740 msgr2=0x56023c64edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 -- 172.21.15.139:0/270953817 shutdown_connections 2024-04-26T18:14:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.191+0000 7f39b77bf740 1 -- 172.21.15.139:0/270953817 wait complete. 2024-04-26T18:14:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.192+0000 7f39b77bf740 1 -- start start 2024-04-26T18:14:29.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.192+0000 7f39b77bf740 1 Processor -- start 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c6bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c660800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c6bbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f39b01fe150 con 0x56023c64aae0 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f39b01feed0 con 0x56023c60b5e0 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f39b01fe800 con 0x56023c60cb40 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 10 client.0 _ll_register_callbacks cb 0x7f39a4006a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c6bbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c6bbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33290/0 (socket says 172.21.15.139:33290) 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 -- 172.21.15.139:0/2945037355 learned_addr learned my addr 172.21.15.139:0/2945037355 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:29.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39add9b640 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c660800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39ae59c640 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c6bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 -- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 msgr2=0x56023c660800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c660800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 -- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 msgr2=0x56023c6bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c6bcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 -- 172.21.15.139:0/2945037355 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56023c6bd4a0 con 0x56023c64aae0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39aed9d640 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c6bbe10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f39a800a040 tx=0x7f39a8058d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e9fddcaa8bedbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f398d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f398d7fa640 1 -- 172.21.15.139:0/2945037355 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8087060 con 0x56023c64aae0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f398d7fa640 1 -- 172.21.15.139:0/2945037355 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f39a80552c0 con 0x56023c64aae0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.193+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39a002b070 con 0x56023c64aae0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f398d7fa640 1 -- 172.21.15.139:0/2945037355 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f39a8071170 con 0x56023c64aae0 2024-04-26T18:14:29.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 10 client.5451 fetch_fsmap learned FSMap version 9 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56023c64a3e0 con 0x56023c64aae0 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f398d7fa640 1 -- 172.21.15.139:0/2945037355 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a002b070 con 0x56023c64aae0 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f398d7fa640 1 -- 172.21.15.139:0/2945037355 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f39a80580a0 con 0x56023c64aae0 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 10 client.5451 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 10 client.5451 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 20 client.5451 populate_metadata read hostname 'smithi139' 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c660d40 0x56023c6bc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 4 client.5451 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.0, "await_for": 42.0}] 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.0, "await_for": 42.0}) -- 0x56023c576800 con 0x56023c660d40 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39ae59c640 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c660d40 0x56023c6bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f398d7fa640 10 client.5451 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:29.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:29.194+0000 7f39ae59c640 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c660d40 0x56023c6bc350 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c0981b4782040ae server_cookie=344eb7bce6c78c96 in_seq=0 out_seq=0 2024-04-26T18:14:30.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f398d7fa640 1 -- 172.21.15.139:0/2945037355 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x56023c576800 con 0x56023c660d40 2024-04-26T18:14:30.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f398d7fa640 10 client.5451 handle_command_reply: tid=0 2024-04-26T18:14:30.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 client.5451 shutdown 2024-04-26T18:14:30.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 msgr2=0x56023c6bbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:30.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c6bbe10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f39a800a040 tx=0x7f39a8058d10 comp rx=0 tx=0).stop 2024-04-26T18:14:30.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 shutdown_connections 2024-04-26T18:14:30.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56023c64aae0 0x56023c6bbe10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56023c660d40 0x56023c6bc350 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56023c60cb40 0x56023c660800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 --2- 172.21.15.139:0/2945037355 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56023c60b5e0 0x56023c6bcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f398d7fa640 0 client.5451 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:30.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 >> 172.21.15.139:0/2945037355 conn(0x56023c5d2740 msgr2=0x56023c60bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:30.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 shutdown_connections 2024-04-26T18:14:30.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 1 -- 172.21.15.139:0/2945037355 wait complete. 2024-04-26T18:14:30.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.200+0000 7f39b77bf740 20 client.5451 trim_cache size 0 max 16384 2024-04-26T18:14:30.204 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:14:30.205 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:14:30.205 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:14:30.205 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 50, 2024-04-26T18:14:30.205 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:14:30.205 INFO:teuthology.orchestra.run.smithi139.stdout: "7ec44c1c": { 2024-04-26T18:14:30.205 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 50, 2024-04-26T18:14:30.206 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:14:30.206 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:14:30.206 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:14:30.206 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:14:30.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:14:30.206 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:14:30.207 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 86.0, 2024-04-26T18:14:30.207 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:14:30.207 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:14:30.207 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:14:30.207 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:14:30.207 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:14:30.208 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:14:30.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:30.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:30.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:30.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:30.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:30.208 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:14:30.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f399006c8f0 msgr2=0x7f399006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:30.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f399006c8f0 0x7f399006edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fd0 tx=0x7f39a0009870 comp rx=0 tx=0).stop 2024-04-26T18:14:30.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b0155f60 msgr2=0x7f39b0159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:30.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b0155f60 0x7f39b0159700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c400 tx=0x7f39a800c8c0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 shutdown_connections 2024-04-26T18:14:30.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.210 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39b0155f60 0x7f39b0159700 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f39b00cd520 0x7f39b01f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 --2- 172.21.15.139:0/2333083810 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f39b00c63a0 0x7f39b00cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:30.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 >> 172.21.15.139:0/2333083810 conn(0x7f39b0072930 msgr2=0x7f39b0150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:30.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 shutdown_connections 2024-04-26T18:14:30.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:30.201+0000 7f39b4aa0640 1 -- 172.21.15.139:0/2333083810 wait complete. 2024-04-26T18:14:30.213 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7ec44c1c', quiesce took 1.5 seconds. Will release after: 26.0 2024-04-26T18:14:39.800 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:14:39.803 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:14:56.214 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:14:56.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.322+0000 7f92dfe15640 1 Processor -- start 2024-04-26T18:14:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.323+0000 7f92dfe15640 1 -- start start 2024-04-26T18:14:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.323+0000 7f92dfe15640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f92d8155da0 0x7f92d815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.323+0000 7f92dfe15640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92d80cd840 0x7f92d80c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.323+0000 7f92dfe15640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d815f2a0 con 0x7f92d8156180 2024-04-26T18:14:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.323+0000 7f92dfe15640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f92d815cbc0 con 0x7f92d80cd840 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.323+0000 7f92dfe15640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f92d80cc730 con 0x7f92d8155da0 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92de3b2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92d80cd840 0x7f92d80c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92dd3b0640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f92d8156180 0x7f92d80d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34166/0 (socket says 172.21.15.139:34166) 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92de3b2640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92d80cd840 0x7f92d80c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51012/0 (socket says 172.21.15.139:51012) 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92dd3b0640 1 -- 172.21.15.139:0/3899082377 learned_addr learned my addr 172.21.15.139:0/3899082377 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92ddbb1640 1 --2- 172.21.15.139:0/3899082377 >> v2:172.21.15.143:3300/0 conn(0x7f92d8155da0 0x7f92d815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92de3b2640 1 -- 172.21.15.139:0/3899082377 >> v2:172.21.15.143:3300/0 conn(0x7f92d8155da0 msgr2=0x7f92d815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92de3b2640 1 --2- 172.21.15.139:0/3899082377 >> v2:172.21.15.143:3300/0 conn(0x7f92d8155da0 0x7f92d815c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92de3b2640 1 -- 172.21.15.139:0/3899082377 >> v1:172.21.15.139:6789/0 conn(0x7f92d8156180 legacy=0x7f92d80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92de3b2640 1 -- 172.21.15.139:0/3899082377 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d815f580 con 0x7f92d80cd840 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.324+0000 7f92dcbaf640 1 -- 172.21.15.139:0/3899082377 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844602302 0 0) 0x7f92d815f2a0 con 0x7f92d8156180 2024-04-26T18:14:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92de3b2640 1 --2- 172.21.15.139:0/3899082377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d80c62a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f92d80d2150 tx=0x7f92d002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ba67362cb4c93f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dcbaf640 1 -- 172.21.15.139:0/3899082377 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007740 con 0x7f92d80cd840 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dcbaf640 1 -- 172.21.15.139:0/3899082377 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d00078e0 con 0x7f92d80cd840 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dcbaf640 1 -- 172.21.15.139:0/3899082377 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0007cb0 con 0x7f92d80cd840 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dfe15640 1 -- 172.21.15.139:0/3899082377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 msgr2=0x7f92d80c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3899082377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d80c62a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f92d80d2150 tx=0x7f92d002a5f0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dfe15640 1 -- 172.21.15.139:0/3899082377 shutdown_connections 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3899082377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d80c62a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3899082377 >> v2:172.21.15.143:3300/0 conn(0x7f92d8155da0 0x7f92d815c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.325+0000 7f92dfe15640 1 -- 172.21.15.139:0/3899082377 >> 172.21.15.139:0/3899082377 conn(0x7f92d8068090 msgr2=0x7f92d80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.326+0000 7f92dfe15640 1 -- 172.21.15.139:0/3899082377 shutdown_connections 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.326+0000 7f92dfe15640 1 -- 172.21.15.139:0/3899082377 wait complete. 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 Processor -- start 2024-04-26T18:14:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 -- start start 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d81f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92d8155da0 0x7f92d815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92d8153390 0x7f92d81ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80d19d0 con 0x7f92d80cd840 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f92d815fb40 con 0x7f92d8155da0 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92dfe15640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f92d80d1b50 con 0x7f92d8153390 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.327+0000 7f92ddbb1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d81f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d81f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51020/0 (socket says 172.21.15.139:51020) 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 -- 172.21.15.139:0/3015026627 learned_addr learned my addr 172.21.15.139:0/3015026627 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92dd3b0640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92d8155da0 0x7f92d815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92de3b2640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92d8153390 0x7f92d81ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 -- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92d8153390 msgr2=0x7f92d81ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92d8153390 0x7f92d81ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 -- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92d8155da0 msgr2=0x7f92d815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92d8155da0 0x7f92d815e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 -- 172.21.15.139:0/3015026627 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d8153860 con 0x7f92d80cd840 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92de3b2640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92d8153390 0x7f92d81ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ddbb1640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d81f1370 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00d800 tx=0x7f92cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ca7fc640 1 -- 172.21.15.139:0/3015026627 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00b660 con 0x7f92d80cd840 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ca7fc640 1 -- 172.21.15.139:0/3015026627 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc019070 con 0x7f92d80cd840 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92ca7fc640 1 -- 172.21.15.139:0/3015026627 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00ba20 con 0x7f92d80cd840 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d8153b20 con 0x7f92d80cd840 2024-04-26T18:14:56.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.328+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d81540e0 con 0x7f92d80cd840 2024-04-26T18:14:56.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.329+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d8076d20 con 0x7f92d80cd840 2024-04-26T18:14:56.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.330+0000 7f92ca7fc640 1 -- 172.21.15.139:0/3015026627 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92cc00bbc0 con 0x7f92d80cd840 2024-04-26T18:14:56.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.330+0000 7f92ca7fc640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f92bc06c920 0x7f92bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.330+0000 7f92ca7fc640 1 -- 172.21.15.139:0/3015026627 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f92cc08c270 con 0x7f92d80cd840 2024-04-26T18:14:56.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.330+0000 7f92dd3b0640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f92bc06c920 0x7f92bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.332 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.331+0000 7f92dd3b0640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f92bc06c920 0x7f92bc06ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92d80cb920 tx=0x7f92d4007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.334 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.335+0000 7f92ca7fc640 1 -- 172.21.15.139:0/3015026627 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92cc05a2f0 con 0x7f92d80cd840 2024-04-26T18:14:56.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.546+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92d80cd330 con 0x7f92d80cd840 2024-04-26T18:14:56.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.547+0000 7f92ca7fc640 1 -- 172.21.15.139:0/3015026627 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f92cc059bf0 con 0x7f92d80cd840 2024-04-26T18:14:56.547 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:14:56.547 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:14:56.547 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:14:56.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f92bc06c920 msgr2=0x7f92bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f92bc06c920 0x7f92bc06ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f92d80cb920 tx=0x7f92d4007de0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 msgr2=0x7f92d81f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d81f1370 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00d800 tx=0x7f92cc00dcc0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 shutdown_connections 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f92bc06c920 0x7f92bc06ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92d8153390 0x7f92d81ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92d8155da0 0x7f92d815e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 --2- 172.21.15.139:0/3015026627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92d80cd840 0x7f92d81f1370 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 >> 172.21.15.139:0/3015026627 conn(0x7f92d8068090 msgr2=0x7f92d80c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 shutdown_connections 2024-04-26T18:14:56.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.549+0000 7f92dfe15640 1 -- 172.21.15.139:0/3015026627 wait complete. 2024-04-26T18:14:56.560 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 7ec44c1c --release --await' 2024-04-26T18:14:56.560 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 7ec44c1c --release --await 2024-04-26T18:14:56.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.663+0000 7f10aefe2640 1 Processor -- start 2024-04-26T18:14:56.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.663+0000 7f10aefe2640 1 -- start start 2024-04-26T18:14:56.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10aefe2640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f10a806ffc0 0x7f10a80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10aefe2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 0x7f10a8153680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10aefe2640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a815ddd0 con 0x7f10a806fbe0 2024-04-26T18:14:56.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10aefe2640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f10a815d8a0 con 0x7f10a806ffc0 2024-04-26T18:14:56.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10aefe2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10a8159db0 con 0x7f10a8074600 2024-04-26T18:14:56.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10acd7e640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f10a806fbe0 0x7f10a815a240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34182/0 (socket says 172.21.15.139:34182) 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10acd7e640 1 -- 172.21.15.139:0/3726850315 learned_addr learned my addr 172.21.15.139:0/3726850315 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a7fff640 1 --2- 172.21.15.139:0/3726850315 >> v2:172.21.15.143:3300/0 conn(0x7f10a806ffc0 0x7f10a80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10ad57f640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 0x7f10a8153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970653592 0 0) 0x7f10a815ddd0 con 0x7f10a806fbe0 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1098003520 con 0x7f10a806fbe0 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1186016155 0 0) 0x7f1098003520 con 0x7f10a806fbe0 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 msgr2=0x7f10a8153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 0x7f10a8153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 >> v2:172.21.15.143:3300/0 conn(0x7f10a806ffc0 msgr2=0x7f10a80c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 --2- 172.21.15.139:0/3726850315 >> v2:172.21.15.143:3300/0 conn(0x7f10a806ffc0 0x7f10a80c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a80ca830 con 0x7f10a806fbe0 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f109c001670 con 0x7f10a806fbe0 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 >> v1:172.21.15.139:6789/0 conn(0x7f10a806fbe0 legacy=0x7f10a815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10980039b0 0x7f1098003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 0x7f1098004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1098004d40 0x7f10980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10a815d8a0 con 0x7f10980039b0 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8159db0 con 0x7f1098004d40 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f109800b9c0 con 0x7f10a8074600 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.664+0000 7f10acd7e640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10980039b0 0x7f1098003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10a7fff640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 0x7f1098004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10ad57f640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1098004d40 0x7f10980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10acd7e640 1 -- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 msgr2=0x7f1098004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10acd7e640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a8074600 0x7f1098004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10acd7e640 1 -- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1098004d40 msgr2=0x7f10980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10acd7e640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1098004d40 0x7f10980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10acd7e640 1 -- 172.21.15.139:0/3726850315 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1098003520 con 0x7f10980039b0 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.665+0000 7f10acd7e640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10980039b0 0x7f1098003dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c190 tx=0x7f1098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02bf217299925ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c007c60 con 0x7f10980039b0 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c005ad0 con 0x7f10980039b0 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10a77fe640 1 -- 172.21.15.139:0/3726850315 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c007070 con 0x7f10980039b0 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10aefe2640 1 -- 172.21.15.139:0/3726850315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10980039b0 msgr2=0x7f1098003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10aefe2640 1 --2- 172.21.15.139:0/3726850315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10980039b0 0x7f1098003dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c190 tx=0x7f1098005830 comp rx=0 tx=0).stop 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10ad57f640 1 -- 172.21.15.139:0/3726850315 reap_dead start 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10aefe2640 1 -- 172.21.15.139:0/3726850315 shutdown_connections 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10aefe2640 1 -- 172.21.15.139:0/3726850315 >> 172.21.15.139:0/3726850315 conn(0x7f10a806dd40 msgr2=0x7f10a806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10aefe2640 1 -- 172.21.15.139:0/3726850315 shutdown_connections 2024-04-26T18:14:56.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.666+0000 7f10aefe2640 1 -- 172.21.15.139:0/3726850315 wait complete. 2024-04-26T18:14:56.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.667+0000 7f10aefe2640 1 Processor -- start 2024-04-26T18:14:56.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.667+0000 7f10aefe2640 1 -- start start 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10aefe2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10980039b0 0x7f10a81ef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10aefe2640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a814dd00 0x7f10a815c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10aefe2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a814e650 0x7f10a814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10aefe2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10a80c9460 con 0x7f10a814e650 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10aefe2640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8159a40 con 0x7f10980039b0 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10aefe2640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10a80ca4c0 con 0x7f10a814dd00 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a814e650 0x7f10a814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a814e650 0x7f10a814ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51046/0 (socket says 172.21.15.139:51046) 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 -- 172.21.15.139:0/3182963448 learned_addr learned my addr 172.21.15.139:0/3182963448 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10acd7e640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10980039b0 0x7f10a81ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10a7fff640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a814dd00 0x7f10a815c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 -- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a814dd00 msgr2=0x7f10a815c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a814dd00 0x7f10a815c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 -- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10980039b0 msgr2=0x7f10a81ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10980039b0 0x7f10a81ef750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.668+0000 7f10ad57f640 1 -- 172.21.15.139:0/3182963448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a814f010 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.669+0000 7f10ad57f640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a814e650 0x7f10a814ead0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f10a80c43d0 tx=0x7f10a000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.669+0000 7f10a57fa640 1 -- 172.21.15.139:0/3182963448 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a000fcb0 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.669+0000 7f10a57fa640 1 -- 172.21.15.139:0/3182963448 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a001d070 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.669+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a81f2e80 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.669+0000 7f10a57fa640 1 -- 172.21.15.139:0/3182963448 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0015670 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.669+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a81f3440 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.670+0000 7f10a57fa640 1 -- 172.21.15.139:0/3182963448 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10a0015810 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.671+0000 7f10a57fa640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108c06c920 0x7f108c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.671+0000 7f10a57fa640 1 -- 172.21.15.139:0/3182963448 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f10a008c6d0 con 0x7f10a814e650 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.671+0000 7f10acd7e640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108c06c920 0x7f108c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.671+0000 7f10acd7e640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108c06c920 0x7f108c06ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f109c032000 tx=0x7f109c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 Processor -- start 2024-04-26T18:14:56.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 -- start start 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a7aa9b0 0x55ea2a76b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a76bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ea2a6d0040 con 0x55ea2a76b4b0 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ea2a66bb60 con 0x55ea2a76ca10 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ea2a6cc000 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10acd7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10acd7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51050/0 (socket says 172.21.15.139:51050) 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.672+0000 7f10acd7e640 1 -- 172.21.15.139:0/760146154 learned_addr learned my addr 172.21.15.139:0/760146154 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10ad57f640 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a76bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10a7fff640 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a7aa9b0 0x55ea2a76b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10acd7e640 1 -- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a7aa9b0 msgr2=0x55ea2a76b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10acd7e640 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a7aa9b0 0x55ea2a76b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10acd7e640 1 -- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 msgr2=0x55ea2a76bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10acd7e640 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a76bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10acd7e640 1 -- 172.21.15.139:0/760146154 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea2a6609c0 con 0x55ea2a76b4b0 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10acd7e640 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7aa470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f109c02ad60 tx=0x7f109c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f088460f459880 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10927fc640 1 -- 172.21.15.139:0/760146154 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c051070 con 0x55ea2a76b4b0 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10927fc640 1 -- 172.21.15.139:0/760146154 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c004c70 con 0x55ea2a76b4b0 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10927fc640 1 -- 172.21.15.139:0/760146154 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c03f640 con 0x55ea2a76b4b0 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.673+0000 7f10b1dce740 1 -- 172.21.15.139:0/760146154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76b4b0 msgr2=0x55ea2a7aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7aa470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f109c02ad60 tx=0x7f109c02c000 comp rx=0 tx=0).stop 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 -- 172.21.15.139:0/760146154 shutdown_connections 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a76bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a7aa9b0 0x55ea2a76b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 --2- 172.21.15.139:0/760146154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7aa470 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 -- 172.21.15.139:0/760146154 >> 172.21.15.139:0/760146154 conn(0x55ea2a732930 msgr2=0x55ea2a7af450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 -- 172.21.15.139:0/760146154 shutdown_connections 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 -- 172.21.15.139:0/760146154 wait complete. 2024-04-26T18:14:56.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 -- start start 2024-04-26T18:14:56.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.674+0000 7f10b1dce740 1 Processor -- start 2024-04-26T18:14:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7a8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a795bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10b1dce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ea2a769af0 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55ea2a6694f0 con 0x55ea2a76ca10 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55ea2a76d040 con 0x55ea2a76b4b0 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10b1dce740 10 client.0 _ll_register_callbacks cb 0x55ea2a6c6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51058/0 (socket says 172.21.15.139:51058) 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 -- 172.21.15.139:0/64447783 learned_addr learned my addr 172.21.15.139:0/64447783 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10acd7e640 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10a7fff640 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a795bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 -- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 msgr2=0x55ea2a7a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 -- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 msgr2=0x55ea2a795bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a795bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.675+0000 7f10ad57f640 1 -- 172.21.15.139:0/64447783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea2a3e1920 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10ad57f640 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7bf0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10a0062670 tx=0x7f10a005a770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5dcb2e66174065 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10877fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10877fe640 1 -- 172.21.15.139:0/64447783 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0086060 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10877fe640 1 -- 172.21.15.139:0/64447783 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f10a0062910 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f109c004c70 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10877fe640 1 -- 172.21.15.139:0/64447783 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f10a0062ba0 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 10 client.5472 fetch_fsmap learned FSMap version 9 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ea2a4add30 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10877fe640 1 -- 172.21.15.139:0/64447783 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c004c70 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10877fe640 1 -- 172.21.15.139:0/64447783 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f10a0059380 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 10 client.5472 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:14:56.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 10 client.5472 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 20 client.5472 populate_metadata read hostname 'smithi139' 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a7921f0 0x55ea2a792600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 4 client.5472 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea2a6a3a00 con 0x55ea2a7921f0 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.676+0000 7f10acd7e640 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a7921f0 0x55ea2a792600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.677+0000 7f10acd7e640 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a7921f0 0x55ea2a792600 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7df1d7c7a955813f server_cookie=7a8581063b9f654d in_seq=0 out_seq=0 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.677+0000 7f10877fe640 10 client.5472 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.677+0000 7f10877fe640 1 -- 172.21.15.139:0/64447783 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ea2a6a3a00 con 0x55ea2a7921f0 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.677+0000 7f10877fe640 10 client.5472 handle_command_reply: tid=0 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 client.5472 shutdown 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 msgr2=0x55ea2a7bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7bf0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10a0062670 tx=0x7f10a005a770 comp rx=0 tx=0).stop 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 shutdown_connections 2024-04-26T18:14:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7bf0c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76ca10 0x55ea2a795bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a7921f0 0x55ea2a792600 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 --2- 172.21.15.139:0/64447783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10877fe640 0 client.5472 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 >> 172.21.15.139:0/64447783 conn(0x55ea2a732930 msgr2=0x55ea2a794ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 shutdown_connections 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 1 -- 172.21.15.139:0/64447783 wait complete. 2024-04-26T18:14:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.678+0000 7f10b1dce740 20 client.5472 trim_cache size 0 max 16384 2024-04-26T18:14:56.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.695+0000 7f10b1dce740 1 Processor -- start 2024-04-26T18:14:56.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.695+0000 7f10b1dce740 1 -- start start 2024-04-26T18:14:56.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76ca10 0x55ea2a794a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10b1dce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81fed10 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81fdbf0 con 0x55ea2a76b4b0 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10a81e3a60 con 0x55ea2a76ca10 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7925d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51060/0 (socket says 172.21.15.139:51060) 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 -- 172.21.15.139:0/2802119674 learned_addr learned my addr 172.21.15.139:0/2802119674 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 -- 172.21.15.139:0/2802119674 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76ca10 msgr2=0x55ea2a794a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76ca10 0x55ea2a794a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 -- 172.21.15.139:0/2802119674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76b4b0 msgr2=0x55ea2a7944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10acd7e640 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7944d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 -- 172.21.15.139:0/2802119674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea2a7cfbd0 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f10ad57f640 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7925d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f10a0056390 tx=0x7f10a0024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f5d48e32d46e18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f1091ffb640 1 -- 172.21.15.139:0/2802119674 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0079070 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f1091ffb640 1 -- 172.21.15.139:0/2802119674 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a000fe50 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.696+0000 7f1091ffb640 1 -- 172.21.15.139:0/2802119674 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0059d00 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 -- 172.21.15.139:0/2802119674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 msgr2=0x55ea2a7925d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7925d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f10a0056390 tx=0x7f10a0024000 comp rx=0 tx=0).stop 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 -- 172.21.15.139:0/2802119674 shutdown_connections 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a7925d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76ca10 0x55ea2a794a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 --2- 172.21.15.139:0/2802119674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a76b4b0 0x55ea2a7944d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 -- 172.21.15.139:0/2802119674 >> 172.21.15.139:0/2802119674 conn(0x55ea2a732930 msgr2=0x55ea2a7aae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 -- 172.21.15.139:0/2802119674 shutdown_connections 2024-04-26T18:14:56.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 -- 172.21.15.139:0/2802119674 wait complete. 2024-04-26T18:14:56.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.697+0000 7f10b1dce740 1 -- start start 2024-04-26T18:14:56.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 1 Processor -- start 2024-04-26T18:14:56.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7929d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76ca10 0x55ea2a81f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a81fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81fc7f0 con 0x55ea2a76ca10 2024-04-26T18:14:56.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81fd520 con 0x55ea2a7aa9b0 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f10a81fce80 con 0x55ea2a76b4b0 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10b1dce740 10 client.0 _ll_register_callbacks cb 0x7f10a0004a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10a7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76ca10 0x55ea2a81f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10a7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76ca10 0x55ea2a81f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51074/0 (socket says 172.21.15.139:51074) 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.698+0000 7f10a7fff640 1 -- 172.21.15.139:0/1744989846 learned_addr learned my addr 172.21.15.139:0/1744989846 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10ad57f640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a81fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10acd7e640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10a7fff640 1 -- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 msgr2=0x55ea2a7929d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10a7fff640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7929d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10a7fff640 1 -- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a7aa9b0 msgr2=0x55ea2a81fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10a7fff640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a81fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10a7fff640 1 -- 172.21.15.139:0/1744989846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea2a78c5f0 con 0x55ea2a76ca10 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10ad57f640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a81fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:14:56.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10a7fff640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76ca10 0x55ea2a81f8d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f10a815cf80 tx=0x7f1094017bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f02488c62024e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10877fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10877fe640 1 -- 172.21.15.139:0/1744989846 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094004240 con 0x55ea2a76ca10 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10877fe640 1 -- 172.21.15.139:0/1744989846 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f109400f040 con 0x55ea2a76ca10 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a000fe50 con 0x55ea2a76ca10 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10877fe640 1 -- 172.21.15.139:0/1744989846 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1094029050 con 0x55ea2a76ca10 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 10 client.5478 fetch_fsmap learned FSMap version 9 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55ea2a7a85d0 con 0x55ea2a76ca10 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10877fe640 1 -- 172.21.15.139:0/1744989846 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a000fe50 con 0x55ea2a76ca10 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10877fe640 1 -- 172.21.15.139:0/1744989846 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f109402c020 con 0x55ea2a76ca10 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 10 client.5478 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 10 client.5478 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 20 client.5478 populate_metadata read hostname 'smithi139' 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a795d80 0x55ea2a7aba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 4 client.5478 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7ec44c1c", "release": true, "await": true}] 2024-04-26T18:14:56.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.699+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7ec44c1c", "release": true, "await": true}) -- 0x55ea2a7afbc0 con 0x55ea2a795d80 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10acd7e640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a795d80 0x55ea2a7aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10acd7e640 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a795d80 0x55ea2a7aba80 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0ed3c160a5669a0 server_cookie=47df5db793874ddd in_seq=0 out_seq=0 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10877fe640 10 client.5478 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10877fe640 1 -- 172.21.15.139:0/1744989846 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55ea2a7afbc0 con 0x55ea2a795d80 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10877fe640 10 client.5478 handle_command_reply: tid=0 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 client.5478 shutdown 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76ca10 msgr2=0x55ea2a81f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76ca10 0x55ea2a81f8d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f10a815cf80 tx=0x7f1094017bc0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 shutdown_connections 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55ea2a7aa9b0 0x55ea2a81fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea2a76ca10 0x55ea2a81f8d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55ea2a795d80 0x55ea2a7aba80 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 --2- 172.21.15.139:0/1744989846 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55ea2a76b4b0 0x55ea2a7929d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10877fe640 0 client.5478 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.700+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 >> 172.21.15.139:0/1744989846 conn(0x55ea2a732930 msgr2=0x55ea2a7aae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 shutdown_connections 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10b1dce740 1 -- 172.21.15.139:0/1744989846 wait complete. 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10b1dce740 20 client.5478 trim_cache size 0 max 16384 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 52, 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stdout: "7ec44c1c": { 2024-04-26T18:14:56.707 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 52, 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 86.0, 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:56.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:56.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:56.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:56.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:14:56.709 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108c06c920 msgr2=0x7f108c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108c06c920 0x7f108c06ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f109c032000 tx=0x7f109c007000 comp rx=0 tx=0).stop 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a814e650 msgr2=0x7f10a814ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a814e650 0x7f10a814ead0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f10a80c43d0 tx=0x7f10a000f1b0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 shutdown_connections 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f108c06c920 0x7f108c06ede0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10a814e650 0x7f10a814ead0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f10a814dd00 0x7f10a815c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 --2- 172.21.15.139:0/3182963448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f10980039b0 0x7f10a81ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:56.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 >> 172.21.15.139:0/3182963448 conn(0x7f10a806dd40 msgr2=0x7f10a80c76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:56.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 shutdown_connections 2024-04-26T18:14:56.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:14:56.701+0000 7f10aefe2640 1 -- 172.21.15.139:0/3182963448 wait complete. 2024-04-26T18:14:56.711 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7ec44c1c', seconds elapsed: 28.0 2024-04-26T18:14:56.934 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 61% (66/107) Updating files: 62% (67/107) Updating files: 63% (68/107) Updating files: 64% (69/107) Updating files: 65% (70/107) Updating files: 66% (71/107) Updating files: 67% (72/107) Updating files: 68% (73/107) Updating files: 69% (74/107) Updating files: 70% (75/107) Updating files: 71% (76/107) Updating files: 72% (78/107) Updating files: 73% (79/107) Updating files: 74% (80/107) Updating files: 75% (81/107) Updating files: 76% (82/107) Updating files: 77% (83/107) Updating files: 78% (84/107) Updating files: 79% (85/107) Updating files: 80% (86/107) Updating files: 81% (87/107) Updating files: 82% (88/107) Updating files: 83% (89/107) Updating files: 84% (90/107) Updating files: 85% (91/107) Updating files: 86% (93/107) Updating files: 87% (94/107) Updating files: 88% (95/107) Updating files: 89% (96/107) Updating files: 90% (97/107) Updating files: 91% (98/107) Updating files: 92% (99/107) Updating files: 93% (100/107) Updating files: 94% (101/107) Updating files: 95% (102/107) Updating files: 96% (103/107) Updating files: 97% (104/107) Updating files: 98% (105/107) Updating files: 99% (106/107) Updating files: 100% (107/107) Updating files: 100% (107/107), done. 2024-04-26T18:14:57.030 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 38dbaa5175c v0.16 2024-04-26T18:14:57.049 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.16 2024-04-26T18:14:57.057 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:14:57.057 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 17 -eq 48 ']' 2024-04-26T18:14:57.057 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.17 2024-04-26T18:14:57.057 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.17 2024-04-26T18:14:57.057 INFO:tasks.workunit.client.0.smithi139.stdout:v0.17 2024-04-26T18:14:57.058 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.17 2024-04-26T18:15:05.784 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 38% (83/217) Updating files: 39% (85/217) Updating files: 40% (87/217) Updating files: 41% (89/217) Updating files: 42% (92/217) Updating files: 43% (94/217) Updating files: 44% (96/217) Updating files: 45% (98/217) Updating files: 46% (100/217) Updating files: 47% (102/217) Updating files: 48% (105/217) Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 86% (188/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-04-26T18:15:05.864 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at dac3a8c35fb v0.17 2024-04-26T18:15:05.865 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.17 2024-04-26T18:15:05.878 INFO:tasks.workunit.client.0.smithi139.stdout:v0.18 2024-04-26T18:15:05.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:15:05.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 18 -eq 48 ']' 2024-04-26T18:15:05.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.18 2024-04-26T18:15:05.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.18 2024-04-26T18:15:05.878 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.18 2024-04-26T18:15:10.164 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:15:10.166 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:15:13.952 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 18% (147/779) Updating files: 19% (149/779) Updating files: 20% (156/779) Updating files: 21% (164/779) Updating files: 22% (172/779) Updating files: 23% (180/779) Updating files: 24% (187/779) Updating files: 25% (195/779) Updating files: 26% (203/779) Updating files: 27% (211/779) Updating files: 28% (219/779) Updating files: 29% (226/779) Updating files: 30% (234/779) Updating files: 31% (242/779) Updating files: 32% (250/779) Updating files: 33% (258/779) Updating files: 34% (265/779) Updating files: 35% (273/779) Updating files: 36% (281/779) Updating files: 37% (289/779) Updating files: 38% (297/779) Updating files: 39% (304/779) Updating files: 40% (312/779) Updating files: 41% (320/779) Updating files: 42% (328/779) Updating files: 42% (332/779) Updating files: 43% (335/779) Updating files: 44% (343/779) Updating files: 45% (351/779) Updating files: 46% (359/779) Updating files: 47% (367/779) Updating files: 48% (374/779) Updating files: 49% (382/779) Updating files: 49% (383/779) Updating files: 50% (390/779) Updating files: 51% (398/779) Updating files: 52% (406/779) Updating files: 53% (413/779) Updating files: 54% (421/779) Updating files: 55% (429/779) Updating files: 56% (437/779) Updating files: 57% (445/779) Updating files: 58% (452/779) Updating files: 59% (460/779) Updating files: 60% (468/779) Updating files: 60% (473/779) Updating files: 61% (476/779) Updating files: 62% (483/779) Updating files: 63% (491/779) Updating files: 64% (499/779) Updating files: 65% (507/779) Updating files: 66% (515/779) Updating files: 67% (522/779) Updating files: 68% (530/779) Updating files: 69% (538/779) Updating files: 70% (546/779) Updating files: 71% (554/779) Updating files: 72% (561/779) Updating files: 73% (569/779) Updating files: 74% (577/779) Updating files: 75% (585/779) Updating files: 76% (593/779) Updating files: 77% (600/779) Updating files: 78% (608/779) Updating files: 79% (616/779) Updating files: 80% (624/779) Updating files: 81% (631/779) Updating files: 82% (639/779) Updating files: 83% (647/779) Updating files: 84% (655/779) Updating files: 84% (660/779) Updating files: 85% (663/779) Updating files: 86% (670/779) Updating files: 86% (673/779) Updating files: 87% (678/779) Updating files: 88% (686/779) Updating files: 89% (694/779) Updating files: 90% (702/779) Updating files: 91% (709/779) Updating files: 92% (717/779) Updating files: 93% (725/779) Updating files: 94% (733/779) Updating files: 95% (741/779) Updating files: 96% (748/779) Updating files: 97% (756/779) Updating files: 98% (764/779) Updating files: 98% (766/779) Updating files: 99% (772/779) Updating files: 100% (779/779) Updating files: 100% (779/779), done. 2024-04-26T18:15:13.966 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 2f10137986a v0.18 2024-04-26T18:15:13.967 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.18 2024-04-26T18:15:14.495 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:15:14.496 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 19 -eq 48 ']' 2024-04-26T18:15:14.496 INFO:tasks.workunit.client.0.smithi139.stdout:v0.19 2024-04-26T18:15:14.497 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.19 2024-04-26T18:15:14.497 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.19 2024-04-26T18:15:14.497 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.19 2024-04-26T18:15:18.557 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 80% (175/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-04-26T18:15:18.582 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 98f5be53f85 v0.19 2024-04-26T18:15:18.584 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.19 2024-04-26T18:15:18.622 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:15:18.622 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 20 -eq 48 ']' 2024-04-26T18:15:18.622 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.20 2024-04-26T18:15:18.623 INFO:tasks.workunit.client.0.smithi139.stdout:v0.20 2024-04-26T18:15:18.623 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.20 2024-04-26T18:15:18.623 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.20 2024-04-26T18:15:21.592 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 76% (188/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-26T18:15:21.614 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 266d2076b6c debian: fix up debian scripts 2024-04-26T18:15:21.616 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.20 2024-04-26T18:15:22.752 INFO:tasks.workunit.client.0.smithi139.stdout:v0.21 2024-04-26T18:15:22.752 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:15:22.752 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 21 -eq 48 ']' 2024-04-26T18:15:22.752 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.21 2024-04-26T18:15:22.753 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.21 2024-04-26T18:15:22.753 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.21 2024-04-26T18:15:39.345 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 9% (49/537) Updating files: 10% (54/537) Updating files: 11% (60/537) Updating files: 12% (65/537) Updating files: 13% (70/537) Updating files: 14% (76/537) Updating files: 15% (81/537) Updating files: 16% (86/537) Updating files: 17% (92/537) Updating files: 18% (97/537) Updating files: 19% (103/537) Updating files: 20% (108/537) Updating files: 21% (113/537) Updating files: 22% (119/537) Updating files: 23% (124/537) Updating files: 24% (129/537) Updating files: 25% (135/537) Updating files: 26% (140/537) Updating files: 27% (145/537) Updating files: 28% (151/537) Updating files: 29% (156/537) Updating files: 30% (162/537) Updating files: 31% (167/537) Updating files: 31% (168/537) Updating files: 32% (172/537) Updating files: 33% (178/537) Updating files: 34% (183/537) Updating files: 35% (188/537) Updating files: 36% (194/537) Updating files: 37% (199/537) Updating files: 38% (205/537) Updating files: 39% (210/537) Updating files: 40% (215/537) Updating files: 41% (221/537) Updating files: 42% (226/537) Updating files: 43% (231/537) Updating files: 44% (237/537) Updating files: 45% (242/537) Updating files: 46% (248/537) Updating files: 47% (253/537) Updating files: 48% (258/537) Updating files: 49% (264/537) Updating files: 50% (269/537) Updating files: 51% (274/537) Updating files: 52% (280/537) Updating files: 53% (285/537) Updating files: 54% (290/537) Updating files: 55% (296/537) Updating files: 56% (301/537) Updating files: 57% (307/537) Updating files: 58% (312/537) Updating files: 59% (317/537) Updating files: 60% (323/537) Updating files: 61% (328/537) Updating files: 62% (333/537) Updating files: 63% (339/537) Updating files: 64% (344/537) Updating files: 65% (350/537) Updating files: 66% (355/537) Updating files: 67% (360/537) Updating files: 68% (366/537) Updating files: 69% (371/537) Updating files: 70% (376/537) Updating files: 71% (382/537) Updating files: 72% (387/537) Updating files: 73% (393/537) Updating files: 74% (398/537) Updating files: 75% (403/537) Updating files: 76% (409/537) Updating files: 77% (414/537) Updating files: 78% (419/537) Updating files: 79% (425/537) Updating files: 80% (430/537) Updating files: 81% (435/537) Updating files: 82% (441/537) Updating files: 83% (446/537) Updating files: 84% (452/537) Updating files: 85% (457/537) Updating files: 85% (461/537) Updating files: 86% (462/537) Updating files: 87% (468/537) Updating files: 88% (473/537) Updating files: 89% (478/537) Updating files: 89% (480/537) Updating files: 90% (484/537) Updating files: 91% (489/537) Updating files: 92% (495/537) Updating files: 93% (500/537) Updating files: 94% (505/537) Updating files: 95% (511/537) Updating files: 96% (516/537) Updating files: 97% (521/537) Updating files: 98% (527/537) Updating files: 99% (532/537) Updating files: 100% (537/537) Updating files: 100% (537/537), done. 2024-04-26T18:15:39.371 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 090436f56ac v0.21 2024-04-26T18:15:39.373 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.21 2024-04-26T18:15:39.519 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:15:39.519 INFO:tasks.workunit.client.0.smithi139.stdout:v0.22 2024-04-26T18:15:39.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 22 -eq 48 ']' 2024-04-26T18:15:39.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.22 2024-04-26T18:15:39.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.22 2024-04-26T18:15:39.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.22 2024-04-26T18:15:40.246 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:15:40.249 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:15:40.368 INFO:tasks.ceph.mds.b.smithi143.stderr:2024-04-26T18:15:40.367+0000 7fcd15b93640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41293) UID: 0 2024-04-26T18:15:40.368 INFO:tasks.ceph.mds.d.smithi143.stderr:2024-04-26T18:15:40.367+0000 7f5c36f68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41293) UID: 0 2024-04-26T18:15:40.369 INFO:tasks.ceph.mds.f.smithi143.stderr:2024-04-26T18:15:40.367+0000 7f05e3086640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 41293) UID: 0 2024-04-26T18:15:40.983 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2024-04-26T18:15:41.016 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 8a7c95f60ad v0.22 2024-04-26T18:15:41.018 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.22 2024-04-26T18:15:41.049 INFO:tasks.workunit.client.0.smithi139.stdout:v0.23 2024-04-26T18:15:41.049 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:15:41.049 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 23 -eq 48 ']' 2024-04-26T18:15:41.049 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.23 2024-04-26T18:15:41.049 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.23 2024-04-26T18:15:41.049 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.23 2024-04-26T18:15:44.545 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 3% (5/163) Updating files: 4% (7/163) Updating files: 5% (9/163) Updating files: 6% (10/163) Updating files: 7% (12/163) Updating files: 8% (14/163) Updating files: 9% (15/163) Updating files: 10% (17/163) Updating files: 11% (18/163) Updating files: 12% (20/163) Updating files: 13% (22/163) Updating files: 14% (23/163) Updating files: 15% (25/163) Updating files: 16% (27/163) Updating files: 17% (28/163) Updating files: 18% (30/163) Updating files: 19% (31/163) Updating files: 20% (33/163) Updating files: 21% (35/163) Updating files: 22% (36/163) Updating files: 23% (38/163) Updating files: 24% (40/163) Updating files: 25% (41/163) Updating files: 26% (43/163) Updating files: 27% (45/163) Updating files: 28% (46/163) Updating files: 29% (48/163) Updating files: 30% (49/163) Updating files: 31% (51/163) Updating files: 32% (53/163) Updating files: 33% (54/163) Updating files: 34% (56/163) Updating files: 35% (58/163) Updating files: 36% (59/163) Updating files: 37% (61/163) Updating files: 38% (62/163) Updating files: 39% (64/163) Updating files: 40% (66/163) Updating files: 41% (67/163) Updating files: 42% (69/163) Updating files: 43% (71/163) Updating files: 44% (72/163) Updating files: 45% (74/163) Updating files: 46% (75/163) Updating files: 47% (77/163) Updating files: 48% (79/163) Updating files: 49% (80/163) Updating files: 50% (82/163) Updating files: 51% (84/163) Updating files: 52% (85/163) Updating files: 53% (87/163) Updating files: 54% (89/163) Updating files: 55% (90/163) Updating files: 56% (92/163) Updating files: 57% (93/163) Updating files: 58% (95/163) Updating files: 59% (97/163) Updating files: 60% (98/163) Updating files: 61% (100/163) Updating files: 62% (102/163) Updating files: 63% (103/163) Updating files: 64% (105/163) Updating files: 65% (106/163) Updating files: 66% (108/163) Updating files: 67% (110/163) Updating files: 68% (111/163) Updating files: 69% (113/163) Updating files: 70% (115/163) Updating files: 71% (116/163) Updating files: 72% (118/163) Updating files: 73% (119/163) Updating files: 74% (121/163) Updating files: 75% (123/163) Updating files: 76% (124/163) Updating files: 77% (126/163) Updating files: 78% (128/163) Updating files: 79% (129/163) Updating files: 80% (131/163) Updating files: 81% (133/163) Updating files: 82% (134/163) Updating files: 83% (136/163) Updating files: 84% (137/163) Updating files: 85% (139/163) Updating files: 85% (140/163) Updating files: 86% (141/163) Updating files: 87% (142/163) Updating files: 88% (144/163) Updating files: 89% (146/163) Updating files: 90% (147/163) Updating files: 91% (149/163) Updating files: 92% (150/163) Updating files: 93% (152/163) Updating files: 94% (154/163) Updating files: 95% (155/163) Updating files: 96% (157/163) Updating files: 97% (159/163) Updating files: 98% (160/163) Updating files: 99% (162/163) Updating files: 100% (163/163) Updating files: 100% (163/163), done. 2024-04-26T18:15:44.574 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 5d1d8d0c460 v0.23 2024-04-26T18:15:44.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.23 2024-04-26T18:15:44.998 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.1 2024-04-26T18:15:44.999 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:15:45.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.108+0000 7eff45b5f640 1 Processor -- start 2024-04-26T18:15:45.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.109+0000 7eff45b5f640 1 -- start start 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.109+0000 7eff45b5f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7eff400cd840 0x7eff4015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.109+0000 7eff45b5f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4015f2a0 con 0x7eff40156180 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.109+0000 7eff45b5f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4015f580 con 0x7eff40155da0 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.109+0000 7eff45b5f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7eff4015cbc0 con 0x7eff400cd840 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.110+0000 7eff36ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7eff40156180 0x7eff400c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42238/0 (socket says 172.21.15.139:42238) 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.110+0000 7eff3ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7eff400cd840 0x7eff4015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.110+0000 7eff36ffd640 1 -- 172.21.15.139:0/1305737126 learned_addr learned my addr 172.21.15.139:0/1305737126 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.110+0000 7eff3effd640 1 -- 172.21.15.139:0/1305737126 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964276592 0 0) 0x7eff4015f2a0 con 0x7eff40156180 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.110+0000 7eff3ffff640 1 -- 172.21.15.139:0/1305737126 >> v1:172.21.15.143:6789/0 conn(0x7eff40155da0 legacy=0x7eff400d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.110+0000 7eff3ffff640 1 -- 172.21.15.139:0/1305737126 >> v1:172.21.15.139:6789/0 conn(0x7eff40156180 legacy=0x7eff400c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.110+0000 7eff3ffff640 1 -- 172.21.15.139:0/1305737126 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4015f860 con 0x7eff400cd840 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff3ffff640 1 --2- 172.21.15.139:0/1305737126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff400cd840 0x7eff4015c680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff38009d90 tx=0x7eff3802a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580043c912c4d3f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff3effd640 1 -- 172.21.15.139:0/1305737126 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38007740 con 0x7eff400cd840 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff3effd640 1 -- 172.21.15.139:0/1305737126 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff380078e0 con 0x7eff400cd840 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff3effd640 1 -- 172.21.15.139:0/1305737126 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38007cb0 con 0x7eff400cd840 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff45b5f640 1 -- 172.21.15.139:0/1305737126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff400cd840 msgr2=0x7eff4015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff45b5f640 1 --2- 172.21.15.139:0/1305737126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff400cd840 0x7eff4015c680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff38009d90 tx=0x7eff3802a580 comp rx=0 tx=0).stop 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff45b5f640 1 -- 172.21.15.139:0/1305737126 shutdown_connections 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff45b5f640 1 --2- 172.21.15.139:0/1305737126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff400cd840 0x7eff4015c680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff45b5f640 1 -- 172.21.15.139:0/1305737126 >> 172.21.15.139:0/1305737126 conn(0x7eff40068090 msgr2=0x7eff400684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:45.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff45b5f640 1 -- 172.21.15.139:0/1305737126 shutdown_connections 2024-04-26T18:15:45.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.111+0000 7eff45b5f640 1 -- 172.21.15.139:0/1305737126 wait complete. 2024-04-26T18:15:45.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.113+0000 7eff45b5f640 1 Processor -- start 2024-04-26T18:15:45.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.113+0000 7eff45b5f640 1 -- start start 2024-04-26T18:15:45.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff45b5f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff400cd840 0x7eff401e8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff45b5f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff40155da0 0x7eff4015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff45b5f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff400d1440 0x7eff401f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff45b5f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7eff400d19d0 con 0x7eff400d1440 2024-04-26T18:15:45.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff45b5f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7eff400cc730 con 0x7eff40155da0 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff45b5f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7eff400d1b50 con 0x7eff400cd840 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff3ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff400d1440 0x7eff401f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff3ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff400d1440 0x7eff401f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33296/0 (socket says 172.21.15.139:33296) 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff3ffff640 1 -- 172.21.15.139:0/2753151466 learned_addr learned my addr 172.21.15.139:0/2753151466 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff36ffd640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff40155da0 0x7eff4015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff3f7fe640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff400cd840 0x7eff401e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff36ffd640 1 -- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff400cd840 msgr2=0x7eff401e8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff36ffd640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff400cd840 0x7eff401e8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff36ffd640 1 -- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff400d1440 msgr2=0x7eff401f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff36ffd640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff400d1440 0x7eff401f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.114+0000 7eff36ffd640 1 -- 172.21.15.139:0/2753151466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4015ce70 con 0x7eff40155da0 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.115+0000 7eff36ffd640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff40155da0 0x7eff4015e1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff40073b60 tx=0x7eff2800c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.115+0000 7eff3cff9640 1 -- 172.21.15.139:0/2753151466 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff280074e0 con 0x7eff40155da0 2024-04-26T18:15:45.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.115+0000 7eff3cff9640 1 -- 172.21.15.139:0/2753151466 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff28007680 con 0x7eff40155da0 2024-04-26T18:15:45.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.115+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4015d150 con 0x7eff40155da0 2024-04-26T18:15:45.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.115+0000 7eff3cff9640 1 -- 172.21.15.139:0/2753151466 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28004a00 con 0x7eff40155da0 2024-04-26T18:15:45.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.115+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4015d710 con 0x7eff40155da0 2024-04-26T18:15:45.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.117+0000 7eff3cff9640 1 -- 172.21.15.139:0/2753151466 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff28011070 con 0x7eff40155da0 2024-04-26T18:15:45.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.117+0000 7eff3cff9640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff2006c920 0x7eff2006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.118+0000 7eff3cff9640 1 -- 172.21.15.139:0/2753151466 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7eff2808ba20 con 0x7eff40155da0 2024-04-26T18:15:45.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.119+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff40076d20 con 0x7eff40155da0 2024-04-26T18:15:45.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.119+0000 7eff3f7fe640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff2006c920 0x7eff2006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.120+0000 7eff3f7fe640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff2006c920 0x7eff2006ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff300019c0 tx=0x7eff30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.130+0000 7eff3cff9640 1 -- 172.21.15.139:0/2753151466 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff280593c0 con 0x7eff40155da0 2024-04-26T18:15:45.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.348+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff400cd330 con 0x7eff40155da0 2024-04-26T18:15:45.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.349+0000 7eff3cff9640 1 -- 172.21.15.139:0/2753151466 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7eff2805d6c0 con 0x7eff40155da0 2024-04-26T18:15:45.350 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:15:45.350 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:15:45.350 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:15:45.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff2006c920 msgr2=0x7eff2006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff2006c920 0x7eff2006ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff300019c0 tx=0x7eff30009040 comp rx=0 tx=0).stop 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff40155da0 msgr2=0x7eff4015e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff40155da0 0x7eff4015e1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff40073b60 tx=0x7eff2800c870 comp rx=0 tx=0).stop 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 shutdown_connections 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff2006c920 0x7eff2006ede0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff400d1440 0x7eff401f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff40155da0 0x7eff4015e1f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 --2- 172.21.15.139:0/2753151466 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7eff400cd840 0x7eff401e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 >> 172.21.15.139:0/2753151466 conn(0x7eff40068090 msgr2=0x7eff400c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 shutdown_connections 2024-04-26T18:15:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.351+0000 7eff45b5f640 1 -- 172.21.15.139:0/2753151466 wait complete. 2024-04-26T18:15:45.363 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 91.1 --await-for 42.0' 2024-04-26T18:15:45.363 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 91.1 --await-for 42.0 2024-04-26T18:15:45.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.469+0000 7efd77fda640 1 Processor -- start 2024-04-26T18:15:45.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.470+0000 7efd77fda640 1 -- start start 2024-04-26T18:15:45.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.470+0000 7efd77fda640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efd70155c80 0x7efd70073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.470+0000 7efd77fda640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cedc0 0x7efd700cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.470+0000 7efd77fda640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd70073870 con 0x7efd700cb730 2024-04-26T18:15:45.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.470+0000 7efd77fda640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7efd70073b10 con 0x7efd70155c80 2024-04-26T18:15:45.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.470+0000 7efd77fda640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd700cca30 con 0x7efd700cedc0 2024-04-26T18:15:45.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd75d76640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7efd70155c80 0x7efd70073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd75575640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cedc0 0x7efd700cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd76577640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7efd700cb730 0x7efd7015bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:56376/0 (socket says 172.21.15.139:56376) 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd76577640 1 -- 172.21.15.139:0/126381796 learned_addr learned my addr 172.21.15.139:0/126381796 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd75d76640 1 -- 172.21.15.139:0/126381796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cedc0 msgr2=0x7efd700cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd75d76640 1 --2- 172.21.15.139:0/126381796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cedc0 0x7efd700cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd75d76640 1 -- 172.21.15.139:0/126381796 >> v1:172.21.15.143:6789/0 conn(0x7efd700cb730 legacy=0x7efd7015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd75d76640 1 -- 172.21.15.139:0/126381796 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd700ccd10 con 0x7efd70155c80 2024-04-26T18:15:45.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.471+0000 7efd74d74640 1 -- 172.21.15.139:0/126381796 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762842405 0 0) 0x7efd70073870 con 0x7efd700cb730 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd75d76640 1 --2- 172.21.15.139:0/126381796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd70155c80 0x7efd70073280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0097a0 tx=0x7efd6c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef14315e71414f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd74d74640 1 -- 172.21.15.139:0/126381796 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c037070 con 0x7efd70155c80 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd74d74640 1 -- 172.21.15.139:0/126381796 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c032440 con 0x7efd70155c80 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd74d74640 1 -- 172.21.15.139:0/126381796 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c032810 con 0x7efd70155c80 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd77fda640 1 -- 172.21.15.139:0/126381796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd70155c80 msgr2=0x7efd70073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd77fda640 1 --2- 172.21.15.139:0/126381796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd70155c80 0x7efd70073280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0097a0 tx=0x7efd6c02a210 comp rx=0 tx=0).stop 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd77fda640 1 -- 172.21.15.139:0/126381796 shutdown_connections 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd77fda640 1 --2- 172.21.15.139:0/126381796 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cedc0 0x7efd700cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd77fda640 1 --2- 172.21.15.139:0/126381796 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd70155c80 0x7efd70073280 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.472+0000 7efd77fda640 1 -- 172.21.15.139:0/126381796 >> 172.21.15.139:0/126381796 conn(0x7efd7006ef00 msgr2=0x7efd7006f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.473+0000 7efd77fda640 1 -- 172.21.15.139:0/126381796 shutdown_connections 2024-04-26T18:15:45.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.473+0000 7efd77fda640 1 -- 172.21.15.139:0/126381796 wait complete. 2024-04-26T18:15:45.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 Processor -- start 2024-04-26T18:15:45.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 -- start start 2024-04-26T18:15:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cb730 0x7efd701f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd700cedc0 0x7efd70150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd70155c80 0x7efd70150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd700cd5b0 con 0x7efd70155c80 2024-04-26T18:15:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efd700cd2d0 con 0x7efd700cedc0 2024-04-26T18:15:45.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd77fda640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd70156060 con 0x7efd700cb730 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd75d76640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cb730 0x7efd701f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd76577640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd70155c80 0x7efd70150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd75d76640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cb730 0x7efd701f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:35264/0 (socket says 172.21.15.139:35264) 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd75d76640 1 -- 172.21.15.139:0/4145849564 learned_addr learned my addr 172.21.15.139:0/4145849564 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.474+0000 7efd75575640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd700cedc0 0x7efd70150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd75575640 1 -- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cb730 msgr2=0x7efd701f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd75575640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cb730 0x7efd701f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd75575640 1 -- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd70155c80 msgr2=0x7efd70150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd75575640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd70155c80 0x7efd70150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd75575640 1 -- 172.21.15.139:0/4145849564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd700caa70 con 0x7efd700cedc0 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd75d76640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cb730 0x7efd701f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd75575640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd700cedc0 0x7efd70150530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd6000e870 tx=0x7efd6000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd667fc640 1 -- 172.21.15.139:0/4145849564 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60017070 con 0x7efd700cedc0 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd667fc640 1 -- 172.21.15.139:0/4145849564 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6000ee60 con 0x7efd700cedc0 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd701564c0 con 0x7efd700cedc0 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd667fc640 1 -- 172.21.15.139:0/4145849564 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6000cb60 con 0x7efd700cedc0 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.475+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd70158b80 con 0x7efd700cedc0 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.477+0000 7efd667fc640 1 -- 172.21.15.139:0/4145849564 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd6001a070 con 0x7efd700cedc0 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.477+0000 7efd667fc640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd5406c8f0 0x7efd5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.477+0000 7efd667fc640 1 -- 172.21.15.139:0/4145849564 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efd6008c110 con 0x7efd700cedc0 2024-04-26T18:15:45.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.477+0000 7efd75d76640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd5406c8f0 0x7efd5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.478+0000 7efd75d76640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd5406c8f0 0x7efd5406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02a250 tx=0x7efd6c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.478+0000 7efd7adc9740 1 Processor -- start 2024-04-26T18:15:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.478+0000 7efd7adc9740 1 -- start start 2024-04-26T18:15:45.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3ac75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3a889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3a88f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd7adc9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5635b39ebd80 con 0x5635b3a89b40 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5635b3987c20 con 0x5635b3ac7ae0 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5635b39e7d40 con 0x5635b3a885e0 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3a88f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3a88f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33310/0 (socket says 172.21.15.139:33310) 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 -- 172.21.15.139:0/612139425 learned_addr learned my addr 172.21.15.139:0/612139425 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd75d76640 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3ac75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd75575640 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3a889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 -- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 msgr2=0x5635b3ac75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3ac75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 -- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 msgr2=0x5635b3a889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3a889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 -- 172.21.15.139:0/612139425 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b37c9d80 con 0x5635b3a89b40 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd76577640 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3a88f00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efd68001bc0 tx=0x7efd68002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fbb353c7884815 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd537fe640 1 -- 172.21.15.139:0/612139425 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd680077f0 con 0x5635b3a89b40 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd537fe640 1 -- 172.21.15.139:0/612139425 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68018070 con 0x5635b3a89b40 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.479+0000 7efd537fe640 1 -- 172.21.15.139:0/612139425 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd680133f0 con 0x5635b3a89b40 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 -- 172.21.15.139:0/612139425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 msgr2=0x5635b3a88f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3a88f00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efd68001bc0 tx=0x7efd68002080 comp rx=0 tx=0).stop 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 -- 172.21.15.139:0/612139425 shutdown_connections 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3a88f00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3a889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 --2- 172.21.15.139:0/612139425 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3ac75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 -- 172.21.15.139:0/612139425 >> 172.21.15.139:0/612139425 conn(0x5635b3a4f740 msgr2=0x5635b3acc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 -- 172.21.15.139:0/612139425 shutdown_connections 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.480+0000 7efd7adc9740 1 -- 172.21.15.139:0/612139425 wait complete. 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.481+0000 7efd7adc9740 1 -- start start 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.481+0000 7efd7adc9740 1 Processor -- start 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ada880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3adc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3aafe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5635b3a86c20 con 0x5635b3ac7ae0 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5635b3985840 con 0x5635b3a885e0 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5635b3a8a170 con 0x5635b3a89b40 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 10 client.0 _ll_register_callbacks cb 0x5635b39895b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3aafe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3aafe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33312/0 (socket says 172.21.15.139:33312) 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd75d76640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ada880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 -- 172.21.15.139:0/2552480624 learned_addr learned my addr 172.21.15.139:0/2552480624 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd75575640 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3adc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 -- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 msgr2=0x5635b3adc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3adc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 -- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 msgr2=0x5635b3ada880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ada880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 -- 172.21.15.139:0/2552480624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b382a510 con 0x5635b3ac7ae0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd75d76640 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ada880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd76577640 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3aafe10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5635b3ac8b80 tx=0x7efd68012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc19212c7b67044 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd50ff9640 1 -- 172.21.15.139:0/2552480624 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68013bb0 con 0x5635b3ac7ae0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd50ff9640 1 -- 172.21.15.139:0/2552480624 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efd68013d50 con 0x5635b3ac7ae0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd68018070 con 0x5635b3ac7ae0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd50ff9640 1 -- 172.21.15.139:0/2552480624 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7efd6802f050 con 0x5635b3ac7ae0 2024-04-26T18:15:45.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 10 client.5493 fetch_fsmap learned FSMap version 9 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.482+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5635b36bd670 con 0x5635b3ac7ae0 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd50ff9640 1 -- 172.21.15.139:0/2552480624 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68018070 con 0x5635b3ac7ae0 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd50ff9640 1 -- 172.21.15.139:0/2552480624 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7efd6801c450 con 0x5635b3ac7ae0 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd7adc9740 10 client.5493 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd7adc9740 10 client.5493 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd7adc9740 20 client.5493 populate_metadata read hostname 'smithi139' 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd7adc9740 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ab0350 0x5635b3ac4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd7adc9740 4 client.5493 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635b39f9990 con 0x5635b3ab0350 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd75d76640 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ab0350 0x5635b3ac4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd50ff9640 10 client.5493 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.483+0000 7efd75d76640 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ab0350 0x5635b3ac4820 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37bdecb34d0702dd server_cookie=c8394703afe8af61 in_seq=0 out_seq=0 2024-04-26T18:15:45.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd50ff9640 1 -- 172.21.15.139:0/2552480624 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5635b39f9990 con 0x5635b3ab0350 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd50ff9640 10 client.5493 handle_command_reply: tid=0 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 client.5493 shutdown 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 msgr2=0x5635b3aafe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3aafe10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5635b3ac8b80 tx=0x7efd68012000 comp rx=0 tx=0).stop 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 shutdown_connections 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3aafe10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ab0350 0x5635b3ac4820 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3adc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 --2- 172.21.15.139:0/2552480624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ada880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd50ff9640 0 client.5493 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 >> 172.21.15.139:0/2552480624 conn(0x5635b3a4f740 msgr2=0x5635b3acca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 shutdown_connections 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 1 -- 172.21.15.139:0/2552480624 wait complete. 2024-04-26T18:15:45.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.484+0000 7efd7adc9740 20 client.5493 trim_cache size 0 max 16384 2024-04-26T18:15:45.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.501+0000 7efd7adc9740 1 Processor -- start 2024-04-26T18:15:45.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.501+0000 7efd7adc9740 1 -- start start 2024-04-26T18:15:45.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ab1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3ab1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3acbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd7adc9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd702006d0 con 0x5635b3ac7ae0 2024-04-26T18:15:45.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efd701ff5b0 con 0x5635b3a885e0 2024-04-26T18:15:45.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd701f5d10 con 0x5635b3a89b40 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3acbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3acbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33328/0 (socket says 172.21.15.139:33328) 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 -- 172.21.15.139:0/1633091592 learned_addr learned my addr 172.21.15.139:0/1633091592 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd75d76640 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ab1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd75575640 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3ab1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 -- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 msgr2=0x5635b3ab1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3ab1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 -- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 msgr2=0x5635b3ab1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ab1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd76577640 1 -- 172.21.15.139:0/1633091592 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635b39ee220 con 0x5635b3ac7ae0 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.502+0000 7efd75d76640 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ab1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd76577640 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3acbbd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efd68000f80 tx=0x7efd6800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de33f0924f21f643 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd52ffd640 1 -- 172.21.15.139:0/1633091592 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68007b00 con 0x5635b3ac7ae0 2024-04-26T18:15:45.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd52ffd640 1 -- 172.21.15.139:0/1633091592 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68018030 con 0x5635b3ac7ae0 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd52ffd640 1 -- 172.21.15.139:0/1633091592 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6801c450 con 0x5635b3ac7ae0 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 -- 172.21.15.139:0/1633091592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 msgr2=0x5635b3acbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3acbbd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efd68000f80 tx=0x7efd6800a000 comp rx=0 tx=0).stop 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 -- 172.21.15.139:0/1633091592 shutdown_connections 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3ac7ae0 0x5635b3acbbd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a89b40 0x5635b3ab1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 --2- 172.21.15.139:0/1633091592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3a885e0 0x5635b3ab1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 -- 172.21.15.139:0/1633091592 >> 172.21.15.139:0/1633091592 conn(0x5635b3a4f740 msgr2=0x5635b3ac82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 -- 172.21.15.139:0/1633091592 shutdown_connections 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.503+0000 7efd7adc9740 1 -- 172.21.15.139:0/1633091592 wait complete. 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.504+0000 7efd7adc9740 1 -- start start 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.504+0000 7efd7adc9740 1 Processor -- start 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3aec160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3ab0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3b3bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd701fe180 con 0x5635b3a89b40 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efd701feee0 con 0x5635b3ac7ae0 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd701fe810 con 0x5635b3a885e0 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 10 client.0 _ll_register_callbacks cb 0x7efd6c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75d76640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3aec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3ab0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75d76640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3aec160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:35294/0 (socket says 172.21.15.139:35294) 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3ab0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:33344/0 (socket says 172.21.15.139:33344) 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75d76640 1 -- 172.21.15.139:0/505734993 learned_addr learned my addr 172.21.15.139:0/505734993 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd76577640 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3b3bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 -- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 msgr2=0x5635b3aec160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3aec160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 -- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 msgr2=0x5635b3b3bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3b3bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 -- 172.21.15.139:0/505734993 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635b3a85da0 con 0x5635b3a89b40 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75d76640 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3aec160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd75575640 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3ab0c00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efd6008a230 tx=0x7efd6005de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9759f868ca21f025 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd50ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd50ff9640 1 -- 172.21.15.139:0/505734993 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60021040 con 0x5635b3a89b40 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd50ff9640 1 -- 172.21.15.139:0/505734993 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efd60077b80 con 0x5635b3a89b40 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd68018030 con 0x5635b3a89b40 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd50ff9640 1 -- 172.21.15.139:0/505734993 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7efd60077d80 con 0x5635b3a89b40 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.505+0000 7efd7adc9740 10 client.5499 fetch_fsmap learned FSMap version 9 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5635b3abdc40 con 0x5635b3a89b40 2024-04-26T18:15:45.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd50ff9640 1 -- 172.21.15.139:0/505734993 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68018030 con 0x5635b3a89b40 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd50ff9640 1 -- 172.21.15.139:0/505734993 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7efd60083b40 con 0x5635b3a89b40 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd7adc9740 10 client.5499 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd7adc9740 10 client.5499 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd7adc9740 20 client.5499 populate_metadata read hostname 'smithi139' 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd7adc9740 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ad9600 0x5635b3b3c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd7adc9740 4 client.5499 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.1, "await_for": 42.0}] 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.1, "await_for": 42.0}) -- 0x5635b39f3800 con 0x5635b3ad9600 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd75d76640 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ad9600 0x5635b3b3c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd50ff9640 10 client.5499 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:15:45.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:45.506+0000 7efd75d76640 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ad9600 0x5635b3b3c240 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d5d18ea40a9a378 server_cookie=2429d887dde6960f in_seq=0 out_seq=0 2024-04-26T18:15:45.544 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:15:45.545 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 24 -eq 48 ']' 2024-04-26T18:15:45.545 INFO:tasks.workunit.client.0.smithi139.stdout:v0.24 2024-04-26T18:15:45.545 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.24 2024-04-26T18:15:45.545 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.24 2024-04-26T18:15:45.545 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.24 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd50ff9640 1 -- 172.21.15.139:0/505734993 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5635b39f3800 con 0x5635b3ad9600 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd50ff9640 10 client.5499 handle_command_reply: tid=0 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 client.5499 shutdown 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 msgr2=0x5635b3ab0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3ab0c00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efd6008a230 tx=0x7efd6005de20 comp rx=0 tx=0).stop 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 shutdown_connections 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5635b3ac7ae0 0x5635b3b3bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5635b3a89b40 0x5635b3ab0c00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5635b3ad9600 0x5635b3b3c240 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 --2- 172.21.15.139:0/505734993 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5635b3a885e0 0x5635b3aec160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd50ff9640 0 client.5499 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 >> 172.21.15.139:0/505734993 conn(0x5635b3a4f740 msgr2=0x5635b3aafc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 shutdown_connections 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 1 -- 172.21.15.139:0/505734993 wait complete. 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.132+0000 7efd7adc9740 20 client.5499 trim_cache size 0 max 16384 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 54, 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:15:47.134 INFO:teuthology.orchestra.run.smithi139.stdout: "9227e722": { 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 54, 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 91.1, 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:15:47.135 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:15:47.136 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:15:47.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:15:47.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:15:47.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:15:47.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:15:47.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:15:47.136 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd5406c8f0 msgr2=0x7efd5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd5406c8f0 0x7efd5406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efd6c02a250 tx=0x7efd6c02e000 comp rx=0 tx=0).stop 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd700cedc0 msgr2=0x7efd70150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd700cedc0 0x7efd70150530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd6000e870 tx=0x7efd6000ed30 comp rx=0 tx=0).stop 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 shutdown_connections 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd5406c8f0 0x7efd5406edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd70155c80 0x7efd70150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd700cedc0 0x7efd70150530 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 --2- 172.21.15.139:0/4145849564 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd700cb730 0x7efd701f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:47.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 >> 172.21.15.139:0/4145849564 conn(0x7efd7006ef00 msgr2=0x7efd700cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:47.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 shutdown_connections 2024-04-26T18:15:47.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:15:47.133+0000 7efd77fda640 1 -- 172.21.15.139:0/4145849564 wait complete. 2024-04-26T18:15:47.144 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9227e722', quiesce took 2.1 seconds. Will release after: 31.1 2024-04-26T18:16:18.246 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:16:18.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.356+0000 7f1fe1c45640 1 Processor -- start 2024-04-26T18:16:18.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.356+0000 7f1fe1c45640 1 -- start start 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fe1c45640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc072980 0x7f1fdc0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fe1c45640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fdc0734c0 con 0x7f1fdc155d90 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fe1c45640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fdc0737a0 con 0x7f1fdc072dc0 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fe1c45640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc073a80 con 0x7f1fdc072980 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fdb7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1fdc155d90 0x7f1fdc0c8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:54506/0 (socket says 172.21.15.139:54506) 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/3406392306 learned_addr learned my addr 172.21.15.139:0/3406392306 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fd3fff640 1 --2- 172.21.15.139:0/3406392306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc072980 0x7f1fdc0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fdaffd640 1 -- 172.21.15.139:0/3406392306 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812531095 0 0) 0x7f1fdc0734c0 con 0x7f1fdc155d90 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fdaffd640 1 -- 172.21.15.139:0/3406392306 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fc8003520 con 0x7f1fdc155d90 2024-04-26T18:16:18.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fdaffd640 1 -- 172.21.15.139:0/3406392306 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674837993 0 0) 0x7f1fdc0737a0 con 0x7f1fdc072dc0 2024-04-26T18:16:18.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.357+0000 7f1fdaffd640 1 -- 172.21.15.139:0/3406392306 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fdc0734c0 con 0x7f1fdc072dc0 2024-04-26T18:16:18.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.358+0000 7f1fd3fff640 1 -- 172.21.15.139:0/3406392306 >> v1:172.21.15.143:6789/0 conn(0x7f1fdc072dc0 legacy=0x7f1fdc15be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.358+0000 7f1fd3fff640 1 -- 172.21.15.139:0/3406392306 >> v1:172.21.15.139:6789/0 conn(0x7f1fdc155d90 legacy=0x7f1fdc0c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.358+0000 7f1fd3fff640 1 -- 172.21.15.139:0/3406392306 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc073d60 con 0x7f1fdc072980 2024-04-26T18:16:18.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.358+0000 7f1fd3fff640 1 --2- 172.21.15.139:0/3406392306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc072980 0x7f1fdc0cdb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40097d0 tx=0x7f1fc402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6ff230354e5896 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.358+0000 7f1fdaffd640 1 -- 172.21.15.139:0/3406392306 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4037070 con 0x7f1fdc072980 2024-04-26T18:16:18.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fdaffd640 1 -- 172.21.15.139:0/3406392306 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc4032440 con 0x7f1fdc072980 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fdaffd640 1 -- 172.21.15.139:0/3406392306 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4032810 con 0x7f1fdc072980 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fe1c45640 1 -- 172.21.15.139:0/3406392306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc072980 msgr2=0x7f1fdc0cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/3406392306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc072980 0x7f1fdc0cdb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40097d0 tx=0x7f1fc402a210 comp rx=0 tx=0).stop 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fe1c45640 1 -- 172.21.15.139:0/3406392306 shutdown_connections 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/3406392306 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc072980 0x7f1fdc0cdb70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fe1c45640 1 -- 172.21.15.139:0/3406392306 >> 172.21.15.139:0/3406392306 conn(0x7f1fdc06e570 msgr2=0x7f1fdc06e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fe1c45640 1 -- 172.21.15.139:0/3406392306 shutdown_connections 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.359+0000 7f1fe1c45640 1 -- 172.21.15.139:0/3406392306 wait complete. 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.360+0000 7f1fe1c45640 1 Processor -- start 2024-04-26T18:16:18.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.360+0000 7f1fe1c45640 1 -- start start 2024-04-26T18:16:18.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fe1c45640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc072980 0x7f1fdc151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fe1c45640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc155d90 0x7f1fdc156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fe1c45640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fdc0cce10 0x7f1fdc157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fe1c45640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc15c570 con 0x7f1fdc072980 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fe1c45640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc074040 con 0x7f1fdc0cce10 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fe1c45640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc15c6f0 con 0x7f1fdc155d90 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc072980 0x7f1fdc151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fd3fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc155d90 0x7f1fdc156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fdc0cce10 0x7f1fdc157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc072980 0x7f1fdc151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34344/0 (socket says 172.21.15.139:34344) 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/1306904780 learned_addr learned my addr 172.21.15.139:0/1306904780 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/1306904780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc155d90 msgr2=0x7f1fdc156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc155d90 0x7f1fdc156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/1306904780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fdc0cce10 msgr2=0x7f1fdc157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fdc0cce10 0x7f1fdc157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.361+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/1306904780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc14f5f0 con 0x7f1fdc072980 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.362+0000 7f1fd3fff640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc155d90 0x7f1fdc156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.362+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc072980 0x7f1fdc151c10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c500 tx=0x7f1fcc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.362+0000 7f1fd8ff9640 1 -- 172.21.15.139:0/1306904780 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc017070 con 0x7f1fdc072980 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.362+0000 7f1fd8ff9640 1 -- 172.21.15.139:0/1306904780 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc005d00 con 0x7f1fdc072980 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.362+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fdc1590b0 con 0x7f1fdc072980 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.362+0000 7f1fd8ff9640 1 -- 172.21.15.139:0/1306904780 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc007330 con 0x7f1fdc072980 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.362+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fdc1f2130 con 0x7f1fdc072980 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.363+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fdc076d20 con 0x7f1fdc072980 2024-04-26T18:16:18.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.363+0000 7f1fd8ff9640 1 -- 172.21.15.139:0/1306904780 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fcc01a070 con 0x7f1fdc072980 2024-04-26T18:16:18.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.364+0000 7f1fd8ff9640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fbc06c8f0 0x7f1fbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.364+0000 7f1fd8ff9640 1 -- 172.21.15.139:0/1306904780 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1fcc08b360 con 0x7f1fdc072980 2024-04-26T18:16:18.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.364+0000 7f1fd3fff640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fbc06c8f0 0x7f1fbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.364+0000 7f1fd3fff640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fbc06c8f0 0x7f1fbc06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4034000 tx=0x7f1fc402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.368+0000 7f1fd8ff9640 1 -- 172.21.15.139:0/1306904780 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fcc058dd0 con 0x7f1fdc072980 2024-04-26T18:16:18.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.578+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fdc0c8fa0 con 0x7f1fdc072980 2024-04-26T18:16:18.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.579+0000 7f1fd8ff9640 1 -- 172.21.15.139:0/1306904780 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f1fcc05d0d0 con 0x7f1fdc072980 2024-04-26T18:16:18.579 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:16:18.579 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:16:18.580 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:16:18.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fbc06c8f0 msgr2=0x7f1fbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fbc06c8f0 0x7f1fbc06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4034000 tx=0x7f1fc402e000 comp rx=0 tx=0).stop 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc072980 msgr2=0x7f1fdc151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc072980 0x7f1fdc151c10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c500 tx=0x7f1fcc00c9c0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 shutdown_connections 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fbc06c8f0 0x7f1fbc06edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fdc0cce10 0x7f1fdc157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc155d90 0x7f1fdc156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 --2- 172.21.15.139:0/1306904780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc072980 0x7f1fdc151c10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 >> 172.21.15.139:0/1306904780 conn(0x7f1fdc06e570 msgr2=0x7f1fdc070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 shutdown_connections 2024-04-26T18:16:18.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.581+0000 7f1fe1c45640 1 -- 172.21.15.139:0/1306904780 wait complete. 2024-04-26T18:16:18.592 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 9227e722 --release --await' 2024-04-26T18:16:18.592 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 9227e722 --release --await 2024-04-26T18:16:18.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.696+0000 7f30da42c640 1 Processor -- start 2024-04-26T18:16:18.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.696+0000 7f30da42c640 1 -- start start 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.696+0000 7f30da42c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d41527f0 0x7f30d415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.696+0000 7f30da42c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d415cbc0 con 0x7f30d40cc0e0 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30da42c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d415c040 con 0x7f30d415fdf0 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30da42c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30d40c6780 con 0x7f30d41527f0 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d89c9640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f30d40cc0e0 0x7f30d40cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:54508/0 (socket says 172.21.15.139:54508) 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d89c9640 1 -- 172.21.15.139:0/2163923486 learned_addr learned my addr 172.21.15.139:0/2163923486 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d3fff640 1 --2- 172.21.15.139:0/2163923486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d41527f0 0x7f30d415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d2ffd640 1 -- 172.21.15.139:0/2163923486 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590042358 0 0) 0x7f30cc001490 con 0x7f30d40cc0e0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d2ffd640 1 -- 172.21.15.139:0/2163923486 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30bc003520 con 0x7f30d40cc0e0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d2ffd640 1 -- 172.21.15.139:0/2163923486 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021116972 0 0) 0x7f30d415c040 con 0x7f30d415fdf0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d2ffd640 1 -- 172.21.15.139:0/2163923486 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30cc001490 con 0x7f30d415fdf0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d3fff640 1 -- 172.21.15.139:0/2163923486 >> v1:172.21.15.143:6789/0 conn(0x7f30d415fdf0 legacy=0x7f30d40d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d3fff640 1 -- 172.21.15.139:0/2163923486 >> v1:172.21.15.139:6789/0 conn(0x7f30d40cc0e0 legacy=0x7f30d40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.697+0000 7f30d3fff640 1 -- 172.21.15.139:0/2163923486 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d415c320 con 0x7f30d41527f0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30d3fff640 1 --2- 172.21.15.139:0/2163923486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d41527f0 0x7f30d415f8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30c40097d0 tx=0x7f30c402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7db6384095aada6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30d2ffd640 1 -- 172.21.15.139:0/2163923486 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4037070 con 0x7f30d41527f0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30d2ffd640 1 -- 172.21.15.139:0/2163923486 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c4032440 con 0x7f30d41527f0 2024-04-26T18:16:18.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30d2ffd640 1 -- 172.21.15.139:0/2163923486 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4032810 con 0x7f30d41527f0 2024-04-26T18:16:18.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30da42c640 1 -- 172.21.15.139:0/2163923486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d41527f0 msgr2=0x7f30d415f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30da42c640 1 --2- 172.21.15.139:0/2163923486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d41527f0 0x7f30d415f8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f30c40097d0 tx=0x7f30c402a210 comp rx=0 tx=0).stop 2024-04-26T18:16:18.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30da42c640 1 -- 172.21.15.139:0/2163923486 shutdown_connections 2024-04-26T18:16:18.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30da42c640 1 --2- 172.21.15.139:0/2163923486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d41527f0 0x7f30d415f8b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.698+0000 7f30da42c640 1 -- 172.21.15.139:0/2163923486 >> 172.21.15.139:0/2163923486 conn(0x7f30d4076100 msgr2=0x7f30d4073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.699+0000 7f30da42c640 1 -- 172.21.15.139:0/2163923486 shutdown_connections 2024-04-26T18:16:18.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.699+0000 7f30da42c640 1 -- 172.21.15.139:0/2163923486 wait complete. 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 Processor -- start 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 -- start start 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30d40cc0e0 0x7f30d40cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30d41527f0 0x7f30d415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d415fdf0 0x7f30d41589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30d40cdb00 con 0x7f30d40cc0e0 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f30d415c8e0 con 0x7f30d41527f0 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30da42c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30d415bc70 con 0x7f30d415fdf0 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30d40cc0e0 0x7f30d40cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.700+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30d40cc0e0 0x7f30d40cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34358/0 (socket says 172.21.15.139:34358) 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d3fff640 1 -- 172.21.15.139:0/619283293 learned_addr learned my addr 172.21.15.139:0/619283293 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d89c9640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d415fdf0 0x7f30d41589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d37fe640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30d41527f0 0x7f30d415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d3fff640 1 -- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d415fdf0 msgr2=0x7f30d41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d3fff640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d415fdf0 0x7f30d41589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d3fff640 1 -- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30d41527f0 msgr2=0x7f30d415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d3fff640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30d41527f0 0x7f30d415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d3fff640 1 -- 172.21.15.139:0/619283293 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d41f2dc0 con 0x7f30d40cc0e0 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d37fe640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30d41527f0 0x7f30d415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d3fff640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30d40cc0e0 0x7f30d40cfde0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f30c4035040 tx=0x7f30c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d0ff9640 1 -- 172.21.15.139:0/619283293 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4041020 con 0x7f30d40cc0e0 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d0ff9640 1 -- 172.21.15.139:0/619283293 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c403d720 con 0x7f30d40cc0e0 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d415d2e0 con 0x7f30d40cc0e0 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30d0ff9640 1 -- 172.21.15.139:0/619283293 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4037040 con 0x7f30d40cc0e0 2024-04-26T18:16:18.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.701+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d41f22e0 con 0x7f30d40cc0e0 2024-04-26T18:16:18.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.703+0000 7f30d0ff9640 1 -- 172.21.15.139:0/619283293 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30c4044020 con 0x7f30d40cc0e0 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.703+0000 7f30d0ff9640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f30c006c8f0 0x7f30c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.703+0000 7f30d0ff9640 1 -- 172.21.15.139:0/619283293 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f30c40ac590 con 0x7f30d40cc0e0 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.703+0000 7f30d37fe640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f30c006c8f0 0x7f30c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.704+0000 7f30d37fe640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f30c006c8f0 0x7f30c006edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f30d415b610 tx=0x7f30c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.704+0000 7f30dd220740 1 Processor -- start 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.704+0000 7f30dd220740 1 -- start start 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c02470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730c029b0 0x55f730bc3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30dd220740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730bc4a10 0x55f730bc3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30dd220740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f730b28040 con 0x55f730bc4a10 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55f730ac3b60 con 0x55f730bc34b0 2024-04-26T18:16:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55f730b24000 con 0x55f730c029b0 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730bc4a10 0x55f730bc3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730bc4a10 0x55f730bc3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34370/0 (socket says 172.21.15.139:34370) 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 -- 172.21.15.139:0/221668126 learned_addr learned my addr 172.21.15.139:0/221668126 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d3fff640 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c02470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d37fe640 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730c029b0 0x55f730bc3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 -- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730c029b0 msgr2=0x55f730bc3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730c029b0 0x55f730bc3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 -- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 msgr2=0x55f730c02470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c02470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 -- 172.21.15.139:0/221668126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f730ab89c0 con 0x55f730bc4a10 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d3fff640 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c02470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.705+0000 7f30d89c9640 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730bc4a10 0x55f730bc3dd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006f60 tx=0x7f30cc006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cd1949413c50f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30b9ffb640 1 -- 172.21.15.139:0/221668126 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc012560 con 0x55f730bc4a10 2024-04-26T18:16:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30b9ffb640 1 -- 172.21.15.139:0/221668126 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc018070 con 0x55f730bc4a10 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30b9ffb640 1 -- 172.21.15.139:0/221668126 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc012920 con 0x55f730bc4a10 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 -- 172.21.15.139:0/221668126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730bc4a10 msgr2=0x55f730bc3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730bc4a10 0x55f730bc3dd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006f60 tx=0x7f30cc006f90 comp rx=0 tx=0).stop 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 -- 172.21.15.139:0/221668126 shutdown_connections 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730bc4a10 0x55f730bc3dd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730c029b0 0x55f730bc3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 --2- 172.21.15.139:0/221668126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c02470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 -- 172.21.15.139:0/221668126 >> 172.21.15.139:0/221668126 conn(0x55f730b8a930 msgr2=0x55f730c07450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 -- 172.21.15.139:0/221668126 shutdown_connections 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.706+0000 7f30dd220740 1 -- 172.21.15.139:0/221668126 wait complete. 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.707+0000 7f30dd220740 1 -- start start 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.707+0000 7f30dd220740 1 Processor -- start 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c00490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc4a10 0x55f730bc3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730beaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f730bc1af0 con 0x55f730c029b0 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55f730ac14f0 con 0x55f730bc34b0 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55f730bc5040 con 0x55f730bc4a10 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 10 client.0 _ll_register_callbacks cb 0x55f730b1ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c00490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730beaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d37fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc4a10 0x55f730bc3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c00490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:46790/0 (socket says 172.21.15.139:46790) 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 -- 172.21.15.139:0/2551478391 learned_addr learned my addr 172.21.15.139:0/2551478391 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730beaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34374/0 (socket says 172.21.15.139:34374) 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d37fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc4a10 0x55f730bc3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:53024/0 (socket says 172.21.15.139:53024) 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 -- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc4a10 msgr2=0x55f730bc3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc4a10 0x55f730bc3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 -- 172.21.15.139:0/2551478391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 msgr2=0x55f730beaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730beaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 -- 172.21.15.139:0/2551478391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f730839920 con 0x55f730bc34b0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d89c9640 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730beaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30d3fff640 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c00490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f30c4079e20 tx=0x7f30c402a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363d429b86cb8e62 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30b2ffd640 1 -- 172.21.15.139:0/2551478391 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4097060 con 0x55f730bc34b0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30b2ffd640 1 -- 172.21.15.139:0/2551478391 <== mon.1 v2:172.21.15.143:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f30c40827e0 con 0x55f730bc34b0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30cc018070 con 0x55f730bc34b0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.708+0000 7f30b2ffd640 1 -- 172.21.15.139:0/2551478391 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f30c40aa050 con 0x55f730bc34b0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 10 client.5275 fetch_fsmap learned FSMap version 9 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f730905d30 con 0x55f730bc34b0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30b2ffd640 1 -- 172.21.15.139:0/2551478391 <== mon.1 v2:172.21.15.143:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc018070 con 0x55f730bc34b0 2024-04-26T18:16:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30b2ffd640 1 -- 172.21.15.139:0/2551478391 <== mon.1 v2:172.21.15.143:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f30c403a030 con 0x55f730bc34b0 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 10 client.5275 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 10 client.5275 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 20 client.5275 populate_metadata read hostname 'smithi139' 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730bfaef0 0x55f730beb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 4 client.5275 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f730afba00 con 0x55f730bfaef0 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30d37fe640 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730bfaef0 0x55f730beb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30b2ffd640 10 client.5275 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.709+0000 7f30d37fe640 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730bfaef0 0x55f730beb440 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=112ed0546c23c934 server_cookie=59db08c18eccef33 in_seq=0 out_seq=0 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30b2ffd640 1 -- 172.21.15.139:0/2551478391 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f730afba00 con 0x55f730bfaef0 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30b2ffd640 10 client.5275 handle_command_reply: tid=0 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 client.5275 shutdown 2024-04-26T18:16:18.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 msgr2=0x55f730c00490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c00490 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f30c4079e20 tx=0x7f30c402a7c0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 shutdown_connections 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730beaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730bfaef0 0x55f730beb440 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc4a10 0x55f730bc3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 --2- 172.21.15.139:0/2551478391 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc34b0 0x55f730c00490 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30b2ffd640 0 client.5275 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 >> 172.21.15.139:0/2551478391 conn(0x55f730b8a930 msgr2=0x55f730bbd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 shutdown_connections 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 1 -- 172.21.15.139:0/2551478391 wait complete. 2024-04-26T18:16:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.710+0000 7f30dd220740 20 client.5275 trim_cache size 0 max 16384 2024-04-26T18:16:18.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.727+0000 7f30dd220740 1 Processor -- start 2024-04-26T18:16:18.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.727+0000 7f30dd220740 1 -- start start 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730bbf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30dd220740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c26800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30dd220740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4200620 con 0x55f730c029b0 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41ff500 con 0x55f730bc4a10 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30d41f5c90 con 0x55f730bc34b0 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c26800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c26800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34376/0 (socket says 172.21.15.139:34376) 2024-04-26T18:16:18.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 -- 172.21.15.139:0/196741317 learned_addr learned my addr 172.21.15.139:0/196741317 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d3fff640 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730bbf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d37fe640 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 -- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 msgr2=0x55f730bbf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730bbf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 -- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 msgr2=0x55f730c262c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c262c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.728+0000 7f30d89c9640 1 -- 172.21.15.139:0/196741317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f730c01d00 con 0x55f730c029b0 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30d89c9640 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c26800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x55f730c03a50 tx=0x7f30cc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bddb33b00ce64e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30b97fa640 1 -- 172.21.15.139:0/196741317 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc012760 con 0x55f730c029b0 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30b97fa640 1 -- 172.21.15.139:0/196741317 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc018040 con 0x55f730c029b0 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30b97fa640 1 -- 172.21.15.139:0/196741317 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc012b60 con 0x55f730c029b0 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 -- 172.21.15.139:0/196741317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 msgr2=0x55f730c26800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c26800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x55f730c03a50 tx=0x7f30cc00c000 comp rx=0 tx=0).stop 2024-04-26T18:16:18.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 -- 172.21.15.139:0/196741317 shutdown_connections 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c26800 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c262c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 --2- 172.21.15.139:0/196741317 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730bbf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 -- 172.21.15.139:0/196741317 >> 172.21.15.139:0/196741317 conn(0x55f730b8a930 msgr2=0x55f730c002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 -- 172.21.15.139:0/196741317 shutdown_connections 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.729+0000 7f30dd220740 1 -- 172.21.15.139:0/196741317 wait complete. 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.730+0000 7f30dd220740 1 -- start start 2024-04-26T18:16:18.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.730+0000 7f30dd220740 1 Processor -- start 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730c04420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c7d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c76c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41fe220 con 0x55f730c029b0 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41fee30 con 0x55f730bc4a10 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30d41fe760 con 0x55f730bc34b0 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 10 client.0 _ll_register_callbacks cb 0x7f30c4079c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c76c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c76c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34388/0 (socket says 172.21.15.139:34388) 2024-04-26T18:16:18.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 -- 172.21.15.139:0/999127179 learned_addr learned my addr 172.21.15.139:0/999127179 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d3fff640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730c04420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d37fe640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c7d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 -- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 msgr2=0x55f730c04420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730c04420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 -- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 msgr2=0x55f730c7d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c7d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 -- 172.21.15.139:0/999127179 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f730c7d960 con 0x55f730c029b0 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d3fff640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730c04420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30d89c9640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c76c40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f30cc020040 tx=0x7f30cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43616444d0775503 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30b2ffd640 1 -- 172.21.15.139:0/999127179 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc012d20 con 0x55f730c029b0 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30b2ffd640 1 -- 172.21.15.139:0/999127179 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f30cc005040 con 0x55f730c029b0 2024-04-26T18:16:18.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.731+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30cc018040 con 0x55f730c029b0 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30b2ffd640 1 -- 172.21.15.139:0/999127179 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f30cc03c050 con 0x55f730c029b0 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 10 client.5523 fetch_fsmap learned FSMap version 9 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f730c7cf40 con 0x55f730c029b0 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30b2ffd640 1 -- 172.21.15.139:0/999127179 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc018040 con 0x55f730c029b0 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30b2ffd640 1 -- 172.21.15.139:0/999127179 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f30cc03f020 con 0x55f730c029b0 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 10 client.5523 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 10 client.5523 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 20 client.5523 populate_metadata read hostname 'smithi139' 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730c77180 0x55f730c14eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 4 client.5523 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9227e722", "release": true, "await": true}] 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9227e722", "release": true, "await": true}) -- 0x55f730b35c50 con 0x55f730c77180 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30d3fff640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730c77180 0x55f730c14eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:18.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30b2ffd640 10 client.5523 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.732+0000 7f30d3fff640 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730c77180 0x55f730c14eb0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23a8df893934607a server_cookie=6c337ec4a0c2e988 in_seq=0 out_seq=0 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30b2ffd640 1 -- 172.21.15.139:0/999127179 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55f730b35c50 con 0x55f730c77180 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30b2ffd640 10 client.5523 handle_command_reply: tid=0 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 client.5523 shutdown 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 msgr2=0x55f730c76c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c76c40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f30cc020040 tx=0x7f30cc012000 comp rx=0 tx=0).stop 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 shutdown_connections 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f730c029b0 0x55f730c76c40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f730bc4a10 0x55f730c7d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f730c77180 0x55f730c14eb0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 --2- 172.21.15.139:0/999127179 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f730bc34b0 0x55f730c04420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30b2ffd640 0 client.5523 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:16:18.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 >> 172.21.15.139:0/999127179 conn(0x55f730b8a930 msgr2=0x55f730c002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 shutdown_connections 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 1 -- 172.21.15.139:0/999127179 wait complete. 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30dd220740 20 client.5523 trim_cache size 0 max 16384 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 56, 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "9227e722": { 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 56, 2024-04-26T18:16:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 91.1, 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:16:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:16:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:16:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:16:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:16:18.742 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f30c006c8f0 msgr2=0x7f30c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f30c006c8f0 0x7f30c006edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f30d415b610 tx=0x7f30c8009040 comp rx=0 tx=0).stop 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30d40cc0e0 msgr2=0x7f30d40cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30d40cc0e0 0x7f30d40cfde0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f30c4035040 tx=0x7f30c40046c0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 shutdown_connections 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f30c006c8f0 0x7f30c006edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30d415fdf0 0x7f30d41589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30d41527f0 0x7f30d415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 --2- 172.21.15.139:0/619283293 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30d40cc0e0 0x7f30d40cfde0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.733+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 >> 172.21.15.139:0/619283293 conn(0x7f30d4076100 msgr2=0x7f30d40cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.734+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 shutdown_connections 2024-04-26T18:16:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:16:18.734+0000 7f30da42c640 1 -- 172.21.15.139:0/619283293 wait complete. 2024-04-26T18:16:18.744 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9227e722', seconds elapsed: 33.7 2024-04-26T18:16:24.055 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 61% (113/185) Updating files: 62% (115/185) Updating files: 63% (117/185) Updating files: 64% (119/185) Updating files: 65% (121/185) Updating files: 66% (123/185) Updating files: 67% (124/185) Updating files: 68% (126/185) Updating files: 69% (128/185) Updating files: 70% (130/185) Updating files: 71% (132/185) Updating files: 72% (134/185) Updating files: 73% (136/185) Updating files: 74% (137/185) Updating files: 75% (139/185) Updating files: 76% (141/185) Updating files: 77% (143/185) Updating files: 78% (145/185) Updating files: 79% (147/185) Updating files: 80% (148/185) Updating files: 81% (150/185) Updating files: 82% (152/185) Updating files: 83% (154/185) Updating files: 84% (156/185) Updating files: 85% (158/185) Updating files: 86% (160/185) Updating files: 87% (161/185) Updating files: 88% (163/185) Updating files: 89% (165/185) Updating files: 90% (167/185) Updating files: 91% (169/185) Updating files: 92% (171/185) Updating files: 93% (173/185) Updating files: 94% (174/185) Updating files: 95% (176/185) Updating files: 96% (178/185) Updating files: 97% (180/185) Updating files: 98% (182/185) Updating files: 99% (184/185) Updating files: 100% (185/185) Updating files: 100% (185/185), done. 2024-04-26T18:16:24.930 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 180a4176035 v0.24 2024-04-26T18:16:24.931 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.24 2024-04-26T18:16:24.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:16:24.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 25 -eq 48 ']' 2024-04-26T18:16:24.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.25 2024-04-26T18:16:24.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.25 2024-04-26T18:16:24.945 INFO:tasks.workunit.client.0.smithi139.stdout:v0.25 2024-04-26T18:16:24.946 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.25 2024-04-26T18:16:30.164 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 28% (178/622) Updating files: 29% (181/622) Updating files: 30% (187/622) Updating files: 30% (192/622) Updating files: 31% (193/622) Updating files: 32% (200/622) Updating files: 33% (206/622) Updating files: 34% (212/622) Updating files: 35% (218/622) Updating files: 36% (224/622) Updating files: 37% (231/622) Updating files: 38% (237/622) Updating files: 39% (243/622) Updating files: 40% (249/622) Updating files: 41% (256/622) Updating files: 42% (262/622) Updating files: 43% (268/622) Updating files: 44% (274/622) Updating files: 45% (280/622) Updating files: 46% (287/622) Updating files: 47% (293/622) Updating files: 48% (299/622) Updating files: 49% (305/622) Updating files: 50% (311/622) Updating files: 51% (318/622) Updating files: 52% (324/622) Updating files: 53% (330/622) Updating files: 54% (336/622) Updating files: 55% (343/622) Updating files: 56% (349/622) Updating files: 57% (355/622) Updating files: 58% (361/622) Updating files: 59% (367/622) Updating files: 60% (374/622) Updating files: 61% (380/622) Updating files: 62% (386/622) Updating files: 62% (387/622) Updating files: 63% (392/622) Updating files: 64% (399/622) Updating files: 65% (405/622) Updating files: 66% (411/622) Updating files: 67% (417/622) Updating files: 68% (423/622) Updating files: 69% (430/622) Updating files: 70% (436/622) Updating files: 71% (442/622) Updating files: 72% (448/622) Updating files: 73% (455/622) Updating files: 74% (461/622) Updating files: 75% (467/622) Updating files: 76% (473/622) Updating files: 77% (479/622) Updating files: 78% (486/622) Updating files: 79% (492/622) Updating files: 80% (498/622) Updating files: 81% (504/622) Updating files: 82% (511/622) Updating files: 83% (517/622) Updating files: 84% (523/622) Updating files: 85% (529/622) Updating files: 86% (535/622) Updating files: 86% (540/622) Updating files: 87% (542/622) Updating files: 88% (548/622) Updating files: 89% (554/622) Updating files: 90% (560/622) Updating files: 91% (567/622) Updating files: 92% (573/622) Updating files: 93% (579/622) Updating files: 94% (585/622) Updating files: 95% (591/622) Updating files: 96% (598/622) Updating files: 97% (604/622) Updating files: 98% (610/622) Updating files: 99% (616/622) Updating files: 100% (622/622) Updating files: 100% (622/622), done. 2024-04-26T18:16:30.176 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 3fa121bf0a8 v0.25 2024-04-26T18:16:30.178 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.25 2024-04-26T18:16:30.783 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:16:30.783 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 26 -eq 48 ']' 2024-04-26T18:16:30.784 INFO:tasks.workunit.client.0.smithi139.stdout:v0.26 2024-04-26T18:16:30.784 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.26 2024-04-26T18:16:30.784 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.26 2024-04-26T18:16:30.784 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.26 2024-04-26T18:16:33.441 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 52% (126/239) Updating files: 53% (127/239) Updating files: 54% (130/239) Updating files: 55% (132/239) Updating files: 56% (134/239) Updating files: 57% (137/239) Updating files: 58% (139/239) Updating files: 59% (142/239) Updating files: 60% (144/239) Updating files: 61% (146/239) Updating files: 62% (149/239) Updating files: 63% (151/239) Updating files: 64% (153/239) Updating files: 65% (156/239) Updating files: 66% (158/239) Updating files: 67% (161/239) Updating files: 68% (163/239) Updating files: 69% (165/239) Updating files: 70% (168/239) Updating files: 71% (170/239) Updating files: 72% (173/239) Updating files: 73% (175/239) Updating files: 74% (177/239) Updating files: 75% (180/239) Updating files: 76% (182/239) Updating files: 77% (185/239) Updating files: 78% (187/239) Updating files: 79% (189/239) Updating files: 80% (192/239) Updating files: 81% (194/239) Updating files: 82% (196/239) Updating files: 83% (199/239) Updating files: 84% (201/239) Updating files: 85% (204/239) Updating files: 86% (206/239) Updating files: 87% (208/239) Updating files: 88% (211/239) Updating files: 89% (213/239) Updating files: 90% (216/239) Updating files: 91% (218/239) Updating files: 92% (220/239) Updating files: 93% (223/239) Updating files: 94% (225/239) Updating files: 95% (228/239) Updating files: 96% (230/239) Updating files: 97% (232/239) Updating files: 98% (235/239) Updating files: 99% (237/239) Updating files: 100% (239/239) Updating files: 100% (239/239), done. 2024-04-26T18:16:33.471 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 9981ff90968 v0.26 2024-04-26T18:16:33.473 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.26 2024-04-26T18:16:33.532 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:16:33.532 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 27 -eq 48 ']' 2024-04-26T18:16:33.533 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.27 2024-04-26T18:16:33.533 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.27 2024-04-26T18:16:33.533 INFO:tasks.workunit.client.0.smithi139.stdout:v0.27 2024-04-26T18:16:33.533 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.27 2024-04-26T18:16:38.831 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 6% (17/253) Updating files: 7% (18/253) Updating files: 8% (21/253) Updating files: 9% (23/253) Updating files: 10% (26/253) Updating files: 11% (28/253) Updating files: 12% (31/253) Updating files: 13% (33/253) Updating files: 14% (36/253) Updating files: 15% (38/253) Updating files: 15% (39/253) Updating files: 16% (41/253) Updating files: 17% (44/253) Updating files: 18% (46/253) Updating files: 19% (49/253) Updating files: 20% (51/253) Updating files: 21% (54/253) Updating files: 22% (56/253) Updating files: 23% (59/253) Updating files: 24% (61/253) Updating files: 25% (64/253) Updating files: 26% (66/253) Updating files: 27% (69/253) Updating files: 28% (71/253) Updating files: 29% (74/253) Updating files: 30% (76/253) Updating files: 31% (79/253) Updating files: 32% (81/253) Updating files: 33% (84/253) Updating files: 34% (87/253) Updating files: 35% (89/253) Updating files: 35% (90/253) Updating files: 36% (92/253) Updating files: 37% (94/253) Updating files: 38% (97/253) Updating files: 39% (99/253) Updating files: 40% (102/253) Updating files: 41% (104/253) Updating files: 42% (107/253) Updating files: 43% (109/253) Updating files: 44% (112/253) Updating files: 45% (114/253) Updating files: 46% (117/253) Updating files: 47% (119/253) Updating files: 48% (122/253) Updating files: 49% (124/253) Updating files: 50% (127/253) Updating files: 51% (130/253) Updating files: 52% (132/253) Updating files: 53% (135/253) Updating files: 54% (137/253) Updating files: 55% (140/253) Updating files: 56% (142/253) Updating files: 57% (145/253) Updating files: 58% (147/253) Updating files: 59% (150/253) Updating files: 60% (152/253) Updating files: 61% (155/253) Updating files: 62% (157/253) Updating files: 63% (160/253) Updating files: 64% (162/253) Updating files: 65% (165/253) Updating files: 66% (167/253) Updating files: 67% (170/253) Updating files: 68% (173/253) Updating files: 69% (175/253) Updating files: 70% (178/253) Updating files: 71% (180/253) Updating files: 72% (183/253) Updating files: 73% (185/253) Updating files: 74% (188/253) Updating files: 75% (190/253) Updating files: 76% (193/253) Updating files: 77% (195/253) Updating files: 78% (198/253) Updating files: 79% (200/253) Updating files: 80% (203/253) Updating files: 81% (205/253) Updating files: 82% (208/253) Updating files: 83% (210/253) Updating files: 84% (213/253) Updating files: 85% (216/253) Updating files: 86% (218/253) Updating files: 87% (221/253) Updating files: 88% (223/253) Updating files: 89% (226/253) Updating files: 90% (228/253) Updating files: 91% (231/253) Updating files: 92% (233/253) Updating files: 93% (236/253) Updating files: 94% (238/253) Updating files: 95% (241/253) Updating files: 96% (243/253) Updating files: 97% (246/253) Updating files: 98% (248/253) Updating files: 99% (251/253) Updating files: 100% (253/253) Updating files: 100% (253/253), done. 2024-04-26T18:16:38.861 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 793034c62c8 v0.27 2024-04-26T18:16:38.863 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.27 2024-04-26T18:16:39.008 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:16:39.008 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 28 -eq 48 ']' 2024-04-26T18:16:39.008 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.28 2024-04-26T18:16:39.008 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.28 2024-04-26T18:16:39.009 INFO:tasks.workunit.client.0.smithi139.stdout:v0.28 2024-04-26T18:16:39.009 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.28 2024-04-26T18:16:53.154 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 40% (93/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-04-26T18:16:53.186 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 071881d7e55 v0.28 2024-04-26T18:16:53.188 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.28 2024-04-26T18:16:53.548 INFO:tasks.workunit.client.0.smithi139.stdout:v0.29 2024-04-26T18:16:53.548 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:16:53.548 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 29 -eq 48 ']' 2024-04-26T18:16:53.549 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.29 2024-04-26T18:16:53.549 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.29 2024-04-26T18:16:53.549 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.29 2024-04-26T18:16:56.403 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 36% (58/159) Updating files: 37% (59/159) Updating files: 38% (61/159) Updating files: 39% (63/159) Updating files: 40% (64/159) Updating files: 41% (66/159) Updating files: 42% (67/159) Updating files: 43% (69/159) Updating files: 44% (70/159) Updating files: 45% (72/159) Updating files: 46% (74/159) Updating files: 47% (75/159) Updating files: 48% (77/159) Updating files: 49% (78/159) Updating files: 50% (80/159) Updating files: 51% (82/159) Updating files: 52% (83/159) Updating files: 53% (85/159) Updating files: 54% (86/159) Updating files: 55% (88/159) Updating files: 56% (90/159) Updating files: 57% (91/159) Updating files: 58% (93/159) Updating files: 59% (94/159) Updating files: 60% (96/159) Updating files: 61% (97/159) Updating files: 62% (99/159) Updating files: 63% (101/159) Updating files: 64% (102/159) Updating files: 65% (104/159) Updating files: 66% (105/159) Updating files: 67% (107/159) Updating files: 68% (109/159) Updating files: 69% (110/159) Updating files: 70% (112/159) Updating files: 71% (113/159) Updating files: 72% (115/159) Updating files: 73% (117/159) Updating files: 74% (118/159) Updating files: 75% (120/159) Updating files: 76% (121/159) Updating files: 77% (123/159) Updating files: 78% (125/159) Updating files: 79% (126/159) Updating files: 80% (128/159) Updating files: 81% (129/159) Updating files: 82% (131/159) Updating files: 83% (132/159) Updating files: 84% (134/159) Updating files: 85% (136/159) Updating files: 86% (137/159) Updating files: 87% (139/159) Updating files: 88% (140/159) Updating files: 89% (142/159) Updating files: 90% (144/159) Updating files: 91% (145/159) Updating files: 92% (147/159) Updating files: 93% (148/159) Updating files: 94% (150/159) Updating files: 95% (152/159) Updating files: 96% (153/159) Updating files: 97% (155/159) Updating files: 98% (156/159) Updating files: 99% (158/159) Updating files: 100% (159/159) Updating files: 100% (159/159), done. 2024-04-26T18:16:56.428 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 8e69c39f699 v0.29 2024-04-26T18:16:56.430 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.29 2024-04-26T18:16:56.517 INFO:tasks.workunit.client.0.smithi139.stdout:v0.30 2024-04-26T18:16:56.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:16:56.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 30 -eq 48 ']' 2024-04-26T18:16:56.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.30 2024-04-26T18:16:56.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.30 2024-04-26T18:16:56.518 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.30 2024-04-26T18:17:00.740 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 46% (133/285) Updating files: 47% (134/285) Updating files: 48% (137/285) Updating files: 49% (140/285) Updating files: 50% (143/285) Updating files: 51% (146/285) Updating files: 52% (149/285) Updating files: 53% (152/285) Updating files: 54% (154/285) Updating files: 55% (157/285) Updating files: 56% (160/285) Updating files: 57% (163/285) Updating files: 58% (166/285) Updating files: 59% (169/285) Updating files: 60% (171/285) Updating files: 61% (174/285) Updating files: 62% (177/285) Updating files: 63% (180/285) Updating files: 64% (183/285) Updating files: 65% (186/285) Updating files: 66% (189/285) Updating files: 67% (191/285) Updating files: 68% (194/285) Updating files: 69% (197/285) Updating files: 70% (200/285) Updating files: 71% (203/285) Updating files: 72% (206/285) Updating files: 73% (209/285) Updating files: 74% (211/285) Updating files: 75% (214/285) Updating files: 76% (217/285) Updating files: 77% (220/285) Updating files: 78% (223/285) Updating files: 79% (226/285) Updating files: 80% (228/285) Updating files: 81% (231/285) Updating files: 82% (234/285) Updating files: 83% (237/285) Updating files: 84% (240/285) Updating files: 85% (243/285) Updating files: 86% (246/285) Updating files: 87% (248/285) Updating files: 88% (251/285) Updating files: 89% (254/285) Updating files: 90% (257/285) Updating files: 91% (260/285) Updating files: 92% (263/285) Updating files: 93% (266/285) Updating files: 94% (268/285) Updating files: 95% (271/285) Updating files: 96% (274/285) Updating files: 97% (277/285) Updating files: 98% (280/285) Updating files: 99% (283/285) Updating files: 100% (285/285) Updating files: 100% (285/285), done. 2024-04-26T18:17:01.526 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 64b1b2c70f0 v0.30 2024-04-26T18:17:01.528 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.30 2024-04-26T18:17:01.557 INFO:tasks.workunit.client.0.smithi139.stdout:v0.31 2024-04-26T18:17:01.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:17:01.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 31 -eq 48 ']' 2024-04-26T18:17:01.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.31 2024-04-26T18:17:01.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.31 2024-04-26T18:17:01.557 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.31 2024-04-26T18:17:16.503 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.8 2024-04-26T18:17:16.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:17:16.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.603+0000 7f9929738640 1 Processor -- start 2024-04-26T18:17:16.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.604+0000 7f9929738640 1 -- start start 2024-04-26T18:17:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.604+0000 7f9929738640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f9924156180 0x7f992415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.604+0000 7f9929738640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f99240cd840 0x7f99240c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.604+0000 7f9929738640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992415f2a0 con 0x7f9924155da0 2024-04-26T18:17:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.604+0000 7f9929738640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f992415cbc0 con 0x7f99240cd840 2024-04-26T18:17:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.604+0000 7f9929738640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f99240cc730 con 0x7f9924156180 2024-04-26T18:17:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.604+0000 7f99237fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f99240cd840 0x7f99240c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:16.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99237fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f99240cd840 0x7f99240c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47388/0 (socket says 172.21.15.139:47388) 2024-04-26T18:17:16.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99237fe640 1 -- 172.21.15.139:0/174051416 learned_addr learned my addr 172.21.15.139:0/174051416 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:16.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99227fc640 1 --2- 172.21.15.139:0/174051416 >> v2:172.21.15.143:3300/0 conn(0x7f9924156180 0x7f992415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:16.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99237fe640 1 -- 172.21.15.139:0/174051416 >> v2:172.21.15.143:3300/0 conn(0x7f9924156180 msgr2=0x7f992415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:16.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99237fe640 1 --2- 172.21.15.139:0/174051416 >> v2:172.21.15.143:3300/0 conn(0x7f9924156180 0x7f992415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99237fe640 1 -- 172.21.15.139:0/174051416 >> v1:172.21.15.143:6789/0 conn(0x7f9924155da0 legacy=0x7f99240d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99237fe640 1 -- 172.21.15.139:0/174051416 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992415f580 con 0x7f99240cd840 2024-04-26T18:17:16.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f9921ffb640 1 -- 172.21.15.139:0/174051416 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846438227 0 0) 0x7f992415f2a0 con 0x7f9924155da0 2024-04-26T18:17:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.605+0000 7f99237fe640 1 --2- 172.21.15.139:0/174051416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240c62a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99240cbe80 tx=0x7f991c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8aa95b14c0e102 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:16.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9921ffb640 1 -- 172.21.15.139:0/174051416 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c036070 con 0x7f99240cd840 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9921ffb640 1 -- 172.21.15.139:0/174051416 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c031600 con 0x7f99240cd840 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9921ffb640 1 -- 172.21.15.139:0/174051416 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c0319d0 con 0x7f99240cd840 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 -- 172.21.15.139:0/174051416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 msgr2=0x7f99240c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 --2- 172.21.15.139:0/174051416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240c62a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99240cbe80 tx=0x7f991c02a6a0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 -- 172.21.15.139:0/174051416 shutdown_connections 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 --2- 172.21.15.139:0/174051416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240c62a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 --2- 172.21.15.139:0/174051416 >> v2:172.21.15.143:3300/0 conn(0x7f9924156180 0x7f992415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 -- 172.21.15.139:0/174051416 >> 172.21.15.139:0/174051416 conn(0x7f9924068090 msgr2=0x7f99240684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 -- 172.21.15.139:0/174051416 shutdown_connections 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.606+0000 7f9929738640 1 -- 172.21.15.139:0/174051416 wait complete. 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 Processor -- start 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 -- start start 2024-04-26T18:17:16.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9924155da0 0x7f99241f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99241544f0 0x7f9924145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f99240d19d0 con 0x7f99240cd840 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f992415fb40 con 0x7f9924155da0 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9929738640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f99240d1b50 con 0x7f99241544f0 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9922ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9922ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47394/0 (socket says 172.21.15.139:47394) 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f9922ffd640 1 -- 172.21.15.139:0/949859027 learned_addr learned my addr 172.21.15.139:0/949859027 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f99227fc640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9924155da0 0x7f99241f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.608+0000 7f99237fe640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99241544f0 0x7f9924145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9922ffd640 1 -- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99241544f0 msgr2=0x7f9924145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9922ffd640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99241544f0 0x7f9924145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9922ffd640 1 -- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9924155da0 msgr2=0x7f99241f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9922ffd640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9924155da0 0x7f99241f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9922ffd640 1 -- 172.21.15.139:0/949859027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99240cf270 con 0x7f99240cd840 2024-04-26T18:17:16.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9922ffd640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240cacc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f991800c4b0 tx=0x7f991800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:16.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f990b7fe640 1 -- 172.21.15.139:0/949859027 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918017070 con 0x7f99240cd840 2024-04-26T18:17:16.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f990b7fe640 1 -- 172.21.15.139:0/949859027 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9918005480 con 0x7f99240cd840 2024-04-26T18:17:16.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99241f15b0 con 0x7f99240cd840 2024-04-26T18:17:16.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f990b7fe640 1 -- 172.21.15.139:0/949859027 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9918003830 con 0x7f99240cd840 2024-04-26T18:17:16.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.609+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99241f52f0 con 0x7f99240cd840 2024-04-26T18:17:16.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.610+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9924076d20 con 0x7f99240cd840 2024-04-26T18:17:16.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.610+0000 7f990b7fe640 1 -- 172.21.15.139:0/949859027 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f991801a070 con 0x7f99240cd840 2024-04-26T18:17:16.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.611+0000 7f990b7fe640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f991006c8f0 0x7f991006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.611+0000 7f990b7fe640 1 -- 172.21.15.139:0/949859027 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f991808b2a0 con 0x7f99240cd840 2024-04-26T18:17:16.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.611+0000 7f99227fc640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f991006c8f0 0x7f991006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:16.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.611+0000 7f99227fc640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f991006c8f0 0x7f991006edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99240cb950 tx=0x7f9914009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:16.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.615+0000 7f990b7fe640 1 -- 172.21.15.139:0/949859027 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9918058c20 con 0x7f99240cd840 2024-04-26T18:17:16.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.833+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99240cd330 con 0x7f99240cd840 2024-04-26T18:17:16.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.833+0000 7f990b7fe640 1 -- 172.21.15.139:0/949859027 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f991805cf20 con 0x7f99240cd840 2024-04-26T18:17:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:17:16.835 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:17:16.835 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f991006c8f0 msgr2=0x7f991006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f991006c8f0 0x7f991006edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99240cb950 tx=0x7f9914009190 comp rx=0 tx=0).stop 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 msgr2=0x7f99240cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240cacc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f991800c4b0 tx=0x7f991800c970 comp rx=0 tx=0).stop 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 shutdown_connections 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f991006c8f0 0x7f991006edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f99241544f0 0x7f9924145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9924155da0 0x7f99241f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 --2- 172.21.15.139:0/949859027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99240cd840 0x7f99240cacc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 >> 172.21.15.139:0/949859027 conn(0x7f9924068090 msgr2=0x7f9924068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:16.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 shutdown_connections 2024-04-26T18:17:16.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.836+0000 7f9929738640 1 -- 172.21.15.139:0/949859027 wait complete. 2024-04-26T18:17:16.847 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 73.8 --await-for 42.0' 2024-04-26T18:17:16.847 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 73.8 --await-for 42.0 2024-04-26T18:17:16.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.992+0000 7f4c1d724640 1 Processor -- start 2024-04-26T18:17:16.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.993+0000 7f4c1d724640 1 -- start start 2024-04-26T18:17:16.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.993+0000 7f4c1d724640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4c180c64b0 0x7f4c180c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.993+0000 7f4c1d724640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c18156200 con 0x7f4c18155e20 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.993+0000 7f4c1d724640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c180cd550 con 0x7f4c180c6900 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.993+0000 7f4c1d724640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4c1815c330 con 0x7f4c180c64b0 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.993+0000 7f4c16ffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f4c18155e20 0x7f4c1815bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:37088/0 (socket says 172.21.15.139:37088) 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.993+0000 7f4c16ffd640 1 -- 172.21.15.139:0/2623020838 learned_addr learned my addr 172.21.15.139:0/2623020838 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c167fc640 1 --2- 172.21.15.139:0/2623020838 >> v2:172.21.15.143:3300/0 conn(0x7f4c180c64b0 0x7f4c180c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c15ffb640 1 -- 172.21.15.139:0/2623020838 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110754409 0 0) 0x7f4c18156200 con 0x7f4c18155e20 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c15ffb640 1 -- 172.21.15.139:0/2623020838 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c00003520 con 0x7f4c18155e20 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c15ffb640 1 -- 172.21.15.139:0/2623020838 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739325605 0 0) 0x7f4c180cd550 con 0x7f4c180c6900 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c15ffb640 1 -- 172.21.15.139:0/2623020838 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c18156200 con 0x7f4c180c6900 2024-04-26T18:17:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c167fc640 1 -- 172.21.15.139:0/2623020838 >> v1:172.21.15.143:6789/0 conn(0x7f4c180c6900 legacy=0x7f4c180cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c167fc640 1 -- 172.21.15.139:0/2623020838 >> v1:172.21.15.139:6789/0 conn(0x7f4c18155e20 legacy=0x7f4c1815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.994+0000 7f4c167fc640 1 -- 172.21.15.139:0/2623020838 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1815c610 con 0x7f4c180c64b0 2024-04-26T18:17:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c167fc640 1 --2- 172.21.15.139:0/2623020838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c180c64b0 0x7f4c180c77f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0097a0 tx=0x7f4c0c02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103ce1c8d9237169 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c15ffb640 1 -- 172.21.15.139:0/2623020838 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c037070 con 0x7f4c180c64b0 2024-04-26T18:17:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c15ffb640 1 -- 172.21.15.139:0/2623020838 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c032640 con 0x7f4c180c64b0 2024-04-26T18:17:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c15ffb640 1 -- 172.21.15.139:0/2623020838 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0329f0 con 0x7f4c180c64b0 2024-04-26T18:17:16.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c1d724640 1 -- 172.21.15.139:0/2623020838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c180c64b0 msgr2=0x7f4c180c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:16.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c1d724640 1 --2- 172.21.15.139:0/2623020838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c180c64b0 0x7f4c180c77f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0097a0 tx=0x7f4c0c02a2c0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c1d724640 1 -- 172.21.15.139:0/2623020838 shutdown_connections 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c1d724640 1 --2- 172.21.15.139:0/2623020838 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c180c64b0 0x7f4c180c77f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c1d724640 1 -- 172.21.15.139:0/2623020838 >> 172.21.15.139:0/2623020838 conn(0x7f4c18072930 msgr2=0x7f4c18072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c1d724640 1 -- 172.21.15.139:0/2623020838 shutdown_connections 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.995+0000 7f4c1d724640 1 -- 172.21.15.139:0/2623020838 wait complete. 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.996+0000 7f4c1d724640 1 Processor -- start 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c1d724640 1 -- start start 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c1d724640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c180c64b0 0x7f4c1815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c1d724640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c180c6900 0x7f4c18158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c1d724640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c18155e20 0x7f4c18147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c1d724640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4c180c72d0 con 0x7f4c180c64b0 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c1d724640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4c180c6ff0 con 0x7f4c18155e20 2024-04-26T18:17:16.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c1d724640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c180cc8d0 con 0x7f4c180c6900 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c16ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c180c64b0 0x7f4c1815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c16ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c180c64b0 0x7f4c1815b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47402/0 (socket says 172.21.15.139:47402) 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c16ffd640 1 -- 172.21.15.139:0/187252470 learned_addr learned my addr 172.21.15.139:0/187252470 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c177fe640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c18155e20 0x7f4c18147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.997+0000 7f4c167fc640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c180c6900 0x7f4c18158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c16ffd640 1 -- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c180c6900 msgr2=0x7f4c18158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c180c6900 0x7f4c18158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c16ffd640 1 -- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c18155e20 msgr2=0x7f4c18147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c18155e20 0x7f4c18147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c16ffd640 1 -- 172.21.15.139:0/187252470 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c18151f20 con 0x7f4c180c64b0 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c177fe640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c18155e20 0x7f4c18147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:17:17.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c180c64b0 0x7f4c1815b7c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cbd0 tx=0x7f4c0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:17.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4bff7fe640 1 -- 172.21.15.139:0/187252470 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08017070 con 0x7f4c180c64b0 2024-04-26T18:17:17.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4bff7fe640 1 -- 172.21.15.139:0/187252470 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0800ad60 con 0x7f4c180c64b0 2024-04-26T18:17:17.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c18152200 con 0x7f4c180c64b0 2024-04-26T18:17:17.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4bff7fe640 1 -- 172.21.15.139:0/187252470 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08012640 con 0x7f4c180c64b0 2024-04-26T18:17:17.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.998+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c181527c0 con 0x7f4c180c64b0 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:16.999+0000 7f4bff7fe640 1 -- 172.21.15.139:0/187252470 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c0801a070 con 0x7f4c180c64b0 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.000+0000 7f4bff7fe640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c0406c920 0x7f4c0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.000+0000 7f4bff7fe640 1 -- 172.21.15.139:0/187252470 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4c0808bf80 con 0x7f4c180c64b0 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.000+0000 7f4c167fc640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c0406c920 0x7f4c0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.000+0000 7f4c167fc640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c0406c920 0x7f4c0406ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c034000 tx=0x7f4c0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.001+0000 7f4c20442740 1 Processor -- start 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.001+0000 7f4c20442740 1 -- start start 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc60d15e0 0x55bcc61105a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc6110ae0 0x55bcc60d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c20442740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc60d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c20442740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bcc6034d80 con 0x55bcc60d2b40 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55bcc5fd0c20 con 0x55bcc60d15e0 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55bcc6030d40 con 0x55bcc6110ae0 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc60d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc60d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47404/0 (socket says 172.21.15.139:47404) 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 -- 172.21.15.139:0/863035990 learned_addr learned my addr 172.21.15.139:0/863035990 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc60d15e0 0x55bcc61105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c167fc640 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc6110ae0 0x55bcc60d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 -- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc6110ae0 msgr2=0x55bcc60d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc6110ae0 0x55bcc60d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 -- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc60d15e0 msgr2=0x55bcc61105a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc60d15e0 0x55bcc61105a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 -- 172.21.15.139:0/863035990 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc5e12d80 con 0x55bcc60d2b40 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4c177fe640 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc60d1f00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4c10001c50 tx=0x7f4c10007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2af2a2a29386234 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4bfcff9640 1 -- 172.21.15.139:0/863035990 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000fdf0 con 0x55bcc60d2b40 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4bfcff9640 1 -- 172.21.15.139:0/863035990 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c10018070 con 0x55bcc60d2b40 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.002+0000 7f4bfcff9640 1 -- 172.21.15.139:0/863035990 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c100052d0 con 0x55bcc60d2b40 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 -- 172.21.15.139:0/863035990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 msgr2=0x55bcc60d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc60d1f00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4c10001c50 tx=0x7f4c10007ca0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 -- 172.21.15.139:0/863035990 shutdown_connections 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc60d1f00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc6110ae0 0x55bcc60d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 --2- 172.21.15.139:0/863035990 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc60d15e0 0x55bcc61105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 -- 172.21.15.139:0/863035990 >> 172.21.15.139:0/863035990 conn(0x55bcc6098740 msgr2=0x55bcc6115580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 -- 172.21.15.139:0/863035990 shutdown_connections 2024-04-26T18:17:17.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.003+0000 7f4c20442740 1 -- 172.21.15.139:0/863035990 wait complete. 2024-04-26T18:17:17.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.004+0000 7f4c20442740 1 -- start start 2024-04-26T18:17:17.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.004+0000 7f4c20442740 1 Processor -- start 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc610eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc6125370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc60fbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bcc60cfc20 con 0x55bcc60d15e0 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55bcc5fce840 con 0x55bcc6110ae0 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55bcc60d3170 con 0x55bcc60d2b40 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 10 client.0 _ll_register_callbacks cb 0x55bcc5fd25b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc610eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc610eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47420/0 (socket says 172.21.15.139:47420) 2024-04-26T18:17:17.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c167fc640 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc6125370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 -- 172.21.15.139:0/1379504637 learned_addr learned my addr 172.21.15.139:0/1379504637 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c177fe640 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc60fbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 -- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 msgr2=0x55bcc6125370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc6125370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 -- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 msgr2=0x55bcc60fbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc60fbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 -- 172.21.15.139:0/1379504637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc5e73510 con 0x55bcc60d15e0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc610eb50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4c080012e0 tx=0x7f4c0805dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9062c3fe470f99a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4bf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/1379504637 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c080621c0 con 0x55bcc60d15e0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/1379504637 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4c0805aba0 con 0x55bcc60d15e0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c10018070 con 0x55bcc60d15e0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/1379504637 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4c08057ce0 con 0x55bcc60d15e0 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 10 client.5541 fetch_fsmap learned FSMap version 9 2024-04-26T18:17:17.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.005+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bcc5d06670 con 0x55bcc60d15e0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/1379504637 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c10018070 con 0x55bcc60d15e0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/1379504637 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4c08004b60 con 0x55bcc60d15e0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c20442740 10 client.5541 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c20442740 10 client.5541 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c20442740 20 client.5541 populate_metadata read hostname 'smithi139' 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c20442740 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc60f88a0 0x55bcc60f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c20442740 4 client.5541 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcc6042990 con 0x55bcc60f88a0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c167fc640 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc60f88a0 0x55bcc60f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4bf5ffb640 10 client.5541 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.006+0000 7f4c167fc640 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc60f88a0 0x55bcc60f8cc0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8da50118616d3f3 server_cookie=5b83043b7f0b102a in_seq=0 out_seq=0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/1379504637 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bcc6042990 con 0x55bcc60f88a0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4bf5ffb640 10 client.5541 handle_command_reply: tid=0 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 client.5541 shutdown 2024-04-26T18:17:17.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 msgr2=0x55bcc610eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc610eb50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4c080012e0 tx=0x7f4c0805dce0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 shutdown_connections 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc60fbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc60f88a0 0x55bcc60f8cc0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc6125370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 --2- 172.21.15.139:0/1379504637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc610eb50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4bf5ffb640 0 client.5541 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 >> 172.21.15.139:0/1379504637 conn(0x55bcc6098740 msgr2=0x55bcc60d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 shutdown_connections 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 1 -- 172.21.15.139:0/1379504637 wait complete. 2024-04-26T18:17:17.014 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.007+0000 7f4c20442740 20 client.5541 trim_cache size 0 max 16384 2024-04-26T18:17:17.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.024+0000 7f4c20442740 1 Processor -- start 2024-04-26T18:17:17.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.024+0000 7f4c20442740 1 -- start start 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d15e0 0x55bcc61347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c20442740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc61803d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6180910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c20442740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18200440 con 0x55bcc60d2b40 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4c181ff320 con 0x55bcc6110ae0 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1814f260 con 0x55bcc60d15e0 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc61803d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc61803d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47430/0 (socket says 172.21.15.139:47430) 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 -- 172.21.15.139:0/378591547 learned_addr learned my addr 172.21.15.139:0/378591547 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:17.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d15e0 0x55bcc61347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c177fe640 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6180910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 -- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d15e0 msgr2=0x55bcc61347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d15e0 0x55bcc61347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 -- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 msgr2=0x55bcc6180910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6180910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 -- 172.21.15.139:0/378591547 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc60ceda0 con 0x55bcc60d2b40 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.025+0000 7f4c167fc640 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc61803d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098c0 tx=0x7f4c0c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23aac210b0e6f24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4bf7fff640 1 -- 172.21.15.139:0/378591547 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c037040 con 0x55bcc60d2b40 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4bf7fff640 1 -- 172.21.15.139:0/378591547 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c056070 con 0x55bcc60d2b40 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4bf7fff640 1 -- 172.21.15.139:0/378591547 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c032dd0 con 0x55bcc60d2b40 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 -- 172.21.15.139:0/378591547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 msgr2=0x55bcc61803d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc61803d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098c0 tx=0x7f4c0c02c000 comp rx=0 tx=0).stop 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 -- 172.21.15.139:0/378591547 shutdown_connections 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6180910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d2b40 0x55bcc61803d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 --2- 172.21.15.139:0/378591547 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d15e0 0x55bcc61347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 -- 172.21.15.139:0/378591547 >> 172.21.15.139:0/378591547 conn(0x55bcc6098740 msgr2=0x55bcc60cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:17.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 -- 172.21.15.139:0/378591547 shutdown_connections 2024-04-26T18:17:17.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.026+0000 7f4c20442740 1 -- 172.21.15.139:0/378591547 wait complete. 2024-04-26T18:17:17.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 -- start start 2024-04-26T18:17:17.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 Processor -- start 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc60f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc618f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6182520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4c181fdee0 con 0x55bcc60d15e0 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4c181fec50 con 0x55bcc6110ae0 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c181fe580 con 0x55bcc60d2b40 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c20442740 10 client.0 _ll_register_callbacks cb 0x7f4c0800af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.027+0000 7f4c16ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc60f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc60f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:47432/0 (socket says 172.21.15.139:47432) 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 -- 172.21.15.139:0/3306249765 learned_addr learned my addr 172.21.15.139:0/3306249765 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c167fc640 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc618f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c177fe640 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6182520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 -- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 msgr2=0x55bcc618f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc618f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 -- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 msgr2=0x55bcc6182520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6182520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 -- 172.21.15.139:0/3306249765 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc618fed0 con 0x55bcc60d15e0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c16ffd640 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc60f52c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cba0 tx=0x7f4c08089f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a9b8a0dc8d8faa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4bf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/3306249765 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08075020 con 0x55bcc60d15e0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/3306249765 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4c0805ada0 con 0x55bcc60d15e0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c0c056070 con 0x55bcc60d15e0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/3306249765 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4c08080050 con 0x55bcc60d15e0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 10 client.5547 fetch_fsmap learned FSMap version 9 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bcc6126080 con 0x55bcc60d15e0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/3306249765 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0c056070 con 0x55bcc60d15e0 2024-04-26T18:17:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/3306249765 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4c08083020 con 0x55bcc60d15e0 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 10 client.5547 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 10 client.5547 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 20 client.5547 populate_metadata read hostname 'smithi139' 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc6182a60 0x55bcc60f9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 4 client.5547 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 73.8, "await_for": 42.0}] 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.028+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 73.8, "await_for": 42.0}) -- 0x55bcc603c800 con 0x55bcc6182a60 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.029+0000 7f4c167fc640 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc6182a60 0x55bcc60f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.029+0000 7f4bf5ffb640 10 client.5547 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:17.029+0000 7f4c167fc640 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc6182a60 0x55bcc60f9790 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a860157e56c86a52 server_cookie=3603fe31a83bcb29 in_seq=0 out_seq=0 2024-04-26T18:17:19.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4bf5ffb640 1 -- 172.21.15.139:0/3306249765 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55bcc603c800 con 0x55bcc6182a60 2024-04-26T18:17:19.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4bf5ffb640 10 client.5547 handle_command_reply: tid=0 2024-04-26T18:17:19.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 client.5547 shutdown 2024-04-26T18:17:19.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 msgr2=0x55bcc60f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:19.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc60f52c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cba0 tx=0x7f4c08089f40 comp rx=0 tx=0).stop 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 shutdown_connections 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bcc6110ae0 0x55bcc6182520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bcc6182a60 0x55bcc60f9790 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bcc60d2b40 0x55bcc618f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4c20442740 1 --2- 172.21.15.139:0/3306249765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bcc60d15e0 0x55bcc60f52c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.340+0000 7f4bf5ffb640 0 client.5547 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 >> 172.21.15.139:0/3306249765 conn(0x55bcc6098740 msgr2=0x55bcc6122f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 shutdown_connections 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c20442740 1 -- 172.21.15.139:0/3306249765 wait complete. 2024-04-26T18:17:19.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c20442740 20 client.5547 trim_cache size 0 max 16384 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 58, 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "36318a56": { 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 58, 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:17:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 73.8, 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:19.344 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:17:19.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c0406c920 msgr2=0x7f4c0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:19.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c0406c920 0x7f4c0406ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c034000 tx=0x7f4c0c02e000 comp rx=0 tx=0).stop 2024-04-26T18:17:19.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c180c64b0 msgr2=0x7f4c1815b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:19.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c180c64b0 0x7f4c1815b7c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800cbd0 tx=0x7f4c0800a430 comp rx=0 tx=0).stop 2024-04-26T18:17:19.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 shutdown_connections 2024-04-26T18:17:19.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c0406c920 0x7f4c0406ede0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c18155e20 0x7f4c18147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c180c6900 0x7f4c18158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 --2- 172.21.15.139:0/187252470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c180c64b0 0x7f4c1815b7c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:19.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 >> 172.21.15.139:0/187252470 conn(0x7f4c18072930 msgr2=0x7f4c1815a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:19.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 shutdown_connections 2024-04-26T18:17:19.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:19.341+0000 7f4c1d724640 1 -- 172.21.15.139:0/187252470 wait complete. 2024-04-26T18:17:19.353 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '36318a56', quiesce took 2.9 seconds. Will release after: 13.8 2024-04-26T18:17:33.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:17:33.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.263+0000 7f96625f7640 1 Processor -- start 2024-04-26T18:17:33.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.263+0000 7f96625f7640 1 -- start start 2024-04-26T18:17:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f96625f7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f96625f7640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f965c0c89f0 0x7f965c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f96625f7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965c0736a0 con 0x7f965c0c7c20 2024-04-26T18:17:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f96625f7640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f965c0c62e0 con 0x7f965c0c89f0 2024-04-26T18:17:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f96625f7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f965c073940 con 0x7f965c152cb0 2024-04-26T18:17:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f965c0c89f0 0x7f965c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f965c0c89f0 0x7f965c0c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41798/0 (socket says 172.21.15.139:41798) 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965b7fe640 1 -- 172.21.15.139:0/3898888546 learned_addr learned my addr 172.21.15.139:0/3898888546 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965bfff640 1 --2- 172.21.15.139:0/3898888546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965b7fe640 1 -- 172.21.15.139:0/3898888546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 msgr2=0x7f965c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965b7fe640 1 --2- 172.21.15.139:0/3898888546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965b7fe640 1 -- 172.21.15.139:0/3898888546 >> v1:172.21.15.143:6789/0 conn(0x7f965c0c7c20 legacy=0x7f965c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.264+0000 7f965b7fe640 1 -- 172.21.15.139:0/3898888546 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c0c48c0 con 0x7f965c0c89f0 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.265+0000 7f965b7fe640 1 --2- 172.21.15.139:0/3898888546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c89f0 0x7f965c0c67c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9650009870 tx=0x7f965002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2c685f08401e38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.265+0000 7f965affd640 1 -- 172.21.15.139:0/3898888546 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650037070 con 0x7f965c0c89f0 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.265+0000 7f965affd640 1 -- 172.21.15.139:0/3898888546 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965002ae50 con 0x7f965c0c89f0 2024-04-26T18:17:33.266 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.265+0000 7f965affd640 1 -- 172.21.15.139:0/3898888546 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650032860 con 0x7f965c0c89f0 2024-04-26T18:17:33.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 -- 172.21.15.139:0/3898888546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c89f0 msgr2=0x7f965c0c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 --2- 172.21.15.139:0/3898888546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c89f0 0x7f965c0c67c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9650009870 tx=0x7f965002a300 comp rx=0 tx=0).stop 2024-04-26T18:17:33.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 -- 172.21.15.139:0/3898888546 shutdown_connections 2024-04-26T18:17:33.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 --2- 172.21.15.139:0/3898888546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c89f0 0x7f965c0c67c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 --2- 172.21.15.139:0/3898888546 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 -- 172.21.15.139:0/3898888546 >> 172.21.15.139:0/3898888546 conn(0x7f965c068270 msgr2=0x7f965c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 -- 172.21.15.139:0/3898888546 shutdown_connections 2024-04-26T18:17:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.266+0000 7f96625f7640 1 -- 172.21.15.139:0/3898888546 wait complete. 2024-04-26T18:17:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.267+0000 7f96625f7640 1 Processor -- start 2024-04-26T18:17:33.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.267+0000 7f96625f7640 1 -- start start 2024-04-26T18:17:33.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f96625f7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c7c20 0x7f965c14f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f96625f7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965c0c89f0 0x7f965c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f96625f7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c1f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f96625f7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0c4d20 con 0x7f965c0c7c20 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f96625f7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0c4ba0 con 0x7f965c0c89f0 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f96625f7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f965c0cdb70 con 0x7f965c152cb0 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c7c20 0x7f965c14f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c7c20 0x7f965c14f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41802/0 (socket says 172.21.15.139:41802) 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 -- 172.21.15.139:0/3519426543 learned_addr learned my addr 172.21.15.139:0/3519426543 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f9660b94640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c1f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965b7fe640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965c0c89f0 0x7f965c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 -- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 msgr2=0x7f965c1f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c1f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 -- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965c0c89f0 msgr2=0x7f965c06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965c0c89f0 0x7f965c06fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 -- 172.21.15.139:0/3519426543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c158590 con 0x7f965c0c7c20 2024-04-26T18:17:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.268+0000 7f965bfff640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c7c20 0x7f965c14f9a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f964c00d800 tx=0x7f964c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.269+0000 7f9658ff9640 1 -- 172.21.15.139:0/3519426543 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c00b660 con 0x7f965c0c7c20 2024-04-26T18:17:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.269+0000 7f9658ff9640 1 -- 172.21.15.139:0/3519426543 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964c019070 con 0x7f965c0c7c20 2024-04-26T18:17:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.269+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c0c4380 con 0x7f965c0c7c20 2024-04-26T18:17:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.269+0000 7f9658ff9640 1 -- 172.21.15.139:0/3519426543 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c00ba20 con 0x7f965c0c7c20 2024-04-26T18:17:33.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.269+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c14f030 con 0x7f965c0c7c20 2024-04-26T18:17:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.270+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965c076d20 con 0x7f965c0c7c20 2024-04-26T18:17:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.270+0000 7f9658ff9640 1 -- 172.21.15.139:0/3519426543 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f964c00bbc0 con 0x7f965c0c7c20 2024-04-26T18:17:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.270+0000 7f9658ff9640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f964806c8f0 0x7f964806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.271+0000 7f965b7fe640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f964806c8f0 0x7f964806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.271+0000 7f9658ff9640 1 -- 172.21.15.139:0/3519426543 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f964c08c290 con 0x7f965c0c7c20 2024-04-26T18:17:33.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.271+0000 7f965b7fe640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f964806c8f0 0x7f964806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9650034000 tx=0x7f965002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.275+0000 7f9658ff9640 1 -- 172.21.15.139:0/3519426543 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f964c059c30 con 0x7f965c0c7c20 2024-04-26T18:17:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.490+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f965c069930 con 0x7f965c0c7c20 2024-04-26T18:17:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.490+0000 7f9658ff9640 1 -- 172.21.15.139:0/3519426543 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f964c05df30 con 0x7f965c0c7c20 2024-04-26T18:17:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:17:33.491 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:17:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:17:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f964806c8f0 msgr2=0x7f964806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f964806c8f0 0x7f964806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9650034000 tx=0x7f965002e000 comp rx=0 tx=0).stop 2024-04-26T18:17:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c7c20 msgr2=0x7f965c14f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c7c20 0x7f965c14f9a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f964c00d800 tx=0x7f964c00dcc0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 shutdown_connections 2024-04-26T18:17:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f964806c8f0 0x7f964806edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f965c152cb0 0x7f965c1f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f965c0c89f0 0x7f965c06fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 --2- 172.21.15.139:0/3519426543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f965c0c7c20 0x7f965c14f9a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.492+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 >> 172.21.15.139:0/3519426543 conn(0x7f965c068270 msgr2=0x7f965c148e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.493+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 shutdown_connections 2024-04-26T18:17:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.493+0000 7f96625f7640 1 -- 172.21.15.139:0/3519426543 wait complete. 2024-04-26T18:17:33.504 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 36318a56 --release --await' 2024-04-26T18:17:33.504 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 36318a56 --release --await 2024-04-26T18:17:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.607+0000 7f186df78640 1 Processor -- start 2024-04-26T18:17:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.607+0000 7f186df78640 1 -- start start 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f186df78640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 0x7f1868073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f186df78640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1868073870 con 0x7f1868155c80 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f186df78640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1868073b10 con 0x7f18680cedc0 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f186df78640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f18680cca30 con 0x7f186815c680 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18677fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1868155c80 0x7f18680cb1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:40934/0 (socket says 172.21.15.139:40934) 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18677fe640 1 -- 172.21.15.139:0/517040507 learned_addr learned my addr 172.21.15.139:0/517040507 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760785007 0 0) 0x7f1868073870 con 0x7f1868155c80 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f1867fff640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 0x7f1868073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1850003520 con 0x7f1868155c80 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 386338639 0 0) 0x7f1850003520 con 0x7f1868155c80 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 msgr2=0x7f1868073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 0x7f1868073280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 >> v1:172.21.15.143:6789/0 conn(0x7f18680cedc0 legacy=0x7f186815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18680ccd10 con 0x7f1868155c80 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f1858001670 con 0x7f1868155c80 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f1867fff640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 0x7f1868073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 >> v1:172.21.15.139:6789/0 conn(0x7f1868155c80 legacy=0x7f18680cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 0x7f18500039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1850003fd0 0x7f1850004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f18500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.608+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f18680cca30 con 0x7f1850004d40 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f185000bbb0 con 0x7f1850003fd0 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f185000bdb0 con 0x7f186815c680 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1867fff640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f18500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f18677fe640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 0x7f18500039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1866ffd640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1850003fd0 0x7f1850004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1867fff640 1 -- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 msgr2=0x7f18500039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1867fff640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186815c680 0x7f18500039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1867fff640 1 -- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1850003fd0 msgr2=0x7f1850004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1867fff640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1850003fd0 0x7f1850004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1867fff640 1 -- 172.21.15.139:0/517040507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1850003520 con 0x7f1850004d40 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.609+0000 7f1867fff640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f18500051c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18600073e0 tx=0x7f1850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88209ce209b75681 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860009c80 con 0x7f1850004d40 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186002e660 con 0x7f1850004d40 2024-04-26T18:17:33.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f18667fc640 1 -- 172.21.15.139:0/517040507 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186002ea10 con 0x7f1850004d40 2024-04-26T18:17:33.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f186df78640 1 -- 172.21.15.139:0/517040507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 msgr2=0x7f18500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f186df78640 1 --2- 172.21.15.139:0/517040507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f18500051c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18600073e0 tx=0x7f1850005830 comp rx=0 tx=0).stop 2024-04-26T18:17:33.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f1867fff640 1 -- 172.21.15.139:0/517040507 reap_dead start 2024-04-26T18:17:33.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f186df78640 1 -- 172.21.15.139:0/517040507 shutdown_connections 2024-04-26T18:17:33.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f186df78640 1 -- 172.21.15.139:0/517040507 >> 172.21.15.139:0/517040507 conn(0x7f186806ef00 msgr2=0x7f186806f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f186df78640 1 -- 172.21.15.139:0/517040507 shutdown_connections 2024-04-26T18:17:33.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.610+0000 7f186df78640 1 -- 172.21.15.139:0/517040507 wait complete. 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.611+0000 7f186df78640 1 Processor -- start 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f186df78640 1 -- start start 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f186df78640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f1868159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f186df78640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1868159140 0x7f186814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f186df78640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186814b060 0x7f1868157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f186df78640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f18680cd5b0 con 0x7f1850004d40 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f186df78640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f18680cd2d0 con 0x7f1868159140 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f186df78640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1868156060 con 0x7f186814b060 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f18677fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f1868159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f18677fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f1868159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41820/0 (socket says 172.21.15.139:41820) 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f18677fe640 1 -- 172.21.15.139:0/2269351513 learned_addr learned my addr 172.21.15.139:0/2269351513 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:33.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f1866ffd640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1868159140 0x7f186814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.612+0000 7f1867fff640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186814b060 0x7f1868157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f18677fe640 1 -- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186814b060 msgr2=0x7f1868157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f18677fe640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186814b060 0x7f1868157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f18677fe640 1 -- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1868159140 msgr2=0x7f186814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f18677fe640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1868159140 0x7f186814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f18677fe640 1 -- 172.21.15.139:0/2269351513 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18681e7b40 con 0x7f1850004d40 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f1867fff640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186814b060 0x7f1868157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f18677fe640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f1868159ab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1858007310 tx=0x7f18580077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f184ffff640 1 -- 172.21.15.139:0/2269351513 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185800f9a0 con 0x7f1850004d40 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f184ffff640 1 -- 172.21.15.139:0/2269351513 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1858018070 con 0x7f1850004d40 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18681f19d0 con 0x7f1850004d40 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f184ffff640 1 -- 172.21.15.139:0/2269351513 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185800fda0 con 0x7f1850004d40 2024-04-26T18:17:33.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.613+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18681f1f90 con 0x7f1850004d40 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.614+0000 7f184ffff640 1 -- 172.21.15.139:0/2269351513 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f185801d460 con 0x7f1850004d40 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.615+0000 7f184ffff640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f185406c920 0x7f185406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.615+0000 7f184ffff640 1 -- 172.21.15.139:0/2269351513 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f185808bf40 con 0x7f1850004d40 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.615+0000 7f1866ffd640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f185406c920 0x7f185406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.615+0000 7f1866ffd640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f185406c920 0x7f185406ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f18680710b0 tx=0x7f185c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 Processor -- start 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 -- start start 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4689470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a46899b0 0x5651a464a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a464add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5651a45af040 con 0x5651a464ba10 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5651a454ab60 con 0x5651a464a4b0 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5651a45ab000 con 0x5651a46899b0 2024-04-26T18:17:33.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.616+0000 7f1867fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a464add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a464add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41824/0 (socket says 172.21.15.139:41824) 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 -- 172.21.15.139:0/505275064 learned_addr learned my addr 172.21.15.139:0/505275064 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f18677fe640 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4689470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1866ffd640 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a46899b0 0x5651a464a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 -- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a46899b0 msgr2=0x5651a464a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a46899b0 0x5651a464a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 -- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 msgr2=0x5651a4689470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4689470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 -- 172.21.15.139:0/505275064 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a453f9c0 con 0x5651a464ba10 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f1867fff640 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a464add0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1860007500 tx=0x7f186002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c494bb926efd89fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f184d7fa640 1 -- 172.21.15.139:0/505275064 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860047070 con 0x5651a464ba10 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f184d7fa640 1 -- 172.21.15.139:0/505275064 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186002e660 con 0x5651a464ba10 2024-04-26T18:17:33.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.617+0000 7f184d7fa640 1 -- 172.21.15.139:0/505275064 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186002ea10 con 0x5651a464ba10 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 -- 172.21.15.139:0/505275064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 msgr2=0x5651a464add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a464add0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1860007500 tx=0x7f186002f000 comp rx=0 tx=0).stop 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 -- 172.21.15.139:0/505275064 shutdown_connections 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a464add0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a46899b0 0x5651a464a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 --2- 172.21.15.139:0/505275064 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4689470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 -- 172.21.15.139:0/505275064 >> 172.21.15.139:0/505275064 conn(0x5651a4611930 msgr2=0x5651a468e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 -- 172.21.15.139:0/505275064 shutdown_connections 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 -- 172.21.15.139:0/505275064 wait complete. 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 -- start start 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.618+0000 7f1870d6a740 1 Processor -- start 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4674e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 0x5651a4687900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a46899b0 0x5651a469e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1870d6a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5651a4648af0 con 0x5651a46899b0 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5651a45484f0 con 0x5651a464a4b0 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5651a464c040 con 0x5651a464ba10 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1870d6a740 10 client.0 _ll_register_callbacks cb 0x5651a45a5c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1867fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a46899b0 0x5651a469e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1867fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a46899b0 0x5651a469e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41836/0 (socket says 172.21.15.139:41836) 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1867fff640 1 -- 172.21.15.139:0/3715980230 learned_addr learned my addr 172.21.15.139:0/3715980230 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f1866ffd640 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 0x5651a4687900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.619+0000 7f18677fe640 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4674e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1867fff640 1 -- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 msgr2=0x5651a4687900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1867fff640 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 0x5651a4687900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1867fff640 1 -- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 msgr2=0x5651a4674e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1867fff640 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4674e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1867fff640 1 -- 172.21.15.139:0/3715980230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a42c0920 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1867fff640 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a46899b0 0x5651a469e240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f186002b0e0 tx=0x7f186002d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf23a3467cdd1721 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f18467fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f18467fc640 1 -- 172.21.15.139:0/3715980230 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860047070 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f18467fc640 1 -- 172.21.15.139:0/3715980230 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1860003990 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f186002e660 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f18467fc640 1 -- 172.21.15.139:0/3715980230 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1860054050 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 10 client.5565 fetch_fsmap learned FSMap version 9 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5651a438cd30 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f18467fc640 1 -- 172.21.15.139:0/3715980230 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f186002e660 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f18467fc640 1 -- 172.21.15.139:0/3715980230 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1860057020 con 0x5651a46899b0 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 10 client.5565 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 10 client.5565 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:17:33.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 20 client.5565 populate_metadata read hostname 'smithi139' 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a464afa0 0x5651a46716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 4 client.5565 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.620+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651a4582a00 con 0x5651a464afa0 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.621+0000 7f18677fe640 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a464afa0 0x5651a46716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.621+0000 7f18677fe640 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a464afa0 0x5651a46716e0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef34b81d1f7aa91 server_cookie=d947a4e278190056 in_seq=0 out_seq=0 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.621+0000 7f18467fc640 10 client.5565 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.621+0000 7f18467fc640 1 -- 172.21.15.139:0/3715980230 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5651a4582a00 con 0x5651a464afa0 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.621+0000 7f18467fc640 10 client.5565 handle_command_reply: tid=0 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 client.5565 shutdown 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a46899b0 msgr2=0x5651a469e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a46899b0 0x5651a469e240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f186002b0e0 tx=0x7f186002d000 comp rx=0 tx=0).stop 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 shutdown_connections 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a46899b0 0x5651a469e240 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a464afa0 0x5651a46716e0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 0x5651a4687900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 --2- 172.21.15.139:0/3715980230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a464a4b0 0x5651a4674e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f18467fc640 0 client.5565 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:33.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 >> 172.21.15.139:0/3715980230 conn(0x5651a4611930 msgr2=0x5651a46446c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 shutdown_connections 2024-04-26T18:17:33.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 1 -- 172.21.15.139:0/3715980230 wait complete. 2024-04-26T18:17:33.631 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.622+0000 7f1870d6a740 20 client.5565 trim_cache size 0 max 16384 2024-04-26T18:17:33.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.639+0000 7f1870d6a740 1 Processor -- start 2024-04-26T18:17:33.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.639+0000 7f1870d6a740 1 -- start start 2024-04-26T18:17:33.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464a4b0 0x5651a46ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 0x5651a4647c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f1870d6a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1868200d10 con 0x5651a464a4b0 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ffbf0 con 0x5651a46899b0 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f18681fe150 con 0x5651a464ba10 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464a4b0 0x5651a46ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464a4b0 0x5651a46ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41846/0 (socket says 172.21.15.139:41846) 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 -- 172.21.15.139:0/4111746359 learned_addr learned my addr 172.21.15.139:0/4111746359 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 -- 172.21.15.139:0/4111746359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 msgr2=0x5651a4647c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 0x5651a4647c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 -- 172.21.15.139:0/4111746359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 msgr2=0x5651a46481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f1867fff640 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 -- 172.21.15.139:0/4111746359 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a4646f10 con 0x5651a464a4b0 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f18677fe640 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464a4b0 0x5651a46ae8d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1858059850 tx=0x7f1858089f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fef392205654903 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f184cff9640 1 -- 172.21.15.139:0/4111746359 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18580624a0 con 0x5651a464a4b0 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f184cff9640 1 -- 172.21.15.139:0/4111746359 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185808a140 con 0x5651a464a4b0 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.640+0000 7f184cff9640 1 -- 172.21.15.139:0/4111746359 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858057bc0 con 0x5651a464a4b0 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 -- 172.21.15.139:0/4111746359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464a4b0 msgr2=0x5651a46ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464a4b0 0x5651a46ae8d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1858059850 tx=0x7f1858089f90 comp rx=0 tx=0).stop 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 -- 172.21.15.139:0/4111746359 shutdown_connections 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464ba10 0x5651a4647c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 --2- 172.21.15.139:0/4111746359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464a4b0 0x5651a46ae8d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 -- 172.21.15.139:0/4111746359 >> 172.21.15.139:0/4111746359 conn(0x5651a4611930 msgr2=0x5651a46404b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 -- 172.21.15.139:0/4111746359 shutdown_connections 2024-04-26T18:17:33.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.641+0000 7f1870d6a740 1 -- 172.21.15.139:0/4111746359 wait complete. 2024-04-26T18:17:33.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 -- start start 2024-04-26T18:17:33.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 Processor -- start 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464a4b0 0x5651a469c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a4685780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46fe190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f18681fe7a0 con 0x5651a464ba10 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ff520 con 0x5651a46899b0 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f18681fee50 con 0x5651a464a4b0 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1870d6a740 10 client.0 _ll_register_callbacks cb 0x7f1860045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a4685780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a4685780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41858/0 (socket says 172.21.15.139:41858) 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1866ffd640 1 -- 172.21.15.139:0/2783789499 learned_addr learned my addr 172.21.15.139:0/2783789499 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:33.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f1867fff640 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46fe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.642+0000 7f18677fe640 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464a4b0 0x5651a469c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1866ffd640 1 -- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464a4b0 msgr2=0x5651a469c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1866ffd640 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464a4b0 0x5651a469c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1866ffd640 1 -- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 msgr2=0x5651a46fe190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1866ffd640 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46fe190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1866ffd640 1 -- 172.21.15.139:0/2783789499 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a4688c50 con 0x5651a464ba10 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1866ffd640 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a4685780 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f185c001eb0 tx=0x7f185c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c8383fc0a95a7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f18467fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f18467fc640 1 -- 172.21.15.139:0/2783789499 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c019040 con 0x5651a464ba10 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f18467fc640 1 -- 172.21.15.139:0/2783789499 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f185c010040 con 0x5651a464ba10 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f185808a140 con 0x5651a464ba10 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f18467fc640 1 -- 172.21.15.139:0/2783789499 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f185c022600 con 0x5651a464ba10 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 10 client.5571 fetch_fsmap learned FSMap version 9 2024-04-26T18:17:33.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5651a468e7d0 con 0x5651a464ba10 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f18467fc640 1 -- 172.21.15.139:0/2783789499 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185808a140 con 0x5651a464ba10 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f18467fc640 1 -- 172.21.15.139:0/2783789499 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f185c0227a0 con 0x5651a464ba10 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 10 client.5571 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 10 client.5571 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 20 client.5571 populate_metadata read hostname 'smithi139' 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a4686980 0x5651a46fe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 4 client.5571 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "36318a56", "release": true, "await": true}] 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.643+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "36318a56", "release": true, "await": true}) -- 0x5651a45bcc50 con 0x5651a4686980 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f18677fe640 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a4686980 0x5651a46fe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f18467fc640 10 client.5571 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f18677fe640 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a4686980 0x5651a46fe6d0 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39f39e05ea497e7a server_cookie=cf552e928577d302 in_seq=0 out_seq=0 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f18467fc640 1 -- 172.21.15.139:0/2783789499 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5651a45bcc50 con 0x5651a4686980 2024-04-26T18:17:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f18467fc640 10 client.5571 handle_command_reply: tid=0 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 client.5571 shutdown 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 msgr2=0x5651a4685780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a4685780 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f185c001eb0 tx=0x7f185c007c80 comp rx=0 tx=0).stop 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 shutdown_connections 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5651a46899b0 0x5651a46fe190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5651a464ba10 0x5651a4685780 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5651a4686980 0x5651a46fe6d0 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 --2- 172.21.15.139:0/2783789499 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5651a464a4b0 0x5651a469c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f18467fc640 0 client.5571 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.644+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 >> 172.21.15.139:0/2783789499 conn(0x5651a4611930 msgr2=0x5651a46404b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 shutdown_connections 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f1870d6a740 1 -- 172.21.15.139:0/2783789499 wait complete. 2024-04-26T18:17:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f1870d6a740 20 client.5571 trim_cache size 0 max 16384 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 60, 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "36318a56": { 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 60, 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:17:33.652 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 73.8, 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:33.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:33.654 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:17:33.654 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:17:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f185406c920 msgr2=0x7f185406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f185406c920 0x7f185406ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f18680710b0 tx=0x7f185c009040 comp rx=0 tx=0).stop 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 msgr2=0x7f1868159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f1868159ab0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1858007310 tx=0x7f18580077d0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 shutdown_connections 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f185406c920 0x7f185406ede0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f186814b060 0x7f1868157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1868159140 0x7f186814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 --2- 172.21.15.139:0/2269351513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1850004d40 0x7f1868159ab0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 >> 172.21.15.139:0/2269351513 conn(0x7f186806ef00 msgr2=0x7f18680ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 shutdown_connections 2024-04-26T18:17:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:33.645+0000 7f186df78640 1 -- 172.21.15.139:0/2269351513 wait complete. 2024-04-26T18:17:33.656 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '36318a56', seconds elapsed: 17.2 2024-04-26T18:17:35.282 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 28% (114/398) Updating files: 29% (116/398) Updating files: 30% (120/398) Updating files: 31% (124/398) Updating files: 32% (128/398) Updating files: 33% (132/398) Updating files: 34% (136/398) Updating files: 35% (140/398) Updating files: 36% (144/398) Updating files: 37% (148/398) Updating files: 38% (152/398) Updating files: 39% (156/398) Updating files: 40% (160/398) Updating files: 41% (164/398) Updating files: 42% (168/398) Updating files: 43% (172/398) Updating files: 44% (176/398) Updating files: 45% (180/398) Updating files: 46% (184/398) Updating files: 47% (188/398) Updating files: 48% (192/398) Updating files: 49% (196/398) Updating files: 50% (199/398) Updating files: 51% (203/398) Updating files: 52% (207/398) Updating files: 53% (211/398) Updating files: 54% (215/398) Updating files: 55% (219/398) Updating files: 56% (223/398) Updating files: 57% (227/398) Updating files: 58% (231/398) Updating files: 59% (235/398) Updating files: 60% (239/398) Updating files: 61% (243/398) Updating files: 62% (247/398) Updating files: 63% (251/398) Updating files: 64% (255/398) Updating files: 65% (259/398) Updating files: 66% (263/398) Updating files: 67% (267/398) Updating files: 68% (271/398) Updating files: 69% (275/398) Updating files: 69% (276/398) Updating files: 70% (279/398) Updating files: 70% (280/398) Updating files: 71% (283/398) Updating files: 72% (287/398) Updating files: 73% (291/398) Updating files: 74% (295/398) Updating files: 75% (299/398) Updating files: 76% (303/398) Updating files: 77% (307/398) Updating files: 78% (311/398) Updating files: 79% (315/398) Updating files: 80% (319/398) Updating files: 80% (321/398) Updating files: 81% (323/398) Updating files: 82% (327/398) Updating files: 83% (331/398) Updating files: 84% (335/398) Updating files: 85% (339/398) Updating files: 86% (343/398) Updating files: 87% (347/398) Updating files: 88% (351/398) Updating files: 89% (355/398) Updating files: 90% (359/398) Updating files: 91% (363/398) Updating files: 92% (367/398) Updating files: 93% (371/398) Updating files: 94% (375/398) Updating files: 95% (379/398) Updating files: 96% (383/398) Updating files: 97% (387/398) Updating files: 98% (391/398) Updating files: 99% (395/398) Updating files: 100% (398/398) Updating files: 100% (398/398), done. 2024-04-26T18:17:36.828 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 9019c6ce640 v0.31 2024-04-26T18:17:36.854 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.31 2024-04-26T18:17:36.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:17:36.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 32 -eq 48 ']' 2024-04-26T18:17:36.868 INFO:tasks.workunit.client.0.smithi139.stdout:v0.32 2024-04-26T18:17:36.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.32 2024-04-26T18:17:36.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.32 2024-04-26T18:17:36.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.32 2024-04-26T18:17:45.663 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 21% (41/195) Updating files: 22% (43/195) Updating files: 23% (45/195) Updating files: 24% (47/195) Updating files: 25% (49/195) Updating files: 26% (51/195) Updating files: 27% (53/195) Updating files: 28% (55/195) Updating files: 29% (57/195) Updating files: 30% (59/195) Updating files: 31% (61/195) Updating files: 32% (63/195) Updating files: 33% (65/195) Updating files: 34% (67/195) Updating files: 35% (69/195) Updating files: 36% (71/195) Updating files: 37% (73/195) Updating files: 38% (75/195) Updating files: 39% (77/195) Updating files: 40% (78/195) Updating files: 41% (80/195) Updating files: 42% (82/195) Updating files: 43% (84/195) Updating files: 44% (86/195) Updating files: 45% (88/195) Updating files: 46% (90/195) Updating files: 47% (92/195) Updating files: 48% (94/195) Updating files: 49% (96/195) Updating files: 50% (98/195) Updating files: 51% (100/195) Updating files: 52% (102/195) Updating files: 53% (104/195) Updating files: 54% (106/195) Updating files: 55% (108/195) Updating files: 56% (110/195) Updating files: 57% (112/195) Updating files: 58% (114/195) Updating files: 59% (116/195) Updating files: 60% (117/195) Updating files: 61% (119/195) Updating files: 62% (121/195) Updating files: 63% (123/195) Updating files: 64% (125/195) Updating files: 65% (127/195) Updating files: 66% (129/195) Updating files: 67% (131/195) Updating files: 68% (133/195) Updating files: 69% (135/195) Updating files: 70% (137/195) Updating files: 71% (139/195) Updating files: 72% (141/195) Updating files: 73% (143/195) Updating files: 74% (145/195) Updating files: 75% (147/195) Updating files: 76% (149/195) Updating files: 77% (151/195) Updating files: 78% (153/195) Updating files: 79% (155/195) Updating files: 80% (156/195) Updating files: 81% (158/195) Updating files: 82% (160/195) Updating files: 83% (162/195) Updating files: 84% (164/195) Updating files: 85% (166/195) Updating files: 86% (168/195) Updating files: 87% (170/195) Updating files: 88% (172/195) Updating files: 89% (174/195) Updating files: 90% (176/195) Updating files: 91% (178/195) Updating files: 92% (180/195) Updating files: 93% (182/195) Updating files: 94% (184/195) Updating files: 95% (186/195) Updating files: 96% (188/195) Updating files: 97% (190/195) Updating files: 98% (192/195) Updating files: 99% (194/195) Updating files: 100% (195/195) Updating files: 100% (195/195), done. 2024-04-26T18:17:46.601 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at c08d08baa6a v0.32 2024-04-26T18:17:46.603 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.32 2024-04-26T18:17:46.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:17:46.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 33 -eq 48 ']' 2024-04-26T18:17:46.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.33 2024-04-26T18:17:46.614 INFO:tasks.workunit.client.0.smithi139.stdout:v0.33 2024-04-26T18:17:46.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.33 2024-04-26T18:17:46.615 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.33 2024-04-26T18:17:47.913 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 65% (105/160) Updating files: 66% (106/160) Updating files: 67% (108/160) Updating files: 68% (109/160) Updating files: 69% (111/160) Updating files: 70% (112/160) Updating files: 71% (114/160) Updating files: 72% (116/160) Updating files: 73% (117/160) Updating files: 74% (119/160) Updating files: 75% (120/160) Updating files: 76% (122/160) Updating files: 77% (124/160) Updating files: 78% (125/160) Updating files: 79% (127/160) Updating files: 80% (128/160) Updating files: 81% (130/160) Updating files: 82% (132/160) Updating files: 83% (133/160) Updating files: 84% (135/160) Updating files: 85% (136/160) Updating files: 86% (138/160) Updating files: 87% (140/160) Updating files: 88% (141/160) Updating files: 89% (143/160) Updating files: 90% (144/160) Updating files: 91% (146/160) Updating files: 92% (148/160) Updating files: 93% (149/160) Updating files: 94% (151/160) Updating files: 95% (152/160) Updating files: 96% (154/160) Updating files: 97% (156/160) Updating files: 98% (157/160) Updating files: 99% (159/160) Updating files: 100% (160/160) Updating files: 100% (160/160), done. 2024-04-26T18:17:47.947 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 340b4348bf6 v0.33 2024-04-26T18:17:47.948 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.33 2024-04-26T18:17:47.986 INFO:tasks.workunit.client.0.smithi139.stdout:v0.34 2024-04-26T18:17:47.987 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:17:47.987 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 34 -eq 48 ']' 2024-04-26T18:17:47.987 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.34 2024-04-26T18:17:47.987 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.34 2024-04-26T18:17:47.987 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.34 2024-04-26T18:17:49.089 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 78% (101/129) Updating files: 79% (102/129) Updating files: 80% (104/129) Updating files: 81% (105/129) Updating files: 82% (106/129) Updating files: 83% (108/129) Updating files: 84% (109/129) Updating files: 85% (110/129) Updating files: 86% (111/129) Updating files: 87% (113/129) Updating files: 88% (114/129) Updating files: 89% (115/129) Updating files: 90% (117/129) Updating files: 91% (118/129) Updating files: 92% (119/129) Updating files: 93% (120/129) Updating files: 94% (122/129) Updating files: 95% (123/129) Updating files: 96% (124/129) Updating files: 97% (126/129) Updating files: 98% (127/129) Updating files: 99% (128/129) Updating files: 100% (129/129) Updating files: 100% (129/129), done. 2024-04-26T18:17:49.504 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 2f039eeeb74 v0.34 2024-04-26T18:17:49.505 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.34 2024-04-26T18:17:49.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:17:49.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 35 -eq 48 ']' 2024-04-26T18:17:49.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.35 2024-04-26T18:17:49.517 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.35 2024-04-26T18:17:49.518 INFO:tasks.workunit.client.0.smithi139.stdout:v0.35 2024-04-26T18:17:49.519 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.35 2024-04-26T18:17:59.118 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:17:59.122 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:17:59.286 INFO:tasks.quiescer.fs.[cephfs]:Total duration (47.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:17:59.286 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.7 2024-04-26T18:17:59.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:17:59.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.395+0000 7fde860da640 1 Processor -- start 2024-04-26T18:17:59.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.395+0000 7fde860da640 1 -- start start 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.395+0000 7fde860da640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fde800cd840 0x7fde8015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.395+0000 7fde860da640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8015f2a0 con 0x7fde80155da0 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.395+0000 7fde860da640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8015f580 con 0x7fde80156180 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.395+0000 7fde860da640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fde8015cbc0 con 0x7fde800cd840 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.396+0000 7fde7ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fde800cd840 0x7fde8015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.396+0000 7fde7f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fde80155da0 0x7fde800d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:41078/0 (socket says 172.21.15.139:41078) 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.396+0000 7fde7ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fde800cd840 0x7fde8015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36246/0 (socket says 172.21.15.139:36246) 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.396+0000 7fde7f7fe640 1 -- 172.21.15.139:0/1587040855 learned_addr learned my addr 172.21.15.139:0/1587040855 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.396+0000 7fde7ffff640 1 -- 172.21.15.139:0/1587040855 >> v1:172.21.15.143:6789/0 conn(0x7fde80156180 legacy=0x7fde800c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.396+0000 7fde7ffff640 1 -- 172.21.15.139:0/1587040855 >> v1:172.21.15.139:6789/0 conn(0x7fde80155da0 legacy=0x7fde800d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.396+0000 7fde7ffff640 1 -- 172.21.15.139:0/1587040855 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8015f860 con 0x7fde800cd840 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde7ffff640 1 --2- 172.21.15.139:0/1587040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cd840 0x7fde8015c680 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde78009d90 tx=0x7fde7802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0f8b7210da4509 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde7e7fc640 1 -- 172.21.15.139:0/1587040855 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78007740 con 0x7fde800cd840 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde7e7fc640 1 -- 172.21.15.139:0/1587040855 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde780078e0 con 0x7fde800cd840 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde7e7fc640 1 -- 172.21.15.139:0/1587040855 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78007cb0 con 0x7fde800cd840 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde860da640 1 -- 172.21.15.139:0/1587040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cd840 msgr2=0x7fde8015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde860da640 1 --2- 172.21.15.139:0/1587040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cd840 0x7fde8015c680 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde78009d90 tx=0x7fde7802a660 comp rx=0 tx=0).stop 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde860da640 1 -- 172.21.15.139:0/1587040855 shutdown_connections 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde860da640 1 --2- 172.21.15.139:0/1587040855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cd840 0x7fde8015c680 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde860da640 1 -- 172.21.15.139:0/1587040855 >> 172.21.15.139:0/1587040855 conn(0x7fde80068090 msgr2=0x7fde800684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde860da640 1 -- 172.21.15.139:0/1587040855 shutdown_connections 2024-04-26T18:17:59.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.397+0000 7fde860da640 1 -- 172.21.15.139:0/1587040855 wait complete. 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.398+0000 7fde860da640 1 Processor -- start 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.399+0000 7fde860da640 1 -- start start 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.399+0000 7fde860da640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde800cd840 0x7fde801f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.399+0000 7fde860da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde80155da0 0x7fde80153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.399+0000 7fde860da640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cf210 0x7fde80151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.399+0000 7fde860da640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fde800d19d0 con 0x7fde800cf210 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.399+0000 7fde860da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fde800cc730 con 0x7fde80155da0 2024-04-26T18:17:59.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.399+0000 7fde860da640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fde800d1b50 con 0x7fde800cd840 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cf210 0x7fde80151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cf210 0x7fde80151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36254/0 (socket says 172.21.15.139:36254) 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 -- 172.21.15.139:0/1034013 learned_addr learned my addr 172.21.15.139:0/1034013 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7effd640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde80155da0 0x7fde80153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 -- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde800cd840 msgr2=0x7fde801f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde800cd840 0x7fde801f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 -- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde80155da0 msgr2=0x7fde80153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde80155da0 0x7fde80153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 -- 172.21.15.139:0/1034013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde801f55b0 con 0x7fde800cf210 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7effd640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde80155da0 0x7fde80153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde7ffff640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cf210 0x7fde80151980 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fde78009eb0 tx=0x7fde78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde67fff640 1 -- 172.21.15.139:0/1034013 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7803f070 con 0x7fde800cf210 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde67fff640 1 -- 172.21.15.139:0/1034013 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde78031c90 con 0x7fde800cf210 2024-04-26T18:17:59.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde801f5870 con 0x7fde800cf210 2024-04-26T18:17:59.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde67fff640 1 -- 172.21.15.139:0/1034013 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78044680 con 0x7fde800cf210 2024-04-26T18:17:59.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.400+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde801f1b30 con 0x7fde800cf210 2024-04-26T18:17:59.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.401+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde80076d20 con 0x7fde800cf210 2024-04-26T18:17:59.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.402+0000 7fde67fff640 1 -- 172.21.15.139:0/1034013 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde7803b410 con 0x7fde800cf210 2024-04-26T18:17:59.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.402+0000 7fde67fff640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fde6c06c8f0 0x7fde6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.402+0000 7fde67fff640 1 -- 172.21.15.139:0/1034013 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fde780ad8b0 con 0x7fde800cf210 2024-04-26T18:17:59.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.402+0000 7fde7f7fe640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fde6c06c8f0 0x7fde6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.403+0000 7fde7f7fe640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fde6c06c8f0 0x7fde6c06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fde700015f0 tx=0x7fde70007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.407+0000 7fde67fff640 1 -- 172.21.15.139:0/1034013 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde7807b310 con 0x7fde800cf210 2024-04-26T18:17:59.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.618+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde800cd330 con 0x7fde800cf210 2024-04-26T18:17:59.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.619+0000 7fde67fff640 1 -- 172.21.15.139:0/1034013 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fde7807f610 con 0x7fde800cf210 2024-04-26T18:17:59.619 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:17:59.619 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:17:59.619 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:17:59.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fde6c06c8f0 msgr2=0x7fde6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fde6c06c8f0 0x7fde6c06edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fde700015f0 tx=0x7fde70007a40 comp rx=0 tx=0).stop 2024-04-26T18:17:59.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cf210 msgr2=0x7fde80151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cf210 0x7fde80151980 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fde78009eb0 tx=0x7fde78004a40 comp rx=0 tx=0).stop 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 shutdown_connections 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fde6c06c8f0 0x7fde6c06edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde800cf210 0x7fde80151980 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde80155da0 0x7fde80153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 --2- 172.21.15.139:0/1034013 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fde800cd840 0x7fde801f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 >> 172.21.15.139:0/1034013 conn(0x7fde80068090 msgr2=0x7fde8015c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 shutdown_connections 2024-04-26T18:17:59.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.621+0000 7fde860da640 1 -- 172.21.15.139:0/1034013 wait complete. 2024-04-26T18:17:59.632 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 83.7 --await-for 42.0' 2024-04-26T18:17:59.632 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 83.7 --await-for 42.0 2024-04-26T18:17:59.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.738+0000 7f406d7c1640 1 Processor -- start 2024-04-26T18:17:59.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.738+0000 7f406d7c1640 1 -- start start 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f406d7c1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f40680d14b0 0x7f40680d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f406d7c1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f40680cf260 0x7f40680d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f406d7c1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40680d07e0 con 0x7f406815c2a0 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f406d7c1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f4068160170 con 0x7f40680cf260 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f406d7c1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f406815be10 con 0x7f40680d14b0 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40667fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f40680cf260 0x7f40680d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40677fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f406815c2a0 0x7f40680cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:48628/0 (socket says 172.21.15.139:48628) 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40667fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f40680cf260 0x7f40680d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49472/0 (socket says 172.21.15.139:49472) 2024-04-26T18:17:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40677fe640 1 -- 172.21.15.139:0/2991018342 learned_addr learned my addr 172.21.15.139:0/2991018342 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f4066ffd640 1 --2- 172.21.15.139:0/2991018342 >> v2:172.21.15.143:3300/0 conn(0x7f40680d14b0 0x7f40680d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40667fc640 1 -- 172.21.15.139:0/2991018342 >> v2:172.21.15.143:3300/0 conn(0x7f40680d14b0 msgr2=0x7f40680d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40667fc640 1 --2- 172.21.15.139:0/2991018342 >> v2:172.21.15.143:3300/0 conn(0x7f40680d14b0 0x7f40680d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40667fc640 1 -- 172.21.15.139:0/2991018342 >> v1:172.21.15.139:6789/0 conn(0x7f406815c2a0 legacy=0x7f40680cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.739+0000 7f40667fc640 1 -- 172.21.15.139:0/2991018342 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406815f5f0 con 0x7f40680cf260 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.740+0000 7f40667fc640 1 --2- 172.21.15.139:0/2991018342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f40680d02a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4068072cc0 tx=0x7f405c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214349460bf2a5a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.740+0000 7f4065ffb640 1 -- 172.21.15.139:0/2991018342 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c037070 con 0x7f40680cf260 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.740+0000 7f4065ffb640 1 -- 172.21.15.139:0/2991018342 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c032440 con 0x7f40680cf260 2024-04-26T18:17:59.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.740+0000 7f4065ffb640 1 -- 172.21.15.139:0/2991018342 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c032810 con 0x7f40680cf260 2024-04-26T18:17:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 -- 172.21.15.139:0/2991018342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 msgr2=0x7f40680d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 --2- 172.21.15.139:0/2991018342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f40680d02a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4068072cc0 tx=0x7f405c02a1a0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 -- 172.21.15.139:0/2991018342 shutdown_connections 2024-04-26T18:17:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 --2- 172.21.15.139:0/2991018342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f40680d02a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 --2- 172.21.15.139:0/2991018342 >> v2:172.21.15.143:3300/0 conn(0x7f40680d14b0 0x7f40680d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 -- 172.21.15.139:0/2991018342 >> 172.21.15.139:0/2991018342 conn(0x7f4068073c70 msgr2=0x7f4068074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 -- 172.21.15.139:0/2991018342 shutdown_connections 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.741+0000 7f406d7c1640 1 -- 172.21.15.139:0/2991018342 wait complete. 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.742+0000 7f406d7c1640 1 Processor -- start 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.742+0000 7f406d7c1640 1 -- start start 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f4068150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40680d14b0 0x7f406815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f406815c2a0 0x7f40681f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f406815fe90 con 0x7f40680cf260 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f406815fbb0 con 0x7f40680d14b0 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f406815f1d0 con 0x7f406815c2a0 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f4068150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f4068150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49480/0 (socket says 172.21.15.139:49480) 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 -- 172.21.15.139:0/1999093001 learned_addr learned my addr 172.21.15.139:0/1999093001 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f40667fc640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40680d14b0 0x7f406815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f40677fe640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f406815c2a0 0x7f40681f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 -- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f406815c2a0 msgr2=0x7f40681f13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f406815c2a0 0x7f40681f13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 -- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40680d14b0 msgr2=0x7f406815e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40680d14b0 0x7f406815e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 -- 172.21.15.139:0/1999093001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4068159ab0 con 0x7f40680cf260 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f4066ffd640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f4068150de0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4058007e40 tx=0x7f405800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f404f7fe640 1 -- 172.21.15.139:0/1999093001 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058014620 con 0x7f40680cf260 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f404f7fe640 1 -- 172.21.15.139:0/1999093001 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4058019070 con 0x7f40680cf260 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40681f49c0 con 0x7f40680cf260 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f404f7fe640 1 -- 172.21.15.139:0/1999093001 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058014a00 con 0x7f40680cf260 2024-04-26T18:17:59.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.743+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40681f4f80 con 0x7f40680cf260 2024-04-26T18:17:59.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.745+0000 7f404f7fe640 1 -- 172.21.15.139:0/1999093001 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4058014ba0 con 0x7f40680cf260 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.746+0000 7f404f7fe640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f405406c8f0 0x7f405406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.746+0000 7f40667fc640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f405406c8f0 0x7f405406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.746+0000 7f404f7fe640 1 -- 172.21.15.139:0/1999093001 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f405808c670 con 0x7f40680cf260 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.746+0000 7f40667fc640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f405406c8f0 0x7f405406edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f405c034000 tx=0x7f405c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.746+0000 7f40705b4740 1 Processor -- start 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f40705b4740 1 -- start start 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f40705b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf9f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf61b40 0x55b48bf60f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f40705b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b48bec3d80 con 0x55b48bf605e0 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b48be5fc20 con 0x55b48bf61b40 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b48bebfd40 con 0x55b48bf9fae0 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f4066ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf9f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f4066ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf9f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49496/0 (socket says 172.21.15.139:49496) 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.747+0000 7f4066ffd640 1 -- 172.21.15.139:0/933657884 learned_addr learned my addr 172.21.15.139:0/933657884 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f40677fe640 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf61b40 0x55b48bf60f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f40667fc640 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f4066ffd640 1 -- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 msgr2=0x55b48bf609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f4066ffd640 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf609c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f4066ffd640 1 -- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf61b40 msgr2=0x55b48bf60f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f4066ffd640 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf61b40 0x55b48bf60f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f4066ffd640 1 -- 172.21.15.139:0/933657884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b48bca1d80 con 0x55b48bf605e0 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f40677fe640 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf61b40 0x55b48bf60f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f4066ffd640 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf9f5a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4058062610 tx=0x7f405805a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cb9167e0430bd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f404cff9640 1 -- 172.21.15.139:0/933657884 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058062b40 con 0x55b48bf605e0 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f404cff9640 1 -- 172.21.15.139:0/933657884 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4058058310 con 0x55b48bf605e0 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.748+0000 7f404cff9640 1 -- 172.21.15.139:0/933657884 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580626b0 con 0x55b48bf605e0 2024-04-26T18:17:59.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 -- 172.21.15.139:0/933657884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 msgr2=0x55b48bf9f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf9f5a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4058062610 tx=0x7f405805a010 comp rx=0 tx=0).stop 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 -- 172.21.15.139:0/933657884 shutdown_connections 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf61b40 0x55b48bf60f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 --2- 172.21.15.139:0/933657884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf9f5a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 -- 172.21.15.139:0/933657884 >> 172.21.15.139:0/933657884 conn(0x55b48bf27740 msgr2=0x55b48bfa4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 -- 172.21.15.139:0/933657884 shutdown_connections 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 -- 172.21.15.139:0/933657884 wait complete. 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 -- start start 2024-04-26T18:17:59.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.749+0000 7f40705b4740 1 Processor -- start 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40705b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf87d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40705b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b48bf5ec20 con 0x55b48bf61b40 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b48be5d840 con 0x55b48bf605e0 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b48bf62170 con 0x55b48bf9fae0 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40705b4740 10 client.0 _ll_register_callbacks cb 0x55b48be615b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf87d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf87d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49506/0 (socket says 172.21.15.139:49506) 2024-04-26T18:17:59.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 -- 172.21.15.139:0/3133833756 learned_addr learned my addr 172.21.15.139:0/3133833756 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f4066ffd640 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40677fe640 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 -- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 msgr2=0x55b48bf982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 -- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 msgr2=0x55b48bf9a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.750+0000 7f40667fc640 1 -- 172.21.15.139:0/3133833756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b48bd02510 con 0x55b48bf61b40 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40667fc640 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf87d40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f405c02a1e0 tx=0x7f405c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0d9dd187b43050 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f4045ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f4045ffb640 1 -- 172.21.15.139:0/3133833756 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c037040 con 0x55b48bf61b40 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f4045ffb640 1 -- 172.21.15.139:0/3133833756 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f405c049470 con 0x55b48bf61b40 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4058058310 con 0x55b48bf61b40 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f4045ffb640 1 -- 172.21.15.139:0/3133833756 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f405c056050 con 0x55b48bf61b40 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 10 client.5595 fetch_fsmap learned FSMap version 9 2024-04-26T18:17:59.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b48bb95670 con 0x55b48bf61b40 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f4045ffb640 1 -- 172.21.15.139:0/3133833756 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4058058310 con 0x55b48bf61b40 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f4045ffb640 1 -- 172.21.15.139:0/3133833756 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f405c059020 con 0x55b48bf61b40 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 10 client.5595 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 10 client.5595 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 20 client.5595 populate_metadata read hostname 'smithi139' 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf98ce0 0x55b48bfb4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 4 client.5595 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b48bed1990 con 0x55b48bf98ce0 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.751+0000 7f4066ffd640 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf98ce0 0x55b48bfb4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.752+0000 7f4066ffd640 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf98ce0 0x55b48bfb4520 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22160f4aa434314c server_cookie=35782f1f74db77c0 in_seq=0 out_seq=0 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.752+0000 7f4045ffb640 10 client.5595 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.752+0000 7f4045ffb640 1 -- 172.21.15.139:0/3133833756 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b48bed1990 con 0x55b48bf98ce0 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.752+0000 7f4045ffb640 10 client.5595 handle_command_reply: tid=0 2024-04-26T18:17:59.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.752+0000 7f40705b4740 1 client.5595 shutdown 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 msgr2=0x55b48bf87d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf87d40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f405c02a1e0 tx=0x7f405c004730 comp rx=0 tx=0).stop 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 shutdown_connections 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf98ce0 0x55b48bfb4520 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf9fae0 0x55b48bf982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf87d40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f4045ffb640 0 client.5595 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 --2- 172.21.15.139:0/3133833756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 >> 172.21.15.139:0/3133833756 conn(0x55b48bf27740 msgr2=0x55b48bf61250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 shutdown_connections 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 1 -- 172.21.15.139:0/3133833756 wait complete. 2024-04-26T18:17:59.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.753+0000 7f40705b4740 20 client.5595 trim_cache size 0 max 16384 2024-04-26T18:17:59.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.770+0000 7f40705b4740 1 Processor -- start 2024-04-26T18:17:59.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.770+0000 7f40705b4740 1 -- start start 2024-04-26T18:17:59.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.770+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40705b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf878f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf98ce0 0x55b48bf87e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40705b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4068200820 con 0x55b48bf61b40 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f40681ff700 con 0x55b48bf605e0 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f40680b6640 con 0x55b48bf98ce0 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf878f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49512/0 (socket says 172.21.15.139:49512) 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 -- 172.21.15.139:0/3476376358 learned_addr learned my addr 172.21.15.139:0/3476376358 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f4066ffd640 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40677fe640 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf98ce0 0x55b48bf87e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 -- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf98ce0 msgr2=0x55b48bf87e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf98ce0 0x55b48bf87e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 -- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 msgr2=0x55b48bf9aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 -- 172.21.15.139:0/3476376358 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b48bf62300 con 0x55b48bf61b40 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f40667fc640 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf878f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f405c0494d0 tx=0x7f405c046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a076bd4b25334dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f4047fff640 1 -- 172.21.15.139:0/3476376358 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c037040 con 0x55b48bf61b40 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f4047fff640 1 -- 172.21.15.139:0/3476376358 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c04e070 con 0x55b48bf61b40 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.771+0000 7f4047fff640 1 -- 172.21.15.139:0/3476376358 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c032640 con 0x55b48bf61b40 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 -- 172.21.15.139:0/3476376358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 msgr2=0x55b48bf878f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf878f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f405c0494d0 tx=0x7f405c046000 comp rx=0 tx=0).stop 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 -- 172.21.15.139:0/3476376358 shutdown_connections 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf98ce0 0x55b48bf87e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf61b40 0x55b48bf878f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 --2- 172.21.15.139:0/3476376358 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf605e0 0x55b48bf9aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 -- 172.21.15.139:0/3476376358 >> 172.21.15.139:0/3476376358 conn(0x55b48bf27740 msgr2=0x55b48bf99e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 -- 172.21.15.139:0/3476376358 shutdown_connections 2024-04-26T18:17:59.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 -- 172.21.15.139:0/3476376358 wait complete. 2024-04-26T18:17:59.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 -- start start 2024-04-26T18:17:59.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.772+0000 7f40705b4740 1 Processor -- start 2024-04-26T18:17:59.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40705b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf96510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf61b40 0x55b48c014910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40705b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf98ce0 0x55b48c014e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40705b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f40681fe2c0 con 0x55b48bf605e0 2024-04-26T18:17:59.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f40681ff030 con 0x55b48bf98ce0 2024-04-26T18:17:59.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40705b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f40681fe990 con 0x55b48bf61b40 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40705b4740 10 client.0 _ll_register_callbacks cb 0x7f405c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf96510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf96510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49516/0 (socket says 172.21.15.139:49516) 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 -- 172.21.15.139:0/3797929896 learned_addr learned my addr 172.21.15.139:0/3797929896 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40667fc640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf61b40 0x55b48c014910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40677fe640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf98ce0 0x55b48c014e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 -- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf61b40 msgr2=0x55b48c014910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf61b40 0x55b48c014910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 -- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf98ce0 msgr2=0x55b48c014e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf98ce0 0x55b48c014e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 -- 172.21.15.139:0/3797929896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b48c015390 con 0x55b48bf605e0 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40667fc640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf61b40 0x55b48c014910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:59.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f40677fe640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf98ce0 0x55b48c014e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4066ffd640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf96510 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f405808a7b0 tx=0x7f405808c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7de49b6662062e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.773+0000 7f4045ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f4045ffb640 1 -- 172.21.15.139:0/3797929896 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058080060 con 0x55b48bf605e0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f4045ffb640 1 -- 172.21.15.139:0/3797929896 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f405808a290 con 0x55b48bf605e0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f405c04e070 con 0x55b48bf605e0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f4045ffb640 1 -- 172.21.15.139:0/3797929896 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4058079330 con 0x55b48bf605e0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 10 client.5601 fetch_fsmap learned FSMap version 9 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b48bf5c880 con 0x55b48bf605e0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f4045ffb640 1 -- 172.21.15.139:0/3797929896 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c04e070 con 0x55b48bf605e0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f4045ffb640 1 -- 172.21.15.139:0/3797929896 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f40580626b0 con 0x55b48bf605e0 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 10 client.5601 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 10 client.5601 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 20 client.5601 populate_metadata read hostname 'smithi139' 2024-04-26T18:17:59.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf9fae0 0x55b48c01e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:59.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 4 client.5601 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.7, "await_for": 42.0}] 2024-04-26T18:17:59.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.7, "await_for": 42.0}) -- 0x55b48becb800 con 0x55b48bf9fae0 2024-04-26T18:17:59.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40667fc640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf9fae0 0x55b48c01e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:59.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f4045ffb640 10 client.5601 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:17:59.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:17:59.774+0000 7f40667fc640 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf9fae0 0x55b48c01e180 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799478901e9e903a server_cookie=1b2c25ebf22b17be in_seq=0 out_seq=0 2024-04-26T18:18:01.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f4045ffb640 1 -- 172.21.15.139:0/3797929896 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55b48becb800 con 0x55b48bf9fae0 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f4045ffb640 10 client.5601 handle_command_reply: tid=0 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 client.5601 shutdown 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 msgr2=0x55b48bf96510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf96510 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f405808a7b0 tx=0x7f405808c040 comp rx=0 tx=0).stop 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 shutdown_connections 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b48bf98ce0 0x55b48c014e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b48bf9fae0 0x55b48c01e180 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f4045ffb640 0 client.5601 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b48bf61b40 0x55b48c014910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 --2- 172.21.15.139:0/3797929896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b48bf605e0 0x55b48bf96510 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 >> 172.21.15.139:0/3797929896 conn(0x55b48bf27740 msgr2=0x55b48bf9aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 shutdown_connections 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 1 -- 172.21.15.139:0/3797929896 wait complete. 2024-04-26T18:18:01.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.492+0000 7f40705b4740 20 client.5601 trim_cache size 0 max 16384 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 62, 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "9eae8c2c": { 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 62, 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:18:01.494 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 83.7, 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:18:01.495 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:01.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:01.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:01.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:01.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:01.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:01.496 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:18:01.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f405406c8f0 msgr2=0x7f405406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f405406c8f0 0x7f405406edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f405c034000 tx=0x7f405c02e000 comp rx=0 tx=0).stop 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 msgr2=0x7f4068150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f4068150de0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4058007e40 tx=0x7f405800e4b0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 shutdown_connections 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f405406c8f0 0x7f405406edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f406815c2a0 0x7f40681f13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f40680d14b0 0x7f406815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 --2- 172.21.15.139:0/1999093001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40680cf260 0x7f4068150de0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 >> 172.21.15.139:0/1999093001 conn(0x7f4068073c70 msgr2=0x7f4068154020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.493+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 shutdown_connections 2024-04-26T18:18:01.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:01.494+0000 7f406d7c1640 1 -- 172.21.15.139:0/1999093001 wait complete. 2024-04-26T18:18:01.506 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9eae8c2c', quiesce took 2.2 seconds. Will release after: 23.7 2024-04-26T18:18:25.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:18:25.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.315+0000 7fae1e978640 1 Processor -- start 2024-04-26T18:18:25.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.316+0000 7fae1e978640 1 -- start start 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.316+0000 7fae1e978640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fae180c89f0 0x7fae1815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.316+0000 7fae1e978640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fae180c7c20 0x7fae180c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.316+0000 7fae1e978640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae180736a0 con 0x7fae18152cb0 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.316+0000 7fae1e978640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fae180c62e0 con 0x7fae180c89f0 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.316+0000 7fae1e978640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fae18073940 con 0x7fae180c7c20 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.316+0000 7fae177fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fae180c89f0 0x7fae1815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae177fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fae180c89f0 0x7fae1815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43800/0 (socket says 172.21.15.139:43800) 2024-04-26T18:18:25.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae17fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fae18152cb0 0x7fae180cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:56806/0 (socket says 172.21.15.139:56806) 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae177fe640 1 -- 172.21.15.139:0/377499908 learned_addr learned my addr 172.21.15.139:0/377499908 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae1cf15640 1 --2- 172.21.15.139:0/377499908 >> v2:172.21.15.143:3300/0 conn(0x7fae180c7c20 0x7fae180c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae177fe640 1 -- 172.21.15.139:0/377499908 >> v2:172.21.15.143:3300/0 conn(0x7fae180c7c20 msgr2=0x7fae180c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae177fe640 1 --2- 172.21.15.139:0/377499908 >> v2:172.21.15.143:3300/0 conn(0x7fae180c7c20 0x7fae180c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae177fe640 1 -- 172.21.15.139:0/377499908 >> v1:172.21.15.139:6789/0 conn(0x7fae18152cb0 legacy=0x7fae180cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae16ffd640 1 -- 172.21.15.139:0/377499908 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250691637 0 0) 0x7fae180736a0 con 0x7fae18152cb0 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae177fe640 1 -- 172.21.15.139:0/377499908 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae180c48c0 con 0x7fae180c89f0 2024-04-26T18:18:25.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae1cf15640 1 --2- 172.21.15.139:0/377499908 >> v2:172.21.15.143:3300/0 conn(0x7fae180c7c20 0x7fae180c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:25.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.317+0000 7fae177fe640 1 --2- 172.21.15.139:0/377499908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae1815bd50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fae18072060 tx=0x7fae0c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cd6081afc396d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae16ffd640 1 -- 172.21.15.139:0/377499908 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c037070 con 0x7fae180c89f0 2024-04-26T18:18:25.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae16ffd640 1 -- 172.21.15.139:0/377499908 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c02ae50 con 0x7fae180c89f0 2024-04-26T18:18:25.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae16ffd640 1 -- 172.21.15.139:0/377499908 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c032860 con 0x7fae180c89f0 2024-04-26T18:18:25.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 -- 172.21.15.139:0/377499908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 msgr2=0x7fae1815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 --2- 172.21.15.139:0/377499908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae1815bd50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fae18072060 tx=0x7fae0c02a300 comp rx=0 tx=0).stop 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 -- 172.21.15.139:0/377499908 shutdown_connections 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 --2- 172.21.15.139:0/377499908 >> v2:172.21.15.143:3300/0 conn(0x7fae180c7c20 0x7fae180c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 --2- 172.21.15.139:0/377499908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae1815bd50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 -- 172.21.15.139:0/377499908 >> 172.21.15.139:0/377499908 conn(0x7fae18068270 msgr2=0x7fae18068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 -- 172.21.15.139:0/377499908 shutdown_connections 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.318+0000 7fae1e978640 1 -- 172.21.15.139:0/377499908 wait complete. 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.319+0000 7fae1e978640 1 Processor -- start 2024-04-26T18:18:25.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae1e978640 1 -- start start 2024-04-26T18:18:25.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae1e978640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae180c7c20 0x7fae181f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae1e978640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae181ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae1e978640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae18152cb0 0x7fae1815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae1e978640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fae180c4d20 con 0x7fae180c89f0 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae1e978640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fae180c4ba0 con 0x7fae180c7c20 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae1e978640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fae180cdb70 con 0x7fae18152cb0 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae181ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae181ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43818/0 (socket says 172.21.15.139:43818) 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.320+0000 7fae177fe640 1 -- 172.21.15.139:0/1792952981 learned_addr learned my addr 172.21.15.139:0/1792952981 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae1cf15640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae18152cb0 0x7fae1815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae17fff640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae180c7c20 0x7fae181f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae177fe640 1 -- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae18152cb0 msgr2=0x7fae1815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae177fe640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae18152cb0 0x7fae1815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae177fe640 1 -- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae180c7c20 msgr2=0x7fae181f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae177fe640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae180c7c20 0x7fae181f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae177fe640 1 -- 172.21.15.139:0/1792952981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae18163210 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae177fe640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae181ea000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000c00 tx=0x7fae0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae14ff9640 1 -- 172.21.15.139:0/1792952981 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c041020 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae14ff9640 1 -- 172.21.15.139:0/1792952981 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c03c870 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae14ff9640 1 -- 172.21.15.139:0/1792952981 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c037040 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae181634b0 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.321+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae18163a70 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.322+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae18076d20 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.323+0000 7fae14ff9640 1 -- 172.21.15.139:0/1792952981 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae0c044020 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.323+0000 7fae14ff9640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fae0406c8f0 0x7fae0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.323+0000 7fae17fff640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fae0406c8f0 0x7fae0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.323+0000 7fae14ff9640 1 -- 172.21.15.139:0/1792952981 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fae0c0ac810 con 0x7fae180c89f0 2024-04-26T18:18:25.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.324+0000 7fae17fff640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fae0406c8f0 0x7fae0406edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae08007fd0 tx=0x7fae08007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.328+0000 7fae14ff9640 1 -- 172.21.15.139:0/1792952981 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae0c04b030 con 0x7fae180c89f0 2024-04-26T18:18:25.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.538+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae18073480 con 0x7fae180c89f0 2024-04-26T18:18:25.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.539+0000 7fae14ff9640 1 -- 172.21.15.139:0/1792952981 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fae0c07a1b0 con 0x7fae180c89f0 2024-04-26T18:18:25.539 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:18:25.539 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:18:25.539 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:18:25.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fae0406c8f0 msgr2=0x7fae0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fae0406c8f0 0x7fae0406edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae08007fd0 tx=0x7fae08007de0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 msgr2=0x7fae181ea000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae181ea000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000c00 tx=0x7fae0c0046c0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 shutdown_connections 2024-04-26T18:18:25.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fae0406c8f0 0x7fae0406edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fae18152cb0 0x7fae1815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae180c89f0 0x7fae181ea000 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 --2- 172.21.15.139:0/1792952981 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fae180c7c20 0x7fae181f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 >> 172.21.15.139:0/1792952981 conn(0x7fae18068270 msgr2=0x7fae180c4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 shutdown_connections 2024-04-26T18:18:25.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.541+0000 7fae1e978640 1 -- 172.21.15.139:0/1792952981 wait complete. 2024-04-26T18:18:25.552 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 9eae8c2c --release --await' 2024-04-26T18:18:25.552 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 9eae8c2c --release --await 2024-04-26T18:18:25.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.655+0000 7fb0f1740640 1 Processor -- start 2024-04-26T18:18:25.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.655+0000 7fb0f1740640 1 -- start start 2024-04-26T18:18:25.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0f1740640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec155f00 0x7fb0ec0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0f1740640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0ec15bc10 con 0x7fb0ec15f800 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0f1740640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0ec15bef0 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0f1740640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec15c1d0 con 0x7fb0ec155f00 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0eb7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb0ec15f800 0x7fb0ec166480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:56808/0 (socket says 172.21.15.139:56808) 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0eb7fe640 1 -- 172.21.15.139:0/2327152163 learned_addr learned my addr 172.21.15.139:0/2327152163 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/2327152163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec155f00 0x7fb0ec0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944354470 0 0) 0x7fb0ec15bc10 con 0x7fb0ec15f800 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.656+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d4003520 con 0x7fb0ec15f800 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.657+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560920170 0 0) 0x7fb0ec15bef0 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.657+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0ec15bc10 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.657+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1131425810 0 0) 0x7fb0d4003520 con 0x7fb0ec15f800 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.657+0000 7fb0eaffd640 1 -- 172.21.15.139:0/2327152163 >> v1:172.21.15.143:6789/0 conn(0x7fb0ec0c9be0 legacy=0x7fb0ec15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.657+0000 7fb0eaffd640 1 -- 172.21.15.139:0/2327152163 >> v1:172.21.15.139:6789/0 conn(0x7fb0ec15f800 legacy=0x7fb0ec166480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.657+0000 7fb0eaffd640 1 -- 172.21.15.139:0/2327152163 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec15c4b0 con 0x7fb0ec155f00 2024-04-26T18:18:25.664 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.657+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/2327152163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec155f00 0x7fb0ec0cf170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009dc0 tx=0x7fb0dc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30695c37e8d4b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4001670 con 0x7fb0ec155f00 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc007540 con 0x7fb0ec155f00 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0e9ffb640 1 -- 172.21.15.139:0/2327152163 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc007910 con 0x7fb0ec155f00 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0f1740640 1 -- 172.21.15.139:0/2327152163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec155f00 msgr2=0x7fb0ec0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0f1740640 1 --2- 172.21.15.139:0/2327152163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec155f00 0x7fb0ec0cf170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009dc0 tx=0x7fb0dc02a660 comp rx=0 tx=0).stop 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0f1740640 1 -- 172.21.15.139:0/2327152163 shutdown_connections 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0f1740640 1 --2- 172.21.15.139:0/2327152163 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec155f00 0x7fb0ec0cf170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0f1740640 1 -- 172.21.15.139:0/2327152163 >> 172.21.15.139:0/2327152163 conn(0x7fb0ec068090 msgr2=0x7fb0ec068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0f1740640 1 -- 172.21.15.139:0/2327152163 shutdown_connections 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.658+0000 7fb0f1740640 1 -- 172.21.15.139:0/2327152163 wait complete. 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.659+0000 7fb0f1740640 1 Processor -- start 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.659+0000 7fb0f1740640 1 -- start start 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0f1740640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ec0c9be0 0x7fb0ec1f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0f1740640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ec155f00 0x7fb0ec0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.665 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0f1740640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec15f800 0x7fb0ec15d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0f1740640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec071030 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0f1740640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec070eb0 con 0x7fb0ec155f00 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0f1740640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec06e160 con 0x7fb0ec15f800 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ec0c9be0 0x7fb0ec1f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ec0c9be0 0x7fb0ec1f1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43822/0 (socket says 172.21.15.139:43822) 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 -- 172.21.15.139:0/1403740307 learned_addr learned my addr 172.21.15.139:0/1403740307 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ec155f00 0x7fb0ec0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eb7fe640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec15f800 0x7fb0ec15d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 -- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec15f800 msgr2=0x7fb0ec15d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec15f800 0x7fb0ec15d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 -- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ec155f00 msgr2=0x7fb0ec0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ec155f00 0x7fb0ec0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eaffd640 1 -- 172.21.15.139:0/1403740307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec15e050 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.660+0000 7fb0eb7fe640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec15f800 0x7fb0ec15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.661+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ec0c9be0 0x7fb0ec1f1b50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009ee0 tx=0x7fb0dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.661+0000 7fb0d37fe640 1 -- 172.21.15.139:0/1403740307 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc040070 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.661+0000 7fb0d37fe640 1 -- 172.21.15.139:0/1403740307 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc031c40 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.661+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ec15e330 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.661+0000 7fb0d37fe640 1 -- 172.21.15.139:0/1403740307 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc007e70 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.661+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ec15e8f0 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.662+0000 7fb0d37fe640 1 -- 172.21.15.139:0/1403740307 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0dc039040 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.663+0000 7fb0d37fe640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb0d806c920 0x7fb0d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.663+0000 7fb0d37fe640 1 -- 172.21.15.139:0/1403740307 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb0dc0ad610 con 0x7fb0ec0c9be0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.663+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb0d806c920 0x7fb0d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.663+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb0d806c920 0x7fb0d806ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0c9680 tx=0x7fb0e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 Processor -- start 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 -- start start 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cf1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cb2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cb2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eb64c17040 con 0x55eb64cb24b0 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55eb64bb2b60 con 0x55eb64cb3a10 2024-04-26T18:18:25.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.664+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55eb64c13000 con 0x55eb64cf19b0 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cf1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cf1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43824/0 (socket says 172.21.15.139:43824) 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 -- 172.21.15.139:0/168750765 learned_addr learned my addr 172.21.15.139:0/168750765 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eb7fe640 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cb2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cb2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 -- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 msgr2=0x55eb64cb2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cb2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 -- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 msgr2=0x55eb64cb2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cb2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 -- 172.21.15.139:0/168750765 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb64ba79c0 con 0x55eb64cb24b0 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eb7fe640 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cb2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cb2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cf1470 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc083640 tx=0x7fb0dc07ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabcf1238a06a1ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0d0ff9640 1 -- 172.21.15.139:0/168750765 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc07f340 con 0x55eb64cb24b0 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0d0ff9640 1 -- 172.21.15.139:0/168750765 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc083b70 con 0x55eb64cb24b0 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.665+0000 7fb0d0ff9640 1 -- 172.21.15.139:0/168750765 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc077600 con 0x55eb64cb24b0 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 -- 172.21.15.139:0/168750765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 msgr2=0x55eb64cf1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cf1470 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc083640 tx=0x7fb0dc07ae90 comp rx=0 tx=0).stop 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 -- 172.21.15.139:0/168750765 shutdown_connections 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cb2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cb2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 --2- 172.21.15.139:0/168750765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cf1470 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 -- 172.21.15.139:0/168750765 >> 172.21.15.139:0/168750765 conn(0x55eb64c79930 msgr2=0x55eb64cf6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 -- 172.21.15.139:0/168750765 shutdown_connections 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 -- 172.21.15.139:0/168750765 wait complete. 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 -- start start 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.666+0000 7fb0f445b740 1 Processor -- start 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb24b0 0x55eb64cec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb3a10 0x55eb64cd9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64cd9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0f445b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eb64cb0af0 con 0x55eb64cb3a10 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55eb64bb04f0 con 0x55eb64cf19b0 2024-04-26T18:18:25.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55eb64cb4040 con 0x55eb64cb24b0 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0f445b740 10 client.0 _ll_register_callbacks cb 0x55eb64c0dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0ea7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb3a10 0x55eb64cd9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0ea7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb3a10 0x55eb64cd9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43836/0 (socket says 172.21.15.139:43836) 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0ea7fc640 1 -- 172.21.15.139:0/3012657602 learned_addr learned my addr 172.21.15.139:0/3012657602 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0eb7fe640 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64cd9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.667+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb24b0 0x55eb64cec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0ea7fc640 1 -- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb24b0 msgr2=0x55eb64cec9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb24b0 0x55eb64cec9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0ea7fc640 1 -- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 msgr2=0x55eb64cd9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64cd9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0ea7fc640 1 -- 172.21.15.139:0/3012657602 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb64928920 con 0x55eb64cb3a10 2024-04-26T18:18:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb3a10 0x55eb64cd9670 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ca000 tx=0x7fb0e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175d7cf297f68f37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/3012657602 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000ea80 con 0x55eb64cb3a10 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/3012657602 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb0e000ec20 con 0x55eb64cb3a10 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0dc083b70 con 0x55eb64cb3a10 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/3012657602 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb0e000ee20 con 0x55eb64cb3a10 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 10 client.5622 fetch_fsmap learned FSMap version 9 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55eb649f4d30 con 0x55eb64cb3a10 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/3012657602 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc083b70 con 0x55eb64cb3a10 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/3012657602 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb0e002d700 con 0x55eb64cb3a10 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 10 client.5622 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 10 client.5622 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 20 client.5622 populate_metadata read hostname 'smithi139' 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cdadf0 0x55eb64d06030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 4 client.5622 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:18:25.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.668+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb64beaa00 con 0x55eb64cdadf0 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.669+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cdadf0 0x55eb64d06030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.669+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cdadf0 0x55eb64d06030 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5538da2abba70c server_cookie=527ea5b72769e71d in_seq=0 out_seq=0 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.669+0000 7fb0c9ffb640 10 client.5622 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/3012657602 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eb64beaa00 con 0x55eb64cdadf0 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0c9ffb640 10 client.5622 handle_command_reply: tid=0 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 client.5622 shutdown 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb3a10 msgr2=0x55eb64cd9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb3a10 0x55eb64cd9670 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ca000 tx=0x7fb0e0000bc0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 shutdown_connections 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64cd9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb3a10 0x55eb64cd9670 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cdadf0 0x55eb64d06030 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3012657602 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb24b0 0x55eb64cec9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0c9ffb640 0 client.5622 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 >> 172.21.15.139:0/3012657602 conn(0x55eb64c79930 msgr2=0x55eb64cdbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 shutdown_connections 2024-04-26T18:18:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 1 -- 172.21.15.139:0/3012657602 wait complete. 2024-04-26T18:18:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.670+0000 7fb0f445b740 20 client.5622 trim_cache size 0 max 16384 2024-04-26T18:18:25.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.687+0000 7fb0f445b740 1 Processor -- start 2024-04-26T18:18:25.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.687+0000 7fb0f445b740 1 -- start start 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cd9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb3a10 0x55eb64ced490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64ced9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0f445b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec200920 con 0x55eb64cb24b0 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec1ff800 con 0x55eb64cf19b0 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec1f5f50 con 0x55eb64cb3a10 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cd9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cd9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43848/0 (socket says 172.21.15.139:43848) 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 -- 172.21.15.139:0/3487883909 learned_addr learned my addr 172.21.15.139:0/3487883909 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eb7fe640 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64ced9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb3a10 0x55eb64ced490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 -- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb3a10 msgr2=0x55eb64ced490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb3a10 0x55eb64ced490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 -- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 msgr2=0x55eb64ced9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64ced9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 -- 172.21.15.139:0/3487883909 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb64cb1d00 con 0x55eb64cb24b0 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eb7fe640 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64ced9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.688+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cd9b60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0ab7e0 tx=0x7fb0dc0ad070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6848364318a6f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0cbfff640 1 -- 172.21.15.139:0/3487883909 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc07f340 con 0x55eb64cb24b0 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0cbfff640 1 -- 172.21.15.139:0/3487883909 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc099070 con 0x55eb64cb24b0 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0cbfff640 1 -- 172.21.15.139:0/3487883909 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0ab360 con 0x55eb64cb24b0 2024-04-26T18:18:25.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 -- 172.21.15.139:0/3487883909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 msgr2=0x55eb64cd9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cd9b60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0ab7e0 tx=0x7fb0dc0ad070 comp rx=0 tx=0).stop 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 -- 172.21.15.139:0/3487883909 shutdown_connections 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cf19b0 0x55eb64ced9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cb3a10 0x55eb64ced490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 --2- 172.21.15.139:0/3487883909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64cd9b60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 -- 172.21.15.139:0/3487883909 >> 172.21.15.139:0/3487883909 conn(0x55eb64c79930 msgr2=0x55eb64cdc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 -- 172.21.15.139:0/3487883909 shutdown_connections 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.689+0000 7fb0f445b740 1 -- 172.21.15.139:0/3487883909 wait complete. 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 -- start start 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 Processor -- start 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64d66b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cad290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cd26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec1fe3b0 con 0x55eb64cb24b0 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec1ff130 con 0x55eb64cb3a10 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.690+0000 7fb0f445b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec1fea60 con 0x55eb64cf19b0 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0f445b740 10 client.0 _ll_register_callbacks cb 0x7fb0e0001330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64d66b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eb7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cd26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0ea7fc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64d66b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43854/0 (socket says 172.21.15.139:43854) 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 -- 172.21.15.139:0/30034962 learned_addr learned my addr 172.21.15.139:0/30034962 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 -- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 msgr2=0x55eb64cd26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cd26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 -- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 msgr2=0x55eb64cad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 -- 172.21.15.139:0/30034962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb64d060d0 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0eaffd640 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64d66b60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc044000 tx=0x7fb0dc047070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83329197cd20ee69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/30034962 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0a0060 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/30034962 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb0dc0ab360 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0dc099070 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/30034962 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb0dc077600 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0f445b740 10 client.5628 fetch_fsmap learned FSMap version 9 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55eb64cd3620 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.691+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/30034962 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc099070 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/30034962 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb0dc0ab040 con 0x55eb64cb24b0 2024-04-26T18:18:25.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 10 client.5628 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 10 client.5628 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 20 client.5628 populate_metadata read hostname 'smithi139' 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cd2c20 0x55eb64cd5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 4 client.5628 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9eae8c2c", "release": true, "await": true}] 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9eae8c2c", "release": true, "await": true}) -- 0x55eb64c24c50 con 0x55eb64cd2c20 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cd2c20 0x55eb64cd5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0c9ffb640 10 client.5628 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0ea7fc640 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cd2c20 0x55eb64cd5d00 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53953bcf86bfd4d0 server_cookie=c43728a171bfbcf1 in_seq=0 out_seq=0 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0c9ffb640 1 -- 172.21.15.139:0/30034962 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55eb64c24c50 con 0x55eb64cd2c20 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0c9ffb640 10 client.5628 handle_command_reply: tid=0 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 1 client.5628 shutdown 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 msgr2=0x55eb64d66b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.692+0000 7fb0f445b740 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64d66b60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc044000 tx=0x7fb0dc047070 comp rx=0 tx=0).stop 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 shutdown_connections 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55eb64cd2c20 0x55eb64cd5d00 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55eb64cf19b0 0x55eb64cd26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55eb64cb3a10 0x55eb64cad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0c9ffb640 0 client.5628 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 --2- 172.21.15.139:0/30034962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb64cb24b0 0x55eb64d66b60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 >> 172.21.15.139:0/30034962 conn(0x55eb64c79930 msgr2=0x55eb64ced3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 shutdown_connections 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 1 -- 172.21.15.139:0/30034962 wait complete. 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f445b740 20 client.5628 trim_cache size 0 max 16384 2024-04-26T18:18:25.702 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 64, 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "9eae8c2c": { 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 64, 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:18:25.703 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 83.7, 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:25.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:25.705 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:18:25.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb0d806c920 msgr2=0x7fb0d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb0d806c920 0x7fb0d806ede0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0c9680 tx=0x7fb0e0009040 comp rx=0 tx=0).stop 2024-04-26T18:18:25.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ec0c9be0 msgr2=0x7fb0ec1f1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ec0c9be0 0x7fb0ec1f1b50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009ee0 tx=0x7fb0dc004a40 comp rx=0 tx=0).stop 2024-04-26T18:18:25.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 shutdown_connections 2024-04-26T18:18:25.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb0d806c920 0x7fb0d806ede0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb0ec15f800 0x7fb0ec15d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb0ec155f00 0x7fb0ec0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 --2- 172.21.15.139:0/1403740307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ec0c9be0 0x7fb0ec1f1b50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 >> 172.21.15.139:0/1403740307 conn(0x7fb0ec068090 msgr2=0x7fb0ec0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 shutdown_connections 2024-04-26T18:18:25.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.693+0000 7fb0f1740640 1 -- 172.21.15.139:0/1403740307 wait complete. 2024-04-26T18:18:25.707 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9eae8c2c', seconds elapsed: 26.4 2024-04-26T18:18:25.707 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.7 2024-04-26T18:18:25.708 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:18:25.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.809+0000 7effaf719640 1 Processor -- start 2024-04-26T18:18:25.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.809+0000 7effaf719640 1 -- start start 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effaf719640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7effa8155d00 0x7effa80c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effaf719640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa80cb680 0x7effa806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effaf719640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7effa80702f0 0x7effa815f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effaf719640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7effa81560e0 con 0x7effa80702f0 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effaf719640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7effa815cb60 con 0x7effa8155d00 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effaf719640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7effa80ccd90 con 0x7effa80cb680 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7effa80702f0 0x7effa815f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7effa80702f0 0x7effa815f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43856/0 (socket says 172.21.15.139:43856) 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 -- 172.21.15.139:0/3441299605 learned_addr learned my addr 172.21.15.139:0/3441299605 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effad4b5640 1 --2- 172.21.15.139:0/3441299605 >> v2:172.21.15.143:3300/0 conn(0x7effa8155d00 0x7effa80c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effaccb4640 1 --2- 172.21.15.139:0/3441299605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa80cb680 0x7effa806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 -- 172.21.15.139:0/3441299605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa80cb680 msgr2=0x7effa806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 --2- 172.21.15.139:0/3441299605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa80cb680 0x7effa806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 -- 172.21.15.139:0/3441299605 >> v2:172.21.15.143:3300/0 conn(0x7effa8155d00 msgr2=0x7effa80c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 --2- 172.21.15.139:0/3441299605 >> v2:172.21.15.143:3300/0 conn(0x7effa8155d00 0x7effa80c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.810+0000 7effadcb6640 1 -- 172.21.15.139:0/3441299605 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa815bfe0 con 0x7effa80702f0 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.811+0000 7effadcb6640 1 --2- 172.21.15.139:0/3441299605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa815f7e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7effa8070cb0 tx=0x7effa002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1950cef32b42c882 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.811+0000 7eff9ffff640 1 -- 172.21.15.139:0/3441299605 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0036070 con 0x7effa80702f0 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.811+0000 7eff9ffff640 1 -- 172.21.15.139:0/3441299605 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa0031600 con 0x7effa80702f0 2024-04-26T18:18:25.812 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.811+0000 7eff9ffff640 1 -- 172.21.15.139:0/3441299605 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00319d0 con 0x7effa80702f0 2024-04-26T18:18:25.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 -- 172.21.15.139:0/3441299605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 msgr2=0x7effa815f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 --2- 172.21.15.139:0/3441299605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa815f7e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7effa8070cb0 tx=0x7effa002a6a0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 -- 172.21.15.139:0/3441299605 shutdown_connections 2024-04-26T18:18:25.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 --2- 172.21.15.139:0/3441299605 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa815f7e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 --2- 172.21.15.139:0/3441299605 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa80cb680 0x7effa806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 --2- 172.21.15.139:0/3441299605 >> v2:172.21.15.143:3300/0 conn(0x7effa8155d00 0x7effa80c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 -- 172.21.15.139:0/3441299605 >> 172.21.15.139:0/3441299605 conn(0x7effa8071bf0 msgr2=0x7effa8071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 -- 172.21.15.139:0/3441299605 shutdown_connections 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.812+0000 7effaf719640 1 -- 172.21.15.139:0/3441299605 wait complete. 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 Processor -- start 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 -- start start 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa80b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effa80cb680 0x7effa81e4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa8155d00 0x7effa80af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7effa815c880 con 0x7effa80702f0 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7effa815c5a0 con 0x7effa80cb680 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.813+0000 7effaf719640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7effa815f2c0 con 0x7effa8155d00 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa80b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa80b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43858/0 (socket says 172.21.15.139:43858) 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 -- 172.21.15.139:0/1060872037 learned_addr learned my addr 172.21.15.139:0/1060872037 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effaccb4640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effa80cb680 0x7effa81e4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effadcb6640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa8155d00 0x7effa80af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 -- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa8155d00 msgr2=0x7effa80af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa8155d00 0x7effa80af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 -- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effa80cb680 msgr2=0x7effa81e4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effa80cb680 0x7effa81e4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 -- 172.21.15.139:0/1060872037 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa8152db0 con 0x7effa80702f0 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effad4b5640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa80b0d00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7effa400e870 tx=0x7effa400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7eff9dffb640 1 -- 172.21.15.139:0/1060872037 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4017070 con 0x7effa80702f0 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7eff9dffb640 1 -- 172.21.15.139:0/1060872037 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa400c940 con 0x7effa80702f0 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa8153070 con 0x7effa80702f0 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7eff9dffb640 1 -- 172.21.15.139:0/1060872037 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa400cd30 con 0x7effa80702f0 2024-04-26T18:18:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.814+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa81f1c70 con 0x7effa80702f0 2024-04-26T18:18:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.816+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa8069ae0 con 0x7effa80702f0 2024-04-26T18:18:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.816+0000 7eff9dffb640 1 -- 172.21.15.139:0/1060872037 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effa401a070 con 0x7effa80702f0 2024-04-26T18:18:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.816+0000 7eff9dffb640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff8c06c8f0 0x7eff8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.817+0000 7effaccb4640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff8c06c8f0 0x7eff8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.817+0000 7eff9dffb640 1 -- 172.21.15.139:0/1060872037 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7effa408bdb0 con 0x7effa80702f0 2024-04-26T18:18:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.817+0000 7effaccb4640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff8c06c8f0 0x7eff8c06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7effa80b0bd0 tx=0x7eff98009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:25.821+0000 7eff9dffb640 1 -- 172.21.15.139:0/1060872037 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effa4059750 con 0x7effa80702f0 2024-04-26T18:18:26.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.043+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effa80ccad0 con 0x7effa80702f0 2024-04-26T18:18:26.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.043+0000 7eff9dffb640 1 -- 172.21.15.139:0/1060872037 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7effa80ccad0 con 0x7effa80702f0 2024-04-26T18:18:26.043 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:18:26.044 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:18:26.044 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:18:26.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff8c06c8f0 msgr2=0x7eff8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff8c06c8f0 0x7eff8c06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7effa80b0bd0 tx=0x7eff98009190 comp rx=0 tx=0).stop 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 msgr2=0x7effa80b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa80b0d00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7effa400e870 tx=0x7effa400ed30 comp rx=0 tx=0).stop 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 shutdown_connections 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7eff8c06c8f0 0x7eff8c06edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effa8155d00 0x7effa80af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effa80cb680 0x7effa81e4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 --2- 172.21.15.139:0/1060872037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effa80702f0 0x7effa80b0d00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 >> 172.21.15.139:0/1060872037 conn(0x7effa8071bf0 msgr2=0x7effa80cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 shutdown_connections 2024-04-26T18:18:26.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.045+0000 7effaf719640 1 -- 172.21.15.139:0/1060872037 wait complete. 2024-04-26T18:18:26.056 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 83.7 --await-for 42.0' 2024-04-26T18:18:26.056 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 83.7 --await-for 42.0 2024-04-26T18:18:26.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.162+0000 7f1e76237640 1 Processor -- start 2024-04-26T18:18:26.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.162+0000 7f1e76237640 1 -- start start 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.163+0000 7f1e76237640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 0x7f1e700cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.163+0000 7f1e76237640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e700cbc40 con 0x7f1e700b1ed0 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.163+0000 7f1e76237640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e700cb110 con 0x7f1e700c9d80 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.163+0000 7f1e76237640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1e700cb430 con 0x7f1e70159510 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.163+0000 7f1e6ffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1e700b1ed0 0x7f1e701667b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:56810/0 (socket says 172.21.15.139:56810) 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.163+0000 7f1e6ffff640 1 -- 172.21.15.139:0/3838662342 learned_addr learned my addr 172.21.15.139:0/3838662342 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 0x7f1e700cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513363363 0 0) 0x7f1e700cbc40 con 0x7f1e700b1ed0 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e5c003520 con 0x7f1e700b1ed0 2024-04-26T18:18:26.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392995771 0 0) 0x7f1e700cb110 con 0x7f1e700c9d80 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e700cbc40 con 0x7f1e700c9d80 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3647606181 0 0) 0x7f1e5c003520 con 0x7f1e700b1ed0 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 msgr2=0x7f1e700cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 0x7f1e700cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 >> v1:172.21.15.143:6789/0 conn(0x7f1e700c9d80 legacy=0x7f1e70070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e700cc730 con 0x7f1e700b1ed0 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f1e680019f0 con 0x7f1e700b1ed0 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 >> v1:172.21.15.139:6789/0 conn(0x7f1e700b1ed0 legacy=0x7f1e701667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e5c003b70 0x7f1e5c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 0x7f1e5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1e700cb430 con 0x7f1e5c004d40 2024-04-26T18:18:26.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c00ba70 con 0x7f1e5c003b70 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5c00bc70 con 0x7f1e70159510 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e5c003b70 0x7f1e5c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 0x7f1e5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6ffff640 1 -- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 msgr2=0x7f1e5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e70159510 0x7f1e5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6ffff640 1 -- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e5c003b70 msgr2=0x7f1e5c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e5c003b70 0x7f1e5c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6ffff640 1 -- 172.21.15.139:0/3838662342 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c003520 con 0x7f1e5c004d40 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.164+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e5c003b70 0x7f1e5c003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.165+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e5c0051c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800a730 tx=0x7f1e5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28b42fc7f8bea88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.165+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800a350 con 0x7f1e5c004d40 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.165+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6802f070 con 0x7f1e5c004d40 2024-04-26T18:18:26.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.165+0000 7f1e6effd640 1 -- 172.21.15.139:0/3838662342 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6802bb90 con 0x7f1e5c004d40 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.166+0000 7f1e76237640 1 -- 172.21.15.139:0/3838662342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 msgr2=0x7f1e5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.166+0000 7f1e76237640 1 --2- 172.21.15.139:0/3838662342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e5c0051c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800a730 tx=0x7f1e5c005830 comp rx=0 tx=0).stop 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.166+0000 7f1e6ffff640 1 -- 172.21.15.139:0/3838662342 reap_dead start 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.166+0000 7f1e76237640 1 -- 172.21.15.139:0/3838662342 shutdown_connections 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.166+0000 7f1e76237640 1 -- 172.21.15.139:0/3838662342 >> 172.21.15.139:0/3838662342 conn(0x7f1e700746d0 msgr2=0x7f1e70076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.166+0000 7f1e76237640 1 -- 172.21.15.139:0/3838662342 shutdown_connections 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.166+0000 7f1e76237640 1 -- 172.21.15.139:0/3838662342 wait complete. 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.167+0000 7f1e76237640 1 Processor -- start 2024-04-26T18:18:26.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.167+0000 7f1e76237640 1 -- start start 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e76237640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e70068300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e76237640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e701f4cd0 0x7f1e700c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e76237640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e700c8d90 0x7f1e700b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e76237640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1e700ca6b0 con 0x7f1e5c004d40 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e76237640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1e700cb960 con 0x7f1e701f4cd0 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e76237640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1e701598f0 con 0x7f1e700c8d90 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e70068300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e70068300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43880/0 (socket says 172.21.15.139:43880) 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3559640903 learned_addr learned my addr 172.21.15.139:0/3559640903 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e700c8d90 0x7f1e700b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e701f4cd0 0x7f1e700c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e700c8d90 msgr2=0x7f1e700b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e700c8d90 0x7f1e700b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e701f4cd0 msgr2=0x7f1e700c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e701f4cd0 0x7f1e700c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3559640903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e700c7220 con 0x7f1e5c004d40 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e700c8d90 0x7f1e700b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e70068300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1e60011ca0 tx=0x7f1e6000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6cff9640 1 -- 172.21.15.139:0/3559640903 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000fd20 con 0x7f1e5c004d40 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6cff9640 1 -- 172.21.15.139:0/3559640903 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e60014440 con 0x7f1e5c004d40 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e6cff9640 1 -- 172.21.15.139:0/3559640903 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60014830 con 0x7f1e5c004d40 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.168+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e700c7500 con 0x7f1e5c004d40 2024-04-26T18:18:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.169+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e700c7ac0 con 0x7f1e5c004d40 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.170+0000 7f1e6cff9640 1 -- 172.21.15.139:0/3559640903 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e60012040 con 0x7f1e5c004d40 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.170+0000 7f1e6cff9640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1e5006c8f0 0x7f1e5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.170+0000 7f1e6cff9640 1 -- 172.21.15.139:0/3559640903 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1e6008c810 con 0x7f1e5c004d40 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.170+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1e5006c8f0 0x7f1e5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.171+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1e5006c8f0 0x7f1e5006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e700c6ba0 tx=0x7f1e58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.171+0000 7f1e7902c740 1 Processor -- start 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.171+0000 7f1e7902c740 1 -- start start 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c09505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0950ae0 0x55e2c09119c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c0911f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e7902c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2c0874d80 con 0x55e2c09115e0 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e2c0810c20 con 0x55e2c0912b40 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e2c0870d40 con 0x55e2c0950ae0 2024-04-26T18:18:26.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c09505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c09505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43894/0 (socket says 172.21.15.139:43894) 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3388917316 learned_addr learned my addr 172.21.15.139:0/3388917316 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c0911f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0950ae0 0x55e2c09119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0950ae0 msgr2=0x55e2c09119c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0950ae0 0x55e2c09119c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 msgr2=0x55e2c0911f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c0911f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.172+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/3388917316 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c0652d80 con 0x55e2c09115e0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c09505a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1e60023030 tx=0x7f1e60059b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7232957d65202c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e657fa640 1 -- 172.21.15.139:0/3388917316 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60062ce0 con 0x55e2c09115e0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e657fa640 1 -- 172.21.15.139:0/3388917316 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e60058400 con 0x55e2c09115e0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e657fa640 1 -- 172.21.15.139:0/3388917316 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6005e0d0 con 0x55e2c09115e0 2024-04-26T18:18:26.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 -- 172.21.15.139:0/3388917316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 msgr2=0x55e2c09505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c09505a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1e60023030 tx=0x7f1e60059b90 comp rx=0 tx=0).stop 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 -- 172.21.15.139:0/3388917316 shutdown_connections 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c0911f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0950ae0 0x55e2c09119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 --2- 172.21.15.139:0/3388917316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c09505a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 -- 172.21.15.139:0/3388917316 >> 172.21.15.139:0/3388917316 conn(0x55e2c08d8740 msgr2=0x55e2c0955580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 -- 172.21.15.139:0/3388917316 shutdown_connections 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.173+0000 7f1e7902c740 1 -- 172.21.15.139:0/3388917316 wait complete. 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.174+0000 7f1e7902c740 1 -- start start 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.174+0000 7f1e7902c740 1 Processor -- start 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c094dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0912b40 0x55e2c09494d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c0938df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2c090fc20 con 0x55e2c09115e0 2024-04-26T18:18:26.183 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e2c080e840 con 0x55e2c0950ae0 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e2c0913170 con 0x55e2c0912b40 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 10 client.0 _ll_register_callbacks cb 0x55e2c08125b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c094dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c094dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43910/0 (socket says 172.21.15.139:43910) 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/284572404 learned_addr learned my addr 172.21.15.139:0/284572404 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c0938df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0912b40 0x55e2c09494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0912b40 msgr2=0x55e2c09494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0912b40 0x55e2c09494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 msgr2=0x55e2c0938df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c0938df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 -- 172.21.15.139:0/284572404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c06b3510 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c094dd40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1e6008cb30 tx=0x7f1e60000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7828d74ba482e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/284572404 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60077060 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/284572404 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1e6005a560 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.175+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e60058400 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/284572404 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1e6007e050 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 10 client.5646 fetch_fsmap learned FSMap version 9 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e2c0546670 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/284572404 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e60058400 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/284572404 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1e60062850 con 0x55e2c09115e0 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 10 client.5646 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 10 client.5646 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 20 client.5646 populate_metadata read hostname 'smithi139' 2024-04-26T18:18:26.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c09653d0 0x55e2c09657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 4 client.5646 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2c0882990 con 0x55e2c09653d0 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c09653d0 0x55e2c09657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e4e7fc640 10 client.5646 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.176+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c09653d0 0x55e2c09657b0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=374394ea8ebdc745 server_cookie=7c79ae0e3f3f839e in_seq=0 out_seq=0 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/284572404 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e2c0882990 con 0x55e2c09653d0 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e4e7fc640 10 client.5646 handle_command_reply: tid=0 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 client.5646 shutdown 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 msgr2=0x55e2c094dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c094dd40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1e6008cb30 tx=0x7f1e60000bc0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 shutdown_connections 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c0938df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c09653d0 0x55e2c09657b0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c0912b40 0x55e2c09494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 --2- 172.21.15.139:0/284572404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c09115e0 0x55e2c094dd40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 >> 172.21.15.139:0/284572404 conn(0x55e2c08d8740 msgr2=0x55e2c0939f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:26.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e4e7fc640 0 client.5646 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:26.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 shutdown_connections 2024-04-26T18:18:26.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 1 -- 172.21.15.139:0/284572404 wait complete. 2024-04-26T18:18:26.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.177+0000 7f1e7902c740 20 client.5646 trim_cache size 0 max 16384 2024-04-26T18:18:26.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.194+0000 7f1e7902c740 1 Processor -- start 2024-04-26T18:18:26.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.194+0000 7f1e7902c740 1 -- start start 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c0939c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c096ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0950ae0 0x55e2c096bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e7902c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e2c090ddb0 con 0x55e2c0950ae0 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1e70200e40 con 0x55e2c0912b40 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1e701ffd20 con 0x55e2c09115e0 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0950ae0 0x55e2c096bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0950ae0 0x55e2c096bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43926/0 (socket says 172.21.15.139:43926) 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e6ffff640 1 -- 172.21.15.139:0/1075941974 learned_addr learned my addr 172.21.15.139:0/1075941974 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c0939c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c096ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e6ffff640 1 -- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 msgr2=0x55e2c0939c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.195+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c0939c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e6ffff640 1 -- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 msgr2=0x55e2c096ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c096ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e6ffff640 1 -- 172.21.15.139:0/1075941974 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c093b2f0 con 0x55e2c0950ae0 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0950ae0 0x55e2c096bf70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800a820 tx=0x7f1e68007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b55466ce9b23b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e64ff9640 1 -- 172.21.15.139:0/1075941974 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68047070 con 0x55e2c0950ae0 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e64ff9640 1 -- 172.21.15.139:0/1075941974 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6802f040 con 0x55e2c0950ae0 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e64ff9640 1 -- 172.21.15.139:0/1075941974 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60009690 con 0x55e2c0950ae0 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e7902c740 1 -- 172.21.15.139:0/1075941974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0950ae0 msgr2=0x55e2c096bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.196+0000 7f1e7902c740 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0950ae0 0x55e2c096bf70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800a820 tx=0x7f1e68007000 comp rx=0 tx=0).stop 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 -- 172.21.15.139:0/1075941974 shutdown_connections 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0950ae0 0x55e2c096bf70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0912b40 0x55e2c096ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 --2- 172.21.15.139:0/1075941974 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c0939c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 -- 172.21.15.139:0/1075941974 >> 172.21.15.139:0/1075941974 conn(0x55e2c08d8740 msgr2=0x55e2c090aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:26.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 -- 172.21.15.139:0/1075941974 shutdown_connections 2024-04-26T18:18:26.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 -- 172.21.15.139:0/1075941974 wait complete. 2024-04-26T18:18:26.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 -- start start 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.197+0000 7f1e7902c740 1 Processor -- start 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c09328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0912b40 0x55e2c0935810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e7902c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c09518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e7902c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701ff650 con 0x55e2c0912b40 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701fe430 con 0x55e2c0950ae0 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e7902c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1e701fe900 con 0x55e2c09115e0 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e7902c740 10 client.0 _ll_register_callbacks cb 0x7f1e60059a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0912b40 0x55e2c0935810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0912b40 0x55e2c0935810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43938/0 (socket says 172.21.15.139:43938) 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c09328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 -- 172.21.15.139:0/2388576148 learned_addr learned my addr 172.21.15.139:0/2388576148 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e6ffff640 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c09518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 -- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 msgr2=0x55e2c09328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c09328a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 -- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 msgr2=0x55e2c09518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c09518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 -- 172.21.15.139:0/2388576148 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c090c7c0 con 0x55e2c0912b40 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c09328a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e66ffd640 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0912b40 0x55e2c0935810 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1e58003e50 tx=0x7f1e580012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1c1cdd8ce9c7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.198+0000 7f1e4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/2388576148 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58024e40 con 0x55e2c0912b40 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/2388576148 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1e58032450 con 0x55e2c0912b40 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6802f040 con 0x55e2c0912b40 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/2388576148 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1e5803a050 con 0x55e2c0912b40 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 10 client.5652 fetch_fsmap learned FSMap version 9 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e2c0907900 con 0x55e2c0912b40 2024-04-26T18:18:26.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/2388576148 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6802f040 con 0x55e2c0912b40 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/2388576148 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1e5803d020 con 0x55e2c0912b40 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 10 client.5652 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 10 client.5652 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 20 client.5652 populate_metadata read hostname 'smithi139' 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c0951de0 0x55e2c0974a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 4 client.5652 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.7, "await_for": 42.0}] 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.7, "await_for": 42.0}) -- 0x55e2c0910850 con 0x55e2c0951de0 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.199+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c0951de0 0x55e2c0974a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.200+0000 7f1e6f7fe640 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c0951de0 0x55e2c0974a30 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a32433b4af044d1 server_cookie=b04cd8fe4943b719 in_seq=0 out_seq=0 2024-04-26T18:18:26.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:26.200+0000 7f1e4e7fc640 10 client.5652 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:29.481 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:18:29.484 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:18:31.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.251+0000 7f1e4e7fc640 1 -- 172.21.15.139:0/2388576148 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55e2c0910850 con 0x55e2c0951de0 2024-04-26T18:18:31.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.251+0000 7f1e4e7fc640 10 client.5652 handle_command_reply: tid=0 2024-04-26T18:18:31.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 client.5652 shutdown 2024-04-26T18:18:31.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0912b40 msgr2=0x55e2c0935810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:31.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0912b40 0x55e2c0935810 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1e58003e50 tx=0x7f1e580012d0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 shutdown_connections 2024-04-26T18:18:31.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e2c0950ae0 0x55e2c09518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2c0912b40 0x55e2c0935810 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e2c0951de0 0x55e2c0974a30 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 --2- 172.21.15.139:0/2388576148 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e2c09115e0 0x55e2c09328a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e4e7fc640 0 client.5652 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 >> 172.21.15.139:0/2388576148 conn(0x55e2c08d8740 msgr2=0x55e2c0939e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 shutdown_connections 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 1 -- 172.21.15.139:0/2388576148 wait complete. 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.252+0000 7f1e7902c740 20 client.5652 trim_cache size 0 max 16384 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:18:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 66, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "39ff5f28": { 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 66, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 83.7, 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:18:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:31.256 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1e5006c8f0 msgr2=0x7f1e5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1e5006c8f0 0x7f1e5006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e700c6ba0 tx=0x7f1e58009040 comp rx=0 tx=0).stop 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 msgr2=0x7f1e70068300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e70068300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1e60011ca0 tx=0x7f1e6000f610 comp rx=0 tx=0).stop 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 shutdown_connections 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1e5006c8f0 0x7f1e5006edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1e700c8d90 0x7f1e700b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1e701f4cd0 0x7f1e700c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 --2- 172.21.15.139:0/3559640903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1e5c004d40 0x7f1e70068300 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:31.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 >> 172.21.15.139:0/3559640903 conn(0x7f1e700746d0 msgr2=0x7f1e70157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:31.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 shutdown_connections 2024-04-26T18:18:31.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:31.253+0000 7f1e76237640 1 -- 172.21.15.139:0/3559640903 wait complete. 2024-04-26T18:18:31.266 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '39ff5f28', quiesce took 5.6 seconds. Will release after: 23.7 2024-04-26T18:18:54.968 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:18:55.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.078+0000 7fce7edbf640 1 Processor -- start 2024-04-26T18:18:55.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.078+0000 7fce7edbf640 1 -- start start 2024-04-26T18:18:55.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7edbf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce78153b10 0x7fce780c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7edbf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce7815ce60 0x7fce7815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7edbf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce7815d830 con 0x7fce7806e240 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7edbf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fce7806e8d0 con 0x7fce7815ce60 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7edbf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce78073910 con 0x7fce78153b10 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7cb5b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce78153b10 0x7fce780c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7d35c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce7815ce60 0x7fce7815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7cb5b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce78153b10 0x7fce780c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:37966/0 (socket says 172.21.15.139:37966) 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7d35c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce7815ce60 0x7fce7815d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:43498/0 (socket says 172.21.15.139:43498) 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7cb5b640 1 -- 172.21.15.139:0/2514083341 learned_addr learned my addr 172.21.15.139:0/2514083341 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce77fff640 1 --1- 172.21.15.139:0/2514083341 >> v1:172.21.15.143:6789/0 conn(0x7fce7806e240 0x7fce780cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:53208/0 (socket says 172.21.15.139:53208) 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7cb5b640 1 -- 172.21.15.139:0/2514083341 >> v2:172.21.15.143:3300/0 conn(0x7fce7815ce60 msgr2=0x7fce7815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7cb5b640 1 --2- 172.21.15.139:0/2514083341 >> v2:172.21.15.143:3300/0 conn(0x7fce7815ce60 0x7fce7815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7cb5b640 1 -- 172.21.15.139:0/2514083341 >> v1:172.21.15.143:6789/0 conn(0x7fce7806e240 legacy=0x7fce780cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7cb5b640 1 -- 172.21.15.139:0/2514083341 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce780c7d30 con 0x7fce78153b10 2024-04-26T18:18:55.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.079+0000 7fce7d35c640 1 --2- 172.21.15.139:0/2514083341 >> v2:172.21.15.143:3300/0 conn(0x7fce7815ce60 0x7fce7815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.080+0000 7fce7cb5b640 1 --2- 172.21.15.139:0/2514083341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce78153b10 0x7fce780c96d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009870 tx=0x7fce6c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b78fe3fdb2f897 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.080+0000 7fce777fe640 1 -- 172.21.15.139:0/2514083341 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c037070 con 0x7fce78153b10 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.080+0000 7fce777fe640 1 -- 172.21.15.139:0/2514083341 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c02ae50 con 0x7fce78153b10 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.080+0000 7fce777fe640 1 -- 172.21.15.139:0/2514083341 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c032860 con 0x7fce78153b10 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 -- 172.21.15.139:0/2514083341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce78153b10 msgr2=0x7fce780c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 --2- 172.21.15.139:0/2514083341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce78153b10 0x7fce780c96d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009870 tx=0x7fce6c02a300 comp rx=0 tx=0).stop 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 -- 172.21.15.139:0/2514083341 shutdown_connections 2024-04-26T18:18:55.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 --2- 172.21.15.139:0/2514083341 >> v2:172.21.15.143:3300/0 conn(0x7fce7815ce60 0x7fce7815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 --2- 172.21.15.139:0/2514083341 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce78153b10 0x7fce780c96d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 -- 172.21.15.139:0/2514083341 >> 172.21.15.139:0/2514083341 conn(0x7fce78068270 msgr2=0x7fce78068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 -- 172.21.15.139:0/2514083341 shutdown_connections 2024-04-26T18:18:55.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.081+0000 7fce7edbf640 1 -- 172.21.15.139:0/2514083341 wait complete. 2024-04-26T18:18:55.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.082+0000 7fce7edbf640 1 Processor -- start 2024-04-26T18:18:55.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.082+0000 7fce7edbf640 1 -- start start 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7edbf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce7806e240 0x7fce7815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7edbf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce78153b10 0x7fce7806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7edbf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce7815ce60 0x7fce7815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7edbf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce780732c0 con 0x7fce78153b10 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7edbf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fce78072fe0 con 0x7fce7815ce60 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7edbf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce780735a0 con 0x7fce7806e240 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce77fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce78153b10 0x7fce7806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce77fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce78153b10 0x7fce7806fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51032/0 (socket says 172.21.15.139:51032) 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce77fff640 1 -- 172.21.15.139:0/3365946020 learned_addr learned my addr 172.21.15.139:0/3365946020 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7cb5b640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce7806e240 0x7fce7815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.083+0000 7fce7d35c640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce7815ce60 0x7fce7815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce77fff640 1 -- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce7806e240 msgr2=0x7fce7815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce77fff640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce7806e240 0x7fce7815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce77fff640 1 -- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce7815ce60 msgr2=0x7fce7815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce77fff640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce7815ce60 0x7fce7815ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce77fff640 1 -- 172.21.15.139:0/3365946020 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce781f08d0 con 0x7fce78153b10 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce77fff640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce78153b10 0x7fce7806fcd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c430 tx=0x7fce6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce757fa640 1 -- 172.21.15.139:0/3365946020 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce640074e0 con 0x7fce78153b10 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce757fa640 1 -- 172.21.15.139:0/3365946020 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce64007680 con 0x7fce78153b10 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce78148280 con 0x7fce78153b10 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce757fa640 1 -- 172.21.15.139:0/3365946020 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64004a00 con 0x7fce78153b10 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.084+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce78148820 con 0x7fce78153b10 2024-04-26T18:18:55.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.085+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce78076d20 con 0x7fce78153b10 2024-04-26T18:18:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.085+0000 7fce757fa640 1 -- 172.21.15.139:0/3365946020 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce6401a020 con 0x7fce78153b10 2024-04-26T18:18:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.086+0000 7fce757fa640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fce5c06c8f0 0x7fce5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.086+0000 7fce7cb5b640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fce5c06c8f0 0x7fce5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.086+0000 7fce757fa640 1 -- 172.21.15.139:0/3365946020 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fce6408b720 con 0x7fce78153b10 2024-04-26T18:18:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.086+0000 7fce7cb5b640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fce5c06c8f0 0x7fce5c06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fce6c034000 tx=0x7fce6c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.091+0000 7fce757fa640 1 -- 172.21.15.139:0/3365946020 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce64059680 con 0x7fce78153b10 2024-04-26T18:18:55.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.302+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce7806eab0 con 0x7fce78153b10 2024-04-26T18:18:55.302 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.302+0000 7fce757fa640 1 -- 172.21.15.139:0/3365946020 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fce64058f80 con 0x7fce78153b10 2024-04-26T18:18:55.303 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:18:55.303 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:18:55.303 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:18:55.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fce5c06c8f0 msgr2=0x7fce5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fce5c06c8f0 0x7fce5c06edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fce6c034000 tx=0x7fce6c02e000 comp rx=0 tx=0).stop 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce78153b10 msgr2=0x7fce7806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce78153b10 0x7fce7806fcd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fce6400c430 tx=0x7fce6400c830 comp rx=0 tx=0).stop 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 shutdown_connections 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fce5c06c8f0 0x7fce5c06edb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce7815ce60 0x7fce7815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce78153b10 0x7fce7806fcd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 --2- 172.21.15.139:0/3365946020 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce7806e240 0x7fce7815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 >> 172.21.15.139:0/3365946020 conn(0x7fce78068270 msgr2=0x7fce78151f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 shutdown_connections 2024-04-26T18:18:55.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.304+0000 7fce7edbf640 1 -- 172.21.15.139:0/3365946020 wait complete. 2024-04-26T18:18:55.315 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 39ff5f28 --release --await' 2024-04-26T18:18:55.316 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 39ff5f28 --release --await 2024-04-26T18:18:55.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.421+0000 7f2eedb90640 1 Processor -- start 2024-04-26T18:18:55.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.421+0000 7f2eedb90640 1 -- start start 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2eedb90640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2ee8153ab0 0x7f2ee80c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2eedb90640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee815ce90 0x7f2ee815a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2eedb90640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee81599b0 con 0x7f2ee80c9be0 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2eedb90640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee80716c0 con 0x7f2ee8153ab0 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2eedb90640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80709e0 con 0x7f2ee815ce90 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2ee7fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2ee80c9be0 0x7f2ee80cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:50388/0 (socket says 172.21.15.139:50388) 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2ee7fff640 1 -- 172.21.15.139:0/657632916 learned_addr learned my addr 172.21.15.139:0/657632916 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:18:55.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2edffff640 1 --2- 172.21.15.139:0/657632916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee815ce90 0x7f2ee815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/657632916 >> v2:172.21.15.143:3300/0 conn(0x7f2ee8153ab0 0x7f2ee80c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2ee6ffd640 1 -- 172.21.15.139:0/657632916 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400936178 0 0) 0x7f2ee81599b0 con 0x7f2ee80c9be0 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2ee6ffd640 1 -- 172.21.15.139:0/657632916 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ed4003520 con 0x7f2ee80c9be0 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2ee6ffd640 1 -- 172.21.15.139:0/657632916 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2806394438 0 0) 0x7f2ed4003520 con 0x7f2ee80c9be0 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2edffff640 1 -- 172.21.15.139:0/657632916 >> v2:172.21.15.143:3300/0 conn(0x7f2ee8153ab0 msgr2=0x7f2ee80c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2edffff640 1 --2- 172.21.15.139:0/657632916 >> v2:172.21.15.143:3300/0 conn(0x7f2ee8153ab0 0x7f2ee80c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2edffff640 1 -- 172.21.15.139:0/657632916 >> v1:172.21.15.139:6789/0 conn(0x7f2ee80c9be0 legacy=0x7f2ee80cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2edffff640 1 -- 172.21.15.139:0/657632916 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee8070cc0 con 0x7f2ee815ce90 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.422+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/657632916 >> v2:172.21.15.143:3300/0 conn(0x7f2ee8153ab0 0x7f2ee80c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.423+0000 7f2edffff640 1 --2- 172.21.15.139:0/657632916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee815ce90 0x7f2ee815a450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097a0 tx=0x7f2ed002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3e8c2cd7d04b0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.423+0000 7f2ee6ffd640 1 -- 172.21.15.139:0/657632916 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0037070 con 0x7f2ee815ce90 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.423+0000 7f2ee6ffd640 1 -- 172.21.15.139:0/657632916 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed002ac30 con 0x7f2ee815ce90 2024-04-26T18:18:55.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.423+0000 7f2ee6ffd640 1 -- 172.21.15.139:0/657632916 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0001a10 con 0x7f2ee815ce90 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 -- 172.21.15.139:0/657632916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee815ce90 msgr2=0x7f2ee815a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 --2- 172.21.15.139:0/657632916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee815ce90 0x7f2ee815a450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097a0 tx=0x7f2ed002a1a0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 -- 172.21.15.139:0/657632916 shutdown_connections 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 --2- 172.21.15.139:0/657632916 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee815ce90 0x7f2ee815a450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 --2- 172.21.15.139:0/657632916 >> v2:172.21.15.143:3300/0 conn(0x7f2ee8153ab0 0x7f2ee80c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 -- 172.21.15.139:0/657632916 >> 172.21.15.139:0/657632916 conn(0x7f2ee8068090 msgr2=0x7f2ee8068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 -- 172.21.15.139:0/657632916 shutdown_connections 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.424+0000 7f2eedb90640 1 -- 172.21.15.139:0/657632916 wait complete. 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.425+0000 7f2eedb90640 1 Processor -- start 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.425+0000 7f2eedb90640 1 -- start start 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee80c9be0 0x7f2ee81583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee8153ab0 0x7f2ee80ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ee815ce90 0x7f2ee814cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80ca010 con 0x7f2ee815ce90 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8159f30 con 0x7f2ee80c9be0 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee8070fa0 con 0x7f2ee8153ab0 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ee815ce90 0x7f2ee814cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ee815ce90 0x7f2ee814cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51040/0 (socket says 172.21.15.139:51040) 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1769925963 learned_addr learned my addr 172.21.15.139:0/1769925963 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2edffff640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee8153ab0 0x7f2ee80ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee80c9be0 0x7f2ee81583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee8153ab0 msgr2=0x7f2ee80ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee8153ab0 0x7f2ee80ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee80c9be0 msgr2=0x7f2ee81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee80c9be0 0x7f2ee81583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1769925963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee81e2f00 con 0x7f2ee815ce90 2024-04-26T18:18:55.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee80c9be0 0x7f2ee81583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:18:55.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ee815ce90 0x7f2ee814cd20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000cb70 tx=0x7f2ee000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee4ff9640 1 -- 172.21.15.139:0/1769925963 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0018070 con 0x7f2ee815ce90 2024-04-26T18:18:55.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee4ff9640 1 -- 172.21.15.139:0/1769925963 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee0004d60 con 0x7f2ee815ce90 2024-04-26T18:18:55.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2ee4ff9640 1 -- 172.21.15.139:0/1769925963 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000ad40 con 0x7f2ee815ce90 2024-04-26T18:18:55.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee81e31e0 con 0x7f2ee815ce90 2024-04-26T18:18:55.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.426+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee81e37a0 con 0x7f2ee815ce90 2024-04-26T18:18:55.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.428+0000 7f2ee4ff9640 1 -- 172.21.15.139:0/1769925963 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ee001b070 con 0x7f2ee815ce90 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.428+0000 7f2ee4ff9640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ec806c8f0 0x7f2ec806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.428+0000 7f2ee4ff9640 1 -- 172.21.15.139:0/1769925963 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2ee008b780 con 0x7f2ee815ce90 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.428+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ec806c8f0 0x7f2ec806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.429+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ec806c8f0 0x7f2ec806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009ba0 tx=0x7f2ed8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.429+0000 7f2ef0983740 1 Processor -- start 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.429+0000 7f2ef0983740 1 -- start start 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6724b0 0x5613de6b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de672890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ef0983740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5613de5d7040 con 0x5613de6724b0 2024-04-26T18:18:55.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5613de572b60 con 0x5613de673a10 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5613de5d3000 con 0x5613de6b19b0 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6724b0 0x5613de6b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6724b0 0x5613de6b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51054/0 (socket says 172.21.15.139:51054) 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 -- 172.21.15.139:0/1567424152 learned_addr learned my addr 172.21.15.139:0/1567424152 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2edffff640 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de672890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 -- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 msgr2=0x5613de672890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de672890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 -- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 msgr2=0x5613de672dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 -- 172.21.15.139:0/1567424152 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613de5679c0 con 0x5613de6724b0 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2edffff640 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de672890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.430+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6724b0 0x5613de6b1470 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8011e70 tx=0x7f2ed8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54f33ccb06a4b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2edd7fa640 1 -- 172.21.15.139:0/1567424152 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8015e50 con 0x5613de6724b0 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2edd7fa640 1 -- 172.21.15.139:0/1567424152 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed8026070 con 0x5613de6724b0 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2edd7fa640 1 -- 172.21.15.139:0/1567424152 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8021660 con 0x5613de6724b0 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 -- 172.21.15.139:0/1567424152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6724b0 msgr2=0x5613de6b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6724b0 0x5613de6b1470 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8011e70 tx=0x7f2ed8014000 comp rx=0 tx=0).stop 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 -- 172.21.15.139:0/1567424152 shutdown_connections 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de672890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1567424152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6724b0 0x5613de6b1470 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 -- 172.21.15.139:0/1567424152 >> 172.21.15.139:0/1567424152 conn(0x5613de639930 msgr2=0x5613de6b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 -- 172.21.15.139:0/1567424152 shutdown_connections 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.431+0000 7f2ef0983740 1 -- 172.21.15.139:0/1567424152 wait complete. 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.432+0000 7f2ef0983740 1 -- start start 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.432+0000 7f2ef0983740 1 Processor -- start 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de699820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de673a10 0x5613de6c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de6c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5613de670af0 con 0x5613de673a10 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5613de5704f0 con 0x5613de6724b0 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5613de674040 con 0x5613de6b19b0 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 10 client.0 _ll_register_callbacks cb 0x5613de5cdc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de673a10 0x5613de6c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de673a10 0x5613de6c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51062/0 (socket says 172.21.15.139:51062) 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 -- 172.21.15.139:0/3984464130 learned_addr learned my addr 172.21.15.139:0/3984464130 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de6c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de699820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 -- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 msgr2=0x5613de6c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de6c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 -- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 msgr2=0x5613de699820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de699820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 -- 172.21.15.139:0/3984464130 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613de2e8920 con 0x5613de673a10 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de699820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2edffff640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de673a10 0x5613de6c3c30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097a0 tx=0x7f2ed0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a8c5241dad2299 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ec67fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ec67fc640 1 -- 172.21.15.139:0/3984464130 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0037040 con 0x5613de673a10 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ec67fc640 1 -- 172.21.15.139:0/3984464130 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2ed0032df0 con 0x5613de673a10 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.433+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ed8026070 con 0x5613de673a10 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ec67fc640 1 -- 172.21.15.139:0/3984464130 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2ed0006e10 con 0x5613de673a10 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 10 client.5667 fetch_fsmap learned FSMap version 9 2024-04-26T18:18:55.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5613de3b4d30 con 0x5613de673a10 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ec67fc640 1 -- 172.21.15.139:0/3984464130 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed8026070 con 0x5613de673a10 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ec67fc640 1 -- 172.21.15.139:0/3984464130 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2ed004e050 con 0x5613de673a10 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 10 client.5667 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 10 client.5667 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 20 client.5667 populate_metadata read hostname 'smithi139' 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b6e10 0x5613de6c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 4 client.5667 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613de5aaa00 con 0x5613de6b6e10 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b6e10 0x5613de6c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ec67fc640 10 client.5667 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.434+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b6e10 0x5613de6c6210 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=733f83255079d7cd server_cookie=96a779513f802c23 in_seq=0 out_seq=0 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ec67fc640 1 -- 172.21.15.139:0/3984464130 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5613de5aaa00 con 0x5613de6b6e10 2024-04-26T18:18:55.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ec67fc640 10 client.5667 handle_command_reply: tid=0 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 client.5667 shutdown 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de673a10 msgr2=0x5613de6c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de673a10 0x5613de6c3c30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097a0 tx=0x7f2ed0004730 comp rx=0 tx=0).stop 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 shutdown_connections 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b6e10 0x5613de6c6210 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6b19b0 0x5613de6c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ec67fc640 0 client.5667 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de673a10 0x5613de6c3c30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 --2- 172.21.15.139:0/3984464130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de699820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 >> 172.21.15.139:0/3984464130 conn(0x5613de639930 msgr2=0x5613de672890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 shutdown_connections 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.435+0000 7f2ef0983740 1 -- 172.21.15.139:0/3984464130 wait complete. 2024-04-26T18:18:55.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.436+0000 7f2ef0983740 20 client.5667 trim_cache size 0 max 16384 2024-04-26T18:18:55.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.453+0000 7f2ef0983740 1 Processor -- start 2024-04-26T18:18:55.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.453+0000 7f2ef0983740 1 -- start start 2024-04-26T18:18:55.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6724b0 0x5613de672a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ef0983740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81fe390 con 0x5613de6b19b0 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81fd270 con 0x5613de673a10 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80c82e0 con 0x5613de6724b0 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6bf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51078/0 (socket says 172.21.15.139:51078) 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1408618053 learned_addr learned my addr 172.21.15.139:0/1408618053 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2edffff640 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6724b0 msgr2=0x5613de672a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6724b0 0x5613de672a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6724b0 0x5613de672a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 msgr2=0x5613de672fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 -- 172.21.15.139:0/1408618053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613de69cb70 con 0x5613de6b19b0 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6724b0 0x5613de672a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6bf5e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0055610 tx=0x7f2ee0058db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164a2192609c045d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2edcff9640 1 -- 172.21.15.139:0/1408618053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee005d4b0 con 0x5613de6b19b0 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2edcff9640 1 -- 172.21.15.139:0/1408618053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee0061ce0 con 0x5613de6b19b0 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.454+0000 7f2edcff9640 1 -- 172.21.15.139:0/1408618053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0055820 con 0x5613de6b19b0 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 -- 172.21.15.139:0/1408618053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 msgr2=0x5613de6bf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6bf5e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0055610 tx=0x7f2ee0058db0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 -- 172.21.15.139:0/1408618053 shutdown_connections 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6bf5e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de673a10 0x5613de672fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 --2- 172.21.15.139:0/1408618053 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de6724b0 0x5613de672a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 -- 172.21.15.139:0/1408618053 >> 172.21.15.139:0/1408618053 conn(0x5613de639930 msgr2=0x5613de66fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 -- 172.21.15.139:0/1408618053 shutdown_connections 2024-04-26T18:18:55.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.455+0000 7f2ef0983740 1 -- 172.21.15.139:0/1408618053 wait complete. 2024-04-26T18:18:55.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 -- start start 2024-04-26T18:18:55.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 Processor -- start 2024-04-26T18:18:55.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de6d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de673a10 0x5613de7250d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81fbef0 con 0x5613de6b19b0 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81fcba0 con 0x5613de6724b0 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee81fc4d0 con 0x5613de673a10 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ef0983740 10 client.0 _ll_register_callbacks cb 0x7f2ed40036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ee7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51092/0 (socket says 172.21.15.139:51092) 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ee7fff640 1 -- 172.21.15.139:0/2643020167 learned_addr learned my addr 172.21.15.139:0/2643020167 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.456+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de6d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2edffff640 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de673a10 0x5613de7250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ee7fff640 1 -- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de673a10 msgr2=0x5613de7250d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de673a10 0x5613de7250d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ee7fff640 1 -- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 msgr2=0x5613de6d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de6d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ee7fff640 1 -- 172.21.15.139:0/2643020167 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613de66fc70 con 0x5613de6b19b0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ee7fff640 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6ac4c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000cfd0 tx=0x7f2ee001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd4d1bf5cdb57bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ec67fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ec67fc640 1 -- 172.21.15.139:0/2643020167 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0058600 con 0x5613de6b19b0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ec67fc640 1 -- 172.21.15.139:0/2643020167 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2ee00587a0 con 0x5613de6b19b0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee0061ce0 con 0x5613de6b19b0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ec67fc640 1 -- 172.21.15.139:0/2643020167 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2ee006db10 con 0x5613de6b19b0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 10 client.5673 fetch_fsmap learned FSMap version 9 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5613de6929f0 con 0x5613de6b19b0 2024-04-26T18:18:55.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ec67fc640 1 -- 172.21.15.139:0/2643020167 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee0061ce0 con 0x5613de6b19b0 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ec67fc640 1 -- 172.21.15.139:0/2643020167 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2ee006dcb0 con 0x5613de6b19b0 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 10 client.5673 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 10 client.5673 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 20 client.5673 populate_metadata read hostname 'smithi139' 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b3490 0x5613de723790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 4 client.5673 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "39ff5f28", "release": true, "await": true}] 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.457+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "39ff5f28", "release": true, "await": true}) -- 0x5613de5e4c50 con 0x5613de6b3490 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b3490 0x5613de723790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ec67fc640 10 client.5673 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ee77fe640 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b3490 0x5613de723790 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7a97e24d2b4a69 server_cookie=4713beeb2668c06f in_seq=0 out_seq=0 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ec67fc640 1 -- 172.21.15.139:0/2643020167 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5613de5e4c50 con 0x5613de6b3490 2024-04-26T18:18:55.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ec67fc640 10 client.5673 handle_command_reply: tid=0 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 client.5673 shutdown 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 msgr2=0x5613de6ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6ac4c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000cfd0 tx=0x7f2ee001f040 comp rx=0 tx=0).stop 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 shutdown_connections 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613de6b19b0 0x5613de6ac4c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613de6b3490 0x5613de723790 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613de673a10 0x5613de7250d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 --2- 172.21.15.139:0/2643020167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613de6724b0 0x5613de6d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ec67fc640 0 client.5673 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 >> 172.21.15.139:0/2643020167 conn(0x5613de639930 msgr2=0x5613de672a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 shutdown_connections 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.458+0000 7f2ef0983740 1 -- 172.21.15.139:0/2643020167 wait complete. 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2ef0983740 20 client.5673 trim_cache size 0 max 16384 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 68, 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stdout: "39ff5f28": { 2024-04-26T18:18:55.467 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 68, 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 83.7, 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:55.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:55.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:55.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:18:55.469 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:18:55.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ec806c8f0 msgr2=0x7f2ec806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ec806c8f0 0x7f2ec806edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009ba0 tx=0x7f2ed8008040 comp rx=0 tx=0).stop 2024-04-26T18:18:55.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ee815ce90 msgr2=0x7f2ee814cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:55.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ee815ce90 0x7f2ee814cd20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000cb70 tx=0x7f2ee000a430 comp rx=0 tx=0).stop 2024-04-26T18:18:55.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 shutdown_connections 2024-04-26T18:18:55.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ec806c8f0 0x7f2ec806edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ee815ce90 0x7f2ee814cd20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ee8153ab0 0x7f2ee80ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 --2- 172.21.15.139:0/1769925963 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ee80c9be0 0x7f2ee81583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:55.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 >> 172.21.15.139:0/1769925963 conn(0x7f2ee8068090 msgr2=0x7f2ee80c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:55.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 shutdown_connections 2024-04-26T18:18:55.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:18:55.459+0000 7f2eedb90640 1 -- 172.21.15.139:0/1769925963 wait complete. 2024-04-26T18:18:55.471 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '39ff5f28', seconds elapsed: 29.8 2024-04-26T18:18:58.239 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 16% (56/334) Updating files: 17% (57/334) Updating files: 18% (61/334) Updating files: 19% (64/334) Updating files: 20% (67/334) Updating files: 21% (71/334) Updating files: 22% (74/334) Updating files: 23% (77/334) Updating files: 24% (81/334) Updating files: 25% (84/334) Updating files: 26% (87/334) Updating files: 27% (91/334) Updating files: 28% (94/334) Updating files: 29% (97/334) Updating files: 30% (101/334) Updating files: 31% (104/334) Updating files: 32% (107/334) Updating files: 33% (111/334) Updating files: 34% (114/334) Updating files: 35% (117/334) Updating files: 36% (121/334) Updating files: 37% (124/334) Updating files: 38% (127/334) Updating files: 39% (131/334) Updating files: 40% (134/334) Updating files: 41% (137/334) Updating files: 42% (141/334) Updating files: 43% (144/334) Updating files: 44% (147/334) Updating files: 45% (151/334) Updating files: 46% (154/334) Updating files: 47% (157/334) Updating files: 48% (161/334) Updating files: 49% (164/334) Updating files: 50% (167/334) Updating files: 51% (171/334) Updating files: 52% (174/334) Updating files: 53% (178/334) Updating files: 54% (181/334) Updating files: 55% (184/334) Updating files: 55% (187/334) Updating files: 56% (188/334) Updating files: 57% (191/334) Updating files: 58% (194/334) Updating files: 59% (198/334) Updating files: 59% (200/334) Updating files: 60% (201/334) Updating files: 61% (204/334) Updating files: 62% (208/334) Updating files: 63% (211/334) Updating files: 64% (214/334) Updating files: 65% (218/334) Updating files: 66% (221/334) Updating files: 67% (224/334) Updating files: 68% (228/334) Updating files: 69% (231/334) Updating files: 70% (234/334) Updating files: 71% (238/334) Updating files: 71% (239/334) Updating files: 72% (241/334) Updating files: 73% (244/334) Updating files: 74% (248/334) Updating files: 75% (251/334) Updating files: 76% (254/334) Updating files: 77% (258/334) Updating files: 78% (261/334) Updating files: 79% (264/334) Updating files: 80% (268/334) Updating files: 81% (271/334) Updating files: 82% (274/334) Updating files: 83% (278/334) Updating files: 84% (281/334) Updating files: 85% (284/334) Updating files: 86% (288/334) Updating files: 87% (291/334) Updating files: 88% (294/334) Updating files: 89% (298/334) Updating files: 90% (301/334) Updating files: 91% (304/334) Updating files: 92% (308/334) Updating files: 93% (311/334) Updating files: 94% (314/334) Updating files: 95% (318/334) Updating files: 95% (320/334) Updating files: 96% (321/334) Updating files: 97% (324/334) Updating files: 98% (328/334) Updating files: 99% (331/334) Updating files: 100% (334/334) Updating files: 100% (334/334), done. 2024-04-26T18:18:58.397 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 0afda378124 v0.35 2024-04-26T18:18:58.421 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.35 2024-04-26T18:18:58.431 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:18:58.431 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 36 -eq 48 ']' 2024-04-26T18:18:58.431 INFO:tasks.workunit.client.0.smithi139.stdout:v0.36 2024-04-26T18:18:58.431 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.36 2024-04-26T18:18:58.431 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.36 2024-04-26T18:18:58.431 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.36 2024-04-26T18:18:59.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:18:59.622 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:19:08.696 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 69% (169/244) Updating files: 70% (171/244) Updating files: 71% (174/244) Updating files: 72% (176/244) Updating files: 73% (179/244) Updating files: 74% (181/244) Updating files: 75% (183/244) Updating files: 76% (186/244) Updating files: 77% (188/244) Updating files: 78% (191/244) Updating files: 79% (193/244) Updating files: 80% (196/244) Updating files: 81% (198/244) Updating files: 82% (201/244) Updating files: 83% (203/244) Updating files: 84% (205/244) Updating files: 85% (208/244) Updating files: 86% (210/244) Updating files: 87% (213/244) Updating files: 88% (215/244) Updating files: 89% (218/244) Updating files: 90% (220/244) Updating files: 91% (223/244) Updating files: 92% (225/244) Updating files: 93% (227/244) Updating files: 94% (230/244) Updating files: 95% (232/244) Updating files: 96% (235/244) Updating files: 97% (237/244) Updating files: 98% (240/244) Updating files: 99% (242/244) Updating files: 100% (244/244) Updating files: 100% (244/244), done. 2024-04-26T18:19:09.717 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 877cacbbdbb v0.36 2024-04-26T18:19:09.718 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.36 2024-04-26T18:19:09.741 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:09.742 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 37 -eq 48 ']' 2024-04-26T18:19:09.742 INFO:tasks.workunit.client.0.smithi139.stdout:v0.37 2024-04-26T18:19:09.742 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.37 2024-04-26T18:19:09.743 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.37 2024-04-26T18:19:09.743 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.37 2024-04-26T18:19:10.941 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 72% (132/181) Updating files: 73% (133/181) Updating files: 74% (134/181) Updating files: 75% (136/181) Updating files: 76% (138/181) Updating files: 77% (140/181) Updating files: 78% (142/181) Updating files: 79% (143/181) Updating files: 80% (145/181) Updating files: 81% (147/181) Updating files: 82% (149/181) Updating files: 83% (151/181) Updating files: 84% (153/181) Updating files: 85% (154/181) Updating files: 86% (156/181) Updating files: 87% (158/181) Updating files: 88% (160/181) Updating files: 89% (162/181) Updating files: 90% (163/181) Updating files: 91% (165/181) Updating files: 92% (167/181) Updating files: 93% (169/181) Updating files: 94% (171/181) Updating files: 95% (172/181) Updating files: 96% (174/181) Updating files: 97% (176/181) Updating files: 98% (178/181) Updating files: 99% (180/181) Updating files: 100% (181/181) Updating files: 100% (181/181), done. 2024-04-26T18:19:11.540 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at a6f3bbb744a v0.37 2024-04-26T18:19:11.542 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.37 2024-04-26T18:19:11.617 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:11.617 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 38 -eq 48 ']' 2024-04-26T18:19:11.617 INFO:tasks.workunit.client.0.smithi139.stdout:v0.38 2024-04-26T18:19:11.617 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.38 2024-04-26T18:19:11.618 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.38 2024-04-26T18:19:11.618 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.38 2024-04-26T18:19:15.640 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 55% (95/171) Updating files: 56% (96/171) Updating files: 57% (98/171) Updating files: 58% (100/171) Updating files: 59% (101/171) Updating files: 59% (102/171) Updating files: 60% (103/171) Updating files: 61% (105/171) Updating files: 62% (107/171) Updating files: 63% (108/171) Updating files: 64% (110/171) Updating files: 65% (112/171) Updating files: 66% (113/171) Updating files: 67% (115/171) Updating files: 68% (117/171) Updating files: 69% (118/171) Updating files: 70% (120/171) Updating files: 71% (122/171) Updating files: 72% (124/171) Updating files: 73% (125/171) Updating files: 74% (127/171) Updating files: 75% (129/171) Updating files: 76% (130/171) Updating files: 77% (132/171) Updating files: 77% (133/171) Updating files: 78% (134/171) Updating files: 79% (136/171) Updating files: 80% (137/171) Updating files: 81% (139/171) Updating files: 82% (141/171) Updating files: 83% (142/171) Updating files: 84% (144/171) Updating files: 85% (146/171) Updating files: 86% (148/171) Updating files: 87% (149/171) Updating files: 88% (151/171) Updating files: 89% (153/171) Updating files: 90% (154/171) Updating files: 91% (156/171) Updating files: 92% (158/171) Updating files: 93% (160/171) Updating files: 94% (161/171) Updating files: 95% (163/171) Updating files: 96% (165/171) Updating files: 97% (166/171) Updating files: 98% (168/171) Updating files: 99% (170/171) Updating files: 100% (171/171) Updating files: 100% (171/171), done. 2024-04-26T18:19:15.928 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at b600ec2ac7c v0.38 2024-04-26T18:19:15.929 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.38 2024-04-26T18:19:15.944 INFO:tasks.workunit.client.0.smithi139.stdout:v0.39 2024-04-26T18:19:15.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:15.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 39 -eq 48 ']' 2024-04-26T18:19:15.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.39 2024-04-26T18:19:15.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.39 2024-04-26T18:19:15.945 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.39 2024-04-26T18:19:29.198 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 10% (27/258) Updating files: 11% (29/258) Updating files: 12% (31/258) Updating files: 13% (34/258) Updating files: 14% (37/258) Updating files: 15% (39/258) Updating files: 16% (42/258) Updating files: 17% (44/258) Updating files: 18% (47/258) Updating files: 19% (50/258) Updating files: 20% (52/258) Updating files: 21% (55/258) Updating files: 22% (57/258) Updating files: 23% (60/258) Updating files: 24% (62/258) Updating files: 25% (65/258) Updating files: 26% (68/258) Updating files: 27% (70/258) Updating files: 28% (73/258) Updating files: 29% (75/258) Updating files: 30% (78/258) Updating files: 31% (80/258) Updating files: 32% (83/258) Updating files: 33% (86/258) Updating files: 34% (88/258) Updating files: 35% (91/258) Updating files: 36% (93/258) Updating files: 37% (96/258) Updating files: 38% (99/258) Updating files: 39% (101/258) Updating files: 40% (104/258) Updating files: 41% (106/258) Updating files: 42% (109/258) Updating files: 43% (111/258) Updating files: 44% (114/258) Updating files: 45% (117/258) Updating files: 46% (119/258) Updating files: 47% (122/258) Updating files: 48% (124/258) Updating files: 49% (127/258) Updating files: 50% (129/258) Updating files: 51% (132/258) Updating files: 52% (135/258) Updating files: 53% (137/258) Updating files: 54% (140/258) Updating files: 55% (142/258) Updating files: 56% (145/258) Updating files: 57% (148/258) Updating files: 58% (150/258) Updating files: 59% (153/258) Updating files: 60% (155/258) Updating files: 61% (158/258) Updating files: 61% (159/258) Updating files: 62% (160/258) Updating files: 63% (163/258) Updating files: 64% (166/258) Updating files: 65% (168/258) Updating files: 66% (171/258) Updating files: 67% (173/258) Updating files: 68% (176/258) Updating files: 69% (179/258) Updating files: 70% (181/258) Updating files: 71% (184/258) Updating files: 72% (186/258) Updating files: 73% (189/258) Updating files: 74% (191/258) Updating files: 75% (194/258) Updating files: 76% (197/258) Updating files: 77% (199/258) Updating files: 78% (202/258) Updating files: 79% (204/258) Updating files: 80% (207/258) Updating files: 81% (209/258) Updating files: 82% (212/258) Updating files: 83% (215/258) Updating files: 84% (217/258) Updating files: 85% (220/258) Updating files: 86% (222/258) Updating files: 87% (225/258) Updating files: 88% (228/258) Updating files: 89% (230/258) Updating files: 90% (233/258) Updating files: 91% (235/258) Updating files: 92% (238/258) Updating files: 93% (240/258) Updating files: 94% (243/258) Updating files: 95% (246/258) Updating files: 96% (248/258) Updating files: 97% (251/258) Updating files: 98% (253/258) Updating files: 99% (256/258) Updating files: 100% (258/258) Updating files: 100% (258/258), done. 2024-04-26T18:19:29.223 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 321ecdaba2c v0.39 2024-04-26T18:19:29.224 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.39 2024-04-26T18:19:29.297 INFO:tasks.workunit.client.0.smithi139.stdout:v0.40 2024-04-26T18:19:29.297 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:29.297 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 40 -eq 48 ']' 2024-04-26T18:19:29.297 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.40 2024-04-26T18:19:29.298 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.40 2024-04-26T18:19:29.298 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.40 2024-04-26T18:19:29.693 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:19:29.696 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:19:34.783 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 38% (88/226) Updating files: 39% (89/226) Updating files: 40% (91/226) Updating files: 41% (93/226) Updating files: 42% (95/226) Updating files: 42% (97/226) Updating files: 43% (98/226) Updating files: 44% (100/226) Updating files: 45% (102/226) Updating files: 46% (104/226) Updating files: 47% (107/226) Updating files: 48% (109/226) Updating files: 49% (111/226) Updating files: 50% (113/226) Updating files: 51% (116/226) Updating files: 52% (118/226) Updating files: 53% (120/226) Updating files: 54% (123/226) Updating files: 55% (125/226) Updating files: 56% (127/226) Updating files: 57% (129/226) Updating files: 58% (132/226) Updating files: 59% (134/226) Updating files: 60% (136/226) Updating files: 61% (138/226) Updating files: 62% (141/226) Updating files: 63% (143/226) Updating files: 64% (145/226) Updating files: 65% (147/226) Updating files: 66% (150/226) Updating files: 67% (152/226) Updating files: 68% (154/226) Updating files: 69% (156/226) Updating files: 70% (159/226) Updating files: 70% (160/226) Updating files: 71% (161/226) Updating files: 72% (163/226) Updating files: 73% (165/226) Updating files: 74% (168/226) Updating files: 75% (170/226) Updating files: 76% (172/226) Updating files: 77% (175/226) Updating files: 78% (177/226) Updating files: 79% (179/226) Updating files: 80% (181/226) Updating files: 80% (183/226) Updating files: 81% (184/226) Updating files: 82% (186/226) Updating files: 83% (188/226) Updating files: 84% (190/226) Updating files: 85% (193/226) Updating files: 86% (195/226) Updating files: 87% (197/226) Updating files: 88% (199/226) Updating files: 89% (202/226) Updating files: 90% (204/226) Updating files: 91% (206/226) Updating files: 92% (208/226) Updating files: 93% (211/226) Updating files: 94% (213/226) Updating files: 95% (215/226) Updating files: 96% (217/226) Updating files: 97% (220/226) Updating files: 98% (222/226) Updating files: 99% (224/226) Updating files: 100% (226/226) Updating files: 100% (226/226), done. 2024-04-26T18:19:34.833 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 7eea40ea37f v0.40 2024-04-26T18:19:34.835 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.40 2024-04-26T18:19:34.921 INFO:tasks.workunit.client.0.smithi139.stdout:v0.41 2024-04-26T18:19:34.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:34.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 41 -eq 48 ']' 2024-04-26T18:19:34.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.41 2024-04-26T18:19:34.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.41 2024-04-26T18:19:34.922 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.41 2024-04-26T18:19:37.690 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 17% (15/87) Updating files: 18% (16/87) Updating files: 19% (17/87) Updating files: 20% (18/87) Updating files: 21% (19/87) Updating files: 22% (20/87) Updating files: 24% (21/87) Updating files: 25% (22/87) Updating files: 26% (23/87) Updating files: 27% (24/87) Updating files: 28% (25/87) Updating files: 29% (26/87) Updating files: 31% (27/87) Updating files: 32% (28/87) Updating files: 33% (29/87) Updating files: 34% (30/87) Updating files: 35% (31/87) Updating files: 36% (32/87) Updating files: 37% (33/87) Updating files: 39% (34/87) Updating files: 40% (35/87) Updating files: 41% (36/87) Updating files: 42% (37/87) Updating files: 43% (38/87) Updating files: 44% (39/87) Updating files: 45% (40/87) Updating files: 47% (41/87) Updating files: 48% (42/87) Updating files: 49% (43/87) Updating files: 50% (44/87) Updating files: 51% (45/87) Updating files: 52% (46/87) Updating files: 54% (47/87) Updating files: 55% (48/87) Updating files: 56% (49/87) Updating files: 57% (50/87) Updating files: 58% (51/87) Updating files: 59% (52/87) Updating files: 60% (53/87) Updating files: 62% (54/87) Updating files: 63% (55/87) Updating files: 64% (56/87) Updating files: 65% (57/87) Updating files: 66% (58/87) Updating files: 67% (59/87) Updating files: 68% (60/87) Updating files: 70% (61/87) Updating files: 71% (62/87) Updating files: 72% (63/87) Updating files: 73% (64/87) Updating files: 74% (65/87) Updating files: 75% (66/87) Updating files: 77% (67/87) Updating files: 78% (68/87) Updating files: 79% (69/87) Updating files: 80% (70/87) Updating files: 81% (71/87) Updating files: 82% (72/87) Updating files: 83% (73/87) Updating files: 85% (74/87) Updating files: 86% (75/87) Updating files: 87% (76/87) Updating files: 88% (77/87) Updating files: 89% (78/87) Updating files: 90% (79/87) Updating files: 91% (80/87) Updating files: 93% (81/87) Updating files: 94% (82/87) Updating files: 95% (83/87) Updating files: 96% (84/87) Updating files: 97% (85/87) Updating files: 98% (86/87) Updating files: 100% (87/87) Updating files: 100% (87/87), done. 2024-04-26T18:19:37.725 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at c1345f7136a v0.41 2024-04-26T18:19:37.726 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.41 2024-04-26T18:19:37.763 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:37.764 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 42 -eq 48 ']' 2024-04-26T18:19:37.764 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.42 2024-04-26T18:19:37.764 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.42 2024-04-26T18:19:37.764 INFO:tasks.workunit.client.0.smithi139.stdout:v0.42 2024-04-26T18:19:37.764 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.42 2024-04-26T18:19:43.803 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 9% (23/250) Updating files: 10% (25/250) Updating files: 11% (28/250) Updating files: 12% (30/250) Updating files: 13% (33/250) Updating files: 14% (35/250) Updating files: 15% (38/250) Updating files: 16% (40/250) Updating files: 16% (42/250) Updating files: 17% (43/250) Updating files: 18% (45/250) Updating files: 19% (48/250) Updating files: 20% (50/250) Updating files: 21% (53/250) Updating files: 22% (55/250) Updating files: 23% (58/250) Updating files: 24% (60/250) Updating files: 25% (63/250) Updating files: 26% (65/250) Updating files: 27% (68/250) Updating files: 28% (70/250) Updating files: 29% (73/250) Updating files: 30% (75/250) Updating files: 31% (78/250) Updating files: 32% (80/250) Updating files: 33% (83/250) Updating files: 34% (85/250) Updating files: 35% (88/250) Updating files: 36% (90/250) Updating files: 37% (93/250) Updating files: 38% (95/250) Updating files: 39% (98/250) Updating files: 40% (100/250) Updating files: 41% (103/250) Updating files: 42% (105/250) Updating files: 43% (108/250) Updating files: 44% (110/250) Updating files: 45% (113/250) Updating files: 46% (115/250) Updating files: 47% (118/250) Updating files: 48% (120/250) Updating files: 49% (123/250) Updating files: 50% (125/250) Updating files: 51% (128/250) Updating files: 52% (130/250) Updating files: 53% (133/250) Updating files: 53% (134/250) Updating files: 54% (135/250) Updating files: 55% (138/250) Updating files: 56% (140/250) Updating files: 57% (143/250) Updating files: 58% (145/250) Updating files: 59% (148/250) Updating files: 60% (150/250) Updating files: 61% (153/250) Updating files: 62% (155/250) Updating files: 63% (158/250) Updating files: 64% (160/250) Updating files: 65% (163/250) Updating files: 66% (165/250) Updating files: 67% (168/250) Updating files: 68% (170/250) Updating files: 69% (173/250) Updating files: 70% (175/250) Updating files: 71% (178/250) Updating files: 72% (180/250) Updating files: 73% (183/250) Updating files: 74% (185/250) Updating files: 75% (188/250) Updating files: 76% (190/250) Updating files: 77% (193/250) Updating files: 78% (195/250) Updating files: 79% (198/250) Updating files: 80% (200/250) Updating files: 81% (203/250) Updating files: 82% (205/250) Updating files: 83% (208/250) Updating files: 84% (210/250) Updating files: 85% (213/250) Updating files: 86% (215/250) Updating files: 87% (218/250) Updating files: 88% (220/250) Updating files: 89% (223/250) Updating files: 90% (225/250) Updating files: 91% (228/250) Updating files: 92% (230/250) Updating files: 93% (233/250) Updating files: 94% (235/250) Updating files: 95% (238/250) Updating files: 96% (240/250) Updating files: 97% (243/250) Updating files: 98% (245/250) Updating files: 99% (248/250) Updating files: 100% (250/250) Updating files: 100% (250/250), done. 2024-04-26T18:19:43.818 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at b205c64c687 v0.42 2024-04-26T18:19:43.820 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.42 2024-04-26T18:19:43.927 INFO:tasks.workunit.client.0.smithi139.stdout:v0.43 2024-04-26T18:19:43.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:43.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 43 -eq 48 ']' 2024-04-26T18:19:43.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.43 2024-04-26T18:19:43.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.43 2024-04-26T18:19:43.928 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.43 2024-04-26T18:19:47.945 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 19% (22/111) Updating files: 20% (23/111) Updating files: 21% (24/111) Updating files: 22% (25/111) Updating files: 23% (26/111) Updating files: 24% (27/111) Updating files: 25% (28/111) Updating files: 26% (29/111) Updating files: 27% (30/111) Updating files: 28% (32/111) Updating files: 29% (33/111) Updating files: 30% (34/111) Updating files: 31% (35/111) Updating files: 32% (36/111) Updating files: 33% (37/111) Updating files: 34% (38/111) Updating files: 35% (39/111) Updating files: 36% (40/111) Updating files: 37% (42/111) Updating files: 38% (43/111) Updating files: 39% (44/111) Updating files: 40% (45/111) Updating files: 41% (46/111) Updating files: 42% (47/111) Updating files: 43% (48/111) Updating files: 44% (49/111) Updating files: 45% (50/111) Updating files: 46% (52/111) Updating files: 47% (53/111) Updating files: 48% (54/111) Updating files: 49% (55/111) Updating files: 50% (56/111) Updating files: 51% (57/111) Updating files: 52% (58/111) Updating files: 53% (59/111) Updating files: 54% (60/111) Updating files: 55% (62/111) Updating files: 56% (63/111) Updating files: 57% (64/111) Updating files: 58% (65/111) Updating files: 59% (66/111) Updating files: 60% (67/111) Updating files: 61% (68/111) Updating files: 62% (69/111) Updating files: 63% (70/111) Updating files: 64% (72/111) Updating files: 65% (73/111) Updating files: 66% (74/111) Updating files: 67% (75/111) Updating files: 68% (76/111) Updating files: 69% (77/111) Updating files: 70% (78/111) Updating files: 71% (79/111) Updating files: 72% (80/111) Updating files: 73% (82/111) Updating files: 74% (83/111) Updating files: 75% (84/111) Updating files: 76% (85/111) Updating files: 77% (86/111) Updating files: 78% (87/111) Updating files: 79% (88/111) Updating files: 80% (89/111) Updating files: 81% (90/111) Updating files: 82% (92/111) Updating files: 83% (93/111) Updating files: 84% (94/111) Updating files: 85% (95/111) Updating files: 86% (96/111) Updating files: 87% (97/111) Updating files: 88% (98/111) Updating files: 89% (99/111) Updating files: 90% (100/111) Updating files: 90% (101/111) Updating files: 91% (102/111) Updating files: 92% (103/111) Updating files: 93% (104/111) Updating files: 94% (105/111) Updating files: 95% (106/111) Updating files: 96% (107/111) Updating files: 97% (108/111) Updating files: 98% (109/111) Updating files: 99% (110/111) Updating files: 100% (111/111) Updating files: 100% (111/111), done. 2024-04-26T18:19:47.977 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 9fa8781c014 v0.43 2024-04-26T18:19:47.978 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.43 2024-04-26T18:19:48.037 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:19:48.037 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 44 -eq 48 ']' 2024-04-26T18:19:48.037 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.44 2024-04-26T18:19:48.037 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.44 2024-04-26T18:19:48.038 INFO:tasks.workunit.client.0.smithi139.stdout:v0.44 2024-04-26T18:19:48.038 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.44 2024-04-26T18:19:59.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:19:59.826 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:20:02.323 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 24% (45/186) Updating files: 25% (47/186) Updating files: 26% (49/186) Updating files: 27% (51/186) Updating files: 28% (53/186) Updating files: 29% (54/186) Updating files: 30% (56/186) Updating files: 31% (58/186) Updating files: 32% (60/186) Updating files: 33% (62/186) Updating files: 34% (64/186) Updating files: 35% (66/186) Updating files: 36% (67/186) Updating files: 37% (69/186) Updating files: 38% (71/186) Updating files: 39% (73/186) Updating files: 40% (75/186) Updating files: 41% (77/186) Updating files: 42% (79/186) Updating files: 43% (80/186) Updating files: 44% (82/186) Updating files: 45% (84/186) Updating files: 46% (86/186) Updating files: 47% (88/186) Updating files: 48% (90/186) Updating files: 49% (92/186) Updating files: 50% (93/186) Updating files: 51% (95/186) Updating files: 52% (97/186) Updating files: 53% (99/186) Updating files: 54% (101/186) Updating files: 55% (103/186) Updating files: 56% (105/186) Updating files: 57% (107/186) Updating files: 58% (108/186) Updating files: 59% (110/186) Updating files: 60% (112/186) Updating files: 61% (114/186) Updating files: 62% (116/186) Updating files: 63% (118/186) Updating files: 64% (120/186) Updating files: 65% (121/186) Updating files: 66% (123/186) Updating files: 67% (125/186) Updating files: 68% (127/186) Updating files: 69% (129/186) Updating files: 70% (131/186) Updating files: 71% (133/186) Updating files: 72% (134/186) Updating files: 73% (136/186) Updating files: 74% (138/186) Updating files: 75% (140/186) Updating files: 76% (142/186) Updating files: 77% (144/186) Updating files: 78% (146/186) Updating files: 79% (147/186) Updating files: 80% (149/186) Updating files: 81% (151/186) Updating files: 82% (153/186) Updating files: 83% (155/186) Updating files: 84% (157/186) Updating files: 85% (159/186) Updating files: 86% (160/186) Updating files: 87% (162/186) Updating files: 88% (164/186) Updating files: 89% (166/186) Updating files: 90% (168/186) Updating files: 91% (170/186) Updating files: 92% (172/186) Updating files: 93% (173/186) Updating files: 94% (175/186) Updating files: 95% (177/186) Updating files: 96% (179/186) Updating files: 97% (181/186) Updating files: 98% (183/186) Updating files: 99% (185/186) Updating files: 100% (186/186) Updating files: 100% (186/186), done. 2024-04-26T18:20:02.357 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at cdd5298d276 v0.44 2024-04-26T18:20:02.358 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.44 2024-04-26T18:20:02.504 INFO:tasks.workunit.client.0.smithi139.stdout:v0.45 2024-04-26T18:20:02.505 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:20:02.505 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 45 -eq 48 ']' 2024-04-26T18:20:02.505 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.45 2024-04-26T18:20:02.505 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.45 2024-04-26T18:20:02.505 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.45 2024-04-26T18:20:04.757 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 16% (25/154) Updating files: 17% (27/154) Updating files: 18% (28/154) Updating files: 19% (30/154) Updating files: 20% (31/154) Updating files: 21% (33/154) Updating files: 22% (34/154) Updating files: 23% (36/154) Updating files: 24% (37/154) Updating files: 25% (39/154) Updating files: 26% (41/154) Updating files: 27% (42/154) Updating files: 28% (44/154) Updating files: 29% (45/154) Updating files: 30% (47/154) Updating files: 31% (48/154) Updating files: 32% (50/154) Updating files: 33% (51/154) Updating files: 34% (53/154) Updating files: 35% (54/154) Updating files: 36% (56/154) Updating files: 37% (57/154) Updating files: 38% (59/154) Updating files: 39% (61/154) Updating files: 40% (62/154) Updating files: 41% (64/154) Updating files: 42% (65/154) Updating files: 43% (67/154) Updating files: 44% (68/154) Updating files: 45% (70/154) Updating files: 46% (71/154) Updating files: 47% (73/154) Updating files: 48% (74/154) Updating files: 49% (76/154) Updating files: 50% (77/154) Updating files: 51% (79/154) Updating files: 52% (81/154) Updating files: 53% (82/154) Updating files: 54% (84/154) Updating files: 55% (85/154) Updating files: 56% (87/154) Updating files: 57% (88/154) Updating files: 58% (90/154) Updating files: 59% (91/154) Updating files: 60% (93/154) Updating files: 61% (94/154) Updating files: 62% (96/154) Updating files: 63% (98/154) Updating files: 64% (99/154) Updating files: 65% (101/154) Updating files: 66% (102/154) Updating files: 67% (104/154) Updating files: 68% (105/154) Updating files: 69% (107/154) Updating files: 70% (108/154) Updating files: 71% (110/154) Updating files: 72% (111/154) Updating files: 73% (113/154) Updating files: 74% (114/154) Updating files: 75% (116/154) Updating files: 76% (118/154) Updating files: 77% (119/154) Updating files: 78% (121/154) Updating files: 79% (122/154) Updating files: 80% (124/154) Updating files: 81% (125/154) Updating files: 82% (127/154) Updating files: 83% (128/154) Updating files: 84% (130/154) Updating files: 85% (131/154) Updating files: 86% (133/154) Updating files: 87% (134/154) Updating files: 88% (136/154) Updating files: 89% (138/154) Updating files: 90% (139/154) Updating files: 91% (141/154) Updating files: 92% (142/154) Updating files: 93% (144/154) Updating files: 94% (145/154) Updating files: 95% (147/154) Updating files: 96% (148/154) Updating files: 97% (150/154) Updating files: 98% (151/154) Updating files: 99% (153/154) Updating files: 100% (154/154) Updating files: 100% (154/154), done. 2024-04-26T18:20:04.786 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 0aea1cb1df5 v0.45 2024-04-26T18:20:04.787 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.45 2024-04-26T18:20:04.861 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:20:04.861 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 46 -eq 48 ']' 2024-04-26T18:20:04.861 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.46 2024-04-26T18:20:04.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.46 2024-04-26T18:20:04.862 INFO:tasks.workunit.client.0.smithi139.stdout:v0.46 2024-04-26T18:20:04.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.46 2024-04-26T18:20:21.054 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 19% (61/309) Updating files: 20% (62/309) Updating files: 21% (65/309) Updating files: 22% (68/309) Updating files: 23% (72/309) Updating files: 24% (75/309) Updating files: 25% (78/309) Updating files: 26% (81/309) Updating files: 27% (84/309) Updating files: 28% (87/309) Updating files: 29% (90/309) Updating files: 30% (93/309) Updating files: 31% (96/309) Updating files: 32% (99/309) Updating files: 33% (102/309) Updating files: 34% (106/309) Updating files: 35% (109/309) Updating files: 36% (112/309) Updating files: 37% (115/309) Updating files: 37% (116/309) Updating files: 38% (118/309) Updating files: 39% (121/309) Updating files: 40% (124/309) Updating files: 41% (127/309) Updating files: 42% (130/309) Updating files: 43% (133/309) Updating files: 43% (134/309) Updating files: 44% (136/309) Updating files: 45% (140/309) Updating files: 46% (143/309) Updating files: 47% (146/309) Updating files: 48% (149/309) Updating files: 49% (152/309) Updating files: 50% (155/309) Updating files: 51% (158/309) Updating files: 52% (161/309) Updating files: 53% (164/309) Updating files: 54% (167/309) Updating files: 55% (170/309) Updating files: 56% (174/309) Updating files: 57% (177/309) Updating files: 58% (180/309) Updating files: 59% (183/309) Updating files: 60% (186/309) Updating files: 61% (189/309) Updating files: 62% (192/309) Updating files: 63% (195/309) Updating files: 64% (198/309) Updating files: 65% (201/309) Updating files: 66% (204/309) Updating files: 67% (208/309) Updating files: 68% (211/309) Updating files: 69% (214/309) Updating files: 69% (216/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 96% (297/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 98% (304/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2024-04-26T18:20:21.098 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at cb7f1c9c752 v0.46 2024-04-26T18:20:21.099 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.46 2024-04-26T18:20:21.126 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:20:21.126 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 47 -eq 48 ']' 2024-04-26T18:20:21.126 INFO:tasks.workunit.client.0.smithi139.stdout:v0.47 2024-04-26T18:20:21.126 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.47 2024-04-26T18:20:21.127 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.47 2024-04-26T18:20:21.127 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.47 2024-04-26T18:20:23.370 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 44% (97/219) Updating files: 45% (99/219) Updating files: 46% (101/219) Updating files: 47% (103/219) Updating files: 48% (106/219) Updating files: 49% (108/219) Updating files: 50% (110/219) Updating files: 51% (112/219) Updating files: 52% (114/219) Updating files: 53% (117/219) Updating files: 54% (119/219) Updating files: 55% (121/219) Updating files: 56% (123/219) Updating files: 57% (125/219) Updating files: 58% (128/219) Updating files: 59% (130/219) Updating files: 60% (132/219) Updating files: 61% (134/219) Updating files: 62% (136/219) Updating files: 63% (138/219) Updating files: 64% (141/219) Updating files: 65% (143/219) Updating files: 66% (145/219) Updating files: 67% (147/219) Updating files: 68% (149/219) Updating files: 69% (152/219) Updating files: 70% (154/219) Updating files: 71% (156/219) Updating files: 72% (158/219) Updating files: 73% (160/219) Updating files: 74% (163/219) Updating files: 75% (165/219) Updating files: 76% (167/219) Updating files: 77% (169/219) Updating files: 78% (171/219) Updating files: 79% (174/219) Updating files: 80% (176/219) Updating files: 81% (178/219) Updating files: 82% (180/219) Updating files: 83% (182/219) Updating files: 84% (184/219) Updating files: 85% (187/219) Updating files: 86% (189/219) Updating files: 87% (191/219) Updating files: 88% (193/219) Updating files: 89% (195/219) Updating files: 90% (198/219) Updating files: 91% (200/219) Updating files: 92% (202/219) Updating files: 93% (204/219) Updating files: 94% (206/219) Updating files: 95% (209/219) Updating files: 96% (211/219) Updating files: 97% (213/219) Updating files: 98% (215/219) Updating files: 99% (217/219) Updating files: 100% (219/219) Updating files: 100% (219/219), done. 2024-04-26T18:20:23.401 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at ad663d58c89 v0.47 2024-04-26T18:20:23.403 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.47 2024-04-26T18:20:23.481 INFO:tasks.workunit.client.0.smithi139.stdout:v0.49 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 48 -eq 48 ']' 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ continue 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 49 -eq 48 ']' 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.49 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.49 2024-04-26T18:20:23.482 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.49 2024-04-26T18:20:23.501 INFO:tasks.quiescer.fs.[cephfs]:Total duration (45.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:20:23.501 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.65 2024-04-26T18:20:23.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:20:23.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.666+0000 7ffb0957f640 1 Processor -- start 2024-04-26T18:20:23.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.666+0000 7ffb0957f640 1 -- start start 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb0957f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ffb04153c50 0x7ffb040cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb0957f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb0406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb0957f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb04159d70 con 0x7ffb040cfe90 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb0957f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ffb040c43a0 con 0x7ffb04153c50 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb0957f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0415a8d0 con 0x7ffb040caab0 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb037fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ffb040cfe90 0x7ffb0415cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43788/0 (socket says 172.21.15.139:43788) 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb037fe640 1 -- 172.21.15.139:0/917460299 learned_addr learned my addr 172.21.15.139:0/917460299 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb027fc640 1 --2- 172.21.15.139:0/917460299 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb0406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:23.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.667+0000 7ffb02ffd640 1 --2- 172.21.15.139:0/917460299 >> v2:172.21.15.139:3300/0 conn(0x7ffb04153c50 0x7ffb040cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:23.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.668+0000 7ffb027fc640 1 -- 172.21.15.139:0/917460299 >> v2:172.21.15.139:3300/0 conn(0x7ffb04153c50 msgr2=0x7ffb040cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:23.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.668+0000 7ffb01ffb640 1 -- 172.21.15.139:0/917460299 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370802054 0 0) 0x7ffb04159d70 con 0x7ffb040cfe90 2024-04-26T18:20:23.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.668+0000 7ffb027fc640 1 --2- 172.21.15.139:0/917460299 >> v2:172.21.15.139:3300/0 conn(0x7ffb04153c50 0x7ffb040cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.668+0000 7ffb027fc640 1 -- 172.21.15.139:0/917460299 >> v1:172.21.15.139:6789/0 conn(0x7ffb040cfe90 legacy=0x7ffb0415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:23.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.668+0000 7ffb027fc640 1 -- 172.21.15.139:0/917460299 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb04154030 con 0x7ffb040caab0 2024-04-26T18:20:23.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.668+0000 7ffb02ffd640 1 --2- 172.21.15.139:0/917460299 >> v2:172.21.15.139:3300/0 conn(0x7ffb04153c50 0x7ffb040cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:20:23.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.668+0000 7ffb027fc640 1 --2- 172.21.15.139:0/917460299 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb0406fdb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40097a0 tx=0x7ffaf402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf4683859fdc975 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:23.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb01ffb640 1 -- 172.21.15.139:0/917460299 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4037070 con 0x7ffb040caab0 2024-04-26T18:20:23.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb01ffb640 1 -- 172.21.15.139:0/917460299 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4032440 con 0x7ffb040caab0 2024-04-26T18:20:23.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb01ffb640 1 -- 172.21.15.139:0/917460299 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4032810 con 0x7ffb040caab0 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb0957f640 1 -- 172.21.15.139:0/917460299 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 msgr2=0x7ffb0406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb0957f640 1 --2- 172.21.15.139:0/917460299 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb0406fdb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40097a0 tx=0x7ffaf402a210 comp rx=0 tx=0).stop 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb0957f640 1 -- 172.21.15.139:0/917460299 shutdown_connections 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb0957f640 1 --2- 172.21.15.139:0/917460299 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb0406fdb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb0957f640 1 --2- 172.21.15.139:0/917460299 >> v2:172.21.15.139:3300/0 conn(0x7ffb04153c50 0x7ffb040cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb0957f640 1 -- 172.21.15.139:0/917460299 >> 172.21.15.139:0/917460299 conn(0x7ffb04071bf0 msgr2=0x7ffb04071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.669+0000 7ffb0957f640 1 -- 172.21.15.139:0/917460299 shutdown_connections 2024-04-26T18:20:23.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.670+0000 7ffb0957f640 1 -- 172.21.15.139:0/917460299 wait complete. 2024-04-26T18:20:23.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.671+0000 7ffb0957f640 1 Processor -- start 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.671+0000 7ffb0957f640 1 -- start start 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb04154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb040cfe90 0x7ffb0414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb04153c50 0x7ffb040b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0415a310 con 0x7ffb040cfe90 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040cf4c0 con 0x7ffb04153c50 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0415a5f0 con 0x7ffb040caab0 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb040cfe90 0x7ffb0414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb040cfe90 0x7ffb0414e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35506/0 (socket says 172.21.15.139:35506) 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 -- 172.21.15.139:0/2204603758 learned_addr learned my addr 172.21.15.139:0/2204603758 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb02ffd640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb04154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:23.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb037fe640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb04153c50 0x7ffb040b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 -- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 msgr2=0x7ffb04154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb04154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 -- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb04153c50 msgr2=0x7ffb040b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb04153c50 0x7ffb040b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 -- 172.21.15.139:0/2204603758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb041f13d0 con 0x7ffb040cfe90 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb02ffd640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb04154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb027fc640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb040cfe90 0x7ffb0414e590 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40097a0 tx=0x7ffaf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffaeb7fe640 1 -- 172.21.15.139:0/2204603758 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4037050 con 0x7ffb040cfe90 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffaeb7fe640 1 -- 172.21.15.139:0/2204603758 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4038040 con 0x7ffb040cfe90 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb041f1670 con 0x7ffb040cfe90 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffaeb7fe640 1 -- 172.21.15.139:0/2204603758 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4004470 con 0x7ffb040cfe90 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.672+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb040afbc0 con 0x7ffb040cfe90 2024-04-26T18:20:23.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.674+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb04069ae0 con 0x7ffb040cfe90 2024-04-26T18:20:23.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.674+0000 7ffaeb7fe640 1 -- 172.21.15.139:0/2204603758 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffaf4030900 con 0x7ffb040cfe90 2024-04-26T18:20:23.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.675+0000 7ffaeb7fe640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffaf006c8f0 0x7ffaf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:23.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.675+0000 7ffaeb7fe640 1 -- 172.21.15.139:0/2204603758 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ffaf40ac960 con 0x7ffb040cfe90 2024-04-26T18:20:23.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.675+0000 7ffb02ffd640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffaf006c8f0 0x7ffaf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:23.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.675+0000 7ffb02ffd640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffaf006c8f0 0x7ffaf006edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8006fd0 tx=0x7ffaf8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:23.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.679+0000 7ffaeb7fe640 1 -- 172.21.15.139:0/2204603758 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffaf407a390 con 0x7ffb040cfe90 2024-04-26T18:20:23.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.894+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb040c9d80 con 0x7ffb040cfe90 2024-04-26T18:20:23.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.895+0000 7ffaeb7fe640 1 -- 172.21.15.139:0/2204603758 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7ffb040c9d80 con 0x7ffb040cfe90 2024-04-26T18:20:23.896 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:20:23.896 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:20:23.898 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:20:23.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffaf006c8f0 msgr2=0x7ffaf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:23.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffaf006c8f0 0x7ffaf006edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8006fd0 tx=0x7ffaf8008040 comp rx=0 tx=0).stop 2024-04-26T18:20:23.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb040cfe90 msgr2=0x7ffb0414e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:23.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb040cfe90 0x7ffb0414e590 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40097a0 tx=0x7ffaf40046c0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 shutdown_connections 2024-04-26T18:20:23.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ffaf006c8f0 0x7ffaf006edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb04153c50 0x7ffb040b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb040cfe90 0x7ffb0414e590 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 --2- 172.21.15.139:0/2204603758 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ffb040caab0 0x7ffb04154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:23.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 >> 172.21.15.139:0/2204603758 conn(0x7ffb04071bf0 msgr2=0x7ffb04071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:23.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 shutdown_connections 2024-04-26T18:20:23.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:23.897+0000 7ffb0957f640 1 -- 172.21.15.139:0/2204603758 wait complete. 2024-04-26T18:20:23.909 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 82.65 --await-for 42.0' 2024-04-26T18:20:23.909 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 82.65 --await-for 42.0 2024-04-26T18:20:24.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.019+0000 7f2861dda640 1 Processor -- start 2024-04-26T18:20:24.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.019+0000 7f2861dda640 1 -- start start 2024-04-26T18:20:24.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.019+0000 7f2861dda640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f285c155f60 0x7f285c0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.019+0000 7f2861dda640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.019+0000 7f2861dda640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f285c15c450 con 0x7f285c0c63a0 2024-04-26T18:20:24.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.019+0000 7f2861dda640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f285c15c730 con 0x7f285c155f60 2024-04-26T18:20:24.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.019+0000 7f2861dda640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f285c15ca10 con 0x7f285c0cd520 2024-04-26T18:20:24.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f285c155f60 0x7f285c0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285bfff640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f285c0c63a0 0x7f285c0cc140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:33160/0 (socket says 172.21.15.139:33160) 2024-04-26T18:20:24.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:48440/0 (socket says 172.21.15.139:48440) 2024-04-26T18:20:24.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285b7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f285c155f60 0x7f285c0c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:58150/0 (socket says 172.21.15.139:58150) 2024-04-26T18:20:24.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285bfff640 1 -- 172.21.15.139:0/501984513 learned_addr learned my addr 172.21.15.139:0/501984513 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:20:24.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285affd640 1 -- 172.21.15.139:0/501984513 >> v2:172.21.15.143:3300/0 conn(0x7f285c155f60 msgr2=0x7f285c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:24.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285affd640 1 --2- 172.21.15.139:0/501984513 >> v2:172.21.15.143:3300/0 conn(0x7f285c155f60 0x7f285c0c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285affd640 1 -- 172.21.15.139:0/501984513 >> v1:172.21.15.143:6789/0 conn(0x7f285c0c63a0 legacy=0x7f285c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:24.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285affd640 1 -- 172.21.15.139:0/501984513 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c0c6ed0 con 0x7f285c0cd520 2024-04-26T18:20:24.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.020+0000 7f285b7fe640 1 --2- 172.21.15.139:0/501984513 >> v2:172.21.15.143:3300/0 conn(0x7f285c155f60 0x7f285c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:20:24.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f285affd640 1 --2- 172.21.15.139:0/501984513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c15bac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28500097a0 tx=0x7f285002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4d74cde72b87fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:24.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f285a7fc640 1 -- 172.21.15.139:0/501984513 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850037070 con 0x7f285c0cd520 2024-04-26T18:20:24.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f285a7fc640 1 -- 172.21.15.139:0/501984513 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850032440 con 0x7f285c0cd520 2024-04-26T18:20:24.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f285a7fc640 1 -- 172.21.15.139:0/501984513 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850032810 con 0x7f285c0cd520 2024-04-26T18:20:24.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f2861dda640 1 -- 172.21.15.139:0/501984513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 msgr2=0x7f285c15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:24.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f2861dda640 1 --2- 172.21.15.139:0/501984513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c15bac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f28500097a0 tx=0x7f285002a210 comp rx=0 tx=0).stop 2024-04-26T18:20:24.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f2861dda640 1 -- 172.21.15.139:0/501984513 shutdown_connections 2024-04-26T18:20:24.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f2861dda640 1 --2- 172.21.15.139:0/501984513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c15bac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f2861dda640 1 --2- 172.21.15.139:0/501984513 >> v2:172.21.15.143:3300/0 conn(0x7f285c155f60 0x7f285c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f2861dda640 1 -- 172.21.15.139:0/501984513 >> 172.21.15.139:0/501984513 conn(0x7f285c072930 msgr2=0x7f285c072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:24.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.021+0000 7f2861dda640 1 -- 172.21.15.139:0/501984513 shutdown_connections 2024-04-26T18:20:24.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.022+0000 7f2861dda640 1 -- 172.21.15.139:0/501984513 wait complete. 2024-04-26T18:20:24.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 Processor -- start 2024-04-26T18:20:24.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 -- start start 2024-04-26T18:20:24.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f285c0c63a0 0x7f285c0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f285c155f60 0x7f285c1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0c7ef0 con 0x7f285c155f60 2024-04-26T18:20:24.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f285c0c7490 con 0x7f285c0c63a0 2024-04-26T18:20:24.044 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.023+0000 7f2861dda640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f285c0c6ab0 con 0x7f285c0cd520 2024-04-26T18:20:24.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f285c155f60 0x7f285c1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285affd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f285c155f60 0x7f285c1568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35510/0 (socket says 172.21.15.139:35510) 2024-04-26T18:20:24.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 -- 172.21.15.139:0/367372621 learned_addr learned my addr 172.21.15.139:0/367372621 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:24.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285b7fe640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f285c0c63a0 0x7f285c0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 -- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 msgr2=0x7f285c1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:24.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c1563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 -- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f285c0c63a0 msgr2=0x7f285c0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:24.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f285c0c63a0 0x7f285c0cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 -- 172.21.15.139:0/367372621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c1f4d00 con 0x7f285c155f60 2024-04-26T18:20:24.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285affd640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:20:24.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f285bfff640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f285c155f60 0x7f285c1568f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f285400c420 tx=0x7f285400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:24.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f2843fff640 1 -- 172.21.15.139:0/367372621 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854017070 con 0x7f285c155f60 2024-04-26T18:20:24.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f2843fff640 1 -- 172.21.15.139:0/367372621 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2854005ce0 con 0x7f285c155f60 2024-04-26T18:20:24.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c154b80 con 0x7f285c155f60 2024-04-26T18:20:24.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f2843fff640 1 -- 172.21.15.139:0/367372621 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28540072d0 con 0x7f285c155f60 2024-04-26T18:20:24.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.024+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c1f5250 con 0x7f285c155f60 2024-04-26T18:20:24.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.026+0000 7f2843fff640 1 -- 172.21.15.139:0/367372621 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f285401a070 con 0x7f285c155f60 2024-04-26T18:20:24.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.026+0000 7f2843fff640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f284806c920 0x7f284806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.026+0000 7f2843fff640 1 -- 172.21.15.139:0/367372621 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f285408b1f0 con 0x7f285c155f60 2024-04-26T18:20:24.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.026+0000 7f285b7fe640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f284806c920 0x7f284806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.027+0000 7f285b7fe640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f284806c920 0x7f284806ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f284c009bd0 tx=0x7f284c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:24.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.027+0000 7f2864bca740 1 Processor -- start 2024-04-26T18:20:24.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.027+0000 7f2864bca740 1 -- start start 2024-04-26T18:20:24.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f2864bca740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3d95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b39a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39bb40 0x55cb6b39af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f2864bca740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb6b2fdd80 con 0x55cb6b39a5e0 2024-04-26T18:20:24.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55cb6b299c20 con 0x55cb6b39bb40 2024-04-26T18:20:24.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55cb6b2f9d40 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3d95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3d95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35520/0 (socket says 172.21.15.139:35520) 2024-04-26T18:20:24.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285bfff640 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39bb40 0x55cb6b39af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 -- 172.21.15.139:0/3537104506 learned_addr learned my addr 172.21.15.139:0/3537104506 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:24.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285affd640 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b39a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 -- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 msgr2=0x55cb6b39a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:24.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b39a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 -- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39bb40 msgr2=0x55cb6b39af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:24.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39bb40 0x55cb6b39af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 -- 172.21.15.139:0/3537104506 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb6b0dbd80 con 0x55cb6b39a5e0 2024-04-26T18:20:24.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285bfff640 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39bb40 0x55cb6b39af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:20:24.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.028+0000 7f285b7fe640 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3d95a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f284c009a80 tx=0x7f284c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104fdbe09499c2c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:24.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f28417fa640 1 -- 172.21.15.139:0/3537104506 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c027070 con 0x55cb6b39a5e0 2024-04-26T18:20:24.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f28417fa640 1 -- 172.21.15.139:0/3537104506 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c017850 con 0x55cb6b39a5e0 2024-04-26T18:20:24.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f28417fa640 1 -- 172.21.15.139:0/3537104506 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c01b070 con 0x55cb6b39a5e0 2024-04-26T18:20:24.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 -- 172.21.15.139:0/3537104506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39a5e0 msgr2=0x55cb6b3d95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:24.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3d95a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f284c009a80 tx=0x7f284c014000 comp rx=0 tx=0).stop 2024-04-26T18:20:24.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 -- 172.21.15.139:0/3537104506 shutdown_connections 2024-04-26T18:20:24.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39bb40 0x55cb6b39af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b39a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 --2- 172.21.15.139:0/3537104506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3d95a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 -- 172.21.15.139:0/3537104506 >> 172.21.15.139:0/3537104506 conn(0x55cb6b361740 msgr2=0x55cb6b3de580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:24.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 -- 172.21.15.139:0/3537104506 shutdown_connections 2024-04-26T18:20:24.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.029+0000 7f2864bca740 1 -- 172.21.15.139:0/3537104506 wait complete. 2024-04-26T18:20:24.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.030+0000 7f2864bca740 1 -- start start 2024-04-26T18:20:24.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.030+0000 7f2864bca740 1 Processor -- start 2024-04-26T18:20:24.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b3d3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b3ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb6b398c20 con 0x55cb6b39bb40 2024-04-26T18:20:24.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55cb6b297840 con 0x55cb6b39a5e0 2024-04-26T18:20:24.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55cb6b39c170 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 10 client.0 _ll_register_callbacks cb 0x55cb6b29b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:20:24.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b3d3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b3d3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35522/0 (socket says 172.21.15.139:35522) 2024-04-26T18:20:24.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 -- 172.21.15.139:0/1726466665 learned_addr learned my addr 172.21.15.139:0/1726466665 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:24.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285bfff640 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b3ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 -- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 msgr2=0x55cb6b3ebe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:24.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b3ebe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 -- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 msgr2=0x55cb6b3c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:24.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 -- 172.21.15.139:0/1726466665 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb6b13c510 con 0x55cb6b39bb40 2024-04-26T18:20:24.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f285affd640 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b3d3150 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f285002a250 tx=0x7f2850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee087d6326f797 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:24.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f283a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:20:24.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f283a7fc640 1 -- 172.21.15.139:0/1726466665 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850042070 con 0x55cb6b39bb40 2024-04-26T18:20:24.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f283a7fc640 1 -- 172.21.15.139:0/1726466665 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f285003c820 con 0x55cb6b39bb40 2024-04-26T18:20:24.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.031+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f284c017850 con 0x55cb6b39bb40 2024-04-26T18:20:24.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f283a7fc640 1 -- 172.21.15.139:0/1726466665 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f285004f050 con 0x55cb6b39bb40 2024-04-26T18:20:24.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 10 client.5691 fetch_fsmap learned FSMap version 9 2024-04-26T18:20:24.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cb6afcf670 con 0x55cb6b39bb40 2024-04-26T18:20:24.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f283a7fc640 1 -- 172.21.15.139:0/1726466665 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c017850 con 0x55cb6b39bb40 2024-04-26T18:20:24.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f283a7fc640 1 -- 172.21.15.139:0/1726466665 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2850052020 con 0x55cb6b39bb40 2024-04-26T18:20:24.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 10 client.5691 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:20:24.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 10 client.5691 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:20:24.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 20 client.5691 populate_metadata read hostname 'smithi139' 2024-04-26T18:20:24.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b3d8580 0x55cb6b3d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 4 client.5691 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:20:24.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb6b30b990 con 0x55cb6b3d8580 2024-04-26T18:20:24.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f285b7fe640 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b3d8580 0x55cb6b3d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f285b7fe640 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b3d8580 0x55cb6b3d4e90 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=679b980a91ca8f0 server_cookie=28f1bfd08b09d111 in_seq=0 out_seq=0 2024-04-26T18:20:24.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.032+0000 7f283a7fc640 10 client.5691 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:24.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f283a7fc640 1 -- 172.21.15.139:0/1726466665 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cb6b30b990 con 0x55cb6b3d8580 2024-04-26T18:20:24.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f283a7fc640 10 client.5691 handle_command_reply: tid=0 2024-04-26T18:20:24.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 client.5691 shutdown 2024-04-26T18:20:24.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 msgr2=0x55cb6b3d3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:24.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b3d3150 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f285002a250 tx=0x7f2850004730 comp rx=0 tx=0).stop 2024-04-26T18:20:24.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 shutdown_connections 2024-04-26T18:20:24.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b3d8580 0x55cb6b3d4e90 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b3ebe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f283a7fc640 0 client.5691 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:24.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b3d3150 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 --2- 172.21.15.139:0/1726466665 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b3c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.034+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 >> 172.21.15.139:0/1726466665 conn(0x55cb6b361740 msgr2=0x55cb6b3c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:24.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.035+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 shutdown_connections 2024-04-26T18:20:24.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.035+0000 7f2864bca740 1 -- 172.21.15.139:0/1726466665 wait complete. 2024-04-26T18:20:24.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.035+0000 7f2864bca740 20 client.5691 trim_cache size 0 max 16384 2024-04-26T18:20:24.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 Processor -- start 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 -- start start 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b39abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b395e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b396370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cb6b396db0 con 0x55cb6b39bb40 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f285c200620 con 0x55cb6b39a5e0 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.052+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f285c1ff500 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b395e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b395e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35524/0 (socket says 172.21.15.139:35524) 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 -- 172.21.15.139:0/2336107843 learned_addr learned my addr 172.21.15.139:0/2336107843 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285b7fe640 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b39abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 -- 172.21.15.139:0/2336107843 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 msgr2=0x55cb6b396370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b396370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 -- 172.21.15.139:0/2336107843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 msgr2=0x55cb6b39abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b39abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 -- 172.21.15.139:0/2336107843 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb6b3968b0 con 0x55cb6b39bb40 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f285affd640 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b395e30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2850006ee0 tx=0x7f285003e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1a7ab43873491c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f2840ff9640 1 -- 172.21.15.139:0/2336107843 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850042070 con 0x55cb6b39bb40 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f2840ff9640 1 -- 172.21.15.139:0/2336107843 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850040070 con 0x55cb6b39bb40 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.053+0000 7f2840ff9640 1 -- 172.21.15.139:0/2336107843 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850037040 con 0x55cb6b39bb40 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 -- 172.21.15.139:0/2336107843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 msgr2=0x55cb6b395e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b395e30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2850006ee0 tx=0x7f285003e070 comp rx=0 tx=0).stop 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 -- 172.21.15.139:0/2336107843 shutdown_connections 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b3d9ae0 0x55cb6b396370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b39bb40 0x55cb6b395e30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 --2- 172.21.15.139:0/2336107843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b39abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 -- 172.21.15.139:0/2336107843 >> 172.21.15.139:0/2336107843 conn(0x55cb6b361740 msgr2=0x55cb6b398050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 -- 172.21.15.139:0/2336107843 shutdown_connections 2024-04-26T18:20:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 -- 172.21.15.139:0/2336107843 wait complete. 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 -- start start 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.054+0000 7f2864bca740 1 Processor -- start 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b39afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f2864bca740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b39bb40 0x55cb6b454940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f2864bca740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b3d9ae0 0x55cb6b44e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f2864bca740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f285c1fee30 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f285c1fdab0 con 0x55cb6b39a5e0 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f2864bca740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f285c1fe0d0 con 0x55cb6b39bb40 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f2864bca740 10 client.0 _ll_register_callbacks cb 0x7f2850009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b3d9ae0 0x55cb6b44e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b3d9ae0 0x55cb6b44e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:35526/0 (socket says 172.21.15.139:35526) 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 -- 172.21.15.139:0/2417085483 learned_addr learned my addr 172.21.15.139:0/2417085483 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285affd640 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b39bb40 0x55cb6b454940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 -- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b39bb40 msgr2=0x55cb6b454940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b39bb40 0x55cb6b454940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 -- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 msgr2=0x55cb6b39afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b39afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.055+0000 7f285bfff640 1 -- 172.21.15.139:0/2417085483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb6b454e80 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f285bfff640 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b3d9ae0 0x55cb6b44e660 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2854058b00 tx=0x7f285405ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfebbe2fbcb4e43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f283a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f283a7fc640 1 -- 172.21.15.139:0/2417085483 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854087060 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f283a7fc640 1 -- 172.21.15.139:0/2417085483 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2854007670 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2850040070 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f283a7fc640 1 -- 172.21.15.139:0/2417085483 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f285405f0c0 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 10 client.5697 fetch_fsmap learned FSMap version 9 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cb6b3de9c0 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f283a7fc640 1 -- 172.21.15.139:0/2417085483 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850040070 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f283a7fc640 1 -- 172.21.15.139:0/2417085483 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2854057fc0 con 0x55cb6b3d9ae0 2024-04-26T18:20:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 10 client.5697 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 10 client.5697 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 20 client.5697 populate_metadata read hostname 'smithi139' 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b44eba0 0x55cb6b3f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 4 client.5697 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.65, "await_for": 42.0}] 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.65, "await_for": 42.0}) -- 0x55cb6b305800 con 0x55cb6b44eba0 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.056+0000 7f285b7fe640 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b44eba0 0x55cb6b3f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.057+0000 7f283a7fc640 10 client.5697 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:24.057+0000 7f285b7fe640 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b44eba0 0x55cb6b3f4540 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d81c01f0cd31e88 server_cookie=2f7eeb5c2d20d09c in_seq=0 out_seq=0 2024-04-26T18:20:26.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f283a7fc640 1 -- 172.21.15.139:0/2417085483 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55cb6b305800 con 0x55cb6b44eba0 2024-04-26T18:20:26.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f283a7fc640 10 client.5697 handle_command_reply: tid=0 2024-04-26T18:20:26.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 client.5697 shutdown 2024-04-26T18:20:26.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b3d9ae0 msgr2=0x55cb6b44e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:26.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b3d9ae0 0x55cb6b44e660 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2854058b00 tx=0x7f285405ce70 comp rx=0 tx=0).stop 2024-04-26T18:20:26.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 shutdown_connections 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cb6b3d9ae0 0x55cb6b44e660 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55cb6b44eba0 0x55cb6b3f4540 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55cb6b39bb40 0x55cb6b454940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 --2- 172.21.15.139:0/2417085483 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55cb6b39a5e0 0x55cb6b39afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f283a7fc640 0 client.5697 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 >> 172.21.15.139:0/2417085483 conn(0x55cb6b361740 msgr2=0x55cb6b3c4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 shutdown_connections 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 1 -- 172.21.15.139:0/2417085483 wait complete. 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.248+0000 7f2864bca740 20 client.5697 trim_cache size 0 max 16384 2024-04-26T18:20:26.250 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 70, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "12bb5f75": { 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 70, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 82.7, 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:20:26.251 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:26.252 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f284806c920 msgr2=0x7f284806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f284806c920 0x7f284806ede0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f284c009bd0 tx=0x7f284c00b040 comp rx=0 tx=0).stop 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f285c155f60 msgr2=0x7f285c1568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f285c155f60 0x7f285c1568f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f285400c420 tx=0x7f285400c8e0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 shutdown_connections 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f284806c920 0x7f284806ede0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f285c155f60 0x7f285c1568f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f285c0cd520 0x7f285c1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 --2- 172.21.15.139:0/367372621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f285c0c63a0 0x7f285c0cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:26.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 >> 172.21.15.139:0/367372621 conn(0x7f285c072930 msgr2=0x7f285c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:26.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 shutdown_connections 2024-04-26T18:20:26.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:26.249+0000 7f2861dda640 1 -- 172.21.15.139:0/367372621 wait complete. 2024-04-26T18:20:26.260 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '12bb5f75', quiesce took 2.8 seconds. Will release after: 22.65 2024-04-26T18:20:29.892 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:20:29.896 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:20:48.911 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:20:49.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.020+0000 7fe70f2c8640 1 Processor -- start 2024-04-26T18:20:49.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.020+0000 7fe70f2c8640 1 -- start start 2024-04-26T18:20:49.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70f2c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fe7080ca140 0x7fe708155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70f2c8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe7080ca520 0x7fe708155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70f2c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe708070150 0x7fe7080705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70f2c8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe708070b20 con 0x7fe7080ca520 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70f2c8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fe70815bc90 con 0x7fe7080ca140 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70f2c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe70815bf70 con 0x7fe708070150 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe7080ca520 0x7fe708155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe7080ca520 0x7fe708155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40194/0 (socket says 172.21.15.139:40194) 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 -- 172.21.15.139:0/3106493638 learned_addr learned my addr 172.21.15.139:0/3106493638 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70d064640 1 --2- 172.21.15.139:0/3106493638 >> v2:172.21.15.143:3300/0 conn(0x7fe7080ca140 0x7fe708155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70d865640 1 --2- 172.21.15.139:0/3106493638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe708070150 0x7fe7080705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 -- 172.21.15.139:0/3106493638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe708070150 msgr2=0x7fe7080705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 --2- 172.21.15.139:0/3106493638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe708070150 0x7fe7080705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 -- 172.21.15.139:0/3106493638 >> v2:172.21.15.143:3300/0 conn(0x7fe7080ca140 msgr2=0x7fe708155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 --2- 172.21.15.139:0/3106493638 >> v2:172.21.15.143:3300/0 conn(0x7fe7080ca140 0x7fe708155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.021+0000 7fe70c863640 1 -- 172.21.15.139:0/3106493638 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70815c250 con 0x7fe7080ca520 2024-04-26T18:20:49.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.022+0000 7fe70c863640 1 --2- 172.21.15.139:0/3106493638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7080ca520 0x7fe708155e60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe7080d0590 tx=0x7fe6f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f60eb12ea5284a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.022+0000 7fe6fffff640 1 -- 172.21.15.139:0/3106493638 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8037070 con 0x7fe7080ca520 2024-04-26T18:20:49.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.022+0000 7fe6fffff640 1 -- 172.21.15.139:0/3106493638 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f8032440 con 0x7fe7080ca520 2024-04-26T18:20:49.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.022+0000 7fe6fffff640 1 -- 172.21.15.139:0/3106493638 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8032810 con 0x7fe7080ca520 2024-04-26T18:20:49.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3106493638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7080ca520 msgr2=0x7fe708155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3106493638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7080ca520 0x7fe708155e60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe7080d0590 tx=0x7fe6f802a1e0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3106493638 shutdown_connections 2024-04-26T18:20:49.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3106493638 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe708070150 0x7fe7080705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3106493638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7080ca520 0x7fe708155e60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3106493638 >> v2:172.21.15.143:3300/0 conn(0x7fe7080ca140 0x7fe708155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3106493638 >> 172.21.15.139:0/3106493638 conn(0x7fe708071ec0 msgr2=0x7fe7080722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3106493638 shutdown_connections 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.023+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3106493638 wait complete. 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.024+0000 7fe70f2c8640 1 Processor -- start 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.024+0000 7fe70f2c8640 1 -- start start 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70f2c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe708070150 0x7fe70815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70f2c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7080ca140 0x7fe70814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70f2c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7080ca520 0x7fe70815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70f2c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe7080716a0 con 0x7fe708070150 2024-04-26T18:20:49.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70f2c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe70815c810 con 0x7fe7080ca140 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70f2c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe7080cbf60 con 0x7fe7080ca520 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe708070150 0x7fe70815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe708070150 0x7fe70815a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40196/0 (socket says 172.21.15.139:40196) 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 -- 172.21.15.139:0/3659696512 learned_addr learned my addr 172.21.15.139:0/3659696512 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d865640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7080ca520 0x7fe70815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70c863640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7080ca140 0x7fe70814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 -- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7080ca520 msgr2=0x7fe70815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7080ca520 0x7fe70815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 -- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7080ca140 msgr2=0x7fe70814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7080ca140 0x7fe70814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 -- 172.21.15.139:0/3659696512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081f5b20 con 0x7fe708070150 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d865640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7080ca520 0x7fe70815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70c863640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7080ca140 0x7fe70814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.025+0000 7fe70d064640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe708070150 0x7fe70815a500 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe70400d800 tx=0x7fe70400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.026+0000 7fe6fdffb640 1 -- 172.21.15.139:0/3659696512 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70400b6c0 con 0x7fe708070150 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.026+0000 7fe6fdffb640 1 -- 172.21.15.139:0/3659696512 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe704019070 con 0x7fe708070150 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.026+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe708159a20 con 0x7fe708070150 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.026+0000 7fe6fdffb640 1 -- 172.21.15.139:0/3659696512 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70400ba80 con 0x7fe708070150 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.026+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe708159fe0 con 0x7fe708070150 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.027+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe708076d20 con 0x7fe708070150 2024-04-26T18:20:49.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.027+0000 7fe6fdffb640 1 -- 172.21.15.139:0/3659696512 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe70400bc20 con 0x7fe708070150 2024-04-26T18:20:49.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.028+0000 7fe6fdffb640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe6ec06c8f0 0x7fe6ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.028+0000 7fe70c863640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe6ec06c8f0 0x7fe6ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.028+0000 7fe6fdffb640 1 -- 172.21.15.139:0/3659696512 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fe70408c480 con 0x7fe708070150 2024-04-26T18:20:49.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.028+0000 7fe70c863640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe6ec06c8f0 0x7fe6ec06edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8034000 tx=0x7fe6f802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.032+0000 7fe6fdffb640 1 -- 172.21.15.139:0/3659696512 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe70405a470 con 0x7fe708070150 2024-04-26T18:20:49.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.244+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe708071480 con 0x7fe708070150 2024-04-26T18:20:49.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.245+0000 7fe6fdffb640 1 -- 172.21.15.139:0/3659696512 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fe704059d70 con 0x7fe708070150 2024-04-26T18:20:49.245 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:20:49.246 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:20:49.246 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe6ec06c8f0 msgr2=0x7fe6ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe6ec06c8f0 0x7fe6ec06edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8034000 tx=0x7fe6f802e000 comp rx=0 tx=0).stop 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe708070150 msgr2=0x7fe70815a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe708070150 0x7fe70815a500 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe70400d800 tx=0x7fe70400dcc0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 shutdown_connections 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe6ec06c8f0 0x7fe6ec06edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe7080ca520 0x7fe70815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe7080ca140 0x7fe70814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 --2- 172.21.15.139:0/3659696512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe708070150 0x7fe70815a500 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 >> 172.21.15.139:0/3659696512 conn(0x7fe708071ec0 msgr2=0x7fe708154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 shutdown_connections 2024-04-26T18:20:49.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.247+0000 7fe70f2c8640 1 -- 172.21.15.139:0/3659696512 wait complete. 2024-04-26T18:20:49.259 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 12bb5f75 --release --await' 2024-04-26T18:20:49.259 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 12bb5f75 --release --await 2024-04-26T18:20:49.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.362+0000 7f8a5b72b640 1 Processor -- start 2024-04-26T18:20:49.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a5b72b640 1 -- start start 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a5b72b640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8a54155c80 0x7f8a54073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a5b72b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8a5415bf70 0x7f8a5415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a5b72b640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a54073870 con 0x7f8a540cedc0 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a5b72b640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5415c900 con 0x7f8a5415bf70 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a5b72b640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8a54073b10 con 0x7f8a54155c80 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a59cc8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8a5415bf70 0x7f8a5415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a59cc8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8a5415bf70 0x7f8a5415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40206/0 (socket says 172.21.15.139:40206) 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.363+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3858445201 learned_addr learned my addr 172.21.15.139:0/3858445201 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.364+0000 7f8a594c7640 1 --2- 172.21.15.139:0/3858445201 >> v2:172.21.15.143:3300/0 conn(0x7f8a54155c80 0x7f8a54073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.364+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3858445201 >> v2:172.21.15.143:3300/0 conn(0x7f8a54155c80 msgr2=0x7f8a54073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.364+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/3858445201 >> v2:172.21.15.143:3300/0 conn(0x7f8a54155c80 0x7f8a54073280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.364+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3858445201 >> v1:172.21.15.143:6789/0 conn(0x7f8a540cedc0 legacy=0x7f8a540cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.364+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3858445201 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a540cca30 con 0x7f8a5415bf70 2024-04-26T18:20:49.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.364+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/3858445201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a5415bf70 0x7f8a5415c3c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8a540cbcc0 tx=0x7f8a4c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c81f4485d926769 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.364+0000 7f8a4bfff640 1 -- 172.21.15.139:0/3858445201 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c036070 con 0x7f8a5415bf70 2024-04-26T18:20:49.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a4bfff640 1 -- 172.21.15.139:0/3858445201 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c031600 con 0x7f8a5415bf70 2024-04-26T18:20:49.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a4bfff640 1 -- 172.21.15.139:0/3858445201 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0319d0 con 0x7f8a5415bf70 2024-04-26T18:20:49.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 -- 172.21.15.139:0/3858445201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a5415bf70 msgr2=0x7f8a5415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/3858445201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a5415bf70 0x7f8a5415c3c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8a540cbcc0 tx=0x7f8a4c02a780 comp rx=0 tx=0).stop 2024-04-26T18:20:49.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 -- 172.21.15.139:0/3858445201 shutdown_connections 2024-04-26T18:20:49.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/3858445201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a5415bf70 0x7f8a5415c3c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/3858445201 >> v2:172.21.15.143:3300/0 conn(0x7f8a54155c80 0x7f8a54073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 -- 172.21.15.139:0/3858445201 >> 172.21.15.139:0/3858445201 conn(0x7f8a5406ef00 msgr2=0x7f8a5406f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 -- 172.21.15.139:0/3858445201 shutdown_connections 2024-04-26T18:20:49.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.365+0000 7f8a5b72b640 1 -- 172.21.15.139:0/3858445201 wait complete. 2024-04-26T18:20:49.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.366+0000 7f8a5b72b640 1 Processor -- start 2024-04-26T18:20:49.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.366+0000 7f8a5b72b640 1 -- start start 2024-04-26T18:20:49.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a5b72b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a540cedc0 0x7f8a541e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a5b72b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a54155c80 0x7f8a540c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a5b72b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a5415bf70 0x7f8a541e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a5b72b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8a540cd2d0 con 0x7f8a54155c80 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a5b72b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8a540ccff0 con 0x7f8a5415bf70 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a5b72b640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8a540cd5b0 con 0x7f8a540cedc0 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a54155c80 0x7f8a540c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a54155c80 0x7f8a540c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40218/0 (socket says 172.21.15.139:40218) 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 -- 172.21.15.139:0/4261139032 learned_addr learned my addr 172.21.15.139:0/4261139032 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a5415bf70 0x7f8a541e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a594c7640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a540cedc0 0x7f8a541e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 -- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a540cedc0 msgr2=0x7f8a541e6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a540cedc0 0x7f8a541e6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 -- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a5415bf70 msgr2=0x7f8a541e3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a5415bf70 0x7f8a541e3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a58cc6640 1 -- 172.21.15.139:0/4261139032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a541f2f40 con 0x7f8a54155c80 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a5415bf70 0x7f8a541e3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:20:49.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.367+0000 7f8a594c7640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a540cedc0 0x7f8a541e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.368+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a54155c80 0x7f8a540c9ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400b3f0 tx=0x7f8a4400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.368+0000 7f8a49ffb640 1 -- 172.21.15.139:0/4261139032 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44015020 con 0x7f8a54155c80 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.368+0000 7f8a49ffb640 1 -- 172.21.15.139:0/4261139032 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44011830 con 0x7f8a54155c80 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.368+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a541e4fb0 con 0x7f8a54155c80 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.368+0000 7f8a49ffb640 1 -- 172.21.15.139:0/4261139032 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44011c20 con 0x7f8a54155c80 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.368+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a541e5570 con 0x7f8a54155c80 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.369+0000 7f8a49ffb640 1 -- 172.21.15.139:0/4261139032 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a44018020 con 0x7f8a54155c80 2024-04-26T18:20:49.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.370+0000 7f8a49ffb640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8a3806c8f0 0x7f8a3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.370+0000 7f8a49ffb640 1 -- 172.21.15.139:0/4261139032 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8a4408bc20 con 0x7f8a54155c80 2024-04-26T18:20:49.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.370+0000 7f8a594c7640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8a3806c8f0 0x7f8a3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.370+0000 7f8a594c7640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8a3806c8f0 0x7f8a3806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a50006fd0 tx=0x7f8a50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.370+0000 7f8a5e446740 1 Processor -- start 2024-04-26T18:20:49.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a5e446740 1 -- start start 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950134b0 0x562195052470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950529b0 0x562195013890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x562195013dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a5e446740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562194f78040 con 0x5621950529b0 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562194f13b60 con 0x562195014a10 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562194f74000 con 0x5621950134b0 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a58cc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950529b0 0x562195013890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a58cc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950529b0 0x562195013890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40224/0 (socket says 172.21.15.139:40224) 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a58cc6640 1 -- 172.21.15.139:0/108066892 learned_addr learned my addr 172.21.15.139:0/108066892 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a594c7640 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950134b0 0x562195052470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.371+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x562195013dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a58cc6640 1 -- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950134b0 msgr2=0x562195052470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950134b0 0x562195052470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a58cc6640 1 -- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 msgr2=0x562195013dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x562195013dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a58cc6640 1 -- 172.21.15.139:0/108066892 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562194f089c0 con 0x5621950529b0 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x562195013dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a594c7640 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950134b0 0x562195052470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950529b0 0x562195013890 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8a44061bc0 tx=0x7f8a440595c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f08146f5af68e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a3effd640 1 -- 172.21.15.139:0/108066892 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44088070 con 0x5621950529b0 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a3effd640 1 -- 172.21.15.139:0/108066892 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44057780 con 0x5621950529b0 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a3effd640 1 -- 172.21.15.139:0/108066892 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44071030 con 0x5621950529b0 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 -- 172.21.15.139:0/108066892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950529b0 msgr2=0x562195013890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950529b0 0x562195013890 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8a44061bc0 tx=0x7f8a440595c0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 -- 172.21.15.139:0/108066892 shutdown_connections 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x562195013dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950529b0 0x562195013890 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 --2- 172.21.15.139:0/108066892 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950134b0 0x562195052470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 -- 172.21.15.139:0/108066892 >> 172.21.15.139:0/108066892 conn(0x562194fda930 msgr2=0x562195057450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 -- 172.21.15.139:0/108066892 shutdown_connections 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.372+0000 7f8a5e446740 1 -- 172.21.15.139:0/108066892 wait complete. 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.373+0000 7f8a5e446740 1 -- start start 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.373+0000 7f8a5e446740 1 Processor -- start 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x56219503cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950529b0 0x56219503dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a5e446740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562195011af0 con 0x5621950134b0 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x562194f114f0 con 0x562195014a10 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x562195015040 con 0x5621950529b0 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a5e446740 10 client.0 _ll_register_callbacks cb 0x562194f6ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40236/0 (socket says 172.21.15.139:40236) 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 -- 172.21.15.139:0/4279227394 learned_addr learned my addr 172.21.15.139:0/4279227394 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950529b0 0x56219503dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x56219503cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 -- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950529b0 msgr2=0x56219503dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950529b0 0x56219503dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 -- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 msgr2=0x56219503cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x56219503cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 -- 172.21.15.139:0/4279227394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562194c89920 con 0x5621950134b0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a594c7640 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195067660 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000ea70 tx=0x7f8a500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535f2ac1cf145 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.374+0000 7f8a33fff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a33fff640 1 -- 172.21.15.139:0/4279227394 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50027060 con 0x5621950134b0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a33fff640 1 -- 172.21.15.139:0/4279227394 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8a50003d90 con 0x5621950134b0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a44057780 con 0x5621950134b0 2024-04-26T18:20:49.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a33fff640 1 -- 172.21.15.139:0/4279227394 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8a5002d050 con 0x5621950134b0 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 10 client.5715 fetch_fsmap learned FSMap version 9 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562194d55d30 con 0x5621950134b0 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a33fff640 1 -- 172.21.15.139:0/4279227394 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44057780 con 0x5621950134b0 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a33fff640 1 -- 172.21.15.139:0/4279227394 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f8a50030020 con 0x5621950134b0 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 10 client.5715 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 10 client.5715 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 20 client.5715 populate_metadata read hostname 'smithi139' 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x562195051420 0x56219504f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 4 client.5715 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562194f4ba00 con 0x562195051420 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.375+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x562195051420 0x56219504f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.376+0000 7f8a33fff640 10 client.5715 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.376+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x562195051420 0x56219504f6f0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1a644560f0b19fc server_cookie=52a2e3733d7b3540 in_seq=0 out_seq=0 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.376+0000 7f8a33fff640 1 -- 172.21.15.139:0/4279227394 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562194f4ba00 con 0x562195051420 2024-04-26T18:20:49.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.376+0000 7f8a33fff640 10 client.5715 handle_command_reply: tid=0 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.376+0000 7f8a5e446740 1 client.5715 shutdown 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 msgr2=0x562195067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195067660 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000ea70 tx=0x7f8a500046c0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 shutdown_connections 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x562195051420 0x56219504f6f0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5621950529b0 0x56219503dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a33fff640 0 client.5715 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x56219503cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 --2- 172.21.15.139:0/4279227394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195067660 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 >> 172.21.15.139:0/4279227394 conn(0x562194fda930 msgr2=0x56219500ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 shutdown_connections 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 1 -- 172.21.15.139:0/4279227394 wait complete. 2024-04-26T18:20:49.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.377+0000 7f8a5e446740 20 client.5715 trim_cache size 0 max 16384 2024-04-26T18:20:49.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.394+0000 7f8a5e446740 1 Processor -- start 2024-04-26T18:20:49.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.394+0000 7f8a5e446740 1 -- start start 2024-04-26T18:20:49.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195050690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x56219503b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195051420 0x56219503b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a5e446740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8a542008c0 con 0x5621950134b0 2024-04-26T18:20:49.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541ff7a0 con 0x562195014a10 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8a541f5f70 con 0x562195051420 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195050690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195050690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40250/0 (socket says 172.21.15.139:40250) 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 -- 172.21.15.139:0/1121773367 learned_addr learned my addr 172.21.15.139:0/1121773367 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 -- 172.21.15.139:0/1121773367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195051420 msgr2=0x56219503b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 --2- 172.21.15.139:0/1121773367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195051420 0x56219503b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 -- 172.21.15.139:0/1121773367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 msgr2=0x56219503b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 --2- 172.21.15.139:0/1121773367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x56219503b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 -- 172.21.15.139:0/1121773367 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219503db60 con 0x5621950134b0 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a594c7640 1 --2- 172.21.15.139:0/1121773367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195050690 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000f010 tx=0x7f8a5001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8739ba53a141cdb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a3e7fc640 1 -- 172.21.15.139:0/1121773367 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000f040 con 0x5621950134b0 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a3e7fc640 1 -- 172.21.15.139:0/1121773367 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5001b070 con 0x5621950134b0 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.395+0000 7f8a3e7fc640 1 -- 172.21.15.139:0/1121773367 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50003c20 con 0x5621950134b0 2024-04-26T18:20:49.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 -- 172.21.15.139:0/1121773367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 msgr2=0x562195050690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 --2- 172.21.15.139:0/1121773367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195050690 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000f010 tx=0x7f8a5001c000 comp rx=0 tx=0).stop 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 -- 172.21.15.139:0/1121773367 shutdown_connections 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 --2- 172.21.15.139:0/1121773367 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195051420 0x56219503b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 --2- 172.21.15.139:0/1121773367 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x562195014a10 0x56219503b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 --2- 172.21.15.139:0/1121773367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621950134b0 0x562195050690 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 -- 172.21.15.139:0/1121773367 >> 172.21.15.139:0/1121773367 conn(0x562194fda930 msgr2=0x56219503c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 -- 172.21.15.139:0/1121773367 shutdown_connections 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 -- 172.21.15.139:0/1121773367 wait complete. 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 -- start start 2024-04-26T18:20:49.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.396+0000 7f8a5e446740 1 Processor -- start 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5621950134b0 0x56219504db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195014a10 0x5621950d5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a5e446740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562195051420 0x5621950cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a5e446740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541fe4b0 con 0x562195051420 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8a541ff0f0 con 0x5621950134b0 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a5e446740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8a541fea40 con 0x562195014a10 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a5e446740 10 client.0 _ll_register_callbacks cb 0x7f8a50009200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a59cc8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562195051420 0x5621950cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a59cc8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562195051420 0x5621950cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40252/0 (socket says 172.21.15.139:40252) 2024-04-26T18:20:49.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3535266893 learned_addr learned my addr 172.21.15.139:0/3535266893 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a594c7640 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5621950134b0 0x56219504db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.397+0000 7f8a58cc6640 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195014a10 0x5621950d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195014a10 msgr2=0x5621950d5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195014a10 0x5621950d5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5621950134b0 msgr2=0x56219504db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5621950134b0 0x56219504db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a59cc8640 1 -- 172.21.15.139:0/3535266893 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562195077400 con 0x562195051420 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a59cc8640 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562195051420 0x5621950cf8c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c034040 tx=0x7f8a4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72dcccffb0bbbe6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a33fff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a33fff640 1 -- 172.21.15.139:0/3535266893 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c036040 con 0x562195051420 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a33fff640 1 -- 172.21.15.139:0/3535266893 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8a4c031da0 con 0x562195051420 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a5001b070 con 0x562195051420 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a33fff640 1 -- 172.21.15.139:0/3535266893 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8a4c04f050 con 0x562195051420 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 10 client.5721 fetch_fsmap learned FSMap version 9 2024-04-26T18:20:49.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562195077120 con 0x562195051420 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a33fff640 1 -- 172.21.15.139:0/3535266893 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5001b070 con 0x562195051420 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a33fff640 1 -- 172.21.15.139:0/3535266893 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f8a4c052020 con 0x562195051420 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 10 client.5721 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 10 client.5721 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 20 client.5721 populate_metadata read hostname 'smithi139' 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5621950529b0 0x5621950cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 4 client.5721 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "12bb5f75", "release": true, "await": true}] 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.398+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "12bb5f75", "release": true, "await": true}) -- 0x562195052000 con 0x5621950529b0 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a594c7640 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5621950529b0 0x5621950cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a594c7640 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5621950529b0 0x5621950cfe00 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4844afa189bbb9e9 server_cookie=12d4a1d4c0471b8a in_seq=0 out_seq=0 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a33fff640 10 client.5721 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a33fff640 1 -- 172.21.15.139:0/3535266893 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x562195052000 con 0x5621950529b0 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a33fff640 10 client.5721 handle_command_reply: tid=0 2024-04-26T18:20:49.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 client.5721 shutdown 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562195051420 msgr2=0x5621950cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562195051420 0x5621950cf8c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c034040 tx=0x7f8a4c004a40 comp rx=0 tx=0).stop 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 shutdown_connections 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562195051420 0x5621950cf8c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5621950529b0 0x5621950cfe00 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x562195014a10 0x5621950d5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a33fff640 0 client.5721 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 --2- 172.21.15.139:0/3535266893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5621950134b0 0x56219504db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.399+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 >> 172.21.15.139:0/3535266893 conn(0x562194fda930 msgr2=0x56219503cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 shutdown_connections 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5e446740 1 -- 172.21.15.139:0/3535266893 wait complete. 2024-04-26T18:20:49.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5e446740 20 client.5721 trim_cache size 0 max 16384 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 72, 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "12bb5f75": { 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 72, 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:20:49.406 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 82.7, 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:49.407 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:20:49.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8a3806c8f0 msgr2=0x7f8a3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8a3806c8f0 0x7f8a3806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a50006fd0 tx=0x7f8a50008040 comp rx=0 tx=0).stop 2024-04-26T18:20:49.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a54155c80 msgr2=0x7f8a540c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a54155c80 0x7f8a540c9ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400b3f0 tx=0x7f8a4400b8b0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 shutdown_connections 2024-04-26T18:20:49.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8a3806c8f0 0x7f8a3806edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a5415bf70 0x7f8a541e3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8a54155c80 0x7f8a540c9ba0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 --2- 172.21.15.139:0/4261139032 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8a540cedc0 0x7f8a541e6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 >> 172.21.15.139:0/4261139032 conn(0x7f8a5406ef00 msgr2=0x7f8a54071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 shutdown_connections 2024-04-26T18:20:49.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.400+0000 7f8a5b72b640 1 -- 172.21.15.139:0/4261139032 wait complete. 2024-04-26T18:20:49.411 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '12bb5f75', seconds elapsed: 25.9 2024-04-26T18:20:49.411 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.65 2024-04-26T18:20:49.412 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:20:49.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.510+0000 7fb604ac4640 1 Processor -- start 2024-04-26T18:20:49.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.510+0000 7fb604ac4640 1 -- start start 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb604ac4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb60015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb604ac4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb6000cd840 0x7fb6000c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb604ac4640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60015f2a0 con 0x7fb600156180 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb604ac4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb60015cbc0 con 0x7fb6000cd840 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb604ac4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb6000cc730 con 0x7fb600155da0 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb5fed9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb6000cd840 0x7fb6000c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb5fdd9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb600156180 0x7fb6000d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45238/0 (socket says 172.21.15.139:45238) 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb5fdd9b640 1 -- 172.21.15.139:0/2185239995 learned_addr learned my addr 172.21.15.139:0/2185239995 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.511+0000 7fb5fe59c640 1 --2- 172.21.15.139:0/2185239995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb60015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fed9d640 1 -- 172.21.15.139:0/2185239995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 msgr2=0x7fb60015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fed9d640 1 --2- 172.21.15.139:0/2185239995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb60015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fed9d640 1 -- 172.21.15.139:0/2185239995 >> v1:172.21.15.139:6789/0 conn(0x7fb600156180 legacy=0x7fb6000d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fed9d640 1 -- 172.21.15.139:0/2185239995 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60015f580 con 0x7fb6000cd840 2024-04-26T18:20:49.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fd59a640 1 -- 172.21.15.139:0/2185239995 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164228268 0 0) 0x7fb60015f2a0 con 0x7fb600156180 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fed9d640 1 --2- 172.21.15.139:0/2185239995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6000cd840 0x7fb6000c62a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80097a0 tx=0x7fb5f802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc160f7b285080ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fd59a640 1 -- 172.21.15.139:0/2185239995 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8037070 con 0x7fb6000cd840 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.512+0000 7fb5fd59a640 1 -- 172.21.15.139:0/2185239995 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f802ae50 con 0x7fb6000cd840 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb5fd59a640 1 -- 172.21.15.139:0/2185239995 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8032660 con 0x7fb6000cd840 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 -- 172.21.15.139:0/2185239995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6000cd840 msgr2=0x7fb6000c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 --2- 172.21.15.139:0/2185239995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6000cd840 0x7fb6000c62a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80097a0 tx=0x7fb5f802a100 comp rx=0 tx=0).stop 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 -- 172.21.15.139:0/2185239995 shutdown_connections 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 --2- 172.21.15.139:0/2185239995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6000cd840 0x7fb6000c62a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 --2- 172.21.15.139:0/2185239995 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb60015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 -- 172.21.15.139:0/2185239995 >> 172.21.15.139:0/2185239995 conn(0x7fb600068090 msgr2=0x7fb6000684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 -- 172.21.15.139:0/2185239995 shutdown_connections 2024-04-26T18:20:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.513+0000 7fb604ac4640 1 -- 172.21.15.139:0/2185239995 wait complete. 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.514+0000 7fb604ac4640 1 Processor -- start 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.514+0000 7fb604ac4640 1 -- start start 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb604ac4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6000cd840 0x7fb6001e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb604ac4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb6001e54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb604ac4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6001e6600 0x7fb6001e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb604ac4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6000d19d0 con 0x7fb6001e6600 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb604ac4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb60015fb40 con 0x7fb6000cd840 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb604ac4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb6000d1b50 con 0x7fb600155da0 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb5fed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6001e6600 0x7fb6001e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb5fed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6001e6600 0x7fb6001e5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56670/0 (socket says 172.21.15.139:56670) 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb5fed9d640 1 -- 172.21.15.139:0/346535081 learned_addr learned my addr 172.21.15.139:0/346535081 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb5fdd9b640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb6001e54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.515+0000 7fb5fe59c640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6000cd840 0x7fb6001e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5fed9d640 1 -- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 msgr2=0x7fb6001e54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5fed9d640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb6001e54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5fed9d640 1 -- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6000cd840 msgr2=0x7fb6001e60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5fed9d640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6000cd840 0x7fb6001e60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5fed9d640 1 -- 172.21.15.139:0/346535081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6001f26f0 con 0x7fb6001e6600 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5fed9d640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6001e6600 0x7fb6001e5a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80098c0 tx=0x7fb5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5eeffd640 1 -- 172.21.15.139:0/346535081 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8041020 con 0x7fb6001e6600 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5eeffd640 1 -- 172.21.15.139:0/346535081 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f803c670 con 0x7fb6001e6600 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb600155170 con 0x7fb6001e6600 2024-04-26T18:20:49.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb5eeffd640 1 -- 172.21.15.139:0/346535081 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8037040 con 0x7fb6001e6600 2024-04-26T18:20:49.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.516+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60014f260 con 0x7fb6001e6600 2024-04-26T18:20:49.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.517+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb600076d20 con 0x7fb6001e6600 2024-04-26T18:20:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.517+0000 7fb5eeffd640 1 -- 172.21.15.139:0/346535081 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5f8044020 con 0x7fb6001e6600 2024-04-26T18:20:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.518+0000 7fb5eeffd640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb5e006c920 0x7fb5e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.518+0000 7fb5eeffd640 1 -- 172.21.15.139:0/346535081 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb5f80ac450 con 0x7fb6001e6600 2024-04-26T18:20:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.518+0000 7fb5fe59c640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb5e006c920 0x7fb5e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.518+0000 7fb5fe59c640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb5e006c920 0x7fb5e006ede0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00113e0 tx=0x7fb5f000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.522+0000 7fb5eeffd640 1 -- 172.21.15.139:0/346535081 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5f804b030 con 0x7fb6001e6600 2024-04-26T18:20:49.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.734+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6000ccd30 con 0x7fb6001e6600 2024-04-26T18:20:49.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.734+0000 7fb5eeffd640 1 -- 172.21.15.139:0/346535081 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fb5f8079fa0 con 0x7fb6001e6600 2024-04-26T18:20:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:20:49.735 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:20:49.736 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb5e006c920 msgr2=0x7fb5e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb5e006c920 0x7fb5e006ede0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00113e0 tx=0x7fb5f000b040 comp rx=0 tx=0).stop 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6001e6600 msgr2=0x7fb6001e5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6001e6600 0x7fb6001e5a20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80098c0 tx=0x7fb5f80046c0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 shutdown_connections 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb5e006c920 0x7fb5e006ede0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6001e6600 0x7fb6001e5a20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb600155da0 0x7fb6001e54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 --2- 172.21.15.139:0/346535081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb6000cd840 0x7fb6001e60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 >> 172.21.15.139:0/346535081 conn(0x7fb600068090 msgr2=0x7fb6000ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 shutdown_connections 2024-04-26T18:20:49.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.736+0000 7fb604ac4640 1 -- 172.21.15.139:0/346535081 wait complete. 2024-04-26T18:20:49.747 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 82.65 --await-for 42.0' 2024-04-26T18:20:49.747 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 82.65 --await-for 42.0 2024-04-26T18:20:49.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.858+0000 7f1fe1f33640 1 Processor -- start 2024-04-26T18:20:49.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.858+0000 7f1fe1f33640 1 -- start start 2024-04-26T18:20:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.859+0000 7f1fe1f33640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 0x7f1fdc0d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.859+0000 7f1fe1f33640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1fdc15c2a0 0x7f1fdc15c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.859+0000 7f1fe1f33640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fdc15f5f0 con 0x7f1fdc0d14b0 2024-04-26T18:20:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.859+0000 7f1fe1f33640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1fdc160170 con 0x7f1fdc15c2a0 2024-04-26T18:20:49.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.859+0000 7f1fe1f33640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc15be10 con 0x7f1fdc0cf260 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.859+0000 7f1fdb7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f1fdc0d14b0 0x7f1fdc0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:45248/0 (socket says 172.21.15.139:45248) 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.859+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/2172155254 learned_addr learned my addr 172.21.15.139:0/2172155254 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/2172155254 >> v2:172.21.15.143:3300/0 conn(0x7f1fdc15c2a0 0x7f1fdc15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618268730 0 0) 0x7f1fdc15f5f0 con 0x7f1fdc0d14b0 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 0x7f1fdc0d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fc4003520 con 0x7f1fdc0d14b0 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 294330016 0 0) 0x7f1fc4003520 con 0x7f1fdc0d14b0 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 msgr2=0x7f1fdc0d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 0x7f1fdc0d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 >> v2:172.21.15.143:3300/0 conn(0x7f1fdc15c2a0 msgr2=0x7f1fdc15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 --2- 172.21.15.139:0/2172155254 >> v2:172.21.15.143:3300/0 conn(0x7f1fdc15c2a0 0x7f1fdc15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc15f8d0 con 0x7f1fdc0d14b0 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f1fcc001670 con 0x7f1fdc0d14b0 2024-04-26T18:20:49.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 >> v1:172.21.15.139:6789/0 conn(0x7f1fdc0d14b0 legacy=0x7f1fdc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 0x7f1fc40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc4003f30 0x7f1fc4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4004d40 0x7f1fc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc160170 con 0x7f1fc4003f30 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc15be10 con 0x7f1fc4004d40 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc400b9f0 con 0x7f1fdc0cf260 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc4003f30 0x7f1fc4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 0x7f1fc40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4004d40 0x7f1fc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdaffd640 1 -- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 msgr2=0x7f1fc40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc0cf260 0x7f1fc40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdaffd640 1 -- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4004d40 msgr2=0x7f1fc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4004d40 0x7f1fc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.860+0000 7f1fdaffd640 1 -- 172.21.15.139:0/2172155254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc4003520 con 0x7f1fc4003f30 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.861+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc4003f30 0x7f1fc4004800 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009ac0 tx=0x7f1fc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd78fbcfadd709ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.861+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0036070 con 0x7f1fc4003f30 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.861+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd0031400 con 0x7f1fc4003f30 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.861+0000 7f1fda7fc640 1 -- 172.21.15.139:0/2172155254 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0009690 con 0x7f1fc4003f30 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.862+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2172155254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc4003f30 msgr2=0x7f1fc4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.862+0000 7f1fe1f33640 1 --2- 172.21.15.139:0/2172155254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc4003f30 0x7f1fc4004800 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009ac0 tx=0x7f1fc4005830 comp rx=0 tx=0).stop 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.862+0000 7f1fdbfff640 1 -- 172.21.15.139:0/2172155254 reap_dead start 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.862+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2172155254 shutdown_connections 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.862+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2172155254 >> 172.21.15.139:0/2172155254 conn(0x7f1fdc073c70 msgr2=0x7f1fdc074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.862+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2172155254 shutdown_connections 2024-04-26T18:20:49.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.862+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2172155254 wait complete. 2024-04-26T18:20:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.863+0000 7f1fe1f33640 1 Processor -- start 2024-04-26T18:20:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.863+0000 7f1fe1f33640 1 -- start start 2024-04-26T18:20:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4003f30 0x7f1fdc15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc156510 0x7f1fdc15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc14bc10 0x7f1fdc14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc15f1d0 con 0x7f1fdc156510 2024-04-26T18:20:49.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc15fe90 con 0x7f1fc4003f30 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc15f350 con 0x7f1fdc14bc10 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc156510 0x7f1fdc15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc156510 0x7f1fdc15e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56692/0 (socket says 172.21.15.139:56692) 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 -- 172.21.15.139:0/2769154989 learned_addr learned my addr 172.21.15.139:0/2769154989 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4003f30 0x7f1fdc15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc14bc10 0x7f1fdc14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 -- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc14bc10 msgr2=0x7f1fdc14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc14bc10 0x7f1fdc14c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 -- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4003f30 msgr2=0x7f1fdc15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4003f30 0x7f1fdc15dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 -- 172.21.15.139:0/2769154989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc0c8ed0 con 0x7f1fdc156510 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4003f30 0x7f1fdc15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc156510 0x7f1fdc15e2c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0034040 tx=0x7f1fd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fc3fff640 1 -- 172.21.15.139:0/2769154989 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0040020 con 0x7f1fdc156510 2024-04-26T18:20:49.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fc3fff640 1 -- 172.21.15.139:0/2769154989 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd0003c60 con 0x7f1fdc156510 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fdc159140 con 0x7f1fdc156510 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fc3fff640 1 -- 172.21.15.139:0/2769154989 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0036040 con 0x7f1fdc156510 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.864+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fdc0c8bf0 con 0x7f1fdc156510 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.866+0000 7f1fc3fff640 1 -- 172.21.15.139:0/2769154989 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fd0043020 con 0x7f1fdc156510 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.866+0000 7f1fc3fff640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc806c8f0 0x7f1fc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.866+0000 7f1fc3fff640 1 -- 172.21.15.139:0/2769154989 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1fd00ac0b0 con 0x7f1fdc156510 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.866+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc806c8f0 0x7f1fc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.867+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc806c8f0 0x7f1fc806edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc001470 tx=0x7f1fcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.867+0000 7f1fe4c4c740 1 Processor -- start 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.867+0000 7f1fe4c4c740 1 -- start start 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d299c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d29f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b7c2c8cd80 con 0x55b7c2d295e0 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b7c2c28c20 con 0x55b7c2d2ab40 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b7c2c88d40 con 0x55b7c2d68ae0 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56696/0 (socket says 172.21.15.139:56696) 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/4229856529 learned_addr learned my addr 172.21.15.139:0/4229856529 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d299c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d29f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 msgr2=0x55b7c2d299c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d299c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 msgr2=0x55b7c2d29f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d29f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.868+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/4229856529 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c2a6ad80 con 0x55b7c2d295e0 2024-04-26T18:20:49.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.869+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d685a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007ed0 tx=0x7f1fcc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5892fab250c7308d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.869+0000 7f1fc17fa640 1 -- 172.21.15.139:0/4229856529 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc026070 con 0x55b7c2d295e0 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.869+0000 7f1fc17fa640 1 -- 172.21.15.139:0/4229856529 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc01c050 con 0x55b7c2d295e0 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.869+0000 7f1fc17fa640 1 -- 172.21.15.139:0/4229856529 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc015de0 con 0x55b7c2d295e0 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.869+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/4229856529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 msgr2=0x55b7c2d685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.869+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d685a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007ed0 tx=0x7f1fcc013000 comp rx=0 tx=0).stop 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/4229856529 shutdown_connections 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d29f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d299c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/4229856529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d685a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/4229856529 >> 172.21.15.139:0/4229856529 conn(0x55b7c2cf0740 msgr2=0x55b7c2d6d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/4229856529 shutdown_connections 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/4229856529 wait complete. 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 -- start start 2024-04-26T18:20:49.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.870+0000 7f1fe4c4c740 1 Processor -- start 2024-04-26T18:20:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d295e0 0x55b7c2d63a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d51030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2d51570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b7c2d27c20 con 0x55b7c2d68ae0 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b7c2c26840 con 0x55b7c2d2ab40 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b7c2d2b170 con 0x55b7c2d295e0 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fe4c4c740 10 client.0 _ll_register_callbacks cb 0x55b7c2c2a5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2d51570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2d51570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56708/0 (socket says 172.21.15.139:56708) 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 -- 172.21.15.139:0/2506100410 learned_addr learned my addr 172.21.15.139:0/2506100410 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d295e0 0x55b7c2d63a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d51030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 -- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d295e0 msgr2=0x55b7c2d63a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d295e0 0x55b7c2d63a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 -- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 msgr2=0x55b7c2d51030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d51030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 -- 172.21.15.139:0/2506100410 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c2acb510 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2d51570 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc06dc30 tx=0x7f1fd4004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc408fbe143b28ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.871+0000 7f1fba7fc640 1 -- 172.21.15.139:0/2506100410 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd401b070 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fcc01c050 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fba7fc640 1 -- 172.21.15.139:0/2506100410 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1fd4007a60 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fba7fc640 1 -- 172.21.15.139:0/2506100410 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1fd4026050 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 10 client.5742 fetch_fsmap learned FSMap version 9 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b7c295e670 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fba7fc640 1 -- 172.21.15.139:0/2506100410 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc01c050 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fba7fc640 1 -- 172.21.15.139:0/2506100410 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1fd4029020 con 0x55b7c2d68ae0 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 10 client.5742 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:20:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 10 client.5742 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 20 client.5742 populate_metadata read hostname 'smithi139' 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d61f80 0x55b7c2d7d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 4 client.5742 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7c2c9a990 con 0x55b7c2d61f80 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d61f80 0x55b7c2d7d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fba7fc640 10 client.5742 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.872+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d61f80 0x55b7c2d7d790 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf1771d97c3eac3 server_cookie=4c1655efec6ffc05 in_seq=0 out_seq=0 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fba7fc640 1 -- 172.21.15.139:0/2506100410 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b7c2c9a990 con 0x55b7c2d61f80 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fba7fc640 10 client.5742 handle_command_reply: tid=0 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 client.5742 shutdown 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 msgr2=0x55b7c2d51570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2d51570 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc06dc30 tx=0x7f1fd4004640 comp rx=0 tx=0).stop 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 shutdown_connections 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2d51570 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d51030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d61f80 0x55b7c2d7d790 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2506100410 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d295e0 0x55b7c2d63a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 >> 172.21.15.139:0/2506100410 conn(0x55b7c2cf0740 msgr2=0x55b7c2d6da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fba7fc640 0 client.5742 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 shutdown_connections 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2506100410 wait complete. 2024-04-26T18:20:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.873+0000 7f1fe4c4c740 20 client.5742 trim_cache size 0 max 16384 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.890+0000 7f1fe4c4c740 1 Processor -- start 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.890+0000 7f1fe4c4c740 1 -- start start 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d4e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d64b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc200e00 con 0x55b7c2d295e0 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1ffce0 con 0x55b7c2d2ab40 2024-04-26T18:20:49.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc1fe3b0 con 0x55b7c2d68ae0 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d4e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d4e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56712/0 (socket says 172.21.15.139:56712) 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/2614610600 learned_addr learned my addr 172.21.15.139:0/2614610600 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d64b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 msgr2=0x55b7c2d64b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d64b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 msgr2=0x55b7c2d645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdb7fe640 1 -- 172.21.15.139:0/2614610600 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c2d26da0 con 0x55b7c2d295e0 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.891+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d4e460 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc005fd0 tx=0x7f1fcc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ff4d54385fa093 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fc0ff9640 1 -- 172.21.15.139:0/2614610600 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc035070 con 0x55b7c2d295e0 2024-04-26T18:20:49.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fc0ff9640 1 -- 172.21.15.139:0/2614610600 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc01c040 con 0x55b7c2d295e0 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fc0ff9640 1 -- 172.21.15.139:0/2614610600 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc026040 con 0x55b7c2d295e0 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2614610600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 msgr2=0x55b7c2d4e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d4e460 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc005fd0 tx=0x7f1fcc016000 comp rx=0 tx=0).stop 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2614610600 shutdown_connections 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d68ae0 0x55b7c2d64b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d2ab40 0x55b7c2d645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/2614610600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d295e0 0x55b7c2d4e460 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2614610600 >> 172.21.15.139:0/2614610600 conn(0x55b7c2cf0740 msgr2=0x55b7c2d22ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2614610600 shutdown_connections 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.892+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/2614610600 wait complete. 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.893+0000 7f1fe4c4c740 1 -- start start 2024-04-26T18:20:49.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.893+0000 7f1fe4c4c740 1 Processor -- start 2024-04-26T18:20:49.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d295e0 0x55b7c2d526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d2ab40 0x55b7c2d64980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2de4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1fe8a0 con 0x55b7c2d68ae0 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc1ff610 con 0x55b7c2d295e0 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc1fef70 con 0x55b7c2d2ab40 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 10 client.0 _ll_register_callbacks cb 0x7f1fd4009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2de4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdb7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d295e0 0x55b7c2d526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2de4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56716/0 (socket says 172.21.15.139:56716) 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 -- 172.21.15.139:0/440319498 learned_addr learned my addr 172.21.15.139:0/440319498 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdaffd640 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d2ab40 0x55b7c2d64980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 -- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d2ab40 msgr2=0x55b7c2d64980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d2ab40 0x55b7c2d64980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 -- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d295e0 msgr2=0x55b7c2d526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d295e0 0x55b7c2d526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 -- 172.21.15.139:0/440319498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c2d68910 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d295e0 0x55b7c2d526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fdbfff640 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2de4c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55b7c2d6b330 tx=0x7f1fd4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac276de970a6ffc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fba7fc640 1 -- 172.21.15.139:0/440319498 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd401b040 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fba7fc640 1 -- 172.21.15.139:0/440319498 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1fd40208a0 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.894+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fcc01c040 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fba7fc640 1 -- 172.21.15.139:0/440319498 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1fd4039050 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 10 client.5748 fetch_fsmap learned FSMap version 9 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b7c2d29d00 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fba7fc640 1 -- 172.21.15.139:0/440319498 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc01c040 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fba7fc640 1 -- 172.21.15.139:0/440319498 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1fd403c020 con 0x55b7c2d68ae0 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 10 client.5748 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:20:49.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 10 client.5748 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:20:49.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 20 client.5748 populate_metadata read hostname 'smithi139' 2024-04-26T18:20:49.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d69fc0 0x55b7c2de5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:20:49.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 4 client.5748 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.65, "await_for": 42.0}] 2024-04-26T18:20:49.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.65, "await_for": 42.0}) -- 0x55b7c2c94800 con 0x55b7c2d69fc0 2024-04-26T18:20:49.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d69fc0 0x55b7c2de5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:20:49.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fba7fc640 10 client.5748 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:49.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:49.895+0000 7f1fdb7fe640 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d69fc0 0x55b7c2de5150 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc708deb5137021 server_cookie=ea29613e5cbcd9e5 in_seq=0 out_seq=0 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.692+0000 7f1fba7fc640 1 -- 172.21.15.139:0/440319498 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55b7c2c94800 con 0x55b7c2d69fc0 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.692+0000 7f1fba7fc640 10 client.5748 handle_command_reply: tid=0 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.692+0000 7f1fe4c4c740 1 client.5748 shutdown 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 msgr2=0x55b7c2de4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2de4c10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55b7c2d6b330 tx=0x7f1fd4004ab0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 shutdown_connections 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7c2d68ae0 0x55b7c2de4c10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b7c2d69fc0 0x55b7c2de5150 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b7c2d2ab40 0x55b7c2d64980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 --2- 172.21.15.139:0/440319498 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b7c2d295e0 0x55b7c2d526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fba7fc640 0 client.5748 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 >> 172.21.15.139:0/440319498 conn(0x55b7c2cf0740 msgr2=0x55b7c2d66b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 shutdown_connections 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 1 -- 172.21.15.139:0/440319498 wait complete. 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe4c4c740 20 client.5748 trim_cache size 0 max 16384 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:20:50.695 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 74, 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "775da850": { 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 74, 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 82.7, 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:20:50.696 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:20:50.697 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:20:50.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:50.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:50.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:50.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:50.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:20:50.697 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc806c8f0 msgr2=0x7f1fc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe1f33640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc806c8f0 0x7f1fc806edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc001470 tx=0x7f1fcc009040 comp rx=0 tx=0).stop 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc156510 msgr2=0x7f1fdc15e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.693+0000 7f1fe1f33640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc156510 0x7f1fdc15e2c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0034040 tx=0x7f1fd0004730 comp rx=0 tx=0).stop 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 shutdown_connections 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1fc806c8f0 0x7f1fc806edb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1fdc14bc10 0x7f1fdc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fdc156510 0x7f1fdc15e2c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 --2- 172.21.15.139:0/2769154989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1fc4003f30 0x7f1fdc15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:20:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 >> 172.21.15.139:0/2769154989 conn(0x7f1fdc073c70 msgr2=0x7f1fdc0c6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:20:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 shutdown_connections 2024-04-26T18:20:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:20:50.694+0000 7f1fe1f33640 1 -- 172.21.15.139:0/2769154989 wait complete. 2024-04-26T18:20:50.705 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '775da850', quiesce took 1.3 seconds. Will release after: 22.65 2024-04-26T18:21:00.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:21:00.034 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:21:13.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:21:13.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.466+0000 7fd5a1d5f640 1 Processor -- start 2024-04-26T18:21:13.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.466+0000 7fd5a1d5f640 1 -- start start 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.466+0000 7fd5a1d5f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd59c0cb410 0x7fd59c15c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd5a1d5f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59c0ca3e0 con 0x7fd59c070400 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd5a1d5f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59c15fdd0 con 0x7fd59c070020 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd5a1d5f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd59c15fba0 con 0x7fd59c0cb410 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59affd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd59c070400 0x7fd59c155a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55856/0 (socket says 172.21.15.139:55856) 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59affd640 1 -- 172.21.15.139:0/2534750474 learned_addr learned my addr 172.21.15.139:0/2534750474 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59bfff640 1 --2- 172.21.15.139:0/2534750474 >> v2:172.21.15.143:3300/0 conn(0x7fd59c0cb410 0x7fd59c15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532351651 0 0) 0x7fd59c0ca3e0 con 0x7fd59c070400 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd584003520 con 0x7fd59c070400 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 790432879 0 0) 0x7fd584003520 con 0x7fd59c070400 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 >> v2:172.21.15.143:3300/0 conn(0x7fd59c0cb410 msgr2=0x7fd59c15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 --2- 172.21.15.139:0/2534750474 >> v2:172.21.15.143:3300/0 conn(0x7fd59c0cb410 0x7fd59c15c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 >> v1:172.21.15.143:6789/0 conn(0x7fd59c070020 legacy=0x7fd59c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c160070 con 0x7fd59c070400 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7fd590001670 con 0x7fd59c070400 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59bfff640 1 --2- 172.21.15.139:0/2534750474 >> v2:172.21.15.143:3300/0 conn(0x7fd59c0cb410 0x7fd59c15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 >> v1:172.21.15.139:6789/0 conn(0x7fd59c070400 legacy=0x7fd59c155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5840039b0 0x7fd584003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd584004800 0x7fd584004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5840051c0 0x7fd58400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd58400c030 con 0x7fd584004800 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd58400c1e0 con 0x7fd5840039b0 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd58400c3e0 con 0x7fd5840051c0 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59affd640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd584004800 0x7fd584004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.467+0000 7fd59b7fe640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5840039b0 0x7fd584003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59bfff640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5840051c0 0x7fd58400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59affd640 1 -- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5840051c0 msgr2=0x7fd58400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59affd640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5840051c0 0x7fd58400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59affd640 1 -- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5840039b0 msgr2=0x7fd584003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59affd640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5840039b0 0x7fd584003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59affd640 1 -- 172.21.15.139:0/2534750474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd584003520 con 0x7fd584004800 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59bfff640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5840051c0 0x7fd58400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59bfff640 1 -- 172.21.15.139:0/2534750474 reap_dead start 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59affd640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd584004800 0x7fd584004c80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd59000c240 tx=0x7fd584005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b247909827c3d55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590007cf0 con 0x7fd584004800 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590005af0 con 0x7fd584004800 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.468+0000 7fd59a7fc640 1 -- 172.21.15.139:0/2534750474 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590007070 con 0x7fd584004800 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.469+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/2534750474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd584004800 msgr2=0x7fd584004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.469+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd584004800 0x7fd584004c80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd59000c240 tx=0x7fd584005830 comp rx=0 tx=0).stop 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.469+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/2534750474 shutdown_connections 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.469+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/2534750474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd584004800 0x7fd584004c80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.469+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/2534750474 >> 172.21.15.139:0/2534750474 conn(0x7fd59c071bf0 msgr2=0x7fd59c071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.469+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/2534750474 shutdown_connections 2024-04-26T18:21:13.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.469+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/2534750474 wait complete. 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.470+0000 7fd5a1d5f640 1 Processor -- start 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd5a1d5f640 1 -- start start 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd5a1d5f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd584004800 0x7fd59c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd5a1d5f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c0b1a90 0x7fd59c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd5a1d5f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd59c1539b0 0x7fd59c1f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd5a1d5f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0cccb0 con 0x7fd59c0b1a90 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd5a1d5f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0ca100 con 0x7fd584004800 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd5a1d5f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c0cacc0 con 0x7fd59c1539b0 2024-04-26T18:21:13.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd59affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c0b1a90 0x7fd59c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd59affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c0b1a90 0x7fd59c153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34244/0 (socket says 172.21.15.139:34244) 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd59b7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd584004800 0x7fd59c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd59affd640 1 -- 172.21.15.139:0/599415621 learned_addr learned my addr 172.21.15.139:0/599415621 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.471+0000 7fd59bfff640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd59c1539b0 0x7fd59c1f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd59affd640 1 -- 172.21.15.139:0/599415621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd59c1539b0 msgr2=0x7fd59c1f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd59affd640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd59c1539b0 0x7fd59c1f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd59affd640 1 -- 172.21.15.139:0/599415621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd584004800 msgr2=0x7fd59c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd59affd640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd584004800 0x7fd59c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd59affd640 1 -- 172.21.15.139:0/599415621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c0c6790 con 0x7fd59c0b1a90 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd59affd640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c0b1a90 0x7fd59c153470 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd590001970 tx=0x7fd59c15bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd583fff640 1 -- 172.21.15.139:0/599415621 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59003f020 con 0x7fd59c0b1a90 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd583fff640 1 -- 172.21.15.139:0/599415621 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590001470 con 0x7fd59c0b1a90 2024-04-26T18:21:13.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd583fff640 1 -- 172.21.15.139:0/599415621 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5900049e0 con 0x7fd59c0b1a90 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c0c6a70 con 0x7fd59c0b1a90 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.472+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c0b0820 con 0x7fd59c0b1a90 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.473+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c069ae0 con 0x7fd59c0b1a90 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.473+0000 7fd583fff640 1 -- 172.21.15.139:0/599415621 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd590042020 con 0x7fd59c0b1a90 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.474+0000 7fd583fff640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58806c8f0 0x7fd58806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.474+0000 7fd583fff640 1 -- 172.21.15.139:0/599415621 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fd5900aba90 con 0x7fd59c0b1a90 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.474+0000 7fd59b7fe640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58806c8f0 0x7fd58806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.474+0000 7fd59b7fe640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58806c8f0 0x7fd58806edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd58c000c00 tx=0x7fd58c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.478+0000 7fd583fff640 1 -- 172.21.15.139:0/599415621 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd5900793a0 con 0x7fd59c0b1a90 2024-04-26T18:21:13.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.689+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd59c076d20 con 0x7fd59c0b1a90 2024-04-26T18:21:13.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.690+0000 7fd583fff640 1 -- 172.21.15.139:0/599415621 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fd59007d6a0 con 0x7fd59c0b1a90 2024-04-26T18:21:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:21:13.691 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:21:13.691 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58806c8f0 msgr2=0x7fd58806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58806c8f0 0x7fd58806edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd58c000c00 tx=0x7fd58c009040 comp rx=0 tx=0).stop 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c0b1a90 msgr2=0x7fd59c153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c0b1a90 0x7fd59c153470 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd590001970 tx=0x7fd59c15bd40 comp rx=0 tx=0).stop 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 shutdown_connections 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58806c8f0 0x7fd58806edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd59c1539b0 0x7fd59c1f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd59c0b1a90 0x7fd59c153470 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 --2- 172.21.15.139:0/599415621 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd584004800 0x7fd59c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 >> 172.21.15.139:0/599415621 conn(0x7fd59c071bf0 msgr2=0x7fd59c15f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 shutdown_connections 2024-04-26T18:21:13.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.692+0000 7fd5a1d5f640 1 -- 172.21.15.139:0/599415621 wait complete. 2024-04-26T18:21:13.703 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 775da850 --release --await' 2024-04-26T18:21:13.704 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 775da850 --release --await 2024-04-26T18:21:13.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.808+0000 7ff25eb24640 1 Processor -- start 2024-04-26T18:21:13.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.808+0000 7ff25eb24640 1 -- start start 2024-04-26T18:21:13.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25eb24640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7ff2580c6050 0x7ff25815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25eb24640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2580c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25eb24640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2581599b0 con 0x7ff258153ab0 2024-04-26T18:21:13.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25eb24640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7ff2580716c0 con 0x7ff2580c6050 2024-04-26T18:21:13.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25eb24640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff25815a880 con 0x7ff25815a450 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25c8c0640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff258153ab0 0x7ff2580cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:55862/0 (socket says 172.21.15.139:55862) 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25c8c0640 1 -- 172.21.15.139:0/4149742318 learned_addr learned my addr 172.21.15.139:0/4149742318 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff257fff640 1 --2- 172.21.15.139:0/4149742318 >> v2:172.21.15.143:3300/0 conn(0x7ff2580c6050 0x7ff25815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff25d0c1640 1 --2- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2580c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff2577fe640 1 -- 172.21.15.139:0/4149742318 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973463060 0 0) 0x7ff2581599b0 con 0x7ff258153ab0 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.809+0000 7ff2577fe640 1 -- 172.21.15.139:0/4149742318 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff240003520 con 0x7ff258153ab0 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.810+0000 7ff257fff640 1 -- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 msgr2=0x7ff2580c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.810+0000 7ff257fff640 1 --2- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2580c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.810+0000 7ff257fff640 1 -- 172.21.15.139:0/4149742318 >> v1:172.21.15.139:6789/0 conn(0x7ff258153ab0 legacy=0x7ff2580cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.810+0000 7ff2577fe640 1 -- 172.21.15.139:0/4149742318 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1791281639 0 0) 0x7ff240003520 con 0x7ff258153ab0 2024-04-26T18:21:13.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.810+0000 7ff257fff640 1 -- 172.21.15.139:0/4149742318 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2580709e0 con 0x7ff2580c6050 2024-04-26T18:21:13.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.810+0000 7ff257fff640 1 --2- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2580c6050 0x7ff25815ce90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0097d0 tx=0x7ff24c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9c1b7c8733035 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff2577fe640 1 -- 172.21.15.139:0/4149742318 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c037070 con 0x7ff2580c6050 2024-04-26T18:21:13.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff2577fe640 1 -- 172.21.15.139:0/4149742318 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c02ac70 con 0x7ff2580c6050 2024-04-26T18:21:13.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff2577fe640 1 -- 172.21.15.139:0/4149742318 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248001690 con 0x7ff2580c6050 2024-04-26T18:21:13.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 -- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2580c6050 msgr2=0x7ff25815ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2580c6050 0x7ff25815ce90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0097d0 tx=0x7ff24c02a1e0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 -- 172.21.15.139:0/4149742318 shutdown_connections 2024-04-26T18:21:13.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2580c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4149742318 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff2580c6050 0x7ff25815ce90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 -- 172.21.15.139:0/4149742318 >> 172.21.15.139:0/4149742318 conn(0x7ff258068090 msgr2=0x7ff258068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 -- 172.21.15.139:0/4149742318 shutdown_connections 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.811+0000 7ff25eb24640 1 -- 172.21.15.139:0/4149742318 wait complete. 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.812+0000 7ff25eb24640 1 Processor -- start 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.812+0000 7ff25eb24640 1 -- start start 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25eb24640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2580c6050 0x7ff2581562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25eb24640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff258153ab0 0x7ff2581f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25eb24640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2581f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25eb24640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff258159f30 con 0x7ff2580c6050 2024-04-26T18:21:13.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25eb24640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff258159c50 con 0x7ff258153ab0 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25eb24640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff258070fa0 con 0x7ff25815a450 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25c8c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2580c6050 0x7ff2581562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25c8c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2580c6050 0x7ff2581562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34246/0 (socket says 172.21.15.139:34246) 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25c8c0640 1 -- 172.21.15.139:0/4191755087 learned_addr learned my addr 172.21.15.139:0/4191755087 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25d0c1640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2581f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff257fff640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff258153ab0 0x7ff2581f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.813+0000 7ff25c8c0640 1 -- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 msgr2=0x7ff2581f03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2581f03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff25c8c0640 1 -- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff258153ab0 msgr2=0x7ff2581f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff258153ab0 0x7ff2581f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff25c8c0640 1 -- 172.21.15.139:0/4191755087 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2581f2fd0 con 0x7ff2580c6050 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2580c6050 0x7ff2581562f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff24800c750 tx=0x7ff24800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff2557fa640 1 -- 172.21.15.139:0/4191755087 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248018070 con 0x7ff2580c6050 2024-04-26T18:21:13.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff2557fa640 1 -- 172.21.15.139:0/4191755087 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2480072d0 con 0x7ff2580c6050 2024-04-26T18:21:13.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2581f32b0 con 0x7ff2580c6050 2024-04-26T18:21:13.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff2557fa640 1 -- 172.21.15.139:0/4191755087 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2480047e0 con 0x7ff2580c6050 2024-04-26T18:21:13.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.814+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff258154e80 con 0x7ff2580c6050 2024-04-26T18:21:13.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.815+0000 7ff2557fa640 1 -- 172.21.15.139:0/4191755087 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff24801b070 con 0x7ff2580c6050 2024-04-26T18:21:13.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.816+0000 7ff2557fa640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff24406c8f0 0x7ff24406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.816+0000 7ff2557fa640 1 -- 172.21.15.139:0/4191755087 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ff24808b3f0 con 0x7ff2580c6050 2024-04-26T18:21:13.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.816+0000 7ff257fff640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff24406c8f0 0x7ff24406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.816+0000 7ff257fff640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff24406c8f0 0x7ff24406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff24c034000 tx=0x7ff24c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 Processor -- start 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 -- start start 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b1d54b0 0x55a24b214470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b2149b0 0x55a24b1d5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a24b13a040 con 0x55a24b2149b0 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a24b0d5b60 con 0x55a24b1d6a10 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a24b136000 con 0x55a24b1d54b0 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff257fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b2149b0 0x55a24b1d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff257fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b2149b0 0x55a24b1d5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34258/0 (socket says 172.21.15.139:34258) 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff257fff640 1 -- 172.21.15.139:0/2925709662 learned_addr learned my addr 172.21.15.139:0/2925709662 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b1d54b0 0x55a24b214470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.817+0000 7ff25d0c1640 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff257fff640 1 -- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b1d54b0 msgr2=0x55a24b214470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff257fff640 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b1d54b0 0x55a24b214470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff257fff640 1 -- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 msgr2=0x55a24b1d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff257fff640 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1d5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff257fff640 1 -- 172.21.15.139:0/2925709662 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a24b0ca9c0 con 0x55a24b2149b0 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b1d54b0 0x55a24b214470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff257fff640 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b2149b0 0x55a24b1d5890 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff24c02a220 tx=0x7ff24c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefebb8daf9f0437 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff23e7fc640 1 -- 172.21.15.139:0/2925709662 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c037040 con 0x55a24b2149b0 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff23e7fc640 1 -- 172.21.15.139:0/2925709662 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c04c070 con 0x55a24b2149b0 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff23e7fc640 1 -- 172.21.15.139:0/2925709662 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c032bc0 con 0x55a24b2149b0 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff26183f740 1 -- 172.21.15.139:0/2925709662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b2149b0 msgr2=0x55a24b1d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.818+0000 7ff26183f740 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b2149b0 0x55a24b1d5890 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff24c02a220 tx=0x7ff24c02c000 comp rx=0 tx=0).stop 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 -- 172.21.15.139:0/2925709662 shutdown_connections 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1d5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b2149b0 0x55a24b1d5890 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 --2- 172.21.15.139:0/2925709662 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b1d54b0 0x55a24b214470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 -- 172.21.15.139:0/2925709662 >> 172.21.15.139:0/2925709662 conn(0x55a24b19c930 msgr2=0x55a24b219450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 -- 172.21.15.139:0/2925709662 shutdown_connections 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 -- 172.21.15.139:0/2925709662 wait complete. 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 -- start start 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.819+0000 7ff26183f740 1 Processor -- start 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff26183f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b2126c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1fca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b1ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff26183f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a24b1d3af0 con 0x55a24b1d54b0 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a24b0d34f0 con 0x55a24b1d6a10 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a24b1d7040 con 0x55a24b2149b0 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff26183f740 10 client.0 _ll_register_callbacks cb 0x55a24b130c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b2126c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b2126c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34270/0 (socket says 172.21.15.139:34270) 2024-04-26T18:21:13.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1786048128 learned_addr learned my addr 172.21.15.139:0/1786048128 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff257fff640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25d0c1640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b1ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 msgr2=0x55a24b1ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b1ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 msgr2=0x55a24b1fca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1fca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1786048128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a24ae4b920 con 0x55a24b1d54b0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.820+0000 7ff25d0c1640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b1ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b2126c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff24800a430 tx=0x7ff24805d1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0c70d5e558896b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff2377fe640 1 -- 172.21.15.139:0/1786048128 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2480581e0 con 0x55a24b1d54b0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff2377fe640 1 -- 172.21.15.139:0/1786048128 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ff248058380 con 0x55a24b1d54b0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff24c04c070 con 0x55a24b1d54b0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff2377fe640 1 -- 172.21.15.139:0/1786048128 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff248089050 con 0x55a24b1d54b0 2024-04-26T18:21:13.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 10 client.5766 fetch_fsmap learned FSMap version 9 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a24af17d30 con 0x55a24b1d54b0 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff2377fe640 1 -- 172.21.15.139:0/1786048128 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c04c070 con 0x55a24b1d54b0 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff2377fe640 1 -- 172.21.15.139:0/1786048128 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7ff24805f290 con 0x55a24b1d54b0 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 10 client.5766 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 10 client.5766 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 20 client.5766 populate_metadata read hostname 'smithi139' 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b1fff70 0x55a24b229190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 4 client.5766 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a24b10da00 con 0x55a24b1fff70 2024-04-26T18:21:13.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.821+0000 7ff257fff640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b1fff70 0x55a24b229190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.822+0000 7ff2377fe640 10 client.5766 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:21:13.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.822+0000 7ff257fff640 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b1fff70 0x55a24b229190 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62e84bc375ec9eb6 server_cookie=5035e4db43b1d2d3 in_seq=0 out_seq=0 2024-04-26T18:21:13.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.822+0000 7ff2377fe640 1 -- 172.21.15.139:0/1786048128 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a24b10da00 con 0x55a24b1fff70 2024-04-26T18:21:13.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.822+0000 7ff2377fe640 10 client.5766 handle_command_reply: tid=0 2024-04-26T18:21:13.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.822+0000 7ff26183f740 1 client.5766 shutdown 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 msgr2=0x55a24b2126c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b2126c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff24800a430 tx=0x7ff24805d1d0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 shutdown_connections 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b1fff70 0x55a24b229190 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b1ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b1fca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 --2- 172.21.15.139:0/1786048128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b2126c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 >> 172.21.15.139:0/1786048128 conn(0x55a24b19c930 msgr2=0x55a24b1cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff2377fe640 0 client.5766 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 shutdown_connections 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 1 -- 172.21.15.139:0/1786048128 wait complete. 2024-04-26T18:21:13.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.823+0000 7ff26183f740 20 client.5766 trim_cache size 0 max 16384 2024-04-26T18:21:13.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.840+0000 7ff26183f740 1 Processor -- start 2024-04-26T18:21:13.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.840+0000 7ff26183f740 1 -- start start 2024-04-26T18:21:13.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff26183f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b1fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b20ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b20bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff26183f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581fe130 con 0x55a24b1d54b0 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581fd010 con 0x55a24b1d6a10 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff2581fb5a0 con 0x55a24b2149b0 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b1fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b1fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34282/0 (socket says 172.21.15.139:34282) 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1936208630 learned_addr learned my addr 172.21.15.139:0/1936208630 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1936208630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 msgr2=0x55a24b20bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b20bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1936208630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 msgr2=0x55a24b20ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff257fff640 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b20ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b20ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 -- 172.21.15.139:0/1936208630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a24b223560 con 0x55a24b1d54b0 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b1fdc00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff248001990 tx=0x7ff24801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a5597ce097de72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff23dffb640 1 -- 172.21.15.139:0/1936208630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248056e30 con 0x55a24b1d54b0 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff23dffb640 1 -- 172.21.15.139:0/1936208630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff248078260 con 0x55a24b1d54b0 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.841+0000 7ff23dffb640 1 -- 172.21.15.139:0/1936208630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24805f290 con 0x55a24b1d54b0 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 -- 172.21.15.139:0/1936208630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 msgr2=0x55a24b1fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b1fdc00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff248001990 tx=0x7ff24801e000 comp rx=0 tx=0).stop 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 -- 172.21.15.139:0/1936208630 shutdown_connections 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b20bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d6a10 0x55a24b20ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 --2- 172.21.15.139:0/1936208630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d54b0 0x55a24b1fdc00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 -- 172.21.15.139:0/1936208630 >> 172.21.15.139:0/1936208630 conn(0x55a24b19c930 msgr2=0x55a24b1ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 -- 172.21.15.139:0/1936208630 shutdown_connections 2024-04-26T18:21:13.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 -- 172.21.15.139:0/1936208630 wait complete. 2024-04-26T18:21:13.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.842+0000 7ff26183f740 1 -- start start 2024-04-26T18:21:13.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 1 Processor -- start 2024-04-26T18:21:13.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d54b0 0x55a24b20b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d6a10 0x55a24b1fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b2103e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581fbbf0 con 0x55a24b1d6a10 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581fc940 con 0x55a24b1d54b0 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff2581fc270 con 0x55a24b2149b0 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff26183f740 10 client.0 _ll_register_callbacks cb 0x7ff2480586f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff257fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d6a10 0x55a24b1fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff257fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d6a10 0x55a24b1fbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34284/0 (socket says 172.21.15.139:34284) 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.843+0000 7ff257fff640 1 -- 172.21.15.139:0/947336451 learned_addr learned my addr 172.21.15.139:0/947336451 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d54b0 0x55a24b20b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff25d0c1640 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b2103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff257fff640 1 -- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 msgr2=0x55a24b2103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff257fff640 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b2103e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff257fff640 1 -- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d54b0 msgr2=0x55a24b20b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff257fff640 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d54b0 0x55a24b20b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff257fff640 1 -- 172.21.15.139:0/947336451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a24b213430 con 0x55a24b1d6a10 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff257fff640 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d6a10 0x55a24b1fbcc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff24c02a7d0 tx=0x7ff24c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4deb3279e23753 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff2377fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff2377fe640 1 -- 172.21.15.139:0/947336451 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c004430 con 0x55a24b1d6a10 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff2377fe640 1 -- 172.21.15.139:0/947336451 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ff24c057050 con 0x55a24b1d6a10 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff248078260 con 0x55a24b1d6a10 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff2377fe640 1 -- 172.21.15.139:0/947336451 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ff24c063050 con 0x55a24b1d6a10 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 10 client.5772 fetch_fsmap learned FSMap version 9 2024-04-26T18:21:13.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a24b22fd00 con 0x55a24b1d6a10 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff2377fe640 1 -- 172.21.15.139:0/947336451 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff248078260 con 0x55a24b1d6a10 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff2377fe640 1 -- 172.21.15.139:0/947336451 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7ff24c066020 con 0x55a24b1d6a10 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 10 client.5772 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 10 client.5772 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 20 client.5772 populate_metadata read hostname 'smithi139' 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b2898f0 0x55a24b289cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 4 client.5772 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "775da850", "release": true, "await": true}] 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.844+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "775da850", "release": true, "await": true}) -- 0x55a24b147c50 con 0x55a24b2898f0 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b2898f0 0x55a24b289cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff2377fe640 10 client.5772 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff25c8c0640 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b2898f0 0x55a24b289cd0 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc2d2be222ae352 server_cookie=da65d6bebe5740b9 in_seq=0 out_seq=0 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff2377fe640 1 -- 172.21.15.139:0/947336451 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55a24b147c50 con 0x55a24b2898f0 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff2377fe640 10 client.5772 handle_command_reply: tid=0 2024-04-26T18:21:13.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 client.5772 shutdown 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d6a10 msgr2=0x55a24b1fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d6a10 0x55a24b1fbcc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff24c02a7d0 tx=0x7ff24c02c070 comp rx=0 tx=0).stop 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 shutdown_connections 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a24b2898f0 0x55a24b289cd0 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a24b2149b0 0x55a24b2103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a24b1d6a10 0x55a24b1fbcc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff2377fe640 0 client.5772 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 --2- 172.21.15.139:0/947336451 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a24b1d54b0 0x55a24b20b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.845+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 >> 172.21.15.139:0/947336451 conn(0x55a24b19c930 msgr2=0x55a24b1ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 shutdown_connections 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff26183f740 1 -- 172.21.15.139:0/947336451 wait complete. 2024-04-26T18:21:13.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff26183f740 20 client.5772 trim_cache size 0 max 16384 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 76, 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "775da850": { 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 76, 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:21:13.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 82.7, 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:21:13.854 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:21:13.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff24406c8f0 msgr2=0x7ff24406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff24406c8f0 0x7ff24406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff24c034000 tx=0x7ff24c02e000 comp rx=0 tx=0).stop 2024-04-26T18:21:13.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2580c6050 msgr2=0x7ff2581562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2580c6050 0x7ff2581562f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff24800c750 tx=0x7ff24800cc10 comp rx=0 tx=0).stop 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 shutdown_connections 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff24406c8f0 0x7ff24406edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff25815a450 0x7ff2581f03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff258153ab0 0x7ff2581f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 --2- 172.21.15.139:0/4191755087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2580c6050 0x7ff2581562f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 >> 172.21.15.139:0/4191755087 conn(0x7ff258068090 msgr2=0x7ff2581582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 shutdown_connections 2024-04-26T18:21:13.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:21:13.846+0000 7ff25eb24640 1 -- 172.21.15.139:0/4191755087 wait complete. 2024-04-26T18:21:13.857 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '775da850', seconds elapsed: 24.4 2024-04-26T18:21:18.733 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 0% (3/481) Updating files: 1% (5/481) Updating files: 2% (10/481) Updating files: 3% (15/481) Updating files: 4% (20/481) Updating files: 5% (25/481) Updating files: 6% (29/481) Updating files: 7% (34/481) Updating files: 8% (39/481) Updating files: 9% (44/481) Updating files: 10% (49/481) Updating files: 11% (53/481) Updating files: 11% (55/481) Updating files: 12% (58/481) Updating files: 13% (63/481) Updating files: 14% (68/481) Updating files: 15% (73/481) Updating files: 16% (77/481) Updating files: 17% (82/481) Updating files: 18% (87/481) Updating files: 19% (92/481) Updating files: 20% (97/481) Updating files: 21% (102/481) Updating files: 22% (106/481) Updating files: 23% (111/481) Updating files: 24% (116/481) Updating files: 25% (121/481) Updating files: 26% (126/481) Updating files: 27% (130/481) Updating files: 28% (135/481) Updating files: 29% (140/481) Updating files: 30% (145/481) Updating files: 31% (150/481) Updating files: 32% (154/481) Updating files: 33% (159/481) Updating files: 34% (164/481) Updating files: 35% (169/481) Updating files: 36% (174/481) Updating files: 37% (178/481) Updating files: 38% (183/481) Updating files: 39% (188/481) Updating files: 40% (193/481) Updating files: 40% (197/481) Updating files: 41% (198/481) Updating files: 42% (203/481) Updating files: 43% (207/481) Updating files: 44% (212/481) Updating files: 45% (217/481) Updating files: 46% (222/481) Updating files: 47% (227/481) Updating files: 48% (231/481) Updating files: 49% (236/481) Updating files: 50% (241/481) Updating files: 50% (243/481) Updating files: 51% (246/481) Updating files: 52% (251/481) Updating files: 53% (255/481) Updating files: 54% (260/481) Updating files: 55% (265/481) Updating files: 56% (270/481) Updating files: 57% (275/481) Updating files: 58% (279/481) Updating files: 59% (284/481) Updating files: 60% (289/481) Updating files: 61% (294/481) Updating files: 62% (299/481) Updating files: 63% (304/481) Updating files: 64% (308/481) Updating files: 65% (313/481) Updating files: 66% (318/481) Updating files: 67% (323/481) Updating files: 68% (328/481) Updating files: 69% (332/481) Updating files: 70% (337/481) Updating files: 71% (342/481) Updating files: 72% (347/481) Updating files: 73% (352/481) Updating files: 74% (356/481) Updating files: 75% (361/481) Updating files: 76% (366/481) Updating files: 77% (371/481) Updating files: 78% (376/481) Updating files: 79% (380/481) Updating files: 80% (385/481) Updating files: 81% (390/481) Updating files: 82% (395/481) Updating files: 83% (400/481) Updating files: 84% (405/481) Updating files: 85% (409/481) Updating files: 86% (414/481) Updating files: 87% (419/481) Updating files: 88% (424/481) Updating files: 89% (429/481) Updating files: 90% (433/481) Updating files: 91% (438/481) Updating files: 92% (443/481) Updating files: 92% (447/481) Updating files: 93% (448/481) Updating files: 94% (453/481) Updating files: 95% (457/481) Updating files: 96% (462/481) Updating files: 97% (467/481) Updating files: 98% (472/481) Updating files: 99% (477/481) Updating files: 100% (481/481) Updating files: 100% (481/481), done. 2024-04-26T18:21:19.015 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at ca6265d0f4d v0.49 2024-04-26T18:21:19.038 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.49 2024-04-26T18:21:19.050 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:21:19.050 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 50 -eq 48 ']' 2024-04-26T18:21:19.050 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.50 2024-04-26T18:21:19.050 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.50 2024-04-26T18:21:19.050 INFO:tasks.workunit.client.0.smithi139.stdout:v0.50 2024-04-26T18:21:19.051 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.50 2024-04-26T18:21:23.445 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 9% (13/137) Updating files: 10% (14/137) Updating files: 11% (16/137) Updating files: 12% (17/137) Updating files: 13% (18/137) Updating files: 14% (20/137) Updating files: 15% (21/137) Updating files: 16% (22/137) Updating files: 17% (24/137) Updating files: 18% (25/137) Updating files: 19% (27/137) Updating files: 20% (28/137) Updating files: 21% (29/137) Updating files: 22% (31/137) Updating files: 23% (32/137) Updating files: 24% (33/137) Updating files: 25% (35/137) Updating files: 26% (36/137) Updating files: 27% (37/137) Updating files: 28% (39/137) Updating files: 29% (40/137) Updating files: 30% (42/137) Updating files: 31% (43/137) Updating files: 32% (44/137) Updating files: 33% (46/137) Updating files: 34% (47/137) Updating files: 35% (48/137) Updating files: 36% (50/137) Updating files: 37% (51/137) Updating files: 38% (53/137) Updating files: 39% (54/137) Updating files: 40% (55/137) Updating files: 41% (57/137) Updating files: 42% (58/137) Updating files: 43% (59/137) Updating files: 44% (61/137) Updating files: 45% (62/137) Updating files: 46% (64/137) Updating files: 47% (65/137) Updating files: 48% (66/137) Updating files: 49% (68/137) Updating files: 50% (69/137) Updating files: 51% (70/137) Updating files: 52% (72/137) Updating files: 53% (73/137) Updating files: 54% (74/137) Updating files: 55% (76/137) Updating files: 56% (77/137) Updating files: 57% (79/137) Updating files: 58% (80/137) Updating files: 59% (81/137) Updating files: 60% (83/137) Updating files: 61% (84/137) Updating files: 62% (85/137) Updating files: 63% (87/137) Updating files: 64% (88/137) Updating files: 65% (90/137) Updating files: 66% (91/137) Updating files: 67% (92/137) Updating files: 68% (94/137) Updating files: 69% (95/137) Updating files: 70% (96/137) Updating files: 71% (98/137) Updating files: 72% (99/137) Updating files: 73% (101/137) Updating files: 74% (102/137) Updating files: 75% (103/137) Updating files: 76% (105/137) Updating files: 77% (106/137) Updating files: 78% (107/137) Updating files: 79% (109/137) Updating files: 80% (110/137) Updating files: 81% (111/137) Updating files: 82% (113/137) Updating files: 83% (114/137) Updating files: 84% (116/137) Updating files: 85% (117/137) Updating files: 86% (118/137) Updating files: 87% (120/137) Updating files: 88% (121/137) Updating files: 89% (122/137) Updating files: 90% (124/137) Updating files: 91% (125/137) Updating files: 92% (127/137) Updating files: 93% (128/137) Updating files: 94% (129/137) Updating files: 95% (131/137) Updating files: 96% (132/137) Updating files: 97% (133/137) Updating files: 98% (135/137) Updating files: 99% (136/137) Updating files: 100% (137/137) Updating files: 100% (137/137), done. 2024-04-26T18:21:23.499 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at a4428bd0e19 v0.50 2024-04-26T18:21:23.500 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.50 2024-04-26T18:21:23.591 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:21:23.591 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 51 -eq 48 ']' 2024-04-26T18:21:23.591 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.51 2024-04-26T18:21:23.592 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.51 2024-04-26T18:21:23.592 INFO:tasks.workunit.client.0.smithi139.stdout:v0.51 2024-04-26T18:21:23.592 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.51 2024-04-26T18:21:24.653 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at c03ca95d235 v0.51 2024-04-26T18:21:24.654 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.51 2024-04-26T18:21:24.722 INFO:tasks.workunit.client.0.smithi139.stdout:v0.52 2024-04-26T18:21:24.722 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:21:24.722 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 52 -eq 48 ']' 2024-04-26T18:21:24.723 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.52 2024-04-26T18:21:24.723 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.52 2024-04-26T18:21:24.723 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.52 2024-04-26T18:21:26.552 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 28% (53/183) Updating files: 29% (54/183) Updating files: 30% (55/183) Updating files: 31% (57/183) Updating files: 32% (59/183) Updating files: 33% (61/183) Updating files: 34% (63/183) Updating files: 35% (65/183) Updating files: 36% (66/183) Updating files: 37% (68/183) Updating files: 38% (70/183) Updating files: 39% (72/183) Updating files: 40% (74/183) Updating files: 41% (76/183) Updating files: 42% (77/183) Updating files: 43% (79/183) Updating files: 44% (81/183) Updating files: 45% (83/183) Updating files: 46% (85/183) Updating files: 47% (87/183) Updating files: 48% (88/183) Updating files: 49% (90/183) Updating files: 50% (92/183) Updating files: 51% (94/183) Updating files: 52% (96/183) Updating files: 53% (97/183) Updating files: 54% (99/183) Updating files: 55% (101/183) Updating files: 56% (103/183) Updating files: 57% (105/183) Updating files: 58% (107/183) Updating files: 59% (108/183) Updating files: 60% (110/183) Updating files: 61% (112/183) Updating files: 62% (114/183) Updating files: 63% (116/183) Updating files: 64% (118/183) Updating files: 65% (119/183) Updating files: 66% (121/183) Updating files: 67% (123/183) Updating files: 68% (125/183) Updating files: 69% (127/183) Updating files: 70% (129/183) Updating files: 71% (130/183) Updating files: 72% (132/183) Updating files: 73% (134/183) Updating files: 74% (136/183) Updating files: 75% (138/183) Updating files: 76% (140/183) Updating files: 77% (141/183) Updating files: 78% (143/183) Updating files: 79% (145/183) Updating files: 80% (147/183) Updating files: 81% (149/183) Updating files: 82% (151/183) Updating files: 83% (152/183) Updating files: 84% (154/183) Updating files: 85% (156/183) Updating files: 86% (158/183) Updating files: 87% (160/183) Updating files: 88% (162/183) Updating files: 89% (163/183) Updating files: 90% (165/183) Updating files: 91% (167/183) Updating files: 92% (169/183) Updating files: 93% (171/183) Updating files: 94% (173/183) Updating files: 95% (174/183) Updating files: 96% (176/183) Updating files: 97% (178/183) Updating files: 98% (180/183) Updating files: 99% (182/183) Updating files: 100% (183/183) Updating files: 100% (183/183), done. 2024-04-26T18:21:26.854 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at e48859474c4 v0.52 2024-04-26T18:21:26.856 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.52 2024-04-26T18:21:26.874 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:21:26.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 53 -eq 48 ']' 2024-04-26T18:21:26.875 INFO:tasks.workunit.client.0.smithi139.stdout:v0.53 2024-04-26T18:21:26.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.53 2024-04-26T18:21:26.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.53 2024-04-26T18:21:26.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.53 2024-04-26T18:21:30.123 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:21:30.126 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:21:34.356 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 7% (29/386) Updating files: 8% (31/386) Updating files: 9% (35/386) Updating files: 10% (39/386) Updating files: 11% (43/386) Updating files: 12% (47/386) Updating files: 13% (51/386) Updating files: 14% (55/386) Updating files: 15% (58/386) Updating files: 16% (62/386) Updating files: 17% (66/386) Updating files: 18% (70/386) Updating files: 19% (74/386) Updating files: 20% (78/386) Updating files: 21% (82/386) Updating files: 22% (85/386) Updating files: 22% (86/386) Updating files: 23% (89/386) Updating files: 24% (93/386) Updating files: 25% (97/386) Updating files: 26% (101/386) Updating files: 27% (105/386) Updating files: 28% (109/386) Updating files: 29% (112/386) Updating files: 30% (116/386) Updating files: 31% (120/386) Updating files: 32% (124/386) Updating files: 33% (128/386) Updating files: 34% (132/386) Updating files: 35% (136/386) Updating files: 36% (139/386) Updating files: 37% (143/386) Updating files: 38% (147/386) Updating files: 39% (151/386) Updating files: 40% (155/386) Updating files: 41% (159/386) Updating files: 42% (163/386) Updating files: 43% (166/386) Updating files: 44% (170/386) Updating files: 45% (174/386) Updating files: 46% (178/386) Updating files: 47% (182/386) Updating files: 48% (186/386) Updating files: 49% (190/386) Updating files: 50% (193/386) Updating files: 51% (197/386) Updating files: 52% (201/386) Updating files: 53% (205/386) Updating files: 54% (209/386) Updating files: 55% (213/386) Updating files: 56% (217/386) Updating files: 57% (221/386) Updating files: 58% (224/386) Updating files: 59% (228/386) Updating files: 60% (232/386) Updating files: 61% (236/386) Updating files: 62% (240/386) Updating files: 62% (243/386) Updating files: 63% (244/386) Updating files: 64% (248/386) Updating files: 65% (251/386) Updating files: 66% (255/386) Updating files: 67% (259/386) Updating files: 68% (263/386) Updating files: 69% (267/386) Updating files: 70% (271/386) Updating files: 71% (275/386) Updating files: 72% (278/386) Updating files: 73% (282/386) Updating files: 74% (286/386) Updating files: 74% (287/386) Updating files: 75% (290/386) Updating files: 76% (294/386) Updating files: 77% (298/386) Updating files: 78% (302/386) Updating files: 79% (305/386) Updating files: 80% (309/386) Updating files: 81% (313/386) Updating files: 82% (317/386) Updating files: 83% (321/386) Updating files: 84% (325/386) Updating files: 85% (329/386) Updating files: 86% (332/386) Updating files: 87% (336/386) Updating files: 88% (340/386) Updating files: 89% (344/386) Updating files: 90% (348/386) Updating files: 91% (352/386) Updating files: 92% (356/386) Updating files: 93% (359/386) Updating files: 94% (363/386) Updating files: 95% (367/386) Updating files: 96% (371/386) Updating files: 97% (375/386) Updating files: 98% (379/386) Updating files: 99% (383/386) Updating files: 100% (386/386) Updating files: 100% (386/386), done. 2024-04-26T18:21:34.640 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 2528b5ee105 v0.43 2024-04-26T18:21:34.642 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.53 2024-04-26T18:21:35.363 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:21:35.363 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 54 -eq 48 ']' 2024-04-26T18:21:35.363 INFO:tasks.workunit.client.0.smithi139.stdout:v0.54 2024-04-26T18:21:35.364 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.54 2024-04-26T18:21:35.364 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.54 2024-04-26T18:21:35.364 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.54 2024-04-26T18:21:42.851 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 2% (5/212) Updating files: 3% (7/212) Updating files: 4% (9/212) Updating files: 5% (11/212) Updating files: 6% (13/212) Updating files: 7% (15/212) Updating files: 8% (17/212) Updating files: 9% (20/212) Updating files: 10% (22/212) Updating files: 11% (24/212) Updating files: 12% (26/212) Updating files: 13% (28/212) Updating files: 14% (30/212) Updating files: 15% (32/212) Updating files: 16% (34/212) Updating files: 17% (37/212) Updating files: 18% (39/212) Updating files: 19% (41/212) Updating files: 20% (43/212) Updating files: 21% (45/212) Updating files: 22% (47/212) Updating files: 23% (49/212) Updating files: 24% (51/212) Updating files: 25% (53/212) Updating files: 26% (56/212) Updating files: 27% (58/212) Updating files: 28% (60/212) Updating files: 29% (62/212) Updating files: 30% (64/212) Updating files: 31% (66/212) Updating files: 32% (68/212) Updating files: 33% (70/212) Updating files: 34% (73/212) Updating files: 35% (75/212) Updating files: 36% (77/212) Updating files: 37% (79/212) Updating files: 38% (81/212) Updating files: 39% (83/212) Updating files: 40% (85/212) Updating files: 41% (87/212) Updating files: 42% (90/212) Updating files: 43% (92/212) Updating files: 44% (94/212) Updating files: 45% (96/212) Updating files: 46% (98/212) Updating files: 47% (100/212) Updating files: 48% (102/212) Updating files: 49% (104/212) Updating files: 50% (106/212) Updating files: 51% (109/212) Updating files: 52% (111/212) Updating files: 53% (113/212) Updating files: 54% (115/212) Updating files: 55% (117/212) Updating files: 56% (119/212) Updating files: 57% (121/212) Updating files: 58% (123/212) Updating files: 59% (126/212) Updating files: 60% (128/212) Updating files: 61% (130/212) Updating files: 62% (132/212) Updating files: 63% (134/212) Updating files: 64% (136/212) Updating files: 65% (138/212) Updating files: 66% (140/212) Updating files: 67% (143/212) Updating files: 68% (145/212) Updating files: 69% (147/212) Updating files: 70% (149/212) Updating files: 71% (151/212) Updating files: 72% (153/212) Updating files: 73% (155/212) Updating files: 74% (157/212) Updating files: 75% (159/212) Updating files: 76% (162/212) Updating files: 77% (164/212) Updating files: 78% (166/212) Updating files: 79% (168/212) Updating files: 80% (170/212) Updating files: 81% (172/212) Updating files: 82% (174/212) Updating files: 83% (176/212) Updating files: 84% (179/212) Updating files: 85% (181/212) Updating files: 86% (183/212) Updating files: 87% (185/212) Updating files: 88% (187/212) Updating files: 89% (189/212) Updating files: 90% (191/212) Updating files: 91% (193/212) Updating files: 92% (196/212) Updating files: 93% (198/212) Updating files: 94% (200/212) Updating files: 95% (202/212) Updating files: 96% (204/212) Updating files: 97% (206/212) Updating files: 98% (208/212) Updating files: 99% (210/212) Updating files: 100% (212/212) Updating files: 100% (212/212), done. 2024-04-26T18:21:42.885 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 60b84b095b1 v0.54 2024-04-26T18:21:42.887 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.54 2024-04-26T18:21:43.630 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:21:43.631 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 55 -eq 48 ']' 2024-04-26T18:21:43.631 INFO:tasks.workunit.client.0.smithi139.stdout:v0.55 2024-04-26T18:21:43.631 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.55 2024-04-26T18:21:43.632 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.55 2024-04-26T18:21:43.632 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.55 2024-04-26T18:21:49.154 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 41% (225/540) Updating files: 42% (227/540) Updating files: 43% (233/540) Updating files: 44% (238/540) Updating files: 45% (243/540) Updating files: 46% (249/540) Updating files: 47% (254/540) Updating files: 48% (260/540) Updating files: 49% (265/540) Updating files: 50% (270/540) Updating files: 51% (276/540) Updating files: 52% (281/540) Updating files: 53% (287/540) Updating files: 54% (292/540) Updating files: 54% (296/540) Updating files: 55% (297/540) Updating files: 56% (303/540) Updating files: 57% (308/540) Updating files: 58% (314/540) Updating files: 59% (319/540) Updating files: 60% (324/540) Updating files: 61% (330/540) Updating files: 62% (335/540) Updating files: 63% (341/540) Updating files: 64% (346/540) Updating files: 65% (351/540) Updating files: 66% (357/540) Updating files: 67% (362/540) Updating files: 68% (368/540) Updating files: 69% (373/540) Updating files: 70% (378/540) Updating files: 71% (384/540) Updating files: 72% (389/540) Updating files: 73% (395/540) Updating files: 73% (399/540) Updating files: 74% (400/540) Updating files: 75% (405/540) Updating files: 76% (411/540) Updating files: 77% (416/540) Updating files: 78% (422/540) Updating files: 79% (427/540) Updating files: 80% (432/540) Updating files: 81% (438/540) Updating files: 82% (443/540) Updating files: 83% (449/540) Updating files: 84% (454/540) Updating files: 85% (459/540) Updating files: 86% (465/540) Updating files: 87% (470/540) Updating files: 88% (476/540) Updating files: 89% (481/540) Updating files: 90% (486/540) Updating files: 91% (492/540) Updating files: 92% (497/540) Updating files: 93% (503/540) Updating files: 94% (508/540) Updating files: 95% (513/540) Updating files: 96% (519/540) Updating files: 97% (524/540) Updating files: 98% (530/540) Updating files: 99% (535/540) Updating files: 100% (540/540) Updating files: 100% (540/540), done. 2024-04-26T18:21:49.191 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 690f8175606 v0.55 2024-04-26T18:21:49.194 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.55 2024-04-26T18:21:49.234 INFO:tasks.workunit.client.0.smithi139.stdout:v0.56 2024-04-26T18:21:49.235 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:21:49.235 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 56 -eq 48 ']' 2024-04-26T18:21:49.235 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.56 2024-04-26T18:21:49.235 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.56 2024-04-26T18:21:49.235 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.56 2024-04-26T18:22:00.236 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:22:00.239 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:22:01.851 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 7% (19/246) Updating files: 8% (20/246) Updating files: 9% (23/246) Updating files: 10% (25/246) Updating files: 11% (28/246) Updating files: 12% (30/246) Updating files: 13% (32/246) Updating files: 14% (35/246) Updating files: 15% (37/246) Updating files: 16% (40/246) Updating files: 17% (42/246) Updating files: 18% (45/246) Updating files: 19% (47/246) Updating files: 20% (50/246) Updating files: 21% (52/246) Updating files: 22% (55/246) Updating files: 23% (57/246) Updating files: 24% (60/246) Updating files: 25% (62/246) Updating files: 26% (64/246) Updating files: 27% (67/246) Updating files: 28% (69/246) Updating files: 29% (72/246) Updating files: 29% (73/246) Updating files: 30% (74/246) Updating files: 31% (77/246) Updating files: 32% (79/246) Updating files: 33% (82/246) Updating files: 34% (84/246) Updating files: 35% (87/246) Updating files: 36% (89/246) Updating files: 37% (92/246) Updating files: 38% (94/246) Updating files: 39% (96/246) Updating files: 40% (99/246) Updating files: 41% (101/246) Updating files: 42% (104/246) Updating files: 43% (106/246) Updating files: 44% (109/246) Updating files: 45% (111/246) Updating files: 46% (114/246) Updating files: 47% (116/246) Updating files: 48% (119/246) Updating files: 49% (121/246) Updating files: 50% (123/246) Updating files: 51% (126/246) Updating files: 52% (128/246) Updating files: 53% (131/246) Updating files: 54% (133/246) Updating files: 55% (136/246) Updating files: 56% (138/246) Updating files: 57% (141/246) Updating files: 58% (143/246) Updating files: 59% (146/246) Updating files: 60% (148/246) Updating files: 61% (151/246) Updating files: 62% (153/246) Updating files: 63% (155/246) Updating files: 64% (158/246) Updating files: 65% (160/246) Updating files: 66% (163/246) Updating files: 67% (165/246) Updating files: 68% (168/246) Updating files: 69% (170/246) Updating files: 70% (173/246) Updating files: 71% (175/246) Updating files: 72% (178/246) Updating files: 73% (180/246) Updating files: 74% (183/246) Updating files: 75% (185/246) Updating files: 76% (187/246) Updating files: 76% (189/246) Updating files: 77% (190/246) Updating files: 78% (192/246) Updating files: 79% (195/246) Updating files: 80% (197/246) Updating files: 81% (200/246) Updating files: 82% (202/246) Updating files: 83% (205/246) Updating files: 84% (207/246) Updating files: 85% (210/246) Updating files: 86% (212/246) Updating files: 87% (215/246) Updating files: 88% (217/246) Updating files: 89% (219/246) Updating files: 90% (222/246) Updating files: 91% (224/246) Updating files: 91% (225/246) Updating files: 92% (227/246) Updating files: 93% (229/246) Updating files: 94% (232/246) Updating files: 95% (234/246) Updating files: 96% (237/246) Updating files: 97% (239/246) Updating files: 98% (242/246) Updating files: 99% (244/246) Updating files: 100% (246/246) Updating files: 100% (246/246), done. 2024-04-26T18:22:01.929 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 1a32f0a0b42 v0.56 2024-04-26T18:22:01.932 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.56 2024-04-26T18:22:01.949 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:22:01.949 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 57 -eq 48 ']' 2024-04-26T18:22:01.949 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.57 2024-04-26T18:22:01.949 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.57 2024-04-26T18:22:01.949 INFO:tasks.workunit.client.0.smithi139.stdout:v0.57 2024-04-26T18:22:01.950 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.57 2024-04-26T18:22:22.528 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 10% (31/304) Updating files: 11% (34/304) Updating files: 12% (37/304) Updating files: 13% (40/304) Updating files: 14% (43/304) Updating files: 15% (46/304) Updating files: 16% (49/304) Updating files: 17% (52/304) Updating files: 18% (55/304) Updating files: 19% (58/304) Updating files: 20% (61/304) Updating files: 21% (64/304) Updating files: 22% (67/304) Updating files: 23% (70/304) Updating files: 24% (73/304) Updating files: 25% (76/304) Updating files: 26% (80/304) Updating files: 27% (83/304) Updating files: 28% (86/304) Updating files: 29% (89/304) Updating files: 30% (92/304) Updating files: 31% (95/304) Updating files: 32% (98/304) Updating files: 33% (101/304) Updating files: 34% (104/304) Updating files: 35% (107/304) Updating files: 36% (110/304) Updating files: 37% (113/304) Updating files: 38% (116/304) Updating files: 39% (119/304) Updating files: 40% (122/304) Updating files: 41% (125/304) Updating files: 42% (128/304) Updating files: 43% (131/304) Updating files: 44% (134/304) Updating files: 45% (137/304) Updating files: 46% (140/304) Updating files: 47% (143/304) Updating files: 48% (146/304) Updating files: 49% (149/304) Updating files: 50% (152/304) Updating files: 51% (156/304) Updating files: 52% (159/304) Updating files: 53% (162/304) Updating files: 54% (165/304) Updating files: 55% (168/304) Updating files: 56% (171/304) Updating files: 57% (174/304) Updating files: 58% (177/304) Updating files: 59% (180/304) Updating files: 60% (183/304) Updating files: 60% (185/304) Updating files: 61% (186/304) Updating files: 62% (189/304) Updating files: 63% (192/304) Updating files: 64% (195/304) Updating files: 65% (198/304) Updating files: 66% (201/304) Updating files: 67% (204/304) Updating files: 68% (207/304) Updating files: 69% (210/304) Updating files: 70% (213/304) Updating files: 71% (216/304) Updating files: 72% (219/304) Updating files: 73% (222/304) Updating files: 74% (225/304) Updating files: 75% (228/304) Updating files: 76% (232/304) Updating files: 76% (233/304) Updating files: 77% (235/304) Updating files: 78% (238/304) Updating files: 79% (241/304) Updating files: 80% (244/304) Updating files: 81% (247/304) Updating files: 81% (249/304) Updating files: 82% (250/304) Updating files: 83% (253/304) Updating files: 84% (256/304) Updating files: 85% (259/304) Updating files: 86% (262/304) Updating files: 87% (265/304) Updating files: 88% (268/304) Updating files: 89% (271/304) Updating files: 90% (274/304) Updating files: 91% (277/304) Updating files: 92% (280/304) Updating files: 93% (283/304) Updating files: 94% (286/304) Updating files: 95% (289/304) Updating files: 96% (292/304) Updating files: 97% (295/304) Updating files: 98% (298/304) Updating files: 99% (301/304) Updating files: 100% (304/304) Updating files: 100% (304/304), done. 2024-04-26T18:22:23.524 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 9a7a9d06c06 v0.57 2024-04-26T18:22:23.526 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.57 2024-04-26T18:22:23.606 INFO:tasks.workunit.client.0.smithi139.stdout:v0.58 2024-04-26T18:22:23.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:22:23.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 58 -eq 48 ']' 2024-04-26T18:22:23.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.58 2024-04-26T18:22:23.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.58 2024-04-26T18:22:23.607 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.58 2024-04-26T18:22:30.348 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:22:30.351 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:22:37.257 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 38% (102/268) Updating files: 39% (105/268) Updating files: 40% (108/268) Updating files: 41% (110/268) Updating files: 42% (113/268) Updating files: 43% (116/268) Updating files: 44% (118/268) Updating files: 45% (121/268) Updating files: 46% (124/268) Updating files: 47% (126/268) Updating files: 48% (129/268) Updating files: 49% (132/268) Updating files: 50% (134/268) Updating files: 51% (137/268) Updating files: 51% (138/268) Updating files: 52% (140/268) Updating files: 53% (143/268) Updating files: 54% (145/268) Updating files: 55% (148/268) Updating files: 56% (151/268) Updating files: 57% (153/268) Updating files: 58% (156/268) Updating files: 59% (159/268) Updating files: 60% (161/268) Updating files: 61% (164/268) Updating files: 62% (167/268) Updating files: 63% (169/268) Updating files: 64% (172/268) Updating files: 65% (175/268) Updating files: 66% (177/268) Updating files: 67% (180/268) Updating files: 68% (183/268) Updating files: 69% (185/268) Updating files: 70% (188/268) Updating files: 71% (191/268) Updating files: 72% (193/268) Updating files: 73% (196/268) Updating files: 74% (199/268) Updating files: 74% (200/268) Updating files: 75% (201/268) Updating files: 76% (204/268) Updating files: 77% (207/268) Updating files: 78% (210/268) Updating files: 79% (212/268) Updating files: 79% (214/268) Updating files: 80% (215/268) Updating files: 81% (218/268) Updating files: 82% (220/268) Updating files: 83% (223/268) Updating files: 84% (226/268) Updating files: 84% (227/268) Updating files: 85% (228/268) Updating files: 86% (231/268) Updating files: 87% (234/268) Updating files: 88% (236/268) Updating files: 89% (239/268) Updating files: 90% (242/268) Updating files: 91% (244/268) Updating files: 92% (247/268) Updating files: 93% (250/268) Updating files: 94% (252/268) Updating files: 95% (255/268) Updating files: 96% (258/268) Updating files: 97% (260/268) Updating files: 98% (263/268) Updating files: 99% (266/268) Updating files: 100% (268/268) Updating files: 100% (268/268), done. 2024-04-26T18:22:37.351 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at ba3f91e7504 v0.58 2024-04-26T18:22:37.354 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.58 2024-04-26T18:22:37.367 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:22:37.367 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 59 -eq 48 ']' 2024-04-26T18:22:37.367 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.59 2024-04-26T18:22:37.367 INFO:tasks.workunit.client.0.smithi139.stdout:v0.59 2024-04-26T18:22:37.367 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.59 2024-04-26T18:22:37.368 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.59 2024-04-26T18:22:37.987 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.1 2024-04-26T18:22:37.987 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:22:38.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.086+0000 7fa5113c9640 1 Processor -- start 2024-04-26T18:22:38.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.086+0000 7fa5113c9640 1 -- start start 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa5113c9640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa50c0ca140 0x7fa50c155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa5113c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa5113c9640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa50c15bc90 con 0x7fa50c070150 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa5113c9640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa50c15bf70 con 0x7fa50c0ca140 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa5113c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa50c15c250 con 0x7fa50c0ca520 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa50b7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa50c070150 0x7fa50c0cbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:57512/0 (socket says 172.21.15.139:57512) 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa50b7fe640 1 -- 172.21.15.139:0/2427641090 learned_addr learned my addr 172.21.15.139:0/2427641090 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa50affd640 1 --2- 172.21.15.139:0/2427641090 >> v2:172.21.15.143:3300/0 conn(0x7fa50c0ca140 0x7fa50c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa50a7fc640 1 --2- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa509ffb640 1 -- 172.21.15.139:0/2427641090 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766404327 0 0) 0x7fa50c15bc90 con 0x7fa50c070150 2024-04-26T18:22:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.087+0000 7fa509ffb640 1 -- 172.21.15.139:0/2427641090 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4f4003520 con 0x7fa50c070150 2024-04-26T18:22:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa50affd640 1 -- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 msgr2=0x7fa50c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa50affd640 1 --2- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa50affd640 1 -- 172.21.15.139:0/2427641090 >> v1:172.21.15.139:6789/0 conn(0x7fa50c070150 legacy=0x7fa50c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa50affd640 1 -- 172.21.15.139:0/2427641090 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c15c530 con 0x7fa50c0ca140 2024-04-26T18:22:38.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa50affd640 1 --2- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c0ca140 0x7fa50c155920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009d90 tx=0x7fa4fc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49a2a37282a828ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa509ffb640 1 -- 172.21.15.139:0/2427641090 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007740 con 0x7fa50c0ca140 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa509ffb640 1 -- 172.21.15.139:0/2427641090 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0078e0 con 0x7fa50c0ca140 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.088+0000 7fa509ffb640 1 -- 172.21.15.139:0/2427641090 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc007c90 con 0x7fa50c0ca140 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 -- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c0ca140 msgr2=0x7fa50c155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 --2- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c0ca140 0x7fa50c155920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009d90 tx=0x7fa4fc02a660 comp rx=0 tx=0).stop 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 -- 172.21.15.139:0/2427641090 shutdown_connections 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 --2- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 --2- 172.21.15.139:0/2427641090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c0ca140 0x7fa50c155920 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 -- 172.21.15.139:0/2427641090 >> 172.21.15.139:0/2427641090 conn(0x7fa50c071ec0 msgr2=0x7fa50c0722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 -- 172.21.15.139:0/2427641090 shutdown_connections 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.089+0000 7fa5113c9640 1 -- 172.21.15.139:0/2427641090 wait complete. 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.090+0000 7fa5113c9640 1 Processor -- start 2024-04-26T18:22:38.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.090+0000 7fa5113c9640 1 -- start start 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa5113c9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c070150 0x7fa50c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa5113c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa50c0ca140 0x7fa50c14de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa5113c9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa5113c9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c0cc670 con 0x7fa50c0ca140 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa5113c9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c0716a0 con 0x7fa50c070150 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa5113c9640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa50c0cc7f0 con 0x7fa50c0ca520 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa50c0ca140 0x7fa50c14de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa50c0ca140 0x7fa50c14de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32846/0 (socket says 172.21.15.139:32846) 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 -- 172.21.15.139:0/3161398759 learned_addr learned my addr 172.21.15.139:0/3161398759 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:22:38.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50b7fe640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50affd640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c070150 0x7fa50c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 -- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 msgr2=0x7fa50c14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c14e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 -- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c070150 msgr2=0x7fa50c14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c070150 0x7fa50c14baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 -- 172.21.15.139:0/3161398759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c15ada0 con 0x7fa50c0ca140 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.091+0000 7fa50a7fc640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa50c0ca140 0x7fa50c14de50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e8a0 tx=0x7fa50000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.092+0000 7fa4f37fe640 1 -- 172.21.15.139:0/3161398759 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500017070 con 0x7fa50c0ca140 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.092+0000 7fa4f37fe640 1 -- 172.21.15.139:0/3161398759 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50000c940 con 0x7fa50c0ca140 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.092+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50c14c030 con 0x7fa50c0ca140 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.092+0000 7fa4f37fe640 1 -- 172.21.15.139:0/3161398759 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50000cd30 con 0x7fa50c0ca140 2024-04-26T18:22:38.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.092+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50c15a500 con 0x7fa50c0ca140 2024-04-26T18:22:38.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.093+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50c076d20 con 0x7fa50c0ca140 2024-04-26T18:22:38.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.093+0000 7fa4f37fe640 1 -- 172.21.15.139:0/3161398759 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa50001a070 con 0x7fa50c0ca140 2024-04-26T18:22:38.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.094+0000 7fa4f37fe640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4f806c8f0 0x7fa4f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.094+0000 7fa50affd640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4f806c8f0 0x7fa4f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.094+0000 7fa4f37fe640 1 -- 172.21.15.139:0/3161398759 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa50008c140 con 0x7fa50c0ca140 2024-04-26T18:22:38.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.094+0000 7fa50affd640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4f806c8f0 0x7fa4f806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc034000 tx=0x7fa4fc02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.098+0000 7fa4f37fe640 1 -- 172.21.15.139:0/3161398759 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa500059a50 con 0x7fa50c0ca140 2024-04-26T18:22:38.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.357+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa50c071480 con 0x7fa50c0ca140 2024-04-26T18:22:38.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.357+0000 7fa4f37fe640 1 -- 172.21.15.139:0/3161398759 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fa50005dd50 con 0x7fa50c0ca140 2024-04-26T18:22:38.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:22:38.357 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:22:38.357 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4f806c8f0 msgr2=0x7fa4f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4f806c8f0 0x7fa4f806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc034000 tx=0x7fa4fc02f000 comp rx=0 tx=0).stop 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa50c0ca140 msgr2=0x7fa50c14de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa50c0ca140 0x7fa50c14de50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa50000e8a0 tx=0x7fa50000ed60 comp rx=0 tx=0).stop 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 shutdown_connections 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4f806c8f0 0x7fa4f806edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa50c0ca520 0x7fa50c14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa50c0ca140 0x7fa50c14de50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 --2- 172.21.15.139:0/3161398759 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa50c070150 0x7fa50c14baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.359+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 >> 172.21.15.139:0/3161398759 conn(0x7fa50c071ec0 msgr2=0x7fa50c0722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:38.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.360+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 shutdown_connections 2024-04-26T18:22:38.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.360+0000 7fa5113c9640 1 -- 172.21.15.139:0/3161398759 wait complete. 2024-04-26T18:22:38.370 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 80.1 --await-for 42.0' 2024-04-26T18:22:38.370 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 80.1 --await-for 42.0 2024-04-26T18:22:38.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.477+0000 7f4c924ea640 1 Processor -- start 2024-04-26T18:22:38.477 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.477+0000 7f4c924ea640 1 -- start start 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c924ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c924ea640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4c8c06d0b0 0x7f4c8c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c924ea640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4c8c072f40 0x7f4c8c06c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c924ea640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f4c8c0c8c90 con 0x7f4c8c06d0b0 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c924ea640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4c8c0c8f30 con 0x7f4c8c072f40 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c924ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c0c9210 con 0x7f4c8c153e40 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c8b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4c8c06d0b0 0x7f4c8c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c8b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4c8c06d0b0 0x7f4c8c159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32858/0 (socket says 172.21.15.139:32858) 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.478+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/1115475598 learned_addr learned my addr 172.21.15.139:0/1115475598 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c90a87640 1 --2- 172.21.15.139:0/1115475598 >> v2:172.21.15.143:3300/0 conn(0x7f4c8c072f40 0x7f4c8c06c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/1115475598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/1115475598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 msgr2=0x7f4c8c15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/1115475598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c15dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/1115475598 >> v2:172.21.15.143:3300/0 conn(0x7f4c8c072f40 msgr2=0x7f4c8c06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/1115475598 >> v2:172.21.15.143:3300/0 conn(0x7f4c8c072f40 0x7f4c8c06c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/1115475598 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8c0c94f0 con 0x7f4c8c06d0b0 2024-04-26T18:22:38.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/1115475598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c159bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0706d0 tx=0x7f4c8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f91529bbd80610 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.479+0000 7f4c8affd640 1 -- 172.21.15.139:0/1115475598 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80037070 con 0x7f4c8c06d0b0 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c8affd640 1 -- 172.21.15.139:0/1115475598 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c80032440 con 0x7f4c8c06d0b0 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c8affd640 1 -- 172.21.15.139:0/1115475598 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80032810 con 0x7f4c8c06d0b0 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 -- 172.21.15.139:0/1115475598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c06d0b0 msgr2=0x7f4c8c159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 --2- 172.21.15.139:0/1115475598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c159bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0706d0 tx=0x7f4c8002a1e0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 -- 172.21.15.139:0/1115475598 shutdown_connections 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 --2- 172.21.15.139:0/1115475598 >> v2:172.21.15.143:3300/0 conn(0x7f4c8c072f40 0x7f4c8c06c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 --2- 172.21.15.139:0/1115475598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c159bf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 --2- 172.21.15.139:0/1115475598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 -- 172.21.15.139:0/1115475598 >> 172.21.15.139:0/1115475598 conn(0x7f4c8c070a50 msgr2=0x7f4c8c070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 -- 172.21.15.139:0/1115475598 shutdown_connections 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.480+0000 7f4c924ea640 1 -- 172.21.15.139:0/1115475598 wait complete. 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.481+0000 7f4c924ea640 1 Processor -- start 2024-04-26T18:22:38.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.481+0000 7f4c924ea640 1 -- start start 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c924ea640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c1e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c924ea640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c072f40 0x7f4c8c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c924ea640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c924ea640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c15d720 con 0x7f4c8c072f40 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c924ea640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c15d440 con 0x7f4c8c06d0b0 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c924ea640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c0b3b50 con 0x7f4c8c153e40 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c072f40 0x7f4c8c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c1e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c072f40 0x7f4c8c1569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32866/0 (socket says 172.21.15.139:32866) 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c90a87640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.482+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/3971686721 learned_addr learned my addr 172.21.15.139:0/3971686721 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 msgr2=0x7f4c8c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c8c06d0b0 msgr2=0x7f4c8c1e3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c1e3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/3971686721 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8c1f0290 con 0x7f4c8c072f40 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c1e3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c90a87640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c072f40 0x7f4c8c1569a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4c8002a220 tx=0x7f4c800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c88ff9640 1 -- 172.21.15.139:0/3971686721 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80041020 con 0x7f4c8c072f40 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c88ff9640 1 -- 172.21.15.139:0/3971686721 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c800306c0 con 0x7f4c8c072f40 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c8c0cde40 con 0x7f4c8c072f40 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c88ff9640 1 -- 172.21.15.139:0/3971686721 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80037040 con 0x7f4c8c072f40 2024-04-26T18:22:38.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.483+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c8c073840 con 0x7f4c8c072f40 2024-04-26T18:22:38.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.484+0000 7f4c88ff9640 1 -- 172.21.15.139:0/3971686721 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c80044020 con 0x7f4c8c072f40 2024-04-26T18:22:38.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.485+0000 7f4c88ff9640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c7806c8f0 0x7f4c7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.485+0000 7f4c88ff9640 1 -- 172.21.15.139:0/3971686721 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4c800ac820 con 0x7f4c8c072f40 2024-04-26T18:22:38.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.485+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c7806c8f0 0x7f4c7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.485+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c7806c8f0 0x7f4c7806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c006fd0 tx=0x7f4c7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 Processor -- start 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 -- start start 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a6235a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a623ae0 0x56553a5e49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e5b40 0x56553a5e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56553a547d80 con 0x56553a5e45e0 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x56553a4e3c20 con 0x56553a5e5b40 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x56553a543d40 con 0x56553a623ae0 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a6235a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a6235a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32870/0 (socket says 172.21.15.139:32870) 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3076562530 learned_addr learned my addr 172.21.15.139:0/3076562530 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c90a87640 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e5b40 0x56553a5e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.486+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a623ae0 0x56553a5e49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a623ae0 msgr2=0x56553a5e49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a623ae0 0x56553a5e49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e5b40 msgr2=0x56553a5e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e5b40 0x56553a5e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3076562530 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553a325d80 con 0x56553a5e45e0 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c90a87640 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e5b40 0x56553a5e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a6235a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c007bd0 tx=0x7f4c7c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffd05c5f91acf5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c71ffb640 1 -- 172.21.15.139:0/3076562530 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c01c050 con 0x56553a5e45e0 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c71ffb640 1 -- 172.21.15.139:0/3076562530 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c01d040 con 0x56553a5e45e0 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c71ffb640 1 -- 172.21.15.139:0/3076562530 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c005990 con 0x56553a5e45e0 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c95200740 1 -- 172.21.15.139:0/3076562530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 msgr2=0x56553a6235a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.487+0000 7f4c95200740 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a6235a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c007bd0 tx=0x7f4c7c013000 comp rx=0 tx=0).stop 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 -- 172.21.15.139:0/3076562530 shutdown_connections 2024-04-26T18:22:38.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e5b40 0x56553a5e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a623ae0 0x56553a5e49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 --2- 172.21.15.139:0/3076562530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a6235a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 -- 172.21.15.139:0/3076562530 >> 172.21.15.139:0/3076562530 conn(0x56553a5ab740 msgr2=0x56553a628580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 -- 172.21.15.139:0/3076562530 shutdown_connections 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 -- 172.21.15.139:0/3076562530 wait complete. 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 -- start start 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.488+0000 7f4c95200740 1 Processor -- start 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c95200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a60f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a61d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a61ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c95200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56553a5e2c20 con 0x56553a5e45e0 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x56553a4e1840 con 0x56553a623ae0 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x56553a5e6170 con 0x56553a5e5b40 2024-04-26T18:22:38.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c95200740 10 client.0 _ll_register_callbacks cb 0x56553a4e55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a60f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a60f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32880/0 (socket says 172.21.15.139:32880) 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3375320516 learned_addr learned my addr 172.21.15.139:0/3375320516 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c90a87640 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a61ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a61d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 msgr2=0x56553a61d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a61d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 msgr2=0x56553a61ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a61ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.489+0000 7f4c8bfff640 1 -- 172.21.15.139:0/3375320516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553a386510 con 0x56553a5e45e0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a60f4e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c023040 tx=0x7f4c7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19602b170bd99554 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c6affd640 1 -- 172.21.15.139:0/3375320516 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c02f030 con 0x56553a5e45e0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c6affd640 1 -- 172.21.15.139:0/3375320516 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4c7c00f040 con 0x56553a5e45e0 2024-04-26T18:22:38.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c7c01d040 con 0x56553a5e45e0 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c6affd640 1 -- 172.21.15.139:0/3375320516 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4c7c01c020 con 0x56553a5e45e0 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 10 client.5790 fetch_fsmap learned FSMap version 9 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56553a219670 con 0x56553a5e45e0 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c6affd640 1 -- 172.21.15.139:0/3375320516 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c01d040 con 0x56553a5e45e0 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c6affd640 1 -- 172.21.15.139:0/3375320516 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4c7c014850 con 0x56553a5e45e0 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 10 client.5790 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 10 client.5790 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 20 client.5790 populate_metadata read hostname 'smithi139' 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a61ef80 0x56553a60c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 4 client.5790 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56553a555990 con 0x56553a61ef80 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.490+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a61ef80 0x56553a60c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c6affd640 10 client.5790 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:22:38.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a61ef80 0x56553a60c020 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c18d3290b3b3e64b server_cookie=77c081b92008ed8e in_seq=0 out_seq=0 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c6affd640 1 -- 172.21.15.139:0/3375320516 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56553a555990 con 0x56553a61ef80 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c6affd640 10 client.5790 handle_command_reply: tid=0 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 client.5790 shutdown 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 msgr2=0x56553a60f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a60f4e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c023040 tx=0x7f4c7c004730 comp rx=0 tx=0).stop 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 shutdown_connections 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a61ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a61ef80 0x56553a60c020 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a61d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 --2- 172.21.15.139:0/3375320516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e45e0 0x56553a60f4e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c6affd640 0 client.5790 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.491+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 >> 172.21.15.139:0/3375320516 conn(0x56553a5ab740 msgr2=0x56553a5ddba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.492+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 shutdown_connections 2024-04-26T18:22:38.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.492+0000 7f4c95200740 1 -- 172.21.15.139:0/3375320516 wait complete. 2024-04-26T18:22:38.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.492+0000 7f4c95200740 20 client.5790 trim_cache size 0 max 16384 2024-04-26T18:22:38.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 Processor -- start 2024-04-26T18:22:38.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 -- start start 2024-04-26T18:22:38.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e45e0 0x56553a5dfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e5b40 0x56553a60c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a60c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1fe5b0 con 0x56553a5e5b40 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1fd490 con 0x56553a623ae0 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c1fba00 con 0x56553a5e45e0 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e5b40 0x56553a60c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.509+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e5b40 0x56553a60c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:32888/0 (socket says 172.21.15.139:32888) 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/2643973700 learned_addr learned my addr 172.21.15.139:0/2643973700 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e45e0 0x56553a5dfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c90a87640 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a60c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e45e0 msgr2=0x56553a5dfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e45e0 0x56553a5dfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 msgr2=0x56553a60c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a60c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/2643973700 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553a61edb0 con 0x56553a5e5b40 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e5b40 0x56553a60c020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c8007a0c0 tx=0x7f4c800aa7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2745144d335bf0d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c717fa640 1 -- 172.21.15.139:0/2643973700 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80097070 con 0x56553a5e5b40 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c717fa640 1 -- 172.21.15.139:0/2643973700 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c800781d0 con 0x56553a5e5b40 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c717fa640 1 -- 172.21.15.139:0/2643973700 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8007e0b0 con 0x56553a5e5b40 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c95200740 1 -- 172.21.15.139:0/2643973700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e5b40 msgr2=0x56553a60c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.510+0000 7f4c95200740 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e5b40 0x56553a60c020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c8007a0c0 tx=0x7f4c800aa7e0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 -- 172.21.15.139:0/2643973700 shutdown_connections 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a623ae0 0x56553a60c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a5e5b40 0x56553a60c020 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 --2- 172.21.15.139:0/2643973700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e45e0 0x56553a5dfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 -- 172.21.15.139:0/2643973700 >> 172.21.15.139:0/2643973700 conn(0x56553a5ab740 msgr2=0x56553a5da540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 -- 172.21.15.139:0/2643973700 shutdown_connections 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 -- 172.21.15.139:0/2643973700 wait complete. 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 -- start start 2024-04-26T18:22:38.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.511+0000 7f4c95200740 1 Processor -- start 2024-04-26T18:22:38.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e45e0 0x56553a61d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c95200740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a69edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c95200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a623ae0 0x56553a698290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c95200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1fc020 con 0x56553a623ae0 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1fcdc0 con 0x56553a5e45e0 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c95200740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8c1fc6f0 con 0x56553a5e5b40 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c95200740 10 client.0 _ll_register_callbacks cb 0x7f4c84009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a69edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c90a87640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a623ae0 0x56553a698290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e45e0 0x56553a61d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a69edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:46382/0 (socket says 172.21.15.139:46382) 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e45e0 0x56553a61d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:34964/0 (socket says 172.21.15.139:34964) 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8b7fe640 1 -- 172.21.15.139:0/4144777006 learned_addr learned my addr 172.21.15.139:0/4144777006 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8bfff640 1 -- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 msgr2=0x56553a69edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a69edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8bfff640 1 -- 172.21.15.139:0/4144777006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a623ae0 msgr2=0x56553a698290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:22:38.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a623ae0 0x56553a698290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8bfff640 1 -- 172.21.15.139:0/4144777006 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553a5e4a50 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c90a87640 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a623ae0 0x56553a698290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.512+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a69edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c8bfff640 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e45e0 0x56553a61d320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c008010 tx=0x7f4c7c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=699fea875d3ed642 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c6affd640 1 -- 172.21.15.139:0/4144777006 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c02f040 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c800781d0 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c6affd640 1 -- 172.21.15.139:0/4144777006 <== mon.1 v2:172.21.15.143:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4c7c02b450 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c6affd640 1 -- 172.21.15.139:0/4144777006 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4c7c04f050 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 10 client.5518 fetch_fsmap learned FSMap version 9 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56553a69f520 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c6affd640 1 -- 172.21.15.139:0/4144777006 <== mon.1 v2:172.21.15.143:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c800781d0 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c6affd640 1 -- 172.21.15.139:0/4144777006 <== mon.1 v2:172.21.15.143:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4c7c052020 con 0x56553a5e45e0 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 10 client.5518 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:22:38.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 10 client.5518 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:22:38.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 20 client.5518 populate_metadata read hostname 'smithi139' 2024-04-26T18:22:38.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a625df0 0x56553a6987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:22:38.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 4 client.5518 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.1, "await_for": 42.0}] 2024-04-26T18:22:38.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.1, "await_for": 42.0}) -- 0x56553a54f800 con 0x56553a625df0 2024-04-26T18:22:38.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.513+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a625df0 0x56553a6987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:22:38.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.514+0000 7f4c8b7fe640 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a625df0 0x56553a6987d0 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcaf91a8a24d08b6 server_cookie=40dcaa29aaddb5a0 in_seq=0 out_seq=0 2024-04-26T18:22:38.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:38.514+0000 7f4c6affd640 10 client.5518 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c6affd640 1 -- 172.21.15.139:0/4144777006 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x56553a54f800 con 0x56553a625df0 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c6affd640 10 client.5518 handle_command_reply: tid=0 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 client.5518 shutdown 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e45e0 msgr2=0x56553a61d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e45e0 0x56553a61d320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c008010 tx=0x7f4c7c016000 comp rx=0 tx=0).stop 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 shutdown_connections 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56553a623ae0 0x56553a698290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x56553a625df0 0x56553a6987d0 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56553a5e5b40 0x56553a69edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 --2- 172.21.15.139:0/4144777006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56553a5e45e0 0x56553a61d320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c6affd640 0 client.5518 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 >> 172.21.15.139:0/4144777006 conn(0x56553a5ab740 msgr2=0x56553a60c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 shutdown_connections 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 1 -- 172.21.15.139:0/4144777006 wait complete. 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.510+0000 7f4c95200740 20 client.5518 trim_cache size 0 max 16384 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 78, 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:22:40.512 INFO:teuthology.orchestra.run.smithi139.stdout: "e73944ab": { 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 78, 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 80.1, 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:22:40.513 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:22:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:22:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:22:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:22:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:22:40.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:22:40.514 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c7806c8f0 msgr2=0x7f4c7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c7806c8f0 0x7f4c7806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c006fd0 tx=0x7f4c7c008040 comp rx=0 tx=0).stop 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c072f40 msgr2=0x7f4c8c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c072f40 0x7f4c8c1569a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4c8002a220 tx=0x7f4c800046c0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 shutdown_connections 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4c7806c8f0 0x7f4c7806edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4c8c153e40 0x7f4c8c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4c8c072f40 0x7f4c8c1569a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 --2- 172.21.15.139:0/3971686721 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4c8c06d0b0 0x7f4c8c1e3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 >> 172.21.15.139:0/3971686721 conn(0x7f4c8c070a50 msgr2=0x7f4c8c0b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:22:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 shutdown_connections 2024-04-26T18:22:40.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:22:40.511+0000 7f4c924ea640 1 -- 172.21.15.139:0/3971686721 wait complete. 2024-04-26T18:22:40.522 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e73944ab', quiesce took 2.5 seconds. Will release after: 20.1 2024-04-26T18:23:00.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:23:00.529 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:23:00.623 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:23:00.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.729+0000 7fce07847640 1 Processor -- start 2024-04-26T18:23:00.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.729+0000 7fce07847640 1 -- start start 2024-04-26T18:23:00.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.730+0000 7fce07847640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce000b0c00 0x7fce0015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:00.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.730+0000 7fce07847640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fce00072fd0 0x7fce00073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:00.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.730+0000 7fce07847640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0015c2a0 con 0x7fce000afda0 2024-04-26T18:23:00.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.730+0000 7fce07847640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fce000b0fe0 con 0x7fce00072fd0 2024-04-26T18:23:00.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.730+0000 7fce07847640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce0015cb40 con 0x7fce000b0c00 2024-04-26T18:23:00.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.730+0000 7fce04de2640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fce000afda0 0x7fce0015fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43226/0 (socket says 172.21.15.139:43226) 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.730+0000 7fce04de2640 1 -- 172.21.15.139:0/1381458442 learned_addr learned my addr 172.21.15.139:0/1381458442 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fce055e3640 1 --2- 172.21.15.139:0/1381458442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce000b0c00 0x7fce0015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fce05de4640 1 --2- 172.21.15.139:0/1381458442 >> v2:172.21.15.143:3300/0 conn(0x7fce00072fd0 0x7fce00073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fcdf7fff640 1 -- 172.21.15.139:0/1381458442 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519830769 0 0) 0x7fce0015c2a0 con 0x7fce000afda0 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fcdf7fff640 1 -- 172.21.15.139:0/1381458442 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec003520 con 0x7fce000afda0 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fce055e3640 1 -- 172.21.15.139:0/1381458442 >> v2:172.21.15.143:3300/0 conn(0x7fce00072fd0 msgr2=0x7fce00073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fce055e3640 1 --2- 172.21.15.139:0/1381458442 >> v2:172.21.15.143:3300/0 conn(0x7fce00072fd0 0x7fce00073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fce055e3640 1 -- 172.21.15.139:0/1381458442 >> v1:172.21.15.139:6789/0 conn(0x7fce000afda0 legacy=0x7fce0015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:00.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.731+0000 7fce055e3640 1 -- 172.21.15.139:0/1381458442 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0015c580 con 0x7fce000b0c00 2024-04-26T18:23:00.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.732+0000 7fce055e3640 1 --2- 172.21.15.139:0/1381458442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce000b0c00 0x7fce0015bb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097a0 tx=0x7fcdfc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7630ab5a11c2577e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:00.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.732+0000 7fcdf7fff640 1 -- 172.21.15.139:0/1381458442 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc037070 con 0x7fce000b0c00 2024-04-26T18:23:00.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.732+0000 7fcdf7fff640 1 -- 172.21.15.139:0/1381458442 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc032440 con 0x7fce000b0c00 2024-04-26T18:23:00.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.732+0000 7fcdf7fff640 1 -- 172.21.15.139:0/1381458442 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0327f0 con 0x7fce000b0c00 2024-04-26T18:23:00.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 -- 172.21.15.139:0/1381458442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce000b0c00 msgr2=0x7fce0015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:00.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 --2- 172.21.15.139:0/1381458442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce000b0c00 0x7fce0015bb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0097a0 tx=0x7fcdfc02a210 comp rx=0 tx=0).stop 2024-04-26T18:23:00.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 -- 172.21.15.139:0/1381458442 shutdown_connections 2024-04-26T18:23:00.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 --2- 172.21.15.139:0/1381458442 >> v2:172.21.15.143:3300/0 conn(0x7fce00072fd0 0x7fce00073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 --2- 172.21.15.139:0/1381458442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce000b0c00 0x7fce0015bb80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 -- 172.21.15.139:0/1381458442 >> 172.21.15.139:0/1381458442 conn(0x7fce000ce110 msgr2=0x7fce000ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:00.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 -- 172.21.15.139:0/1381458442 shutdown_connections 2024-04-26T18:23:00.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.733+0000 7fce07847640 1 -- 172.21.15.139:0/1381458442 wait complete. 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.734+0000 7fce07847640 1 Processor -- start 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.734+0000 7fce07847640 1 -- start start 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce07847640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce00072fd0 0x7fce0014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce07847640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce000afda0 0x7fce0015e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce07847640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce000b0c00 0x7fce0014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce07847640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce0015f2d0 con 0x7fce000b0c00 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce07847640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fce0015f640 con 0x7fce000afda0 2024-04-26T18:23:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce07847640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fce00068090 con 0x7fce00072fd0 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce000b0c00 0x7fce0014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce04de2640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce000afda0 0x7fce0015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce000b0c00 0x7fce0014a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39384/0 (socket says 172.21.15.139:39384) 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce055e3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce00072fd0 0x7fce0014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 -- 172.21.15.139:0/4031302202 learned_addr learned my addr 172.21.15.139:0/4031302202 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 -- 172.21.15.139:0/4031302202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce00072fd0 msgr2=0x7fce0014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce00072fd0 0x7fce0014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 -- 172.21.15.139:0/4031302202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce000afda0 msgr2=0x7fce0015e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce000afda0 0x7fce0015e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.735+0000 7fce05de4640 1 -- 172.21.15.139:0/4031302202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce00153630 con 0x7fce000b0c00 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.736+0000 7fce05de4640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce000b0c00 0x7fce0014a510 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009dd0 tx=0x7fcdf800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.736+0000 7fcdf5ffb640 1 -- 172.21.15.139:0/4031302202 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8018020 con 0x7fce000b0c00 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.736+0000 7fcdf5ffb640 1 -- 172.21.15.139:0/4031302202 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf8014480 con 0x7fce000b0c00 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.736+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce00154170 con 0x7fce000b0c00 2024-04-26T18:23:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.736+0000 7fcdf5ffb640 1 -- 172.21.15.139:0/4031302202 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8014870 con 0x7fce000b0c00 2024-04-26T18:23:00.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.736+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce00153bb0 con 0x7fce000b0c00 2024-04-26T18:23:00.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.737+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce000cefb0 con 0x7fce000b0c00 2024-04-26T18:23:00.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.737+0000 7fcdf5ffb640 1 -- 172.21.15.139:0/4031302202 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcdf8005d10 con 0x7fce000b0c00 2024-04-26T18:23:00.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.738+0000 7fcdf5ffb640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcde406c8f0 0x7fcde406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:00.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.738+0000 7fcdf5ffb640 1 -- 172.21.15.139:0/4031302202 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fcdf808c8b0 con 0x7fce000b0c00 2024-04-26T18:23:00.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.738+0000 7fce055e3640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcde406c8f0 0x7fcde406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:00.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.739+0000 7fce055e3640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcde406c8f0 0x7fcde406edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc034000 tx=0x7fcdfc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:00.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.743+0000 7fcdf5ffb640 1 -- 172.21.15.139:0/4031302202 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce000cefb0 con 0x7fce000b0c00 2024-04-26T18:23:00.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.958+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce00076d20 con 0x7fce000b0c00 2024-04-26T18:23:00.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.959+0000 7fcdf5ffb640 1 -- 172.21.15.139:0/4031302202 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fcdf8022070 con 0x7fce000b0c00 2024-04-26T18:23:00.959 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:23:00.959 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:23:00.959 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:23:00.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcde406c8f0 msgr2=0x7fcde406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:00.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcde406c8f0 0x7fcde406edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc034000 tx=0x7fcdfc02e000 comp rx=0 tx=0).stop 2024-04-26T18:23:00.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce000b0c00 msgr2=0x7fce0014a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:00.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce000b0c00 0x7fce0014a510 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009dd0 tx=0x7fcdf800c490 comp rx=0 tx=0).stop 2024-04-26T18:23:00.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 shutdown_connections 2024-04-26T18:23:00.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcde406c8f0 0x7fcde406edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce000b0c00 0x7fce0014a510 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fce000afda0 0x7fce0015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 --2- 172.21.15.139:0/4031302202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fce00072fd0 0x7fce0014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:00.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 >> 172.21.15.139:0/4031302202 conn(0x7fce000ce110 msgr2=0x7fce000cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:00.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 shutdown_connections 2024-04-26T18:23:00.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:00.961+0000 7fce07847640 1 -- 172.21.15.139:0/4031302202 wait complete. 2024-04-26T18:23:00.972 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id e73944ab --release --await' 2024-04-26T18:23:00.972 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id e73944ab --release --await 2024-04-26T18:23:01.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.075+0000 7febb5e59640 1 Processor -- start 2024-04-26T18:23:01.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.075+0000 7febb5e59640 1 -- start start 2024-04-26T18:23:01.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.076+0000 7febb5e59640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7febb01527f0 0x7febb015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.076+0000 7febb5e59640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb015cbc0 con 0x7febb00cc0e0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.076+0000 7febb5e59640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb015c040 con 0x7febb015fdf0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.076+0000 7febb5e59640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7febb00c6780 con 0x7febb01527f0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.076+0000 7febaf7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7febb01527f0 0x7febb015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.076+0000 7febaffff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7febb00cc0e0 0x7febb00cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:43240/0 (socket says 172.21.15.139:43240) 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.076+0000 7febaffff640 1 -- 172.21.15.139:0/1544407584 learned_addr learned my addr 172.21.15.139:0/1544407584 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.077+0000 7febaf7fe640 1 -- 172.21.15.139:0/1544407584 >> v1:172.21.15.143:6789/0 conn(0x7febb015fdf0 legacy=0x7febb00d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.077+0000 7febaf7fe640 1 -- 172.21.15.139:0/1544407584 >> v1:172.21.15.139:6789/0 conn(0x7febb00cc0e0 legacy=0x7febb00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.077+0000 7febaf7fe640 1 -- 172.21.15.139:0/1544407584 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb015c320 con 0x7febb01527f0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.077+0000 7febaeffd640 1 -- 172.21.15.139:0/1544407584 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552866499 0 0) 0x7feba8001490 con 0x7febb00cc0e0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.077+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1544407584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb01527f0 0x7febb015f8b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feba00097d0 tx=0x7feba002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b745f47bc8360 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.077+0000 7febaeffd640 1 -- 172.21.15.139:0/1544407584 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0037070 con 0x7febb01527f0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febaeffd640 1 -- 172.21.15.139:0/1544407584 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba0032440 con 0x7febb01527f0 2024-04-26T18:23:01.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febaeffd640 1 -- 172.21.15.139:0/1544407584 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0032810 con 0x7febb01527f0 2024-04-26T18:23:01.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febb5e59640 1 -- 172.21.15.139:0/1544407584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb01527f0 msgr2=0x7febb015f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febb5e59640 1 --2- 172.21.15.139:0/1544407584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb01527f0 0x7febb015f8b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7feba00097d0 tx=0x7feba002a270 comp rx=0 tx=0).stop 2024-04-26T18:23:01.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febb5e59640 1 -- 172.21.15.139:0/1544407584 shutdown_connections 2024-04-26T18:23:01.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febb5e59640 1 --2- 172.21.15.139:0/1544407584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb01527f0 0x7febb015f8b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febb5e59640 1 -- 172.21.15.139:0/1544407584 >> 172.21.15.139:0/1544407584 conn(0x7febb0076100 msgr2=0x7febb0073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:01.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febb5e59640 1 -- 172.21.15.139:0/1544407584 shutdown_connections 2024-04-26T18:23:01.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.078+0000 7febb5e59640 1 -- 172.21.15.139:0/1544407584 wait complete. 2024-04-26T18:23:01.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.079+0000 7febb5e59640 1 Processor -- start 2024-04-26T18:23:01.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.079+0000 7febb5e59640 1 -- start start 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febb5e59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb00cc0e0 0x7febb01e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febb5e59640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febb01527f0 0x7febb014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febb5e59640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febb015fdf0 0x7febb014c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febb5e59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febb00cdb00 con 0x7febb00cc0e0 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febb5e59640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7febb015c8e0 con 0x7febb01527f0 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febb5e59640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7febb015bc70 con 0x7febb015fdf0 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb00cc0e0 0x7febb01e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb00cc0e0 0x7febb01e5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39398/0 (socket says 172.21.15.139:39398) 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 -- 172.21.15.139:0/3334440006 learned_addr learned my addr 172.21.15.139:0/3334440006 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7feba6ffd640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febb01527f0 0x7febb014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaffff640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febb015fdf0 0x7febb014c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 -- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febb015fdf0 msgr2=0x7febb014c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febb015fdf0 0x7febb014c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 -- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febb01527f0 msgr2=0x7febb014bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febb01527f0 0x7febb014bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaf7fe640 1 -- 172.21.15.139:0/3334440006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb01f1c60 con 0x7febb00cc0e0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7feba6ffd640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febb01527f0 0x7febb014bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.080+0000 7febaffff640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febb015fdf0 0x7febb014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.081+0000 7febaf7fe640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb00cc0e0 0x7febb01e5870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feba002a860 tx=0x7feba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.081+0000 7febacff9640 1 -- 172.21.15.139:0/3334440006 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0037040 con 0x7febb00cc0e0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.081+0000 7febacff9640 1 -- 172.21.15.139:0/3334440006 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba0042070 con 0x7febb00cc0e0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.081+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb01f1f20 con 0x7febb00cc0e0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.081+0000 7febacff9640 1 -- 172.21.15.139:0/3334440006 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0030bf0 con 0x7febb00cc0e0 2024-04-26T18:23:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.081+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb01f24e0 con 0x7febb00cc0e0 2024-04-26T18:23:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.082+0000 7febacff9640 1 -- 172.21.15.139:0/3334440006 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feba0047460 con 0x7febb00cc0e0 2024-04-26T18:23:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.083+0000 7febacff9640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feb9006c920 0x7feb9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.083+0000 7febacff9640 1 -- 172.21.15.139:0/3334440006 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7feba00acb80 con 0x7febb00cc0e0 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.083+0000 7feba6ffd640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feb9006c920 0x7feb9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.083+0000 7feba6ffd640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feb9006c920 0x7feb9006ede0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febb015b870 tx=0x7feb98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 Processor -- start 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 -- start start 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aa4b0 0x55b89b7e9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aba10 0x55b89b7aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b89b70f040 con 0x55b89b7e99b0 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b89b6aab60 con 0x55b89b7aba10 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.084+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b89b70b000 con 0x55b89b7aa4b0 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39410/0 (socket says 172.21.15.139:39410) 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 -- 172.21.15.139:0/193975130 learned_addr learned my addr 172.21.15.139:0/193975130 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7febaf7fe640 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aa4b0 0x55b89b7e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7febaffff640 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aba10 0x55b89b7aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 -- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aa4b0 msgr2=0x55b89b7e9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aa4b0 0x55b89b7e9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 -- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aba10 msgr2=0x55b89b7aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aba10 0x55b89b7aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 -- 172.21.15.139:0/193975130 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89b69f9c0 con 0x55b89b7e99b0 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7febaffff640 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aba10 0x55b89b7aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba6ffd640 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7aa890 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb98007e90 tx=0x7feb98011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcee0159a7e1d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba57fa640 1 -- 172.21.15.139:0/193975130 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98003640 con 0x55b89b7e99b0 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba57fa640 1 -- 172.21.15.139:0/193975130 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb980037e0 con 0x55b89b7e99b0 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.085+0000 7feba57fa640 1 -- 172.21.15.139:0/193975130 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98003b90 con 0x55b89b7e99b0 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 -- 172.21.15.139:0/193975130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 msgr2=0x55b89b7aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7aa890 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb98007e90 tx=0x7feb98011000 comp rx=0 tx=0).stop 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 -- 172.21.15.139:0/193975130 shutdown_connections 2024-04-26T18:23:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aba10 0x55b89b7aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7aa890 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 --2- 172.21.15.139:0/193975130 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aa4b0 0x55b89b7e9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 -- 172.21.15.139:0/193975130 >> 172.21.15.139:0/193975130 conn(0x55b89b771930 msgr2=0x55b89b7ee450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 -- 172.21.15.139:0/193975130 shutdown_connections 2024-04-26T18:23:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 -- 172.21.15.139:0/193975130 wait complete. 2024-04-26T18:23:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 -- start start 2024-04-26T18:23:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.086+0000 7febb8b71740 1 Processor -- start 2024-04-26T18:23:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aba10 0x55b89b7d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febb8b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febb8b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b89b7a8af0 con 0x55b89b7e99b0 2024-04-26T18:23:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b89b6a84f0 con 0x55b89b7aa4b0 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b89b7ac040 con 0x55b89b7aba10 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febb8b71740 10 client.0 _ll_register_callbacks cb 0x55b89b705c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7fb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39424/0 (socket says 172.21.15.139:39424) 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 -- 172.21.15.139:0/1672039942 learned_addr learned my addr 172.21.15.139:0/1672039942 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7feba6ffd640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aba10 0x55b89b7d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 -- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aba10 msgr2=0x55b89b7d4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aba10 0x55b89b7d4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 -- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 msgr2=0x55b89b7e22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7e22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaffff640 1 -- 172.21.15.139:0/1672039942 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89b420920 con 0x55b89b7e99b0 2024-04-26T18:23:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.087+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febaffff640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7fb1c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feba80020f0 tx=0x7feba8007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8116cc457b20aae6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7feb8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1672039942 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba801b060 con 0x55b89b7e99b0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1672039942 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7feba8004d70 con 0x55b89b7e99b0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb980037e0 con 0x55b89b7e99b0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1672039942 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feba8005050 con 0x55b89b7e99b0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 10 client.5817 fetch_fsmap learned FSMap version 9 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b89b4ecd30 con 0x55b89b7e99b0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1672039942 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb980037e0 con 0x55b89b7e99b0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1672039942 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7feba8016730 con 0x55b89b7e99b0 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 10 client.5817 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 10 client.5817 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 20 client.5817 populate_metadata read hostname 'smithi139' 2024-04-26T18:23:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7e8480 0x55b89b7e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 4 client.5817 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b89b6e2a00 con 0x55b89b7e8480 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.088+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7e8480 0x55b89b7e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.089+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7e8480 0x55b89b7e6bc0 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d69fcf5dd16b996 server_cookie=637c8b8efd6c32a1 in_seq=0 out_seq=0 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.089+0000 7feb8e7fc640 10 client.5817 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.089+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1672039942 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b89b6e2a00 con 0x55b89b7e8480 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.089+0000 7feb8e7fc640 10 client.5817 handle_command_reply: tid=0 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.089+0000 7febb8b71740 1 client.5817 shutdown 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 msgr2=0x55b89b7fb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7fb1c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feba80020f0 tx=0x7feba8007420 comp rx=0 tx=0).stop 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 shutdown_connections 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7e99b0 0x55b89b7fb1c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7e8480 0x55b89b7e6bc0 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7aba10 0x55b89b7d4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 --2- 172.21.15.139:0/1672039942 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7feb8e7fc640 0 client.5817 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 >> 172.21.15.139:0/1672039942 conn(0x55b89b771930 msgr2=0x55b89b7aa890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 shutdown_connections 2024-04-26T18:23:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 1 -- 172.21.15.139:0/1672039942 wait complete. 2024-04-26T18:23:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.090+0000 7febb8b71740 20 client.5817 trim_cache size 0 max 16384 2024-04-26T18:23:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.107+0000 7febb8b71740 1 Processor -- start 2024-04-26T18:23:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.107+0000 7febb8b71740 1 -- start start 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febb8b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b7a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b7d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febb8b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febb0200750 con 0x55b89b7aba10 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7febb01ff630 con 0x55b89b7aa4b0 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7febb00b7480 con 0x55b89b7e99b0 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b7a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b7a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39426/0 (socket says 172.21.15.139:39426) 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 -- 172.21.15.139:0/3835869923 learned_addr learned my addr 172.21.15.139:0/3835869923 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febaffff640 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b7d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febaf7fe640 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 -- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 msgr2=0x55b89b7d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b7d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 -- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 msgr2=0x55b89b7a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 -- 172.21.15.139:0/3835869923 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89b7a1040 con 0x55b89b7aba10 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7febaf7fe640 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba6ffd640 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b7a4f70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7feb98014000 tx=0x7feb98005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e94c5605802c699 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba4ff9640 1 -- 172.21.15.139:0/3835869923 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98030070 con 0x55b89b7aba10 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba4ff9640 1 -- 172.21.15.139:0/3835869923 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb98027070 con 0x55b89b7aba10 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.108+0000 7feba4ff9640 1 -- 172.21.15.139:0/3835869923 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98003dd0 con 0x55b89b7aba10 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 -- 172.21.15.139:0/3835869923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 msgr2=0x55b89b7a4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b7a4f70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7feb98014000 tx=0x7feb98005000 comp rx=0 tx=0).stop 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 -- 172.21.15.139:0/3835869923 shutdown_connections 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b7d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b7a4f70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 --2- 172.21.15.139:0/3835869923 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 -- 172.21.15.139:0/3835869923 >> 172.21.15.139:0/3835869923 conn(0x55b89b771930 msgr2=0x55b89b7e6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 -- 172.21.15.139:0/3835869923 shutdown_connections 2024-04-26T18:23:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.109+0000 7febb8b71740 1 -- 172.21.15.139:0/3835869923 wait complete. 2024-04-26T18:23:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 -- start start 2024-04-26T18:23:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 Processor -- start 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b85ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b85f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febb01fe1c0 con 0x55b89b7aba10 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7febb01fef60 con 0x55b89b7aa4b0 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7febb01fe890 con 0x55b89b7e99b0 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7febb8b71740 10 client.0 _ll_register_callbacks cb 0x7feba8005bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b85ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7feba6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b85ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39436/0 (socket says 172.21.15.139:39436) 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.110+0000 7feba6ffd640 1 -- 172.21.15.139:0/1717635449 learned_addr learned my addr 172.21.15.139:0/1717635449 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febaffff640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b85f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feba6ffd640 1 -- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 msgr2=0x55b89b85f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feba6ffd640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b85f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feba6ffd640 1 -- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 msgr2=0x55b89b7ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feba6ffd640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feba6ffd640 1 -- 172.21.15.139:0/1717635449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89b7a7c70 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feba6ffd640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b85ef70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feb9802e040 tx=0x7feb98000f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd3d66651f4c81a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feb8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1717635449 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98030070 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1717635449 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7feb98035660 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb98027070 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1717635449 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feb9803d050 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 10 client.5823 fetch_fsmap learned FSMap version 9 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b89b7fe300 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1717635449 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb98027070 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1717635449 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7feb98040020 con 0x55b89b7aba10 2024-04-26T18:23:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 10 client.5823 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 10 client.5823 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 20 client.5823 populate_metadata read hostname 'smithi139' 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7fe8d0 0x55b89b7d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 4 client.5823 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e73944ab", "release": true, "await": true}] 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.111+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e73944ab", "release": true, "await": true}) -- 0x55b89b71cc50 con 0x55b89b7fe8d0 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.112+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7fe8d0 0x55b89b7d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.112+0000 7febaf7fe640 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7fe8d0 0x55b89b7d13a0 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d1e63a457c750c1 server_cookie=e286bb63ecd9cfc1 in_seq=0 out_seq=0 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.112+0000 7feb8e7fc640 10 client.5823 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.112+0000 7feb8e7fc640 1 -- 172.21.15.139:0/1717635449 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55b89b71cc50 con 0x55b89b7fe8d0 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.112+0000 7feb8e7fc640 10 client.5823 handle_command_reply: tid=0 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.112+0000 7febb8b71740 1 client.5823 shutdown 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.112+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 msgr2=0x55b89b85ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b85ef70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feb9802e040 tx=0x7feb98000f20 comp rx=0 tx=0).stop 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 shutdown_connections 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b89b7fe8d0 0x55b89b7d13a0 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b89b7e99b0 0x55b89b85f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7feb8e7fc640 0 client.5823 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b89b7aba10 0x55b89b85ef70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 --2- 172.21.15.139:0/1717635449 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b89b7aa4b0 0x55b89b7ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 >> 172.21.15.139:0/1717635449 conn(0x55b89b771930 msgr2=0x55b89b7aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 shutdown_connections 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 1 -- 172.21.15.139:0/1717635449 wait complete. 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb8b71740 20 client.5823 trim_cache size 0 max 16384 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:23:01.119 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 80, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "e73944ab": { 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 80, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 80.1, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:23:01.120 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:23:01.121 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:23:01.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:01.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:01.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:01.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:01.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:01.121 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feb9006c920 msgr2=0x7feb9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feb9006c920 0x7feb9006ede0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febb015b870 tx=0x7feb98009040 comp rx=0 tx=0).stop 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb00cc0e0 msgr2=0x7febb01e5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb00cc0e0 0x7febb01e5870 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feba002a860 tx=0x7feba00046c0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 shutdown_connections 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7feb9006c920 0x7feb9006ede0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7febb015fdf0 0x7febb014c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7febb01527f0 0x7febb014bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 --2- 172.21.15.139:0/3334440006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febb00cc0e0 0x7febb01e5870 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 >> 172.21.15.139:0/3334440006 conn(0x7febb0076100 msgr2=0x7febb015a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 shutdown_connections 2024-04-26T18:23:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:01.113+0000 7febb5e59640 1 -- 172.21.15.139:0/3334440006 wait complete. 2024-04-26T18:23:01.124 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e73944ab', seconds elapsed: 23.1 2024-04-26T18:23:03.706 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 11% (25/211) Updating files: 12% (26/211) Updating files: 13% (28/211) Updating files: 14% (30/211) Updating files: 15% (32/211) Updating files: 16% (34/211) Updating files: 17% (36/211) Updating files: 18% (38/211) Updating files: 19% (41/211) Updating files: 20% (43/211) Updating files: 21% (45/211) Updating files: 22% (47/211) Updating files: 23% (49/211) Updating files: 24% (51/211) Updating files: 25% (53/211) Updating files: 26% (55/211) Updating files: 27% (57/211) Updating files: 28% (60/211) Updating files: 29% (62/211) Updating files: 30% (64/211) Updating files: 31% (66/211) Updating files: 32% (68/211) Updating files: 33% (70/211) Updating files: 34% (72/211) Updating files: 35% (74/211) Updating files: 36% (76/211) Updating files: 37% (79/211) Updating files: 38% (81/211) Updating files: 39% (83/211) Updating files: 39% (84/211) Updating files: 40% (85/211) Updating files: 41% (87/211) Updating files: 42% (89/211) Updating files: 43% (91/211) Updating files: 44% (93/211) Updating files: 45% (95/211) Updating files: 46% (98/211) Updating files: 47% (100/211) Updating files: 48% (102/211) Updating files: 49% (104/211) Updating files: 50% (106/211) Updating files: 51% (108/211) Updating files: 52% (110/211) Updating files: 53% (112/211) Updating files: 54% (114/211) Updating files: 55% (117/211) Updating files: 56% (119/211) Updating files: 57% (121/211) Updating files: 58% (123/211) Updating files: 59% (125/211) Updating files: 60% (127/211) Updating files: 61% (129/211) Updating files: 62% (131/211) Updating files: 63% (133/211) Updating files: 64% (136/211) Updating files: 65% (138/211) Updating files: 66% (140/211) Updating files: 67% (142/211) Updating files: 68% (144/211) Updating files: 69% (146/211) Updating files: 70% (148/211) Updating files: 71% (150/211) Updating files: 72% (152/211) Updating files: 73% (155/211) Updating files: 74% (157/211) Updating files: 75% (159/211) Updating files: 75% (160/211) Updating files: 76% (161/211) Updating files: 77% (163/211) Updating files: 78% (165/211) Updating files: 79% (167/211) Updating files: 80% (169/211) Updating files: 81% (171/211) Updating files: 82% (174/211) Updating files: 83% (176/211) Updating files: 84% (178/211) Updating files: 85% (180/211) Updating files: 86% (182/211) Updating files: 87% (184/211) Updating files: 88% (186/211) Updating files: 89% (188/211) Updating files: 90% (190/211) Updating files: 91% (193/211) Updating files: 92% (195/211) Updating files: 93% (197/211) Updating files: 94% (199/211) Updating files: 95% (201/211) Updating files: 96% (203/211) Updating files: 97% (205/211) Updating files: 98% (207/211) Updating files: 99% (209/211) Updating files: 100% (211/211) Updating files: 100% (211/211), done. 2024-04-26T18:23:04.642 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at cbae6a435c6 v0.59 2024-04-26T18:23:04.681 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.59 2024-04-26T18:23:04.737 INFO:tasks.workunit.client.0.smithi139.stdout:v0.60 2024-04-26T18:23:04.738 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:23:04.738 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 60 -eq 48 ']' 2024-04-26T18:23:04.738 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.60 2024-04-26T18:23:04.738 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.60 2024-04-26T18:23:04.738 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.60 2024-04-26T18:23:17.744 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 30% (77/256) Updating files: 31% (80/256) Updating files: 32% (82/256) Updating files: 33% (85/256) Updating files: 34% (88/256) Updating files: 35% (90/256) Updating files: 36% (93/256) Updating files: 37% (95/256) Updating files: 38% (98/256) Updating files: 39% (100/256) Updating files: 40% (103/256) Updating files: 41% (105/256) Updating files: 42% (108/256) Updating files: 42% (110/256) Updating files: 43% (111/256) Updating files: 44% (113/256) Updating files: 45% (116/256) Updating files: 46% (118/256) Updating files: 47% (121/256) Updating files: 48% (123/256) Updating files: 49% (126/256) Updating files: 50% (128/256) Updating files: 51% (131/256) Updating files: 52% (134/256) Updating files: 53% (136/256) Updating files: 54% (139/256) Updating files: 55% (141/256) Updating files: 56% (144/256) Updating files: 57% (146/256) Updating files: 58% (149/256) Updating files: 59% (152/256) Updating files: 60% (154/256) Updating files: 61% (157/256) Updating files: 62% (159/256) Updating files: 63% (162/256) Updating files: 64% (164/256) Updating files: 65% (167/256) Updating files: 66% (169/256) Updating files: 67% (172/256) Updating files: 68% (175/256) Updating files: 69% (177/256) Updating files: 70% (180/256) Updating files: 71% (182/256) Updating files: 72% (185/256) Updating files: 73% (187/256) Updating files: 74% (190/256) Updating files: 75% (192/256) Updating files: 76% (195/256) Updating files: 77% (198/256) Updating files: 78% (200/256) Updating files: 79% (203/256) Updating files: 80% (205/256) Updating files: 81% (208/256) Updating files: 82% (210/256) Updating files: 83% (213/256) Updating files: 83% (214/256) Updating files: 84% (216/256) Updating files: 85% (218/256) Updating files: 86% (221/256) Updating files: 87% (223/256) Updating files: 88% (226/256) Updating files: 89% (228/256) Updating files: 90% (231/256) Updating files: 91% (233/256) Updating files: 92% (236/256) Updating files: 93% (239/256) Updating files: 94% (241/256) Updating files: 95% (244/256) Updating files: 96% (246/256) Updating files: 97% (249/256) Updating files: 98% (251/256) Updating files: 99% (254/256) Updating files: 100% (256/256) Updating files: 100% (256/256), done. 2024-04-26T18:23:17.792 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at f26f7a39021 v0.60 2024-04-26T18:23:17.795 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.60 2024-04-26T18:23:17.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:23:17.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 61 -eq 48 ']' 2024-04-26T18:23:17.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.61 2024-04-26T18:23:17.862 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.61 2024-04-26T18:23:17.863 INFO:tasks.workunit.client.0.smithi139.stdout:v0.61 2024-04-26T18:23:17.863 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.61 2024-04-26T18:23:22.443 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 31% (117/376) Updating files: 32% (121/376) Updating files: 33% (125/376) Updating files: 33% (127/376) Updating files: 34% (128/376) Updating files: 35% (132/376) Updating files: 36% (136/376) Updating files: 37% (140/376) Updating files: 38% (143/376) Updating files: 39% (147/376) Updating files: 40% (151/376) Updating files: 41% (155/376) Updating files: 42% (158/376) Updating files: 43% (162/376) Updating files: 44% (166/376) Updating files: 45% (170/376) Updating files: 46% (173/376) Updating files: 47% (177/376) Updating files: 48% (181/376) Updating files: 49% (185/376) Updating files: 50% (188/376) Updating files: 51% (192/376) Updating files: 52% (196/376) Updating files: 53% (200/376) Updating files: 54% (204/376) Updating files: 55% (207/376) Updating files: 56% (211/376) Updating files: 57% (215/376) Updating files: 58% (219/376) Updating files: 59% (222/376) Updating files: 60% (226/376) Updating files: 61% (230/376) Updating files: 62% (234/376) Updating files: 62% (235/376) Updating files: 63% (237/376) Updating files: 64% (241/376) Updating files: 65% (245/376) Updating files: 66% (249/376) Updating files: 67% (252/376) Updating files: 68% (256/376) Updating files: 69% (260/376) Updating files: 70% (264/376) Updating files: 71% (267/376) Updating files: 72% (271/376) Updating files: 73% (275/376) Updating files: 74% (279/376) Updating files: 75% (282/376) Updating files: 76% (286/376) Updating files: 77% (290/376) Updating files: 78% (294/376) Updating files: 79% (298/376) Updating files: 80% (301/376) Updating files: 81% (305/376) Updating files: 82% (309/376) Updating files: 83% (313/376) Updating files: 84% (316/376) Updating files: 85% (320/376) Updating files: 86% (324/376) Updating files: 87% (328/376) Updating files: 88% (331/376) Updating files: 89% (335/376) Updating files: 90% (339/376) Updating files: 91% (343/376) Updating files: 92% (346/376) Updating files: 93% (350/376) Updating files: 94% (354/376) Updating files: 95% (358/376) Updating files: 96% (361/376) Updating files: 97% (365/376) Updating files: 98% (369/376) Updating files: 99% (373/376) Updating files: 100% (376/376) Updating files: 100% (376/376), done. 2024-04-26T18:23:22.476 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 237f3f1e8d8 v0.61 2024-04-26T18:23:22.479 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.61 2024-04-26T18:23:22.511 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:23:22.511 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 62 -eq 48 ']' 2024-04-26T18:23:22.511 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.62 2024-04-26T18:23:22.512 INFO:tasks.workunit.client.0.smithi139.stdout:v0.62 2024-04-26T18:23:22.512 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.62 2024-04-26T18:23:22.512 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.62 2024-04-26T18:23:24.670 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 52% (31/59) Updating files: 54% (32/59) Updating files: 55% (33/59) Updating files: 57% (34/59) Updating files: 59% (35/59) Updating files: 61% (36/59) Updating files: 62% (37/59) Updating files: 64% (38/59) Updating files: 66% (39/59) Updating files: 67% (40/59) Updating files: 69% (41/59) Updating files: 71% (42/59) Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-04-26T18:23:24.709 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 9382379cc6b v0.62 2024-04-26T18:23:24.710 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.62 2024-04-26T18:23:24.756 INFO:tasks.workunit.client.0.smithi139.stdout:v0.63 2024-04-26T18:23:24.756 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:23:24.757 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 63 -eq 48 ']' 2024-04-26T18:23:24.757 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.63 2024-04-26T18:23:24.757 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.63 2024-04-26T18:23:24.757 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.63 2024-04-26T18:23:30.627 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:23:30.630 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:23:38.120 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 2% (4/146) Updating files: 3% (5/146) Updating files: 4% (6/146) Updating files: 5% (8/146) Updating files: 6% (9/146) Updating files: 7% (11/146) Updating files: 8% (12/146) Updating files: 9% (14/146) Updating files: 10% (15/146) Updating files: 11% (17/146) Updating files: 12% (18/146) Updating files: 13% (19/146) Updating files: 14% (21/146) Updating files: 15% (22/146) Updating files: 16% (24/146) Updating files: 17% (25/146) Updating files: 18% (27/146) Updating files: 19% (28/146) Updating files: 20% (30/146) Updating files: 21% (31/146) Updating files: 22% (33/146) Updating files: 23% (34/146) Updating files: 24% (36/146) Updating files: 25% (37/146) Updating files: 26% (38/146) Updating files: 27% (40/146) Updating files: 28% (41/146) Updating files: 29% (43/146) Updating files: 30% (44/146) Updating files: 31% (46/146) Updating files: 32% (47/146) Updating files: 33% (49/146) Updating files: 34% (50/146) Updating files: 35% (52/146) Updating files: 36% (53/146) Updating files: 37% (55/146) Updating files: 38% (56/146) Updating files: 39% (57/146) Updating files: 40% (59/146) Updating files: 41% (60/146) Updating files: 42% (62/146) Updating files: 43% (63/146) Updating files: 44% (65/146) Updating files: 45% (66/146) Updating files: 46% (68/146) Updating files: 47% (69/146) Updating files: 48% (71/146) Updating files: 49% (72/146) Updating files: 50% (73/146) Updating files: 51% (75/146) Updating files: 52% (76/146) Updating files: 53% (78/146) Updating files: 54% (79/146) Updating files: 55% (81/146) Updating files: 56% (82/146) Updating files: 57% (84/146) Updating files: 58% (85/146) Updating files: 58% (86/146) Updating files: 59% (87/146) Updating files: 60% (88/146) Updating files: 61% (90/146) Updating files: 62% (91/146) Updating files: 63% (92/146) Updating files: 64% (94/146) Updating files: 65% (95/146) Updating files: 66% (97/146) Updating files: 67% (98/146) Updating files: 68% (100/146) Updating files: 69% (101/146) Updating files: 70% (103/146) Updating files: 71% (104/146) Updating files: 72% (106/146) Updating files: 73% (107/146) Updating files: 74% (109/146) Updating files: 75% (110/146) Updating files: 76% (111/146) Updating files: 77% (113/146) Updating files: 78% (114/146) Updating files: 79% (116/146) Updating files: 80% (117/146) Updating files: 81% (119/146) Updating files: 82% (120/146) Updating files: 83% (122/146) Updating files: 84% (123/146) Updating files: 85% (125/146) Updating files: 86% (126/146) Updating files: 87% (128/146) Updating files: 88% (129/146) Updating files: 89% (130/146) Updating files: 90% (132/146) Updating files: 91% (133/146) Updating files: 92% (135/146) Updating files: 93% (136/146) Updating files: 94% (138/146) Updating files: 95% (139/146) Updating files: 96% (141/146) Updating files: 97% (142/146) Updating files: 98% (144/146) Updating files: 99% (145/146) Updating files: 100% (146/146) Updating files: 100% (146/146), done. 2024-04-26T18:23:38.440 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 054e96cf79e v0.63 2024-04-26T18:23:38.442 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.63 2024-04-26T18:23:38.454 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.2 2024-04-26T18:23:38.454 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:23:38.460 INFO:tasks.workunit.client.0.smithi139.stdout:v0.64 2024-04-26T18:23:38.460 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:23:38.460 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 64 -eq 48 ']' 2024-04-26T18:23:38.460 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.64 2024-04-26T18:23:38.460 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.64 2024-04-26T18:23:38.460 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.64 2024-04-26T18:23:38.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.574+0000 7fdcae8e3640 1 Processor -- start 2024-04-26T18:23:38.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.574+0000 7fdcae8e3640 1 -- start start 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.574+0000 7fdcae8e3640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdca8073fa0 0x7fdca80cab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.574+0000 7fdcae8e3640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fdca8073230 0x7fdca80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.574+0000 7fdcae8e3640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca815c3d0 con 0x7fdca8074380 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.574+0000 7fdcae8e3640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fdca80cb180 con 0x7fdca8073fa0 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.574+0000 7fdcae8e3640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fdca80cb460 con 0x7fdca8073230 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdca7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdca8073fa0 0x7fdca80cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdca7fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fdca8073fa0 0x7fdca80cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56982/0 (socket says 172.21.15.139:56982) 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdca7fff640 1 -- 172.21.15.139:0/1637121180 learned_addr learned my addr 172.21.15.139:0/1637121180 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdcace80640 1 --2- 172.21.15.139:0/1637121180 >> v2:172.21.15.143:3300/0 conn(0x7fdca8073230 0x7fdca80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdca7fff640 1 -- 172.21.15.139:0/1637121180 >> v2:172.21.15.143:3300/0 conn(0x7fdca8073230 msgr2=0x7fdca80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdca7fff640 1 --2- 172.21.15.139:0/1637121180 >> v2:172.21.15.143:3300/0 conn(0x7fdca8073230 0x7fdca80736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdca7fff640 1 -- 172.21.15.139:0/1637121180 >> v1:172.21.15.143:6789/0 conn(0x7fdca8074380 legacy=0x7fdca815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.575+0000 7fdca7fff640 1 -- 172.21.15.139:0/1637121180 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca80c97c0 con 0x7fdca8073fa0 2024-04-26T18:23:38.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdca7fff640 1 --2- 172.21.15.139:0/1637121180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca80cab70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009870 tx=0x7fdc9802a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6bcab993e84639 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdca6ffd640 1 -- 172.21.15.139:0/1637121180 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98037070 con 0x7fdca8073fa0 2024-04-26T18:23:38.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdca6ffd640 1 -- 172.21.15.139:0/1637121180 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc98032640 con 0x7fdca8073fa0 2024-04-26T18:23:38.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdca6ffd640 1 -- 172.21.15.139:0/1637121180 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc98032a10 con 0x7fdca8073fa0 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 -- 172.21.15.139:0/1637121180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 msgr2=0x7fdca80cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/1637121180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca80cab70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009870 tx=0x7fdc9802a330 comp rx=0 tx=0).stop 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 -- 172.21.15.139:0/1637121180 shutdown_connections 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/1637121180 >> v2:172.21.15.143:3300/0 conn(0x7fdca8073230 0x7fdca80736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/1637121180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca80cab70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 -- 172.21.15.139:0/1637121180 >> 172.21.15.139:0/1637121180 conn(0x7fdca806c310 msgr2=0x7fdca806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 -- 172.21.15.139:0/1637121180 shutdown_connections 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.576+0000 7fdcae8e3640 1 -- 172.21.15.139:0/1637121180 wait complete. 2024-04-26T18:23:38.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.577+0000 7fdcae8e3640 1 Processor -- start 2024-04-26T18:23:38.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcae8e3640 1 -- start start 2024-04-26T18:23:38.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcae8e3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdca8073230 0x7fdca8158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcae8e3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca8149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcae8e3640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdca8074380 0x7fdca8156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcae8e3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdca80ca2a0 con 0x7fdca8073fa0 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcae8e3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fdca80c9d80 con 0x7fdca8073230 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcae8e3640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fdca80ca420 con 0x7fdca8074380 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdca77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca8149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdca7fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdca8073230 0x7fdca8158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdca77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca8149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:56994/0 (socket says 172.21.15.139:56994) 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdca77fe640 1 -- 172.21.15.139:0/4145948404 learned_addr learned my addr 172.21.15.139:0/4145948404 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.578+0000 7fdcace80640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdca8074380 0x7fdca8156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca77fe640 1 -- 172.21.15.139:0/4145948404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdca8074380 msgr2=0x7fdca8156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca77fe640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdca8074380 0x7fdca8156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca77fe640 1 -- 172.21.15.139:0/4145948404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdca8073230 msgr2=0x7fdca8158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca77fe640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdca8073230 0x7fdca8158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca77fe640 1 -- 172.21.15.139:0/4145948404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca81593f0 con 0x7fdca8073fa0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca77fe640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca8149f50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c470 tx=0x7fdc9c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca4ff9640 1 -- 172.21.15.139:0/4145948404 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0052d0 con 0x7fdca8073fa0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca4ff9640 1 -- 172.21.15.139:0/4145948404 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9c005490 con 0x7fdca8073fa0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca81f1940 con 0x7fdca8073fa0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdca4ff9640 1 -- 172.21.15.139:0/4145948404 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c007260 con 0x7fdca8073fa0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.579+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca815a030 con 0x7fdca8073fa0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.580+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca8076d20 con 0x7fdca8073fa0 2024-04-26T18:23:38.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.581+0000 7fdca4ff9640 1 -- 172.21.15.139:0/4145948404 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc9c007400 con 0x7fdca8073fa0 2024-04-26T18:23:38.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.581+0000 7fdca4ff9640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdc9406c8f0 0x7fdc9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.581+0000 7fdca7fff640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdc9406c8f0 0x7fdc9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.581+0000 7fdca4ff9640 1 -- 172.21.15.139:0/4145948404 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fdc9c08b380 con 0x7fdca8073fa0 2024-04-26T18:23:38.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.582+0000 7fdca7fff640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdc9406c8f0 0x7fdc9406edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc98034000 tx=0x7fdc9802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.586+0000 7fdca4ff9640 1 -- 172.21.15.139:0/4145948404 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc9c058d20 con 0x7fdca8073fa0 2024-04-26T18:23:38.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.798+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdca8071060 con 0x7fdca8073fa0 2024-04-26T18:23:38.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.799+0000 7fdca4ff9640 1 -- 172.21.15.139:0/4145948404 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fdc9c05f020 con 0x7fdca8073fa0 2024-04-26T18:23:38.799 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:23:38.799 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:23:38.799 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.800+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdc9406c8f0 msgr2=0x7fdc9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.800+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdc9406c8f0 0x7fdc9406edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc98034000 tx=0x7fdc9802e000 comp rx=0 tx=0).stop 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.800+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 msgr2=0x7fdca8149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.800+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca8149f50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c470 tx=0x7fdc9c00c930 comp rx=0 tx=0).stop 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 shutdown_connections 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fdc9406c8f0 0x7fdc9406edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fdca8074380 0x7fdca8156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca8073fa0 0x7fdca8149f50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 --2- 172.21.15.139:0/4145948404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdca8073230 0x7fdca8158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 >> 172.21.15.139:0/4145948404 conn(0x7fdca806c310 msgr2=0x7fdca8071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:38.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 shutdown_connections 2024-04-26T18:23:38.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.801+0000 7fdcae8e3640 1 -- 172.21.15.139:0/4145948404 wait complete. 2024-04-26T18:23:38.812 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 85.2 --await-for 42.0' 2024-04-26T18:23:38.812 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 85.2 --await-for 42.0 2024-04-26T18:23:38.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.963+0000 7f1a469bf640 1 Processor -- start 2024-04-26T18:23:38.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.963+0000 7f1a469bf640 1 -- start start 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a469bf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a40159280 0x7f1a4015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a469bf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1a400b1da0 0x7f1a4006c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a469bf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a400ca610 con 0x7f1a400caaf0 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a469bf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4006c850 con 0x7f1a400b1da0 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a469bf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4006ca70 con 0x7f1a40159280 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a40159280 0x7f1a4015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a3f7fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1a400b1da0 0x7f1a4006c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.964+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a40159280 0x7f1a4015bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:43476/0 (socket says 172.21.15.139:43476) 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3ffff640 1 -- 172.21.15.139:0/3112420146 learned_addr learned my addr 172.21.15.139:0/3112420146 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/3112420146 >> v2:172.21.15.143:3300/0 conn(0x7f1a400b1da0 0x7f1a4006c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:35120/0 (socket says 172.21.15.139:35120) 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a44f5c640 1 --1- 172.21.15.139:0/3112420146 >> v1:172.21.15.143:6789/0 conn(0x7f1a400caaf0 0x7f1a40070120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:50122/0 (socket says 172.21.15.139:50122) 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a40159280 msgr2=0x7f1a4015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a40159280 0x7f1a4015bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/3112420146 >> v1:172.21.15.143:6789/0 conn(0x7f1a400caaf0 legacy=0x7f1a40070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/3112420146 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a400cbfa0 con 0x7f1a400b1da0 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3effd640 1 -- 172.21.15.139:0/3112420146 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505414409 0 0) 0x7f1a400ca610 con 0x7f1a400caaf0 2024-04-26T18:23:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.965+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a40159280 0x7f1a4015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:23:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a400b1da0 0x7f1a4006c310 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a340097a0 tx=0x7f1a3402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=924cadea072b6540 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a3effd640 1 -- 172.21.15.139:0/3112420146 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34037070 con 0x7f1a400b1da0 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a3effd640 1 -- 172.21.15.139:0/3112420146 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a34032440 con 0x7f1a400b1da0 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a3effd640 1 -- 172.21.15.139:0/3112420146 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34032810 con 0x7f1a400b1da0 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 -- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a400b1da0 msgr2=0x7f1a4006c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 --2- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a400b1da0 0x7f1a4006c310 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1a340097a0 tx=0x7f1a3402a210 comp rx=0 tx=0).stop 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 -- 172.21.15.139:0/3112420146 shutdown_connections 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 --2- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a400b1da0 0x7f1a4006c310 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 --2- 172.21.15.139:0/3112420146 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a40159280 0x7f1a4015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 -- 172.21.15.139:0/3112420146 >> 172.21.15.139:0/3112420146 conn(0x7f1a400746d0 msgr2=0x7f1a40076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 -- 172.21.15.139:0/3112420146 shutdown_connections 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.966+0000 7f1a469bf640 1 -- 172.21.15.139:0/3112420146 wait complete. 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.967+0000 7f1a469bf640 1 Processor -- start 2024-04-26T18:23:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a469bf640 1 -- start start 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a469bf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a400b1da0 0x7f1a400b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a469bf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a400caaf0 0x7f1a401f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a469bf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a40159280 0x7f1a400b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a469bf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a400caf80 con 0x7f1a400b1da0 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a469bf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1a400cc560 con 0x7f1a40159280 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a469bf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a400cc840 con 0x7f1a400caaf0 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a400b1da0 0x7f1a400b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a3f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a400caaf0 0x7f1a401f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a400b1da0 0x7f1a400b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57008/0 (socket says 172.21.15.139:57008) 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a3ffff640 1 -- 172.21.15.139:0/2581750088 learned_addr learned my addr 172.21.15.139:0/2581750088 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.968+0000 7f1a44f5c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a40159280 0x7f1a400b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/2581750088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a40159280 msgr2=0x7f1a400b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a40159280 0x7f1a400b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a400b1da0 msgr2=0x7f1a400b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a400b1da0 0x7f1a400b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/2581750088 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a400c75a0 con 0x7f1a400caaf0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a400b1da0 0x7f1a400b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a400caaf0 0x7f1a401f5670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a34031000 tx=0x7f1a340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3cff9640 1 -- 172.21.15.139:0/2581750088 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34041030 con 0x7f1a400caaf0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3cff9640 1 -- 172.21.15.139:0/2581750088 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a34030500 con 0x7f1a400caaf0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a401f5bb0 con 0x7f1a400caaf0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a3cff9640 1 -- 172.21.15.139:0/2581750088 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34037040 con 0x7f1a400caaf0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.969+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a400b3830 con 0x7f1a400caaf0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.971+0000 7f1a3cff9640 1 -- 172.21.15.139:0/2581750088 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a34044070 con 0x7f1a400caaf0 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.971+0000 7f1a3cff9640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.971+0000 7f1a3cff9640 1 -- 172.21.15.139:0/2581750088 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1a340ac520 con 0x7f1a400caaf0 2024-04-26T18:23:38.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.971+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.971+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a300113d0 tx=0x7f1a30009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 Processor -- start 2024-04-26T18:23:38.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 -- start start 2024-04-26T18:23:38.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039e5e0 0x5613803dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613803ddae0 0x56138039e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561380301d80 con 0x56138039fb40 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x56138029dc20 con 0x56138039e5e0 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.972+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5613802fdd40 con 0x5613803ddae0 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039e5e0 0x5613803dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57018/0 (socket says 172.21.15.139:57018) 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a3f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613803ddae0 0x56138039e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 -- 172.21.15.139:0/11950260 learned_addr learned my addr 172.21.15.139:0/11950260 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 -- 172.21.15.139:0/11950260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613803ddae0 msgr2=0x56138039e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/11950260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613803ddae0 0x56138039e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 -- 172.21.15.139:0/11950260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039e5e0 msgr2=0x5613803dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/11950260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039e5e0 0x5613803dd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 -- 172.21.15.139:0/11950260 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613800dfd80 con 0x56138039fb40 2024-04-26T18:23:38.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/11950260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1a38001ad0 tx=0x7f1a38001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dd6d6688ffdef8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a25ffb640 1 -- 172.21.15.139:0/11950260 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380077f0 con 0x56138039fb40 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a25ffb640 1 -- 172.21.15.139:0/11950260 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a38018070 con 0x56138039fb40 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.973+0000 7f1a25ffb640 1 -- 172.21.15.139:0/11950260 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380133f0 con 0x56138039fb40 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 -- 172.21.15.139:0/11950260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 msgr2=0x56138039ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 --2- 172.21.15.139:0/11950260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1a38001ad0 tx=0x7f1a38001f90 comp rx=0 tx=0).stop 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 -- 172.21.15.139:0/11950260 shutdown_connections 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 --2- 172.21.15.139:0/11950260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 --2- 172.21.15.139:0/11950260 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5613803ddae0 0x56138039e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 --2- 172.21.15.139:0/11950260 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039e5e0 0x5613803dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 -- 172.21.15.139:0/11950260 >> 172.21.15.139:0/11950260 conn(0x561380365740 msgr2=0x5613803e2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 -- 172.21.15.139:0/11950260 shutdown_connections 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 -- 172.21.15.139:0/11950260 wait complete. 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.974+0000 7f1a497b8740 1 -- start start 2024-04-26T18:23:38.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 1 Processor -- start 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039e5e0 0x5613803dbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039fb40 0x5613803f2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56138039cc20 con 0x56138039e5e0 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x56138029b840 con 0x5613803ddae0 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5613803a0170 con 0x56138039fb40 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a497b8740 10 client.0 _ll_register_callbacks cb 0x56138029f5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039e5e0 0x5613803dbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039e5e0 0x5613803dbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57020/0 (socket says 172.21.15.139:57020) 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a3ffff640 1 -- 172.21.15.139:0/4268159458 learned_addr learned my addr 172.21.15.139:0/4268159458 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039fb40 0x5613803f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.975+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a3ffff640 1 -- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039fb40 msgr2=0x5613803f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039fb40 0x5613803f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a3ffff640 1 -- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 msgr2=0x5613803c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a3ffff640 1 -- 172.21.15.139:0/4268159458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561380140510 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039e5e0 0x5613803dbb50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1a30014f00 tx=0x7f1a300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc85a0755fc90fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a1effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a1effd640 1 -- 172.21.15.139:0/4268159458 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30027030 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a1effd640 1 -- 172.21.15.139:0/4268159458 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1a3000f040 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a38018070 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a1effd640 1 -- 172.21.15.139:0/4268159458 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1a30013cb0 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 10 client.5838 fetch_fsmap learned FSMap version 9 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56137ffd3670 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a1effd640 1 -- 172.21.15.139:0/4268159458 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a38018070 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a1effd640 1 -- 172.21.15.139:0/4268159458 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1a30036080 con 0x56138039e5e0 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 10 client.5838 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 10 client.5838 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 20 client.5838 populate_metadata read hostname 'smithi139' 2024-04-26T18:23:38.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803c58a0 0x5613803c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 4 client.5838 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:23:38.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.976+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56138030f990 con 0x5613803c58a0 2024-04-26T18:23:38.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.977+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803c58a0 0x5613803c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:38.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.977+0000 7f1a1effd640 10 client.5838 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:38.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.977+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803c58a0 0x5613803c5ce0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1240f2c78302988b server_cookie=8d588311a6aa3416 in_seq=0 out_seq=0 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a1effd640 1 -- 172.21.15.139:0/4268159458 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56138030f990 con 0x5613803c58a0 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a1effd640 10 client.5838 handle_command_reply: tid=0 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 client.5838 shutdown 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039e5e0 msgr2=0x5613803dbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039e5e0 0x5613803dbb50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1a30014f00 tx=0x7f1a300046c0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 shutdown_connections 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803c58a0 0x5613803c5ce0 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039fb40 0x5613803f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 --2- 172.21.15.139:0/4268159458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039e5e0 0x5613803dbb50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:38.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a1effd640 0 client.5838 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:38.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.979+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 >> 172.21.15.139:0/4268159458 conn(0x561380365740 msgr2=0x56138039f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:38.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.980+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 shutdown_connections 2024-04-26T18:23:38.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.980+0000 7f1a497b8740 1 -- 172.21.15.139:0/4268159458 wait complete. 2024-04-26T18:23:38.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.980+0000 7f1a497b8740 20 client.5838 trim_cache size 0 max 16384 2024-04-26T18:23:38.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.997+0000 7f1a497b8740 1 Processor -- start 2024-04-26T18:23:38.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.997+0000 7f1a497b8740 1 -- start start 2024-04-26T18:23:38.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x56138039e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:38.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a497b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a402005d0 con 0x56138039fb40 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401ff4b0 con 0x5613803ddae0 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a401fdb10 con 0x56138039e5e0 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57024/0 (socket says 172.21.15.139:57024) 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/3596991713 learned_addr learned my addr 172.21.15.139:0/3596991713 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x56138039e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 msgr2=0x56138039e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x56138039e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 msgr2=0x5613803f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 -- 172.21.15.139:0/3596991713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613803e2990 con 0x56138039fb40 2024-04-26T18:23:39.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a3f7fe640 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1a340764d0 tx=0x7f1a340ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662b2b971fca8fb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a257fa640 1 -- 172.21.15.139:0/3596991713 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34087070 con 0x56138039fb40 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a257fa640 1 -- 172.21.15.139:0/3596991713 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a34082ba0 con 0x56138039fb40 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.998+0000 7f1a257fa640 1 -- 172.21.15.139:0/3596991713 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34078370 con 0x56138039fb40 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 -- 172.21.15.139:0/3596991713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 msgr2=0x56138039ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1a340764d0 tx=0x7f1a340ac040 comp rx=0 tx=0).stop 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 -- 172.21.15.139:0/3596991713 shutdown_connections 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5613803ddae0 0x5613803f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56138039fb40 0x56138039ef00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 --2- 172.21.15.139:0/3596991713 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x56138039e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 -- 172.21.15.139:0/3596991713 >> 172.21.15.139:0/3596991713 conn(0x561380365740 msgr2=0x5613803942c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 -- 172.21.15.139:0/3596991713 shutdown_connections 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:38.999+0000 7f1a497b8740 1 -- 172.21.15.139:0/3596991713 wait complete. 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 -- start start 2024-04-26T18:23:39.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 Processor -- start 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x5613804535a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039fb40 0x561380459ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613803ddae0 0x5613803debb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401fe060 con 0x5613803ddae0 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401fede0 con 0x56138039fb40 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.000+0000 7f1a497b8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1a401fe710 con 0x56138039e5e0 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a497b8740 10 client.0 _ll_register_callbacks cb 0x7f1a30009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613803ddae0 0x5613803debb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613803ddae0 0x5613803debb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57032/0 (socket says 172.21.15.139:57032) 2024-04-26T18:23:39.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 -- 172.21.15.139:0/2077504720 learned_addr learned my addr 172.21.15.139:0/2077504720 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a3f7fe640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039fb40 0x561380459ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x5613804535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 -- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 msgr2=0x5613804535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x5613804535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 -- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039fb40 msgr2=0x561380459ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039fb40 0x561380459ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 -- 172.21.15.139:0/2077504720 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613803c8bc0 con 0x5613803ddae0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a44f5c640 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613803ddae0 0x5613803debb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1a38015040 tx=0x7f1a38007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14adce00ead3bcc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a1effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a1effd640 1 -- 172.21.15.139:0/2077504720 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3801f9f0 con 0x5613803ddae0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a1effd640 1 -- 172.21.15.139:0/2077504720 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1a3801fb90 con 0x5613803ddae0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a34082ba0 con 0x5613803ddae0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a1effd640 1 -- 172.21.15.139:0/2077504720 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1a38031050 con 0x5613803ddae0 2024-04-26T18:23:39.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a497b8740 10 client.5844 fetch_fsmap learned FSMap version 9 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5613803bede0 con 0x5613803ddae0 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.001+0000 7f1a1effd640 1 -- 172.21.15.139:0/2077504720 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a34082ba0 con 0x5613803ddae0 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a1effd640 1 -- 172.21.15.139:0/2077504720 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f1a38034020 con 0x5613803ddae0 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a497b8740 10 client.5844 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a497b8740 10 client.5844 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a497b8740 20 client.5844 populate_metadata read hostname 'smithi139' 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a497b8740 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803df0f0 0x56138045c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a497b8740 4 client.5844 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.2, "await_for": 42.0}] 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.2, "await_for": 42.0}) -- 0x561380309800 con 0x5613803df0f0 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803df0f0 0x56138045c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a3ffff640 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803df0f0 0x56138045c8c0 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f8a2e7613c9817 server_cookie=46e96e84f30950c8 in_seq=0 out_seq=0 2024-04-26T18:23:39.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:39.002+0000 7f1a1effd640 10 client.5844 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.549+0000 7f1a1effd640 1 -- 172.21.15.139:0/2077504720 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x561380309800 con 0x5613803df0f0 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.549+0000 7f1a1effd640 10 client.5844 handle_command_reply: tid=0 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.549+0000 7f1a497b8740 1 client.5844 shutdown 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613803ddae0 msgr2=0x5613803debb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613803ddae0 0x5613803debb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1a38015040 tx=0x7f1a38007f90 comp rx=0 tx=0).stop 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 shutdown_connections 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5613803ddae0 0x5613803debb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x56138039fb40 0x561380459ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5613803df0f0 0x56138045c8c0 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 --2- 172.21.15.139:0/2077504720 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x56138039e5e0 0x5613804535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a1effd640 0 client.5844 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 >> 172.21.15.139:0/2077504720 conn(0x561380365740 msgr2=0x5613803ef0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 shutdown_connections 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 1 -- 172.21.15.139:0/2077504720 wait complete. 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.550+0000 7f1a497b8740 20 client.5844 trim_cache size 0 max 16384 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:23:41.552 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 82, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "2cf339d3": { 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 82, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 85.2, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:23:41.553 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:23:41.554 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a2c06c8f0 msgr2=0x7f1a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a300113d0 tx=0x7f1a30009240 comp rx=0 tx=0).stop 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a400caaf0 msgr2=0x7f1a401f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a400caaf0 0x7f1a401f5670 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a34031000 tx=0x7f1a340046c0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 shutdown_connections 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f1a2c06c8f0 0x7f1a2c06edb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1a40159280 0x7f1a400b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f1a400caaf0 0x7f1a401f5670 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 --2- 172.21.15.139:0/2581750088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a400b1da0 0x7f1a400b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:23:41.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 >> 172.21.15.139:0/2581750088 conn(0x7f1a400746d0 msgr2=0x7f1a400cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:23:41.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 shutdown_connections 2024-04-26T18:23:41.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:23:41.551+0000 7f1a469bf640 1 -- 172.21.15.139:0/2581750088 wait complete. 2024-04-26T18:23:41.562 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2cf339d3', quiesce took 3.1 seconds. Will release after: 25.2 2024-04-26T18:24:00.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:24:00.820 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:24:06.763 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:24:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.873+0000 7f6468d0a640 1 Processor -- start 2024-04-26T18:24:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.873+0000 7f6468d0a640 1 -- start start 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6468d0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 0x7f64640caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6468d0a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6464073090 con 0x7f64640c8620 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6468d0a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64640c8d80 con 0x7f6464155e30 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6468d0a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f64640c8aa0 con 0x7f64640ca600 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f64640c8620 0x7f64640cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58592/0 (socket says 172.21.15.139:58592) 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 -- 172.21.15.139:0/1596702858 learned_addr learned my addr 172.21.15.139:0/1596702858 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6462d9d640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 0x7f64640caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760554753 0 0) 0x7f6464073090 con 0x7f64640c8620 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f644c003520 con 0x7f64640c8620 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3770703160 0 0) 0x7f644c003520 con 0x7f64640c8620 2024-04-26T18:24:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 msgr2=0x7f64640caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 0x7f64640caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 >> v1:172.21.15.143:6789/0 conn(0x7f6464155e30 legacy=0x7f6464072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6464073430 con 0x7f64640c8620 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f6458001690 con 0x7f64640c8620 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 >> v1:172.21.15.139:6789/0 conn(0x7f64640c8620 legacy=0x7f64640cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 0x7f644c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f644c003f60 0x7f644c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c004d40 0x7f644c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f64640c8aa0 con 0x7f644c003f60 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f644c00bb30 con 0x7f644c004d40 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f644c00bd30 con 0x7f64640ca600 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f644c003f60 0x7f644c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f646259c640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 0x7f644c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6462d9d640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c004d40 0x7f644c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 -- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 msgr2=0x7f644c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64640ca600 0x7f644c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 -- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c004d40 msgr2=0x7f644c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c004d40 0x7f644c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 -- 172.21.15.139:0/1596702858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c003520 con 0x7f644c003f60 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.875+0000 7f6461d9b640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f644c003f60 0x7f644c004800 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f645800c210 tx=0x7f644c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119982f424630a3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458007d30 con 0x7f644c003f60 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64580058d0 con 0x7f644c003f60 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f646159a640 1 -- 172.21.15.139:0/1596702858 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458005ca0 con 0x7f644c003f60 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f6468d0a640 1 -- 172.21.15.139:0/1596702858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f644c003f60 msgr2=0x7f644c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f6468d0a640 1 --2- 172.21.15.139:0/1596702858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f644c003f60 0x7f644c004800 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f645800c210 tx=0x7f644c005830 comp rx=0 tx=0).stop 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f6462d9d640 1 -- 172.21.15.139:0/1596702858 reap_dead start 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f6468d0a640 1 -- 172.21.15.139:0/1596702858 shutdown_connections 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f6468d0a640 1 -- 172.21.15.139:0/1596702858 >> 172.21.15.139:0/1596702858 conn(0x7f646406e570 msgr2=0x7f646406e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f6468d0a640 1 -- 172.21.15.139:0/1596702858 shutdown_connections 2024-04-26T18:24:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.876+0000 7f6468d0a640 1 -- 172.21.15.139:0/1596702858 wait complete. 2024-04-26T18:24:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 Processor -- start 2024-04-26T18:24:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 -- start start 2024-04-26T18:24:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c003f60 0x7f64640cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64641490c0 0x7f64641f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64641f53f0 0x7f6464148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6464073cd0 con 0x7f64641490c0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f64640739f0 con 0x7f644c003f60 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6468d0a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6464156210 con 0x7f64641f53f0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6461d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64641490c0 0x7f64641f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6461d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64641490c0 0x7f64641f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37560/0 (socket says 172.21.15.139:37560) 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.878+0000 7f6461d9b640 1 -- 172.21.15.139:0/2504038521 learned_addr learned my addr 172.21.15.139:0/2504038521 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f646259c640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c003f60 0x7f64640cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6462d9d640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64641f53f0 0x7f6464148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6461d9b640 1 -- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64641f53f0 msgr2=0x7f6464148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6461d9b640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64641f53f0 0x7f6464148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6461d9b640 1 -- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c003f60 msgr2=0x7f64640cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6461d9b640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c003f60 0x7f64640cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6461d9b640 1 -- 172.21.15.139:0/2504038521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6464153190 con 0x7f64641490c0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6462d9d640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64641f53f0 0x7f6464148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6461d9b640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64641490c0 0x7f64641f4eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f64580058a0 tx=0x7f646415bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6452ffd640 1 -- 172.21.15.139:0/2504038521 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458038040 con 0x7f64641490c0 2024-04-26T18:24:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6452ffd640 1 -- 172.21.15.139:0/2504038521 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6458042070 con 0x7f64641490c0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6452ffd640 1 -- 172.21.15.139:0/2504038521 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458007290 con 0x7f64641490c0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64641f18c0 con 0x7f64641490c0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.879+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641f1b40 con 0x7f64641490c0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.880+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64640cd920 con 0x7f64641490c0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.881+0000 7f6452ffd640 1 -- 172.21.15.139:0/2504038521 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6458007430 con 0x7f64641490c0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.881+0000 7f6452ffd640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f644406c920 0x7f644406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.881+0000 7f6452ffd640 1 -- 172.21.15.139:0/2504038521 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f64580abf70 con 0x7f64641490c0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.881+0000 7f646259c640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f644406c920 0x7f644406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.881+0000 7f646259c640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f644406c920 0x7f644406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f64540017e0 tx=0x7f6454009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:06.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:06.885+0000 7f6452ffd640 1 -- 172.21.15.139:0/2504038521 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64640cd920 con 0x7f64641490c0 2024-04-26T18:24:07.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.100+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64641f57d0 con 0x7f64641490c0 2024-04-26T18:24:07.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.100+0000 7f6452ffd640 1 -- 172.21.15.139:0/2504038521 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f64641f57d0 con 0x7f64641490c0 2024-04-26T18:24:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:24:07.101 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:24:07.101 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:24:07.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.102+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f644406c920 msgr2=0x7f644406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.102+0000 7f6468d0a640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f644406c920 0x7f644406ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f64540017e0 tx=0x7f6454009040 comp rx=0 tx=0).stop 2024-04-26T18:24:07.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.102+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64641490c0 msgr2=0x7f64641f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.102+0000 7f6468d0a640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64641490c0 0x7f64641f4eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f64580058a0 tx=0x7f646415bb80 comp rx=0 tx=0).stop 2024-04-26T18:24:07.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 shutdown_connections 2024-04-26T18:24:07.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f644406c920 0x7f644406ede0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f64641f53f0 0x7f6464148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64641490c0 0x7f64641f4eb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 --2- 172.21.15.139:0/2504038521 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f644c003f60 0x7f64640cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 >> 172.21.15.139:0/2504038521 conn(0x7f646406e570 msgr2=0x7f64640c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:07.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 shutdown_connections 2024-04-26T18:24:07.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.103+0000 7f6468d0a640 1 -- 172.21.15.139:0/2504038521 wait complete. 2024-04-26T18:24:07.114 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 2cf339d3 --release --await' 2024-04-26T18:24:07.114 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 2cf339d3 --release --await 2024-04-26T18:24:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.218+0000 7f7846119640 1 Processor -- start 2024-04-26T18:24:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.218+0000 7f7846119640 1 -- start start 2024-04-26T18:24:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f7846119640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f78400c7d90 0x7f7840070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f7846119640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7840158c00 con 0x7f78400c8db0 2024-04-26T18:24:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f7846119640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78400c2930 con 0x7f78400c9490 2024-04-26T18:24:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f7846119640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f78400c3240 con 0x7f78400c7d90 2024-04-26T18:24:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f783ffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f78400c7d90 0x7f7840070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f783f7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f78400c8db0 0x7f78400ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:58596/0 (socket says 172.21.15.139:58596) 2024-04-26T18:24:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f783f7fe640 1 -- 172.21.15.139:0/3773505244 learned_addr learned my addr 172.21.15.139:0/3773505244 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:24:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f783ffff640 1 -- 172.21.15.139:0/3773505244 >> v1:172.21.15.143:6789/0 conn(0x7f78400c9490 legacy=0x7f784006fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f783ffff640 1 -- 172.21.15.139:0/3773505244 >> v1:172.21.15.139:6789/0 conn(0x7f78400c8db0 legacy=0x7f78400ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f783ffff640 1 -- 172.21.15.139:0/3773505244 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7840158ec0 con 0x7f78400c7d90 2024-04-26T18:24:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.219+0000 7f783e7fc640 1 -- 172.21.15.139:0/3773505244 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658482506 0 0) 0x7f7840158c00 con 0x7f78400c8db0 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f783ffff640 1 --2- 172.21.15.139:0/3773505244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c7d90 0x7f7840070130 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7838009d90 tx=0x7f783802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bddd47ff1df4803 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f783e7fc640 1 -- 172.21.15.139:0/3773505244 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838007740 con 0x7f78400c7d90 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f783e7fc640 1 -- 172.21.15.139:0/3773505244 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78380078e0 con 0x7f78400c7d90 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f783e7fc640 1 -- 172.21.15.139:0/3773505244 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838007cb0 con 0x7f78400c7d90 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f7846119640 1 -- 172.21.15.139:0/3773505244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c7d90 msgr2=0x7f7840070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f7846119640 1 --2- 172.21.15.139:0/3773505244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c7d90 0x7f7840070130 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7838009d90 tx=0x7f783802a730 comp rx=0 tx=0).stop 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f7846119640 1 -- 172.21.15.139:0/3773505244 shutdown_connections 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f7846119640 1 --2- 172.21.15.139:0/3773505244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c7d90 0x7f7840070130 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f7846119640 1 -- 172.21.15.139:0/3773505244 >> 172.21.15.139:0/3773505244 conn(0x7f784006dd40 msgr2=0x7f784006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f7846119640 1 -- 172.21.15.139:0/3773505244 shutdown_connections 2024-04-26T18:24:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.220+0000 7f7846119640 1 -- 172.21.15.139:0/3773505244 wait complete. 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.221+0000 7f7846119640 1 Processor -- start 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f7846119640 1 -- start start 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f7846119640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78400c7d90 0x7f784014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f7846119640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78400c8db0 0x7f78401f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f7846119640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c9490 0x7f78401f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f7846119640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78400c8660 con 0x7f78400c9490 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f7846119640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f78400c2ed0 con 0x7f78400c8db0 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f7846119640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f78400cd6a0 con 0x7f78400c7d90 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f783ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c9490 0x7f78401f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f783ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c9490 0x7f78401f0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37578/0 (socket says 172.21.15.139:37578) 2024-04-26T18:24:07.224 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.222+0000 7f783ffff640 1 -- 172.21.15.139:0/876238231 learned_addr learned my addr 172.21.15.139:0/876238231 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783f7fe640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78400c7d90 0x7f784014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783ffff640 1 -- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78400c7d90 msgr2=0x7f784014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783ffff640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78400c7d90 0x7f784014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783effd640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78400c8db0 0x7f78401f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783ffff640 1 -- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78400c8db0 msgr2=0x7f78401f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783ffff640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78400c8db0 0x7f78401f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783ffff640 1 -- 172.21.15.139:0/876238231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784014b1f0 con 0x7f78400c9490 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f783ffff640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c9490 0x7f78401f0aa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7838009d90 tx=0x7f7838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f7827fff640 1 -- 172.21.15.139:0/876238231 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838040070 con 0x7f78400c9490 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f7827fff640 1 -- 172.21.15.139:0/876238231 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7838031c40 con 0x7f78400c9490 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f7827fff640 1 -- 172.21.15.139:0/876238231 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838003990 con 0x7f78400c9490 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78401e22c0 con 0x7f78400c9490 2024-04-26T18:24:07.225 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.223+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78401574e0 con 0x7f78400c9490 2024-04-26T18:24:07.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.224+0000 7f7827fff640 1 -- 172.21.15.139:0/876238231 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7838039040 con 0x7f78400c9490 2024-04-26T18:24:07.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.225+0000 7f7827fff640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f782c06c8f0 0x7f782c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.225+0000 7f7827fff640 1 -- 172.21.15.139:0/876238231 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f78380acff0 con 0x7f78400c9490 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.225+0000 7f783f7fe640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f782c06c8f0 0x7f782c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.225+0000 7f783f7fe640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f782c06c8f0 0x7f782c06edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7830007fd0 tx=0x7f7830009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.226+0000 7f7848e3b740 1 Processor -- start 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.226+0000 7f7848e3b740 1 -- start start 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51374b0 0x55a6c5176470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51769b0 0x55a6c5137890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f7848e3b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a6c509c040 con 0x55a6c5138a10 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a6c5037b60 con 0x55a6c51374b0 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a6c5098000 con 0x55a6c51769b0 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5137dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37594/0 (socket says 172.21.15.139:37594) 2024-04-26T18:24:07.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 -- 172.21.15.139:0/2603176650 learned_addr learned my addr 172.21.15.139:0/2603176650 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783f7fe640 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51374b0 0x55a6c5176470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783effd640 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51769b0 0x55a6c5137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 -- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51769b0 msgr2=0x55a6c5137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51769b0 0x55a6c5137890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 -- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51374b0 msgr2=0x55a6c5176470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51374b0 0x55a6c5176470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 -- 172.21.15.139:0/2603176650 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6c502c9c0 con 0x55a6c5138a10 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783f7fe640 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51374b0 0x55a6c5176470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783effd640 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51769b0 0x55a6c5137890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f783ffff640 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5137dd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7838076d70 tx=0x7f783807a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6654de4982498ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f78257fa640 1 -- 172.21.15.139:0/2603176650 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838049070 con 0x55a6c5138a10 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f78257fa640 1 -- 172.21.15.139:0/2603176650 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783807fe50 con 0x55a6c5138a10 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.227+0000 7f78257fa640 1 -- 172.21.15.139:0/2603176650 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838007790 con 0x55a6c5138a10 2024-04-26T18:24:07.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 -- 172.21.15.139:0/2603176650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 msgr2=0x55a6c5137dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5137dd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7838076d70 tx=0x7f783807a9d0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 -- 172.21.15.139:0/2603176650 shutdown_connections 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5137dd0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51769b0 0x55a6c5137890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2603176650 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51374b0 0x55a6c5176470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 -- 172.21.15.139:0/2603176650 >> 172.21.15.139:0/2603176650 conn(0x55a6c50fe930 msgr2=0x55a6c517b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 -- 172.21.15.139:0/2603176650 shutdown_connections 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.228+0000 7f7848e3b740 1 -- 172.21.15.139:0/2603176650 wait complete. 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 -- start start 2024-04-26T18:24:07.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 Processor -- start 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c5132850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5188040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 0x55a6c51618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a6c5135af0 con 0x55a6c5138a10 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a6c50354f0 con 0x55a6c51769b0 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a6c5139040 con 0x55a6c51374b0 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f7848e3b740 10 client.0 _ll_register_callbacks cb 0x55a6c5092c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.229+0000 7f783effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5188040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5188040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37610/0 (socket says 172.21.15.139:37610) 2024-04-26T18:24:07.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 -- 172.21.15.139:0/2859194004 learned_addr learned my addr 172.21.15.139:0/2859194004 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783f7fe640 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c5132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783ffff640 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 0x55a6c51618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 -- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 msgr2=0x55a6c5132850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c5132850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 -- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 msgr2=0x55a6c51618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 0x55a6c51618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 -- 172.21.15.139:0/2859194004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6c4dad920 con 0x55a6c5138a10 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f783effd640 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5188040 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f78401e2050 tx=0x7f783400d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde467af6519f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f781e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f781e7fc640 1 -- 172.21.15.139:0/2859194004 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834016070 con 0x55a6c5138a10 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f781e7fc640 1 -- 172.21.15.139:0/2859194004 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7834012660 con 0x55a6c5138a10 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f783807fe50 con 0x55a6c5138a10 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f781e7fc640 1 -- 172.21.15.139:0/2859194004 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7834021050 con 0x55a6c5138a10 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f7848e3b740 10 client.5865 fetch_fsmap learned FSMap version 9 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a6c4e79d30 con 0x55a6c5138a10 2024-04-26T18:24:07.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.230+0000 7f781e7fc640 1 -- 172.21.15.139:0/2859194004 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783807fe50 con 0x55a6c5138a10 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f781e7fc640 1 -- 172.21.15.139:0/2859194004 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7834024020 con 0x55a6c5138a10 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f7848e3b740 10 client.5865 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f7848e3b740 10 client.5865 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f7848e3b740 20 client.5865 populate_metadata read hostname 'smithi139' 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c5161f70 0x55a6c51736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f7848e3b740 4 client.5865 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6c506fa00 con 0x55a6c5161f70 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f783f7fe640 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c5161f70 0x55a6c51736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f781e7fc640 10 client.5865 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.231+0000 7f783f7fe640 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c5161f70 0x55a6c51736f0 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ab386f835fb388 server_cookie=a3738d2360a2ed5 in_seq=0 out_seq=0 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f781e7fc640 1 -- 172.21.15.139:0/2859194004 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a6c506fa00 con 0x55a6c5161f70 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f781e7fc640 10 client.5865 handle_command_reply: tid=0 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 client.5865 shutdown 2024-04-26T18:24:07.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 msgr2=0x55a6c5188040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5188040 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f78401e2050 tx=0x7f783400d590 comp rx=0 tx=0).stop 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 shutdown_connections 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 0x55a6c51618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c5188040 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c5161f70 0x55a6c51736f0 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 --2- 172.21.15.139:0/2859194004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c5132850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 >> 172.21.15.139:0/2859194004 conn(0x55a6c50fe930 msgr2=0x55a6c5130e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f781e7fc640 0 client.5865 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 shutdown_connections 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 1 -- 172.21.15.139:0/2859194004 wait complete. 2024-04-26T18:24:07.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.232+0000 7f7848e3b740 20 client.5865 trim_cache size 0 max 16384 2024-04-26T18:24:07.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 Processor -- start 2024-04-26T18:24:07.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 -- start start 2024-04-26T18:24:07.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c51749e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 0x55a6c519b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78401fc2f0 con 0x55a6c5138a10 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f78401fb1d0 con 0x55a6c51769b0 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f78401f9760 con 0x55a6c51374b0 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c51749e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c51749e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37624/0 (socket says 172.21.15.139:37624) 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 -- 172.21.15.139:0/593666041 learned_addr learned my addr 172.21.15.139:0/593666041 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 -- 172.21.15.139:0/593666041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 msgr2=0x55a6c51744a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 --2- 172.21.15.139:0/593666041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 -- 172.21.15.139:0/593666041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 msgr2=0x55a6c519b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 --2- 172.21.15.139:0/593666041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 0x55a6c519b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 -- 172.21.15.139:0/593666041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6c516eb00 con 0x55a6c5138a10 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f783effd640 1 --2- 172.21.15.139:0/593666041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c51749e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f783400daf0 tx=0x7f7834012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73a2408174241a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7824ff9640 1 -- 172.21.15.139:0/593666041 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834016070 con 0x55a6c5138a10 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7824ff9640 1 -- 172.21.15.139:0/593666041 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783400b040 con 0x55a6c5138a10 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.250+0000 7f7824ff9640 1 -- 172.21.15.139:0/593666041 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834004260 con 0x55a6c5138a10 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 -- 172.21.15.139:0/593666041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 msgr2=0x55a6c51749e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 --2- 172.21.15.139:0/593666041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c51749e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f783400daf0 tx=0x7f7834012000 comp rx=0 tx=0).stop 2024-04-26T18:24:07.252 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 -- 172.21.15.139:0/593666041 shutdown_connections 2024-04-26T18:24:07.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 --2- 172.21.15.139:0/593666041 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c51769b0 0x55a6c519b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 --2- 172.21.15.139:0/593666041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c5138a10 0x55a6c51749e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 --2- 172.21.15.139:0/593666041 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 -- 172.21.15.139:0/593666041 >> 172.21.15.139:0/593666041 conn(0x55a6c50fe930 msgr2=0x55a6c5132850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:07.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 -- 172.21.15.139:0/593666041 shutdown_connections 2024-04-26T18:24:07.253 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.251+0000 7f7848e3b740 1 -- 172.21.15.139:0/593666041 wait complete. 2024-04-26T18:24:07.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.252+0000 7f7848e3b740 1 -- start start 2024-04-26T18:24:07.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.252+0000 7f7848e3b740 1 Processor -- start 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.252+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51f5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.252+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c5138a10 0x55a6c515ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.252+0000 7f7848e3b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c51769b0 0x55a6c51eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f7848e3b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78401f9db0 con 0x55a6c51769b0 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f78401fab00 con 0x55a6c5138a10 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f7848e3b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f78401fa430 con 0x55a6c51374b0 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f7848e3b740 10 client.0 _ll_register_callbacks cb 0x7f7834006de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c51769b0 0x55a6c51eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c5138a10 0x55a6c515ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:36272/0 (socket says 172.21.15.139:36272) 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783effd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c5138a10 0x55a6c515ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:56812/0 (socket says 172.21.15.139:56812) 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 -- 172.21.15.139:0/3895716698 learned_addr learned my addr 172.21.15.139:0/3895716698 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 -- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c5138a10 msgr2=0x55a6c515ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c5138a10 0x55a6c515ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.255 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 -- 172.21.15.139:0/3895716698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c51769b0 msgr2=0x55a6c51eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:07.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c51769b0 0x55a6c51eb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 -- 172.21.15.139:0/3895716698 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a6c515aec0 con 0x55a6c51374b0 2024-04-26T18:24:07.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f783f7fe640 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51f5810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7830000f60 tx=0x7f7830000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5394d426519662f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:07.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.253+0000 7f781e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.143:3301/0 2024-04-26T18:24:07.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.256+0000 7f781e7fc640 1 -- 172.21.15.139:0/3895716698 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783000de20 con 0x55a6c51374b0 2024-04-26T18:24:07.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.256+0000 7f781e7fc640 1 -- 172.21.15.139:0/3895716698 <== mon.2 v2:172.21.15.143:3301/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7830027af0 con 0x55a6c51374b0 2024-04-26T18:24:07.256 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.256+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f783400b040 con 0x55a6c51374b0 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f781e7fc640 1 -- 172.21.15.139:0/3895716698 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7830027cf0 con 0x55a6c51374b0 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 10 client.5291 fetch_fsmap learned FSMap version 9 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a6c5132060 con 0x55a6c51374b0 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f781e7fc640 1 -- 172.21.15.139:0/3895716698 <== mon.2 v2:172.21.15.143:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783400b040 con 0x55a6c51374b0 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f781e7fc640 1 -- 172.21.15.139:0/3895716698 <== mon.2 v2:172.21.15.143:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f783002f070 con 0x55a6c51374b0 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 10 client.5291 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 10 client.5291 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 20 client.5291 populate_metadata read hostname 'smithi139' 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c518ad10 0x55a6c51eb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 4 client.5291 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2cf339d3", "release": true, "await": true}] 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2cf339d3", "release": true, "await": true}) -- 0x55a6c516f730 con 0x55a6c518ad10 2024-04-26T18:24:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.257+0000 7f783effd640 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c518ad10 0x55a6c51eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:07.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f783effd640 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c518ad10 0x55a6c51eb940 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd008f29ab6f5353 server_cookie=192e2bca67c1a384 in_seq=0 out_seq=0 2024-04-26T18:24:07.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f781e7fc640 10 client.5291 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f781e7fc640 1 -- 172.21.15.139:0/3895716698 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55a6c516f730 con 0x55a6c518ad10 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f781e7fc640 10 client.5291 handle_command_reply: tid=0 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 client.5291 shutdown 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 msgr2=0x55a6c51f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51f5810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7830000f60 tx=0x7f7830000ed0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 shutdown_connections 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a6c51769b0 0x55a6c51eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a6c5138a10 0x55a6c515ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a6c518ad10 0x55a6c51eb940 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 --2- 172.21.15.139:0/3895716698 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a6c51374b0 0x55a6c51f5810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f781e7fc640 0 client.5291 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.258+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 >> 172.21.15.139:0/3895716698 conn(0x55a6c50fe930 msgr2=0x55a6c5131040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 shutdown_connections 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7848e3b740 1 -- 172.21.15.139:0/3895716698 wait complete. 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7848e3b740 20 client.5291 trim_cache size 0 max 16384 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 84, 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "2cf339d3": { 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 84, 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:24:07.261 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 85.2, 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:07.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:07.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:07.263 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:24:07.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f782c06c8f0 msgr2=0x7f782c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f782c06c8f0 0x7f782c06edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7830007fd0 tx=0x7f7830009040 comp rx=0 tx=0).stop 2024-04-26T18:24:07.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c9490 msgr2=0x7f78401f0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c9490 0x7f78401f0aa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7838009d90 tx=0x7f7838004a40 comp rx=0 tx=0).stop 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 shutdown_connections 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f782c06c8f0 0x7f782c06edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78400c9490 0x7f78401f0aa0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f78400c8db0 0x7f78401f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 --2- 172.21.15.139:0/876238231 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78400c7d90 0x7f784014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 >> 172.21.15.139:0/876238231 conn(0x7f784006dd40 msgr2=0x7f784006e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 shutdown_connections 2024-04-26T18:24:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:07.259+0000 7f7846119640 1 -- 172.21.15.139:0/876238231 wait complete. 2024-04-26T18:24:07.270 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2cf339d3', seconds elapsed: 28.8 2024-04-26T18:24:09.596 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 30% (43/143) Updating files: 31% (45/143) Updating files: 32% (46/143) Updating files: 33% (48/143) Updating files: 34% (49/143) Updating files: 35% (51/143) Updating files: 36% (52/143) Updating files: 37% (53/143) Updating files: 38% (55/143) Updating files: 39% (56/143) Updating files: 40% (58/143) Updating files: 41% (59/143) Updating files: 42% (61/143) Updating files: 43% (62/143) Updating files: 44% (63/143) Updating files: 45% (65/143) Updating files: 46% (66/143) Updating files: 47% (68/143) Updating files: 48% (69/143) Updating files: 49% (71/143) Updating files: 50% (72/143) Updating files: 51% (73/143) Updating files: 52% (75/143) Updating files: 53% (76/143) Updating files: 54% (78/143) Updating files: 55% (79/143) Updating files: 56% (81/143) Updating files: 57% (82/143) Updating files: 58% (83/143) Updating files: 59% (85/143) Updating files: 60% (86/143) Updating files: 61% (88/143) Updating files: 62% (89/143) Updating files: 63% (91/143) Updating files: 64% (92/143) Updating files: 65% (93/143) Updating files: 66% (95/143) Updating files: 67% (96/143) Updating files: 68% (98/143) Updating files: 69% (99/143) Updating files: 70% (101/143) Updating files: 71% (102/143) Updating files: 72% (103/143) Updating files: 73% (105/143) Updating files: 74% (106/143) Updating files: 75% (108/143) Updating files: 76% (109/143) Updating files: 77% (111/143) Updating files: 78% (112/143) Updating files: 79% (113/143) Updating files: 80% (115/143) Updating files: 81% (116/143) Updating files: 82% (118/143) Updating files: 83% (119/143) Updating files: 84% (121/143) Updating files: 85% (122/143) Updating files: 86% (123/143) Updating files: 87% (125/143) Updating files: 88% (126/143) Updating files: 89% (128/143) Updating files: 90% (129/143) Updating files: 91% (131/143) Updating files: 92% (132/143) Updating files: 93% (133/143) Updating files: 94% (135/143) Updating files: 95% (136/143) Updating files: 96% (138/143) Updating files: 97% (139/143) Updating files: 98% (141/143) Updating files: 99% (142/143) Updating files: 100% (143/143) Updating files: 100% (143/143), done. 2024-04-26T18:24:09.699 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 42e06c12db6 v0.64 2024-04-26T18:24:09.727 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.64 2024-04-26T18:24:09.739 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:24:09.739 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 65 -eq 48 ']' 2024-04-26T18:24:09.739 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.65 2024-04-26T18:24:09.739 INFO:tasks.workunit.client.0.smithi139.stdout:v0.65 2024-04-26T18:24:09.739 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.65 2024-04-26T18:24:09.740 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.65 2024-04-26T18:24:26.191 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 4% (10/203) Updating files: 5% (11/203) Updating files: 6% (13/203) Updating files: 7% (15/203) Updating files: 8% (17/203) Updating files: 9% (19/203) Updating files: 10% (21/203) Updating files: 11% (23/203) Updating files: 12% (25/203) Updating files: 13% (27/203) Updating files: 14% (29/203) Updating files: 15% (31/203) Updating files: 16% (33/203) Updating files: 17% (35/203) Updating files: 18% (37/203) Updating files: 19% (39/203) Updating files: 20% (41/203) Updating files: 21% (43/203) Updating files: 22% (45/203) Updating files: 23% (47/203) Updating files: 24% (49/203) Updating files: 25% (51/203) Updating files: 26% (53/203) Updating files: 27% (55/203) Updating files: 28% (57/203) Updating files: 29% (59/203) Updating files: 30% (61/203) Updating files: 31% (63/203) Updating files: 32% (65/203) Updating files: 33% (67/203) Updating files: 34% (70/203) Updating files: 35% (72/203) Updating files: 36% (74/203) Updating files: 37% (76/203) Updating files: 38% (78/203) Updating files: 39% (80/203) Updating files: 40% (82/203) Updating files: 41% (84/203) Updating files: 42% (86/203) Updating files: 43% (88/203) Updating files: 44% (90/203) Updating files: 45% (92/203) Updating files: 46% (94/203) Updating files: 47% (96/203) Updating files: 48% (98/203) Updating files: 49% (100/203) Updating files: 50% (102/203) Updating files: 51% (104/203) Updating files: 52% (106/203) Updating files: 53% (108/203) Updating files: 54% (110/203) Updating files: 55% (112/203) Updating files: 56% (114/203) Updating files: 57% (116/203) Updating files: 58% (118/203) Updating files: 59% (120/203) Updating files: 60% (122/203) Updating files: 61% (124/203) Updating files: 62% (126/203) Updating files: 63% (128/203) Updating files: 64% (130/203) Updating files: 65% (132/203) Updating files: 66% (134/203) Updating files: 67% (137/203) Updating files: 68% (139/203) Updating files: 69% (141/203) Updating files: 70% (143/203) Updating files: 71% (145/203) Updating files: 72% (147/203) Updating files: 73% (149/203) Updating files: 74% (151/203) Updating files: 75% (153/203) Updating files: 76% (155/203) Updating files: 77% (157/203) Updating files: 78% (159/203) Updating files: 79% (161/203) Updating files: 80% (163/203) Updating files: 81% (165/203) Updating files: 82% (167/203) Updating files: 83% (169/203) Updating files: 84% (171/203) Updating files: 85% (173/203) Updating files: 86% (175/203) Updating files: 87% (177/203) Updating files: 88% (179/203) Updating files: 89% (181/203) Updating files: 90% (183/203) Updating files: 91% (185/203) Updating files: 92% (187/203) Updating files: 93% (189/203) Updating files: 94% (191/203) Updating files: 95% (193/203) Updating files: 96% (195/203) Updating files: 97% (197/203) Updating files: 98% (199/203) Updating files: 99% (201/203) Updating files: 100% (203/203) Updating files: 100% (203/203), done. 2024-04-26T18:24:26.231 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at c2d517ef966 v0.65 2024-04-26T18:24:26.232 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.65 2024-04-26T18:24:26.270 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:24:26.270 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 66 -eq 48 ']' 2024-04-26T18:24:26.270 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.66 2024-04-26T18:24:26.270 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.66 2024-04-26T18:24:26.270 INFO:tasks.workunit.client.0.smithi139.stdout:v0.66 2024-04-26T18:24:26.270 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.66 2024-04-26T18:24:28.156 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 43% (66/152) Updating files: 44% (67/152) Updating files: 45% (69/152) Updating files: 46% (70/152) Updating files: 47% (72/152) Updating files: 48% (73/152) Updating files: 49% (75/152) Updating files: 50% (76/152) Updating files: 51% (78/152) Updating files: 52% (80/152) Updating files: 53% (81/152) Updating files: 54% (83/152) Updating files: 55% (84/152) Updating files: 56% (86/152) Updating files: 57% (87/152) Updating files: 58% (89/152) Updating files: 59% (90/152) Updating files: 60% (92/152) Updating files: 61% (93/152) Updating files: 62% (95/152) Updating files: 63% (96/152) Updating files: 64% (98/152) Updating files: 65% (99/152) Updating files: 66% (101/152) Updating files: 67% (102/152) Updating files: 68% (104/152) Updating files: 69% (105/152) Updating files: 70% (107/152) Updating files: 71% (108/152) Updating files: 72% (110/152) Updating files: 73% (111/152) Updating files: 74% (113/152) Updating files: 75% (114/152) Updating files: 76% (116/152) Updating files: 77% (118/152) Updating files: 78% (119/152) Updating files: 79% (121/152) Updating files: 80% (122/152) Updating files: 81% (124/152) Updating files: 82% (125/152) Updating files: 83% (127/152) Updating files: 84% (128/152) Updating files: 85% (130/152) Updating files: 86% (131/152) Updating files: 87% (133/152) Updating files: 88% (134/152) Updating files: 89% (136/152) Updating files: 90% (137/152) Updating files: 91% (139/152) Updating files: 92% (140/152) Updating files: 93% (142/152) Updating files: 94% (143/152) Updating files: 95% (145/152) Updating files: 96% (146/152) Updating files: 97% (148/152) Updating files: 98% (149/152) Updating files: 99% (151/152) Updating files: 100% (152/152) Updating files: 100% (152/152), done. 2024-04-26T18:24:29.058 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at b6b48dbefad v0.66 2024-04-26T18:24:29.060 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.66 2024-04-26T18:24:29.074 INFO:tasks.workunit.client.0.smithi139.stdout:v0.67 2024-04-26T18:24:29.074 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:24:29.075 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 67 -eq 48 ']' 2024-04-26T18:24:29.075 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.67 2024-04-26T18:24:29.075 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.67 2024-04-26T18:24:29.075 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.67 2024-04-26T18:24:30.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:24:30.883 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:24:43.619 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 8% (30/355) Updating files: 8% (31/355) Updating files: 9% (32/355) Updating files: 10% (36/355) Updating files: 11% (40/355) Updating files: 12% (43/355) Updating files: 13% (47/355) Updating files: 14% (50/355) Updating files: 15% (54/355) Updating files: 16% (57/355) Updating files: 17% (61/355) Updating files: 18% (64/355) Updating files: 19% (68/355) Updating files: 19% (69/355) Updating files: 20% (71/355) Updating files: 21% (75/355) Updating files: 22% (79/355) Updating files: 23% (82/355) Updating files: 24% (86/355) Updating files: 25% (89/355) Updating files: 26% (93/355) Updating files: 27% (96/355) Updating files: 28% (100/355) Updating files: 29% (103/355) Updating files: 30% (107/355) Updating files: 31% (111/355) Updating files: 32% (114/355) Updating files: 33% (118/355) Updating files: 34% (121/355) Updating files: 35% (125/355) Updating files: 36% (128/355) Updating files: 37% (132/355) Updating files: 38% (135/355) Updating files: 39% (139/355) Updating files: 40% (142/355) Updating files: 41% (146/355) Updating files: 42% (150/355) Updating files: 43% (153/355) Updating files: 44% (157/355) Updating files: 45% (160/355) Updating files: 46% (164/355) Updating files: 47% (167/355) Updating files: 48% (171/355) Updating files: 49% (174/355) Updating files: 50% (178/355) Updating files: 51% (182/355) Updating files: 52% (185/355) Updating files: 53% (189/355) Updating files: 54% (192/355) Updating files: 55% (196/355) Updating files: 56% (199/355) Updating files: 57% (203/355) Updating files: 58% (206/355) Updating files: 59% (210/355) Updating files: 59% (211/355) Updating files: 60% (213/355) Updating files: 61% (217/355) Updating files: 62% (221/355) Updating files: 63% (224/355) Updating files: 64% (228/355) Updating files: 65% (231/355) Updating files: 66% (235/355) Updating files: 67% (238/355) Updating files: 68% (242/355) Updating files: 69% (245/355) Updating files: 70% (249/355) Updating files: 71% (253/355) Updating files: 72% (256/355) Updating files: 73% (260/355) Updating files: 74% (263/355) Updating files: 75% (267/355) Updating files: 75% (269/355) Updating files: 76% (270/355) Updating files: 77% (274/355) Updating files: 78% (277/355) Updating files: 79% (281/355) Updating files: 80% (284/355) Updating files: 81% (288/355) Updating files: 82% (292/355) Updating files: 83% (295/355) Updating files: 84% (299/355) Updating files: 85% (302/355) Updating files: 85% (303/355) Updating files: 86% (306/355) Updating files: 87% (309/355) Updating files: 88% (313/355) Updating files: 89% (316/355) Updating files: 90% (320/355) Updating files: 91% (324/355) Updating files: 92% (327/355) Updating files: 93% (331/355) Updating files: 94% (334/355) Updating files: 95% (338/355) Updating files: 96% (341/355) Updating files: 97% (345/355) Updating files: 98% (348/355) Updating files: 99% (352/355) Updating files: 100% (355/355) Updating files: 100% (355/355), done. 2024-04-26T18:24:43.694 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at e3b7bc5bce8 v0.67 2024-04-26T18:24:43.697 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.67 2024-04-26T18:24:43.707 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:24:43.707 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 68 -eq 48 ']' 2024-04-26T18:24:43.708 INFO:tasks.workunit.client.0.smithi139.stdout:v0.68 2024-04-26T18:24:43.708 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.68 2024-04-26T18:24:43.708 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.68 2024-04-26T18:24:43.708 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.68 2024-04-26T18:24:47.273 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 45% (109/241) Updating files: 46% (111/241) Updating files: 47% (114/241) Updating files: 48% (116/241) Updating files: 49% (119/241) Updating files: 50% (121/241) Updating files: 51% (123/241) Updating files: 52% (126/241) Updating files: 53% (128/241) Updating files: 54% (131/241) Updating files: 55% (133/241) Updating files: 56% (135/241) Updating files: 57% (138/241) Updating files: 58% (140/241) Updating files: 59% (143/241) Updating files: 60% (145/241) Updating files: 61% (148/241) Updating files: 62% (150/241) Updating files: 63% (152/241) Updating files: 64% (155/241) Updating files: 65% (157/241) Updating files: 66% (160/241) Updating files: 67% (162/241) Updating files: 68% (164/241) Updating files: 69% (167/241) Updating files: 70% (169/241) Updating files: 71% (172/241) Updating files: 72% (174/241) Updating files: 73% (176/241) Updating files: 74% (179/241) Updating files: 75% (181/241) Updating files: 76% (184/241) Updating files: 77% (186/241) Updating files: 78% (188/241) Updating files: 79% (191/241) Updating files: 80% (193/241) Updating files: 81% (196/241) Updating files: 82% (198/241) Updating files: 83% (201/241) Updating files: 84% (203/241) Updating files: 85% (205/241) Updating files: 86% (208/241) Updating files: 87% (210/241) Updating files: 88% (213/241) Updating files: 89% (215/241) Updating files: 90% (217/241) Updating files: 91% (220/241) Updating files: 92% (222/241) Updating files: 93% (225/241) Updating files: 94% (227/241) Updating files: 95% (229/241) Updating files: 96% (232/241) Updating files: 97% (234/241) Updating files: 98% (237/241) Updating files: 99% (239/241) Updating files: 100% (241/241) Updating files: 100% (241/241), done. 2024-04-26T18:24:47.308 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at b4cf0f2574b v0.68 2024-04-26T18:24:47.311 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.68 2024-04-26T18:24:47.391 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:24:47.391 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 69 -eq 48 ']' 2024-04-26T18:24:47.391 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.69 2024-04-26T18:24:47.391 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.69 2024-04-26T18:24:47.392 INFO:tasks.workunit.client.0.smithi139.stdout:v0.69 2024-04-26T18:24:47.392 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.69 2024-04-26T18:24:54.072 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:24:54.072 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-04-26T18:24:54.072 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:24:54.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.181+0000 7f78577f0640 1 Processor -- start 2024-04-26T18:24:54.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.182+0000 7f78577f0640 1 -- start start 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.182+0000 7f78577f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f78500cd840 0x7f785015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.182+0000 7f78577f0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785015f2a0 con 0x7f7850156180 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.182+0000 7f78577f0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785015f580 con 0x7f7850155da0 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.182+0000 7f78577f0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f785015cbc0 con 0x7f78500cd840 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7854d8b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7850156180 0x7f78500c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52112/0 (socket says 172.21.15.139:52112) 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7854d8b640 1 -- 172.21.15.139:0/3495114077 learned_addr learned my addr 172.21.15.139:0/3495114077 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7855d8d640 1 --2- 172.21.15.139:0/3495114077 >> v2:172.21.15.143:3300/0 conn(0x7f78500cd840 0x7f785015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696907103 0 0) 0x7f785015f2a0 con 0x7f7850156180 2024-04-26T18:24:54.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f783c003520 con 0x7f7850156180 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392038024 0 0) 0x7f783c003520 con 0x7f7850156180 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 >> v2:172.21.15.143:3300/0 conn(0x7f78500cd840 msgr2=0x7f785015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 --2- 172.21.15.139:0/3495114077 >> v2:172.21.15.143:3300/0 conn(0x7f78500cd840 0x7f785015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 >> v1:172.21.15.143:6789/0 conn(0x7f7850155da0 legacy=0x7f78500d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785015f860 con 0x7f7850156180 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f784c001670 con 0x7f7850156180 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 >> v1:172.21.15.139:6789/0 conn(0x7f7850156180 legacy=0x7f78500c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c0039b0 0x7f783c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f783c004800 0x7f783c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f783c0051c0 0x7f783c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f785015cbc0 con 0x7f783c004800 2024-04-26T18:24:54.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f783c00c160 con 0x7f783c0039b0 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f783c00c360 con 0x7f783c0051c0 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7854d8b640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f783c004800 0x7f783c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f785558c640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c0039b0 0x7f783c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.183+0000 7f7855d8d640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f783c0051c0 0x7f783c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7854d8b640 1 -- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f783c0051c0 msgr2=0x7f783c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7854d8b640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f783c0051c0 0x7f783c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7854d8b640 1 -- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c0039b0 msgr2=0x7f783c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7854d8b640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c0039b0 0x7f783c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7854d8b640 1 -- 172.21.15.139:0/3495114077 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c003520 con 0x7f783c004800 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7855d8d640 1 -- 172.21.15.139:0/3495114077 reap_dead start 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7854d8b640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f783c004800 0x7f783c004c80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7850073b60 tx=0x7f783c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f996844bab38f41f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c007d10 con 0x7f783c004800 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784c005af0 con 0x7f783c004800 2024-04-26T18:24:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.184+0000 7f7843fff640 1 -- 172.21.15.139:0/3495114077 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c007070 con 0x7f783c004800 2024-04-26T18:24:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.185+0000 7f78577f0640 1 -- 172.21.15.139:0/3495114077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f783c004800 msgr2=0x7f783c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.185+0000 7f78577f0640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f783c004800 0x7f783c004c80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7850073b60 tx=0x7f783c005830 comp rx=0 tx=0).stop 2024-04-26T18:24:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.185+0000 7f78577f0640 1 -- 172.21.15.139:0/3495114077 shutdown_connections 2024-04-26T18:24:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.185+0000 7f78577f0640 1 --2- 172.21.15.139:0/3495114077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f783c004800 0x7f783c004c80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.185+0000 7f78577f0640 1 -- 172.21.15.139:0/3495114077 >> 172.21.15.139:0/3495114077 conn(0x7f7850068090 msgr2=0x7f78500684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.185+0000 7f78577f0640 1 -- 172.21.15.139:0/3495114077 shutdown_connections 2024-04-26T18:24:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.185+0000 7f78577f0640 1 -- 172.21.15.139:0/3495114077 wait complete. 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.186+0000 7f78577f0640 1 Processor -- start 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.186+0000 7f78577f0640 1 -- start start 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f78577f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c004800 0x7f78501f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f78577f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78500d1150 0x7f78501e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f78577f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78500cff70 0x7f785015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f78577f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78500cc160 con 0x7f78500cff70 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f78577f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f78500cc730 con 0x7f783c004800 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f78577f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f78500cc2e0 con 0x7f78500d1150 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78500cff70 0x7f785015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78500cff70 0x7f785015e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44000/0 (socket says 172.21.15.139:44000) 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 -- 172.21.15.139:0/2657639614 learned_addr learned my addr 172.21.15.139:0/2657639614 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:54.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7854d8b640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78500d1150 0x7f78501e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f785558c640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c004800 0x7f78501f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 -- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78500d1150 msgr2=0x7f78501e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78500d1150 0x7f78501e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 -- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c004800 msgr2=0x7f78501f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c004800 0x7f78501f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 -- 172.21.15.139:0/2657639614 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78500cf1f0 con 0x7f78500cff70 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.187+0000 7f7855d8d640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78500cff70 0x7f785015e230 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7850069070 tx=0x7f784800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.188+0000 7f7841ffb640 1 -- 172.21.15.139:0/2657639614 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784800fd80 con 0x7f78500cff70 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.188+0000 7f7841ffb640 1 -- 172.21.15.139:0/2657639614 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784801d070 con 0x7f78500cff70 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.188+0000 7f7841ffb640 1 -- 172.21.15.139:0/2657639614 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848015670 con 0x7f78500cff70 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.188+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78500d0920 con 0x7f78500cff70 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.188+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78500d0bf0 con 0x7f78500cff70 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.189+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78500cb9c0 con 0x7f78500cff70 2024-04-26T18:24:54.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.189+0000 7f7841ffb640 1 -- 172.21.15.139:0/2657639614 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7848015810 con 0x7f78500cff70 2024-04-26T18:24:54.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.190+0000 7f7841ffb640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f783406c920 0x7f783406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.190+0000 7f785558c640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f783406c920 0x7f783406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.190+0000 7f7841ffb640 1 -- 172.21.15.139:0/2657639614 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f784808cba0 con 0x7f78500cff70 2024-04-26T18:24:54.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.190+0000 7f785558c640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f783406c920 0x7f783406ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7844000c00 tx=0x7f7844009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.194+0000 7f7841ffb640 1 -- 172.21.15.139:0/2657639614 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f78500cb9c0 con 0x7f78500cff70 2024-04-26T18:24:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.404+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7850076d20 con 0x7f78500cff70 2024-04-26T18:24:54.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.405+0000 7f7841ffb640 1 -- 172.21.15.139:0/2657639614 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f7848027020 con 0x7f78500cff70 2024-04-26T18:24:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:24:54.405 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:24:54.405 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f783406c920 msgr2=0x7f783406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f783406c920 0x7f783406ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7844000c00 tx=0x7f7844009040 comp rx=0 tx=0).stop 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78500cff70 msgr2=0x7f785015e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78500cff70 0x7f785015e230 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7850069070 tx=0x7f784800f580 comp rx=0 tx=0).stop 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 shutdown_connections 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f783406c920 0x7f783406ede0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78500cff70 0x7f785015e230 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f78500d1150 0x7f78501e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 --2- 172.21.15.139:0/2657639614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f783c004800 0x7f78501f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 >> 172.21.15.139:0/2657639614 conn(0x7f7850068090 msgr2=0x7f78500ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 shutdown_connections 2024-04-26T18:24:54.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.407+0000 7f78577f0640 1 -- 172.21.15.139:0/2657639614 wait complete. 2024-04-26T18:24:54.418 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0' 2024-04-26T18:24:54.418 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0 2024-04-26T18:24:54.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.524+0000 7f678d4dc640 1 Processor -- start 2024-04-26T18:24:54.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.524+0000 7f678d4dc640 1 -- start start 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f678d4dc640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f67880d14b0 0x7f67880d1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f678d4dc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f67880cf260 0x7f67880d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f678d4dc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678815c2a0 0x7f678815c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f678d4dc640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f6788160170 con 0x7f67880cf260 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f678d4dc640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f678815be10 con 0x7f67880d14b0 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f678d4dc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f67880d07e0 con 0x7f678815c2a0 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f67867fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f67880cf260 0x7f67880d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f67867fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f67880cf260 0x7f67880d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44008/0 (socket says 172.21.15.139:44008) 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f67867fc640 1 -- 172.21.15.139:0/2223996989 learned_addr learned my addr 172.21.15.139:0/2223996989 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.525+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2223996989 >> v2:172.21.15.143:3300/0 conn(0x7f67880d14b0 0x7f67880d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67877fe640 1 --2- 172.21.15.139:0/2223996989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678815c2a0 0x7f678815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67867fc640 1 -- 172.21.15.139:0/2223996989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678815c2a0 msgr2=0x7f678815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67867fc640 1 --2- 172.21.15.139:0/2223996989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678815c2a0 0x7f678815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67867fc640 1 -- 172.21.15.139:0/2223996989 >> v2:172.21.15.143:3300/0 conn(0x7f67880d14b0 msgr2=0x7f67880d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67867fc640 1 --2- 172.21.15.139:0/2223996989 >> v2:172.21.15.143:3300/0 conn(0x7f67880d14b0 0x7f67880d1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67867fc640 1 -- 172.21.15.139:0/2223996989 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678815f5f0 con 0x7f67880cf260 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67877fe640 1 --2- 172.21.15.139:0/2223996989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678815c2a0 0x7f678815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:24:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f67867fc640 1 --2- 172.21.15.139:0/2223996989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67880cf260 0x7f67880d02a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6788072cc0 tx=0x7f677c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdf144af5deff64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f6785ffb640 1 -- 172.21.15.139:0/2223996989 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c037070 con 0x7f67880cf260 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f6785ffb640 1 -- 172.21.15.139:0/2223996989 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c032440 con 0x7f67880cf260 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.526+0000 7f6785ffb640 1 -- 172.21.15.139:0/2223996989 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c032810 con 0x7f67880cf260 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 -- 172.21.15.139:0/2223996989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67880cf260 msgr2=0x7f67880d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 --2- 172.21.15.139:0/2223996989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67880cf260 0x7f67880d02a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6788072cc0 tx=0x7f677c02a1e0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 -- 172.21.15.139:0/2223996989 shutdown_connections 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 --2- 172.21.15.139:0/2223996989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f678815c2a0 0x7f678815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 --2- 172.21.15.139:0/2223996989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67880cf260 0x7f67880d02a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 --2- 172.21.15.139:0/2223996989 >> v2:172.21.15.143:3300/0 conn(0x7f67880d14b0 0x7f67880d1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 -- 172.21.15.139:0/2223996989 >> 172.21.15.139:0/2223996989 conn(0x7f6788073c70 msgr2=0x7f6788074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 -- 172.21.15.139:0/2223996989 shutdown_connections 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.527+0000 7f678d4dc640 1 -- 172.21.15.139:0/2223996989 wait complete. 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.528+0000 7f678d4dc640 1 Processor -- start 2024-04-26T18:24:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.528+0000 7f678d4dc640 1 -- start start 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f678d4dc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67880cf260 0x7f67881f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f678d4dc640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67880d14b0 0x7f67880b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f678d4dc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f678815c2a0 0x7f678814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f678d4dc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f678815fe90 con 0x7f678815c2a0 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f678d4dc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f678815fbb0 con 0x7f67880cf260 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f678d4dc640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f678815f1d0 con 0x7f67880d14b0 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f678815c2a0 0x7f678814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f678815c2a0 0x7f678814bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44018/0 (socket says 172.21.15.139:44018) 2024-04-26T18:24:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 -- 172.21.15.139:0/3984987187 learned_addr learned my addr 172.21.15.139:0/3984987187 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67880cf260 0x7f67881f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67867fc640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67880d14b0 0x7f67880b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 -- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67880d14b0 msgr2=0x7f67880b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67880d14b0 0x7f67880b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 -- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67880cf260 msgr2=0x7f67881f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67880cf260 0x7f67881f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.529+0000 7f67877fe640 1 -- 172.21.15.139:0/3984987187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678815afa0 con 0x7f678815c2a0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.530+0000 7f67877fe640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f678815c2a0 0x7f678814bda0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f678000c7c0 tx=0x7f678000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.530+0000 7f676f7fe640 1 -- 172.21.15.139:0/3984987187 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780015020 con 0x7f678815c2a0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.530+0000 7f676f7fe640 1 -- 172.21.15.139:0/3984987187 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6780004230 con 0x7f678815c2a0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.530+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678815b280 con 0x7f678815c2a0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.530+0000 7f676f7fe640 1 -- 172.21.15.139:0/3984987187 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780007620 con 0x7f678815c2a0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.530+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67881f3350 con 0x7f678815c2a0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.531+0000 7f676f7fe640 1 -- 172.21.15.139:0/3984987187 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6780018020 con 0x7f678815c2a0 2024-04-26T18:24:54.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.532+0000 7f676f7fe640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f677406c8f0 0x7f677406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.532+0000 7f676f7fe640 1 -- 172.21.15.139:0/3984987187 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f678008bf50 con 0x7f678815c2a0 2024-04-26T18:24:54.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.532+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f677406c8f0 0x7f677406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.532+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f677406c8f0 0x7f677406edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f67780039e0 tx=0x7f6778009790 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 Processor -- start 2024-04-26T18:24:54.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 -- start start 2024-04-26T18:24:54.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c05055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c0505ae0 0x55f9c04c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c7b40 0x55f9c04c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f9c0429d80 con 0x55f9c04c7b40 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55f9c03c5c20 con 0x55f9c0505ae0 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.533+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55f9c0425d40 con 0x55f9c04c65e0 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c7b40 0x55f9c04c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c7b40 0x55f9c04c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44032/0 (socket says 172.21.15.139:44032) 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 -- 172.21.15.139:0/3411858989 learned_addr learned my addr 172.21.15.139:0/3411858989 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c05055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67867fc640 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c0505ae0 0x55f9c04c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 -- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 msgr2=0x55f9c05055a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c05055a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 -- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c0505ae0 msgr2=0x55f9c04c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c0505ae0 0x55f9c04c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 -- 172.21.15.139:0/3411858989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9c0207d80 con 0x55f9c04c7b40 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c05055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:24:54.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f67877fe640 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c7b40 0x55f9c04c6f00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6780004770 tx=0x7f67800624e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4738489e636f276 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f676cff9640 1 -- 172.21.15.139:0/3411858989 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780057c20 con 0x55f9c04c7b40 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f676cff9640 1 -- 172.21.15.139:0/3411858989 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6780055f90 con 0x55f9c04c7b40 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.534+0000 7f676cff9640 1 -- 172.21.15.139:0/3411858989 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678005ada0 con 0x55f9c04c7b40 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 -- 172.21.15.139:0/3411858989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c7b40 msgr2=0x55f9c04c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c7b40 0x55f9c04c6f00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6780004770 tx=0x7f67800624e0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 -- 172.21.15.139:0/3411858989 shutdown_connections 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c7b40 0x55f9c04c6f00 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c0505ae0 0x55f9c04c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/3411858989 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c05055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 -- 172.21.15.139:0/3411858989 >> 172.21.15.139:0/3411858989 conn(0x55f9c048d740 msgr2=0x55f9c050a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 -- 172.21.15.139:0/3411858989 shutdown_connections 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 -- 172.21.15.139:0/3411858989 wait complete. 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.535+0000 7f67901f3740 1 -- start start 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 1 Processor -- start 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c0502820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 0x55f9c04fe420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c04ed8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f9c04c4c20 con 0x55f9c0505ae0 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55f9c03c3840 con 0x55f9c04c7b40 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55f9c04c8170 con 0x55f9c04c65e0 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67901f3740 10 client.0 _ll_register_callbacks cb 0x55f9c03c75b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c04ed8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c04ed8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44048/0 (socket says 172.21.15.139:44048) 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67877fe640 1 -- 172.21.15.139:0/2911358153 learned_addr learned my addr 172.21.15.139:0/2911358153 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c0502820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.536+0000 7f67867fc640 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 0x55f9c04fe420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67877fe640 1 -- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 msgr2=0x55f9c0502820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67877fe640 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c0502820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67877fe640 1 -- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 msgr2=0x55f9c04fe420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67877fe640 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 0x55f9c04fe420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67877fe640 1 -- 172.21.15.139:0/2911358153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9c0268510 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67877fe640 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c04ed8a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f678008a090 tx=0x7f67800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5291cf9a7db0fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f6765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f6765ffb640 1 -- 172.21.15.139:0/2911358153 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780059920 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f6765ffb640 1 -- 172.21.15.139:0/2911358153 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f6780058f80 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6780055f90 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f6765ffb640 1 -- 172.21.15.139:0/2911358153 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f6780055670 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 10 client.5889 fetch_fsmap learned FSMap version 9 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f9c00fb670 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f6765ffb640 1 -- 172.21.15.139:0/2911358153 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6780055f90 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f6765ffb640 1 -- 172.21.15.139:0/2911358153 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f6780055810 con 0x55f9c0505ae0 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 10 client.5889 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 10 client.5889 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 20 client.5889 populate_metadata read hostname 'smithi139' 2024-04-26T18:24:54.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04f1770 0x55f9c04edde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 4 client.5889 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9c0437990 con 0x55f9c04f1770 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.537+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04f1770 0x55f9c04edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.538+0000 7f6765ffb640 10 client.5889 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.538+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04f1770 0x55f9c04edde0 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccee03590886e56c server_cookie=2605a91f632e6a42 in_seq=0 out_seq=0 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.538+0000 7f6765ffb640 1 -- 172.21.15.139:0/2911358153 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f9c0437990 con 0x55f9c04f1770 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.538+0000 7f6765ffb640 10 client.5889 handle_command_reply: tid=0 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.538+0000 7f67901f3740 1 client.5889 shutdown 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 msgr2=0x55f9c04ed8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c04ed8a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f678008a090 tx=0x7f67800046c0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 shutdown_connections 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c04ed8a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 0x55f9c04fe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04f1770 0x55f9c04edde0 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 --2- 172.21.15.139:0/2911358153 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c65e0 0x55f9c0502820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f6765ffb640 0 client.5889 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:54.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 >> 172.21.15.139:0/2911358153 conn(0x55f9c048d740 msgr2=0x55f9c04c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:54.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 shutdown_connections 2024-04-26T18:24:54.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 1 -- 172.21.15.139:0/2911358153 wait complete. 2024-04-26T18:24:54.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.539+0000 7f67901f3740 20 client.5889 trim_cache size 0 max 16384 2024-04-26T18:24:54.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 Processor -- start 2024-04-26T18:24:54.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 -- start start 2024-04-26T18:24:54.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c65e0 0x55f9c052ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 0x55f9c0509fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c0505ae0 0x55f9c050a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6788200910 con 0x55f9c04c65e0 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f67881ff7f0 con 0x55f9c04c7b40 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.556+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f67881fde20 con 0x55f9c0505ae0 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c65e0 0x55f9c052ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c65e0 0x55f9c052ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44060/0 (socket says 172.21.15.139:44060) 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 -- 172.21.15.139:0/3627250019 learned_addr learned my addr 172.21.15.139:0/3627250019 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 -- 172.21.15.139:0/3627250019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c0505ae0 msgr2=0x55f9c050a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3627250019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c0505ae0 0x55f9c050a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 -- 172.21.15.139:0/3627250019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 msgr2=0x55f9c0509fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3627250019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 0x55f9c0509fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 -- 172.21.15.139:0/3627250019 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9c050ab10 con 0x55f9c04c65e0 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6786ffd640 1 --2- 172.21.15.139:0/3627250019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c65e0 0x55f9c052ae40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f67780049c0 tx=0x7f6778013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5685a3a5658cbae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6767fff640 1 -- 172.21.15.139:0/3627250019 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778017880 con 0x55f9c04c65e0 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6767fff640 1 -- 172.21.15.139:0/3627250019 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6778030070 con 0x55f9c04c65e0 2024-04-26T18:24:54.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f6767fff640 1 -- 172.21.15.139:0/3627250019 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6778017a40 con 0x55f9c04c65e0 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f67901f3740 1 -- 172.21.15.139:0/3627250019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c65e0 msgr2=0x55f9c052ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.557+0000 7f67901f3740 1 --2- 172.21.15.139:0/3627250019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c65e0 0x55f9c052ae40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f67780049c0 tx=0x7f6778013000 comp rx=0 tx=0).stop 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 -- 172.21.15.139:0/3627250019 shutdown_connections 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 --2- 172.21.15.139:0/3627250019 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c0505ae0 0x55f9c050a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 --2- 172.21.15.139:0/3627250019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c7b40 0x55f9c0509fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 --2- 172.21.15.139:0/3627250019 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c04c65e0 0x55f9c052ae40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 -- 172.21.15.139:0/3627250019 >> 172.21.15.139:0/3627250019 conn(0x55f9c048d740 msgr2=0x55f9c04bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 -- 172.21.15.139:0/3627250019 shutdown_connections 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 -- 172.21.15.139:0/3627250019 wait complete. 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 -- start start 2024-04-26T18:24:54.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.558+0000 7f67901f3740 1 Processor -- start 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c65e0 0x55f9c04ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67901f3740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c7b40 0x55f9c0506e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67901f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c05015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67901f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f67881fe3a0 con 0x55f9c0505ae0 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f67881ff120 con 0x55f9c04c65e0 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67901f3740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f67881fea50 con 0x55f9c04c7b40 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67901f3740 10 client.0 _ll_register_callbacks cb 0x7f678005dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c05015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c05015c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:44068/0 (socket says 172.21.15.139:44068) 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 -- 172.21.15.139:0/2097612321 learned_addr learned my addr 172.21.15.139:0/2097612321 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c65e0 0x55f9c04ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67867fc640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c7b40 0x55f9c0506e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 -- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c7b40 msgr2=0x55f9c0506e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c7b40 0x55f9c0506e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 -- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c65e0 msgr2=0x55f9c04ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c65e0 0x55f9c04ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 -- 172.21.15.139:0/2097612321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9c04c3da0 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c65e0 0x55f9c04ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f67877fe640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c05015c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f67800598b0 tx=0x7f6780089f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16933c29de593af3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f6765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.559+0000 7f6765ffb640 1 -- 172.21.15.139:0/2097612321 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780055f90 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f6765ffb640 1 -- 172.21.15.139:0/2097612321 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f67800588d0 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6778030070 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f6765ffb640 1 -- 172.21.15.139:0/2097612321 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f6780059920 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 10 client.5895 fetch_fsmap learned FSMap version 9 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f9c0507800 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f6765ffb640 1 -- 172.21.15.139:0/2097612321 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6778030070 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f6765ffb640 1 -- 172.21.15.139:0/2097612321 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f678006a030 con 0x55f9c0505ae0 2024-04-26T18:24:54.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 10 client.5895 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 10 client.5895 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 20 client.5895 populate_metadata read hostname 'smithi139' 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04c3da0 0x55f9c0580740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 4 client.5895 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}] 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}) -- 0x55f9c0431800 con 0x55f9c04c3da0 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04c3da0 0x55f9c0580740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f6786ffd640 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04c3da0 0x55f9c0580740 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd690ce6c21f4a3 server_cookie=8e2788c1d26b2b70 in_seq=0 out_seq=0 2024-04-26T18:24:54.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:54.560+0000 7f6765ffb640 10 client.5895 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:57.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.534+0000 7f6765ffb640 1 -- 172.21.15.139:0/2097612321 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55f9c0431800 con 0x55f9c04c3da0 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.534+0000 7f6765ffb640 10 client.5895 handle_command_reply: tid=0 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.534+0000 7f67901f3740 1 client.5895 shutdown 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 msgr2=0x55f9c05015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c05015c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f67800598b0 tx=0x7f6780089f10 comp rx=0 tx=0).stop 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 shutdown_connections 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f9c0505ae0 0x55f9c05015c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55f9c04c3da0 0x55f9c0580740 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55f9c04c7b40 0x55f9c0506e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 --2- 172.21.15.139:0/2097612321 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f9c04c65e0 0x55f9c04ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f6765ffb640 0 client.5895 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 >> 172.21.15.139:0/2097612321 conn(0x55f9c048d740 msgr2=0x55f9c04bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 shutdown_connections 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 1 -- 172.21.15.139:0/2097612321 wait complete. 2024-04-26T18:24:57.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f67901f3740 20 client.5895 trim_cache size 0 max 16384 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 86, 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "4e4f30f2": { 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 86, 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:24:57.537 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.0, 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:24:57.538 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:24:57.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f677406c8f0 msgr2=0x7f677406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:57.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f678d4dc640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f677406c8f0 0x7f677406edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f67780039e0 tx=0x7f6778009790 comp rx=0 tx=0).stop 2024-04-26T18:24:57.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f678815c2a0 msgr2=0x7f678814bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f678d4dc640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f678815c2a0 0x7f678814bda0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f678000c7c0 tx=0x7f678000cc80 comp rx=0 tx=0).stop 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.535+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 shutdown_connections 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.536+0000 7f678d4dc640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f677406c8f0 0x7f677406edb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.536+0000 7f678d4dc640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f678815c2a0 0x7f678814bda0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.536+0000 7f678d4dc640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f67880d14b0 0x7f67880b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.536+0000 7f678d4dc640 1 --2- 172.21.15.139:0/3984987187 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f67880cf260 0x7f67881f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.536+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 >> 172.21.15.139:0/3984987187 conn(0x7f6788073c70 msgr2=0x7f67881538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.536+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 shutdown_connections 2024-04-26T18:24:57.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:24:57.536+0000 7f678d4dc640 1 -- 172.21.15.139:0/3984987187 wait complete. 2024-04-26T18:24:57.546 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4e4f30f2', quiesce took 3.5 seconds. Will release after: 21.05 2024-04-26T18:25:01.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:25:01.032 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:25:18.597 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:25:18.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.706+0000 7fd51f007640 1 Processor -- start 2024-04-26T18:25:18.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.706+0000 7fd51f007640 1 -- start start 2024-04-26T18:25:18.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51f007640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd5180c89f0 0x7fd51815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51f007640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd5180c7c20 0x7fd5180c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51f007640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5180736a0 con 0x7fd518152cb0 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51f007640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fd5180c62e0 con 0x7fd5180c89f0 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51f007640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd518073940 con 0x7fd5180c7c20 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd517fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd5180c89f0 0x7fd51815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51cda3640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd518152cb0 0x7fd5180cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:48212/0 (socket says 172.21.15.139:48212) 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51cda3640 1 -- 172.21.15.139:0/3159596814 learned_addr learned my addr 172.21.15.139:0/3159596814 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd51d5a4640 1 --2- 172.21.15.139:0/3159596814 >> v2:172.21.15.143:3300/0 conn(0x7fd5180c7c20 0x7fd5180c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.707+0000 7fd517fff640 1 -- 172.21.15.139:0/3159596814 >> v2:172.21.15.143:3300/0 conn(0x7fd5180c7c20 msgr2=0x7fd5180c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd517fff640 1 --2- 172.21.15.139:0/3159596814 >> v2:172.21.15.143:3300/0 conn(0x7fd5180c7c20 0x7fd5180c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd517fff640 1 -- 172.21.15.139:0/3159596814 >> v1:172.21.15.139:6789/0 conn(0x7fd518152cb0 legacy=0x7fd5180cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd517fff640 1 -- 172.21.15.139:0/3159596814 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180c48c0 con 0x7fd5180c89f0 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd5177fe640 1 -- 172.21.15.139:0/3159596814 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705813023 0 0) 0x7fd5180736a0 con 0x7fd518152cb0 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd51d5a4640 1 --2- 172.21.15.139:0/3159596814 >> v2:172.21.15.143:3300/0 conn(0x7fd5180c7c20 0x7fd5180c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd517fff640 1 --2- 172.21.15.139:0/3159596814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5180c89f0 0x7fd51815bd50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd518072060 tx=0x7fd50c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbf79fa0ac805a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:18.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd5177fe640 1 -- 172.21.15.139:0/3159596814 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c037070 con 0x7fd5180c89f0 2024-04-26T18:25:18.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd5177fe640 1 -- 172.21.15.139:0/3159596814 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c032440 con 0x7fd5180c89f0 2024-04-26T18:25:18.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.708+0000 7fd5177fe640 1 -- 172.21.15.139:0/3159596814 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c032810 con 0x7fd5180c89f0 2024-04-26T18:25:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 -- 172.21.15.139:0/3159596814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5180c89f0 msgr2=0x7fd51815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 --2- 172.21.15.139:0/3159596814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5180c89f0 0x7fd51815bd50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd518072060 tx=0x7fd50c02a230 comp rx=0 tx=0).stop 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 -- 172.21.15.139:0/3159596814 shutdown_connections 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 --2- 172.21.15.139:0/3159596814 >> v2:172.21.15.143:3300/0 conn(0x7fd5180c7c20 0x7fd5180c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 --2- 172.21.15.139:0/3159596814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5180c89f0 0x7fd51815bd50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 -- 172.21.15.139:0/3159596814 >> 172.21.15.139:0/3159596814 conn(0x7fd518068270 msgr2=0x7fd518068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 -- 172.21.15.139:0/3159596814 shutdown_connections 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.709+0000 7fd51f007640 1 -- 172.21.15.139:0/3159596814 wait complete. 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.710+0000 7fd51f007640 1 Processor -- start 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.710+0000 7fd51f007640 1 -- start start 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51f007640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5180c7c20 0x7fd51814d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51f007640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5180c89f0 0x7fd5181f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51f007640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd518152cb0 0x7fd518147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51f007640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180c4d20 con 0x7fd518152cb0 2024-04-26T18:25:18.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51f007640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180c4ba0 con 0x7fd5180c7c20 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51f007640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd5180cdb70 con 0x7fd5180c89f0 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51d5a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd518152cb0 0x7fd518147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51d5a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd518152cb0 0x7fd518147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37726/0 (socket says 172.21.15.139:37726) 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51d5a4640 1 -- 172.21.15.139:0/772306452 learned_addr learned my addr 172.21.15.139:0/772306452 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51cda3640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5180c7c20 0x7fd51814d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd517fff640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5180c89f0 0x7fd5181f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51d5a4640 1 -- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5180c89f0 msgr2=0x7fd5181f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51d5a4640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5180c89f0 0x7fd5181f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51d5a4640 1 -- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5180c7c20 msgr2=0x7fd51814d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.711+0000 7fd51d5a4640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5180c7c20 0x7fd51814d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd51d5a4640 1 -- 172.21.15.139:0/772306452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd518155ea0 con 0x7fd518152cb0 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd517fff640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5180c89f0 0x7fd5181f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd51d5a4640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd518152cb0 0x7fd518147bc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd51000cd80 tx=0x7fd51000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd5157fa640 1 -- 172.21.15.139:0/772306452 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51000f680 con 0x7fd518152cb0 2024-04-26T18:25:18.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd5157fa640 1 -- 172.21.15.139:0/772306452 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51000f840 con 0x7fd518152cb0 2024-04-26T18:25:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5181f03e0 con 0x7fd518152cb0 2024-04-26T18:25:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd5157fa640 1 -- 172.21.15.139:0/772306452 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51000fc30 con 0x7fd518152cb0 2024-04-26T18:25:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.712+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5181f06c0 con 0x7fd518152cb0 2024-04-26T18:25:18.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.713+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd518073fa0 con 0x7fd518152cb0 2024-04-26T18:25:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.713+0000 7fd5157fa640 1 -- 172.21.15.139:0/772306452 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5100213f0 con 0x7fd518152cb0 2024-04-26T18:25:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.714+0000 7fd5157fa640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd50406c8f0 0x7fd50406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.714+0000 7fd5157fa640 1 -- 172.21.15.139:0/772306452 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fd51008cc60 con 0x7fd518152cb0 2024-04-26T18:25:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.714+0000 7fd51cda3640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd50406c8f0 0x7fd50406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:18.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.714+0000 7fd51cda3640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd50406c8f0 0x7fd50406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd508000f60 tx=0x7fd508007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:18.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.718+0000 7fd5157fa640 1 -- 172.21.15.139:0/772306452 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd518073fa0 con 0x7fd518152cb0 2024-04-26T18:25:18.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.934+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd518156380 con 0x7fd518152cb0 2024-04-26T18:25:18.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.934+0000 7fd5157fa640 1 -- 172.21.15.139:0/772306452 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fd510014030 con 0x7fd518152cb0 2024-04-26T18:25:18.934 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:25:18.935 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:25:18.935 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd50406c8f0 msgr2=0x7fd50406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd50406c8f0 0x7fd50406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd508000f60 tx=0x7fd508007d50 comp rx=0 tx=0).stop 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd518152cb0 msgr2=0x7fd518147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd518152cb0 0x7fd518147bc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd51000cd80 tx=0x7fd51000a650 comp rx=0 tx=0).stop 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 shutdown_connections 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd50406c8f0 0x7fd50406edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd518152cb0 0x7fd518147bc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5180c89f0 0x7fd5181f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 --2- 172.21.15.139:0/772306452 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5180c7c20 0x7fd51814d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:18.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 >> 172.21.15.139:0/772306452 conn(0x7fd518068270 msgr2=0x7fd518068650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:18.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 shutdown_connections 2024-04-26T18:25:18.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:18.936+0000 7fd51f007640 1 -- 172.21.15.139:0/772306452 wait complete. 2024-04-26T18:25:18.947 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 4e4f30f2 --release --await' 2024-04-26T18:25:18.947 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 4e4f30f2 --release --await 2024-04-26T18:25:19.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.052+0000 7fe2bdaa0640 1 Processor -- start 2024-04-26T18:25:19.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.052+0000 7fe2bdaa0640 1 -- start start 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2bdaa0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806fbe0 0x7fe2b80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2bdaa0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe2b806ffc0 0x7fe2b815a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2bdaa0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b815ddd0 con 0x7fe2b8074600 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2bdaa0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b815d8a0 con 0x7fe2b806ffc0 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2bdaa0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b8159db0 con 0x7fe2b806fbe0 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b7fff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fe2b8074600 0x7fe2b8153680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:48216/0 (socket says 172.21.15.139:48216) 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b6ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe2b806ffc0 0x7fe2b815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b7fff640 1 -- 172.21.15.139:0/3946269283 learned_addr learned my addr 172.21.15.139:0/3946269283 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/3946269283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806fbe0 0x7fe2b80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b6ffd640 1 -- 172.21.15.139:0/3946269283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806fbe0 msgr2=0x7fe2b80c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/3946269283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806fbe0 0x7fe2b80c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b6ffd640 1 -- 172.21.15.139:0/3946269283 >> v1:172.21.15.139:6789/0 conn(0x7fe2b8074600 legacy=0x7fe2b8153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b67fc640 1 -- 172.21.15.139:0/3946269283 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502856824 0 0) 0x7fe2b815ddd0 con 0x7fe2b8074600 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.053+0000 7fe2b6ffd640 1 -- 172.21.15.139:0/3946269283 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b80ca830 con 0x7fe2b806ffc0 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.054+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/3946269283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806ffc0 0x7fe2b815a240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0097a0 tx=0x7fe2ac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24828e12dc713198 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.054+0000 7fe2b67fc640 1 -- 172.21.15.139:0/3946269283 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac037070 con 0x7fe2b806ffc0 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.054+0000 7fe2b67fc640 1 -- 172.21.15.139:0/3946269283 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac032440 con 0x7fe2b806ffc0 2024-04-26T18:25:19.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.054+0000 7fe2b67fc640 1 -- 172.21.15.139:0/3946269283 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac032810 con 0x7fe2b806ffc0 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.054+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/3946269283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806ffc0 msgr2=0x7fe2b815a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.054+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/3946269283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806ffc0 0x7fe2b815a240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0097a0 tx=0x7fe2ac02a210 comp rx=0 tx=0).stop 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.055+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/3946269283 shutdown_connections 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.055+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/3946269283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806ffc0 0x7fe2b815a240 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.055+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/3946269283 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806fbe0 0x7fe2b80c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.055+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/3946269283 >> 172.21.15.139:0/3946269283 conn(0x7fe2b806dd40 msgr2=0x7fe2b806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.055+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/3946269283 shutdown_connections 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.055+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/3946269283 wait complete. 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.056+0000 7fe2bdaa0640 1 Processor -- start 2024-04-26T18:25:19.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.056+0000 7fe2bdaa0640 1 -- start start 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.056+0000 7fe2bdaa0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806fbe0 0x7fe2b80cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.056+0000 7fe2bdaa0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806ffc0 0x7fe2b80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2bdaa0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2b8074600 0x7fe2b80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2bdaa0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b80c9460 con 0x7fe2b806fbe0 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2bdaa0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b8159a40 con 0x7fe2b8074600 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2bdaa0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b80ca4c0 con 0x7fe2b806ffc0 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806fbe0 0x7fe2b80cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806fbe0 0x7fe2b80cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37734/0 (socket says 172.21.15.139:37734) 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1107985239 learned_addr learned my addr 172.21.15.139:0/1107985239 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806ffc0 0x7fe2b80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b7fff640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2b8074600 0x7fe2b80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806ffc0 msgr2=0x7fe2b80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806ffc0 0x7fe2b80cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2b8074600 msgr2=0x7fe2b80cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2b8074600 0x7fe2b80cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1107985239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b80c66f0 con 0x7fe2b806fbe0 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806fbe0 0x7fe2b80cd8e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800d800 tx=0x7fe2a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe29ffff640 1 -- 172.21.15.139:0/1107985239 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800b6c0 con 0x7fe2b806fbe0 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe29ffff640 1 -- 172.21.15.139:0/1107985239 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8019070 con 0x7fe2b806fbe0 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b81effe0 con 0x7fe2b806fbe0 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe29ffff640 1 -- 172.21.15.139:0/1107985239 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800ba80 con 0x7fe2b806fbe0 2024-04-26T18:25:19.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.057+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b814ca30 con 0x7fe2b806fbe0 2024-04-26T18:25:19.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.059+0000 7fe29ffff640 1 -- 172.21.15.139:0/1107985239 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2a800bc20 con 0x7fe2b806fbe0 2024-04-26T18:25:19.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.059+0000 7fe29ffff640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe2a406c8f0 0x7fe2a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.059+0000 7fe29ffff640 1 -- 172.21.15.139:0/1107985239 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fe2a808c3b0 con 0x7fe2b806fbe0 2024-04-26T18:25:19.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.059+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe2a406c8f0 0x7fe2a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.059+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe2a406c8f0 0x7fe2a406edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac034000 tx=0x7fe2ac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.060+0000 7fe2c07bf740 1 Processor -- start 2024-04-26T18:25:19.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.060+0000 7fe2c07bf740 1 -- start start 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530634470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x5615305f5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x5615305f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56153055a040 con 0x5615305f54b0 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5615304f5b60 con 0x5615305f6a10 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x561530556000 con 0x5615306349b0 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530634470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530634470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37742/0 (socket says 172.21.15.139:37742) 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 -- 172.21.15.139:0/3287270024 learned_addr learned my addr 172.21.15.139:0/3287270024 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x5615305f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b7fff640 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x5615305f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 -- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 msgr2=0x5615305f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x5615305f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 -- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 msgr2=0x5615305f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x5615305f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 -- 172.21.15.139:0/3287270024 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615304ea9c0 con 0x5615305f54b0 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.061+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530634470 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8056190 tx=0x7fe2a8011340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8bb49d29d23eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe29d7fa640 1 -- 172.21.15.139:0/3287270024 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8072020 con 0x5615305f54b0 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe29d7fa640 1 -- 172.21.15.139:0/3287270024 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8059d30 con 0x5615305f54b0 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe29d7fa640 1 -- 172.21.15.139:0/3287270024 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a805e0e0 con 0x5615305f54b0 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 -- 172.21.15.139:0/3287270024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 msgr2=0x561530634470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530634470 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8056190 tx=0x7fe2a8011340 comp rx=0 tx=0).stop 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 -- 172.21.15.139:0/3287270024 shutdown_connections 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x5615305f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x5615305f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/3287270024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530634470 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 -- 172.21.15.139:0/3287270024 >> 172.21.15.139:0/3287270024 conn(0x5615305bc930 msgr2=0x561530639450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 -- 172.21.15.139:0/3287270024 shutdown_connections 2024-04-26T18:25:19.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.062+0000 7fe2c07bf740 1 -- 172.21.15.139:0/3287270024 wait complete. 2024-04-26T18:25:19.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.063+0000 7fe2c07bf740 1 -- start start 2024-04-26T18:25:19.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.063+0000 7fe2c07bf740 1 Processor -- start 2024-04-26T18:25:19.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530632190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x561530649240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x56153061fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5615305f3af0 con 0x5615305f54b0 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x5615304f34f0 con 0x5615305f6a10 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x5615305f7040 con 0x5615306349b0 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 10 client.0 _ll_register_callbacks cb 0x561530550c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530632190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530632190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37752/0 (socket says 172.21.15.139:37752) 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 -- 172.21.15.139:0/2823803700 learned_addr learned my addr 172.21.15.139:0/2823803700 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x561530649240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b7fff640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x56153061fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 -- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 msgr2=0x56153061fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x56153061fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 -- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 msgr2=0x561530649240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x561530649240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 -- 172.21.15.139:0/2823803700 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56153026b920 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x561530649240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530632190 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006fd0 tx=0x7fe2a8020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a0c38e6e8b1d9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2967fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2967fc640 1 -- 172.21.15.139:0/2823803700 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8072040 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2967fc640 1 -- 172.21.15.139:0/2823803700 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fe2a8079300 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a8059d30 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2967fc640 1 -- 172.21.15.139:0/2823803700 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe2a808a250 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 10 client.5919 fetch_fsmap learned FSMap version 9 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.064+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561530337d30 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2967fc640 1 -- 172.21.15.139:0/2823803700 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8059d30 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2967fc640 1 -- 172.21.15.139:0/2823803700 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fe2a8013070 con 0x5615305f54b0 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2c07bf740 10 client.5919 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2c07bf740 10 client.5919 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:25:19.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2c07bf740 20 client.5919 populate_metadata read hostname 'smithi139' 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561530633240 0x56153061c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2c07bf740 4 client.5919 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56153052da00 con 0x561530633240 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561530633240 0x56153061c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2967fc640 10 client.5919 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.065+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561530633240 0x56153061c290 crc :-1 s=READY pgs=605 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9b32726fadee10 server_cookie=fffc479817949af in_seq=0 out_seq=0 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2967fc640 1 -- 172.21.15.139:0/2823803700 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56153052da00 con 0x561530633240 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2967fc640 10 client.5919 handle_command_reply: tid=0 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 client.5919 shutdown 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 msgr2=0x561530632190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530632190 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006fd0 tx=0x7fe2a8020070 comp rx=0 tx=0).stop 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 shutdown_connections 2024-04-26T18:25:19.072 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x561530633240 0x56153061c290 crc :-1 s=READY pgs=605 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615306349b0 0x56153061fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615305f6a10 0x561530649240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/2823803700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x561530632190 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2967fc640 0 client.5919 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 >> 172.21.15.139:0/2823803700 conn(0x5615305bc930 msgr2=0x56153061e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 shutdown_connections 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 1 -- 172.21.15.139:0/2823803700 wait complete. 2024-04-26T18:25:19.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.066+0000 7fe2c07bf740 20 client.5919 trim_cache size 0 max 16384 2024-04-26T18:25:19.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.083+0000 7fe2c07bf740 1 Processor -- start 2024-04-26T18:25:19.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.083+0000 7fe2c07bf740 1 -- start start 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x5615305f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615306ab590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x5615306abad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81fe490 con 0x5615305f54b0 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81fd370 con 0x5615306349b0 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b81fb9a0 con 0x5615305f6a10 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x5615305f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x5615305f5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37766/0 (socket says 172.21.15.139:37766) 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 -- 172.21.15.139:0/616780901 learned_addr learned my addr 172.21.15.139:0/616780901 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b7fff640 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x5615306abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615306ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 -- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 msgr2=0x5615306ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615306ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 -- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 msgr2=0x5615306abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x5615306abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 -- 172.21.15.139:0/616780901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615305f4f10 con 0x5615305f54b0 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b7fff640 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x5615306abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615306ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.084+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x5615305f5a80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80623e0 tx=0x7fe2a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f3376bd9adc387 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe29cff9640 1 -- 172.21.15.139:0/616780901 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8059d30 con 0x5615305f54b0 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe29cff9640 1 -- 172.21.15.139:0/616780901 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8077070 con 0x5615305f54b0 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe29cff9640 1 -- 172.21.15.139:0/616780901 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80721e0 con 0x5615305f54b0 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 -- 172.21.15.139:0/616780901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 msgr2=0x5615305f5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x5615305f5a80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80623e0 tx=0x7fe2a8015000 comp rx=0 tx=0).stop 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 -- 172.21.15.139:0/616780901 shutdown_connections 2024-04-26T18:25:19.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x5615306abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615306ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/616780901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x5615305f5a80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 -- 172.21.15.139:0/616780901 >> 172.21.15.139:0/616780901 conn(0x5615305bc930 msgr2=0x561530648610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 -- 172.21.15.139:0/616780901 shutdown_connections 2024-04-26T18:25:19.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.085+0000 7fe2c07bf740 1 -- 172.21.15.139:0/616780901 wait complete. 2024-04-26T18:25:19.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 -- start start 2024-04-26T18:25:19.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 Processor -- start 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x56153064da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615305f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x561530618ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81fbf30 con 0x5615305f54b0 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b81fcca0 con 0x5615306349b0 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.086+0000 7fe2c07bf740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b81fc5d0 con 0x5615305f6a10 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2c07bf740 10 client.0 _ll_register_callbacks cb 0x7fe2b0005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x56153064da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x56153064da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37782/0 (socket says 172.21.15.139:37782) 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1815425525 learned_addr learned my addr 172.21.15.139:0/1815425525 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615305f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b7fff640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x561530618ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 msgr2=0x5615305f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615305f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 msgr2=0x561530618ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x561530618ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 -- 172.21.15.139:0/1815425525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615305efe30 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615305f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2b77fe640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x56153064da30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8059cc0 tx=0x7fe2a8056080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2118474a7d806048 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2967fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2967fc640 1 -- 172.21.15.139:0/1815425525 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8059d30 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2967fc640 1 -- 172.21.15.139:0/1815425525 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fe2a808c0b0 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a8077070 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2967fc640 1 -- 172.21.15.139:0/1815425525 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe2a8062b60 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2c07bf740 10 client.5925 fetch_fsmap learned FSMap version 9 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5615305efe30 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2967fc640 1 -- 172.21.15.139:0/1815425525 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8077070 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2967fc640 1 -- 172.21.15.139:0/1815425525 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fe2a8059180 con 0x5615305f54b0 2024-04-26T18:25:19.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.087+0000 7fe2c07bf740 10 client.5925 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 10 client.5925 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 20 client.5925 populate_metadata read hostname 'smithi139' 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5615306ac9c0 0x5615306acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 4 client.5925 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4e4f30f2", "release": true, "await": true}] 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4e4f30f2", "release": true, "await": true}) -- 0x56153061ddf0 con 0x5615306ac9c0 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5615306ac9c0 0x5615306acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2967fc640 10 client.5925 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2b6ffd640 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5615306ac9c0 0x5615306acda0 crc :-1 s=READY pgs=606 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3cf3b7285558c3a server_cookie=a71c4c064917c456 in_seq=0 out_seq=0 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2967fc640 1 -- 172.21.15.139:0/1815425525 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x56153061ddf0 con 0x5615306ac9c0 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2967fc640 10 client.5925 handle_command_reply: tid=0 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 client.5925 shutdown 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 msgr2=0x56153064da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x56153064da30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8059cc0 tx=0x7fe2a8056080 comp rx=0 tx=0).stop 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 shutdown_connections 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5615306349b0 0x561530618ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5615306ac9c0 0x5615306acda0 crc :-1 s=READY pgs=606 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5615305f6a10 0x5615305f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 --2- 172.21.15.139:0/1815425525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615305f54b0 0x56153064da30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2967fc640 0 client.5925 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.088+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 >> 172.21.15.139:0/1815425525 conn(0x5615305bc930 msgr2=0x561530648610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 shutdown_connections 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2c07bf740 1 -- 172.21.15.139:0/1815425525 wait complete. 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2c07bf740 20 client.5925 trim_cache size 0 max 16384 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:25:19.095 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 88, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "4e4f30f2": { 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 88, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.0, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:25:19.096 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:25:19.097 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:25:19.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:19.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:19.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:19.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:19.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:19.097 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe2a406c8f0 msgr2=0x7fe2a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe2a406c8f0 0x7fe2a406edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac034000 tx=0x7fe2ac02e000 comp rx=0 tx=0).stop 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806fbe0 msgr2=0x7fe2b80cd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806fbe0 0x7fe2b80cd8e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800d800 tx=0x7fe2a800dcc0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 shutdown_connections 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe2a406c8f0 0x7fe2a406edb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe2b8074600 0x7fe2b80cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe2b806ffc0 0x7fe2b80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 --2- 172.21.15.139:0/1107985239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2b806fbe0 0x7fe2b80cd8e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 >> 172.21.15.139:0/1107985239 conn(0x7fe2b806dd40 msgr2=0x7fe2b8158690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 shutdown_connections 2024-04-26T18:25:19.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.089+0000 7fe2bdaa0640 1 -- 172.21.15.139:0/1107985239 wait complete. 2024-04-26T18:25:19.100 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4e4f30f2', seconds elapsed: 25.0 2024-04-26T18:25:19.100 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-04-26T18:25:19.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:25:19.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.197+0000 7f9bda19e640 1 Processor -- start 2024-04-26T18:25:19.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.197+0000 7f9bda19e640 1 -- start start 2024-04-26T18:25:19.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bda19e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9bd406c580 0x7f9bd40745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bda19e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd406c960 0x7f9bd40ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bda19e640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd4073130 con 0x7f9bd40c4ff0 2024-04-26T18:25:19.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bda19e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd4073410 con 0x7f9bd406c580 2024-04-26T18:25:19.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bda19e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd415bde0 con 0x7f9bd406c960 2024-04-26T18:25:19.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bd919c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9bd406c580 0x7f9bd40745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bd899b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f9bd40c4ff0 0x7f9bd4158750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:48226/0 (socket says 172.21.15.139:48226) 2024-04-26T18:25:19.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bd899b640 1 -- 172.21.15.139:0/328192548 learned_addr learned my addr 172.21.15.139:0/328192548 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:25:19.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.198+0000 7f9bd999d640 1 --2- 172.21.15.139:0/328192548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd406c960 0x7f9bd40ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.199+0000 7f9bd919c640 1 -- 172.21.15.139:0/328192548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd406c960 msgr2=0x7f9bd40ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.199+0000 7f9bd919c640 1 --2- 172.21.15.139:0/328192548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd406c960 0x7f9bd40ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.199+0000 7f9bd919c640 1 -- 172.21.15.139:0/328192548 >> v1:172.21.15.139:6789/0 conn(0x7f9bd40c4ff0 legacy=0x7f9bd4158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.199+0000 7f9bcbfff640 1 -- 172.21.15.139:0/328192548 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316051200 0 0) 0x7f9bd4073130 con 0x7f9bd40c4ff0 2024-04-26T18:25:19.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.199+0000 7f9bd919c640 1 -- 172.21.15.139:0/328192548 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd415c0c0 con 0x7f9bd406c580 2024-04-26T18:25:19.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.200+0000 7f9bd919c640 1 --2- 172.21.15.139:0/328192548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd40745f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00097a0 tx=0x7f9bd002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957409cf94926953 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.200+0000 7f9bcbfff640 1 -- 172.21.15.139:0/328192548 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0037070 con 0x7f9bd406c580 2024-04-26T18:25:19.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.201+0000 7f9bcbfff640 1 -- 172.21.15.139:0/328192548 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd0032440 con 0x7f9bd406c580 2024-04-26T18:25:19.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.201+0000 7f9bcbfff640 1 -- 172.21.15.139:0/328192548 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0032810 con 0x7f9bd406c580 2024-04-26T18:25:19.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 -- 172.21.15.139:0/328192548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 msgr2=0x7f9bd40745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 --2- 172.21.15.139:0/328192548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd40745f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00097a0 tx=0x7f9bd002a210 comp rx=0 tx=0).stop 2024-04-26T18:25:19.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 -- 172.21.15.139:0/328192548 shutdown_connections 2024-04-26T18:25:19.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 --2- 172.21.15.139:0/328192548 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd406c960 0x7f9bd40ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 --2- 172.21.15.139:0/328192548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd40745f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 -- 172.21.15.139:0/328192548 >> 172.21.15.139:0/328192548 conn(0x7f9bd4071260 msgr2=0x7f9bd40ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 -- 172.21.15.139:0/328192548 shutdown_connections 2024-04-26T18:25:19.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.202+0000 7f9bda19e640 1 -- 172.21.15.139:0/328192548 wait complete. 2024-04-26T18:25:19.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.203+0000 7f9bda19e640 1 Processor -- start 2024-04-26T18:25:19.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bda19e640 1 -- start start 2024-04-26T18:25:19.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bda19e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bda19e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bd406c960 0x7f9bd4149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bda19e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd40c4ff0 0x7f9bd414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bda19e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4158e60 con 0x7f9bd406c580 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bda19e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd415c680 con 0x7f9bd406c960 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bda19e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd415cba0 con 0x7f9bd40c4ff0 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bd919c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bd919c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd414e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37796/0 (socket says 172.21.15.139:37796) 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bd919c640 1 -- 172.21.15.139:0/2519215234 learned_addr learned my addr 172.21.15.139:0/2519215234 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.204+0000 7f9bd999d640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd40c4ff0 0x7f9bd414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bd899b640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bd406c960 0x7f9bd4149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bd919c640 1 -- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd40c4ff0 msgr2=0x7f9bd414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bd919c640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd40c4ff0 0x7f9bd414ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bd919c640 1 -- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bd406c960 msgr2=0x7f9bd4149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bd919c640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bd406c960 0x7f9bd4149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bd919c640 1 -- 172.21.15.139:0/2519215234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd4150840 con 0x7f9bd406c580 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bd919c640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd414e120 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00097a0 tx=0x7f9bd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bc9ffb640 1 -- 172.21.15.139:0/2519215234 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0041070 con 0x7f9bd406c580 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bc9ffb640 1 -- 172.21.15.139:0/2519215234 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd003c870 con 0x7f9bd406c580 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bc9ffb640 1 -- 172.21.15.139:0/2519215234 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0037040 con 0x7f9bd406c580 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd4150ae0 con 0x7f9bd406c580 2024-04-26T18:25:19.207 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.205+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd414d920 con 0x7f9bd406c580 2024-04-26T18:25:19.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.206+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd40506c0 con 0x7f9bd406c580 2024-04-26T18:25:19.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.207+0000 7f9bc9ffb640 1 -- 172.21.15.139:0/2519215234 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bd0044070 con 0x7f9bd406c580 2024-04-26T18:25:19.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.207+0000 7f9bc9ffb640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9bb806c8f0 0x7f9bb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.208+0000 7f9bd899b640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9bb806c8f0 0x7f9bb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.208+0000 7f9bc9ffb640 1 -- 172.21.15.139:0/2519215234 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f9bd00ac830 con 0x7f9bd406c580 2024-04-26T18:25:19.208 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.208+0000 7f9bd899b640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9bb806c8f0 0x7f9bb806edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9bd41561d0 tx=0x7f9bc4007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.212+0000 7f9bc9ffb640 1 -- 172.21.15.139:0/2519215234 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9bd007a260 con 0x7f9bd406c580 2024-04-26T18:25:19.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.432+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bd40684a0 con 0x7f9bd406c580 2024-04-26T18:25:19.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.433+0000 7f9bc9ffb640 1 -- 172.21.15.139:0/2519215234 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f9bd007e560 con 0x7f9bd406c580 2024-04-26T18:25:19.433 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:25:19.433 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:25:19.433 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:25:19.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9bb806c8f0 msgr2=0x7f9bb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9bb806c8f0 0x7f9bb806edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9bd41561d0 tx=0x7f9bc4007e40 comp rx=0 tx=0).stop 2024-04-26T18:25:19.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 msgr2=0x7f9bd414e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd414e120 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00097a0 tx=0x7f9bd00046c0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 shutdown_connections 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9bb806c8f0 0x7f9bb806edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9bd40c4ff0 0x7f9bd414ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9bd406c960 0x7f9bd4149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 --2- 172.21.15.139:0/2519215234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bd406c580 0x7f9bd414e120 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 >> 172.21.15.139:0/2519215234 conn(0x7f9bd4071260 msgr2=0x7f9bd40c8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 shutdown_connections 2024-04-26T18:25:19.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.435+0000 7f9bda19e640 1 -- 172.21.15.139:0/2519215234 wait complete. 2024-04-26T18:25:19.446 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0' 2024-04-26T18:25:19.446 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0 2024-04-26T18:25:19.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.557+0000 7fb4615e7640 1 Processor -- start 2024-04-26T18:25:19.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.557+0000 7fb4615e7640 1 -- start start 2024-04-26T18:25:19.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb4615e7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0cd520 0x7fb45c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb4615e7640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c15c450 con 0x7fb45c155f60 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb4615e7640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45c15c730 con 0x7fb45c0c63a0 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb4615e7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c15ca10 con 0x7fb45c0cd520 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb45affd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb45c155f60 0x7fb45c0c79b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49076/0 (socket says 172.21.15.139:49076) 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb45affd640 1 -- 172.21.15.139:0/902889575 learned_addr learned my addr 172.21.15.139:0/902889575 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/902889575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0cd520 0x7fb45c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441207875 0 0) 0x7fb45c15c450 con 0x7fb45c155f60 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb444003520 con 0x7fb45c155f60 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927176262 0 0) 0x7fb45c15c730 con 0x7fb45c0c63a0 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb45c15c450 con 0x7fb45c0c63a0 2024-04-26T18:25:19.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218567834 0 0) 0x7fb444003520 con 0x7fb45c155f60 2024-04-26T18:25:19.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb45a7fc640 1 -- 172.21.15.139:0/902889575 >> v1:172.21.15.143:6789/0 conn(0x7fb45c0c63a0 legacy=0x7fb45c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb45a7fc640 1 -- 172.21.15.139:0/902889575 >> v1:172.21.15.139:6789/0 conn(0x7fb45c155f60 legacy=0x7fb45c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.558+0000 7fb45a7fc640 1 -- 172.21.15.139:0/902889575 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c0c6ed0 con 0x7fb45c0cd520 2024-04-26T18:25:19.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.559+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/902889575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0cd520 0x7fb45c15bac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097d0 tx=0x7fb44c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fb5ed6763145140 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.559+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c037070 con 0x7fb45c0cd520 2024-04-26T18:25:19.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.559+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44c02acc0 con 0x7fb45c0cd520 2024-04-26T18:25:19.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.559+0000 7fb459ffb640 1 -- 172.21.15.139:0/902889575 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450001670 con 0x7fb45c0cd520 2024-04-26T18:25:19.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.560+0000 7fb4615e7640 1 -- 172.21.15.139:0/902889575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0cd520 msgr2=0x7fb45c15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.560+0000 7fb4615e7640 1 --2- 172.21.15.139:0/902889575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0cd520 0x7fb45c15bac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097d0 tx=0x7fb44c02a230 comp rx=0 tx=0).stop 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.560+0000 7fb4615e7640 1 -- 172.21.15.139:0/902889575 shutdown_connections 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.560+0000 7fb4615e7640 1 --2- 172.21.15.139:0/902889575 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0cd520 0x7fb45c15bac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.560+0000 7fb4615e7640 1 -- 172.21.15.139:0/902889575 >> 172.21.15.139:0/902889575 conn(0x7fb45c072930 msgr2=0x7fb45c072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.560+0000 7fb4615e7640 1 -- 172.21.15.139:0/902889575 shutdown_connections 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.560+0000 7fb4615e7640 1 -- 172.21.15.139:0/902889575 wait complete. 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.561+0000 7fb4615e7640 1 Processor -- start 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.561+0000 7fb4615e7640 1 -- start start 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4615e7640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0c63a0 0x7fb45c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4615e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb45c0cd520 0x7fb45c0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4615e7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb45c155f60 0x7fb45c15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4615e7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c0c6ab0 con 0x7fb45c0cd520 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4615e7640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c0c7490 con 0x7fb45c155f60 2024-04-26T18:25:19.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4615e7640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c0c6c30 con 0x7fb45c0c63a0 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb45c0cd520 0x7fb45c0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb45c0cd520 0x7fb45c0cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49180/0 (socket says 172.21.15.139:49180) 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 -- 172.21.15.139:0/1655515056 learned_addr learned my addr 172.21.15.139:0/1655515056 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45affd640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0c63a0 0x7fb45c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45b7fe640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb45c155f60 0x7fb45c15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 -- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0c63a0 msgr2=0x7fb45c15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0c63a0 0x7fb45c15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 -- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb45c155f60 msgr2=0x7fb45c15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb45c155f60 0x7fb45c15b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 -- 172.21.15.139:0/1655515056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c15a680 con 0x7fb45c0cd520 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb45c0cd520 0x7fb45c0cbe40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb44c035040 tx=0x7fb44c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4437fe640 1 -- 172.21.15.139:0/1655515056 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c041020 con 0x7fb45c0cd520 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4437fe640 1 -- 172.21.15.139:0/1655515056 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44c03d640 con 0x7fb45c0cd520 2024-04-26T18:25:19.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.562+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c1e5140 con 0x7fb45c0cd520 2024-04-26T18:25:19.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.563+0000 7fb4437fe640 1 -- 172.21.15.139:0/1655515056 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c037040 con 0x7fb45c0cd520 2024-04-26T18:25:19.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.563+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c1f5360 con 0x7fb45c0cd520 2024-04-26T18:25:19.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.564+0000 7fb4437fe640 1 -- 172.21.15.139:0/1655515056 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb44c044020 con 0x7fb45c0cd520 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.564+0000 7fb4437fe640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb44806c8f0 0x7fb44806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.564+0000 7fb4437fe640 1 -- 172.21.15.139:0/1655515056 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb44c0ac3c0 con 0x7fb45c0cd520 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.564+0000 7fb45affd640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb44806c8f0 0x7fb44806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.565+0000 7fb45affd640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb44806c8f0 0x7fb44806edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb4500017e0 tx=0x7fb450001610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.565+0000 7fb4643d9740 1 Processor -- start 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb4643d9740 1 -- start start 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf9213c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf9213cae0 0x55bf920fd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf920fdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb4643d9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf92060d80 con 0x55bf920feb40 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55bf91ffcc20 con 0x55bf920fd5e0 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55bf9205cd40 con 0x55bf9213cae0 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb45b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf920fdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb45affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf9213c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb45affd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf9213c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:46554/0 (socket says 172.21.15.139:46554) 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb45affd640 1 -- 172.21.15.139:0/3069167706 learned_addr learned my addr 172.21.15.139:0/3069167706 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.566+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf9213cae0 0x55bf920fd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45affd640 1 -- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf9213cae0 msgr2=0x55bf920fd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45affd640 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf9213cae0 0x55bf920fd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45affd640 1 -- 172.21.15.139:0/3069167706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 msgr2=0x55bf920fdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45affd640 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf920fdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45affd640 1 -- 172.21.15.139:0/3069167706 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf91e3ed80 con 0x55bf920fd5e0 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf9213cae0 0x55bf920fd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45b7fe640 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf920fdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb45affd640 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf9213c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb45000fb70 tx=0x7fb450012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e4d7e9aea6f601 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb440ff9640 1 -- 172.21.15.139:0/3069167706 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450025070 con 0x55bf920fd5e0 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb440ff9640 1 -- 172.21.15.139:0/3069167706 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45001b050 con 0x55bf920fd5e0 2024-04-26T18:25:19.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.567+0000 7fb440ff9640 1 -- 172.21.15.139:0/3069167706 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450014e20 con 0x55bf920fd5e0 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 -- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 msgr2=0x55bf9213c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf9213c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb45000fb70 tx=0x7fb450012000 comp rx=0 tx=0).stop 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 -- 172.21.15.139:0/3069167706 shutdown_connections 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf920fdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf9213cae0 0x55bf920fd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3069167706 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf9213c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 -- 172.21.15.139:0/3069167706 >> 172.21.15.139:0/3069167706 conn(0x55bf920c4740 msgr2=0x55bf92141580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 -- 172.21.15.139:0/3069167706 shutdown_connections 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 -- 172.21.15.139:0/3069167706 wait complete. 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 -- start start 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.568+0000 7fb4643d9740 1 Processor -- start 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf92136150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920feb40 0x55bf92127a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf9213cae0 0x55bf92137a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb4643d9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf920fbc20 con 0x55bf9213cae0 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55bf91ffa840 con 0x55bf920fd5e0 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55bf920ff170 con 0x55bf920feb40 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb4643d9740 10 client.0 _ll_register_callbacks cb 0x55bf91ffe5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf9213cae0 0x55bf92137a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf9213cae0 0x55bf92137a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49190/0 (socket says 172.21.15.139:49190) 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 -- 172.21.15.139:0/2353438171 learned_addr learned my addr 172.21.15.139:0/2353438171 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45affd640 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf92136150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920feb40 0x55bf92127a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 -- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920feb40 msgr2=0x55bf92127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920feb40 0x55bf92127a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 -- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 msgr2=0x55bf92136150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf92136150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.569+0000 7fb45b7fe640 1 -- 172.21.15.139:0/2353438171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf91e9f510 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb45b7fe640 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf9213cae0 0x55bf92137a40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb4540128c0 tx=0x7fb454012d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d013ba064181f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb439ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb439ffb640 1 -- 172.21.15.139:0/2353438171 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454002070 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb439ffb640 1 -- 172.21.15.139:0/2353438171 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb454006d60 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb45001b050 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb439ffb640 1 -- 172.21.15.139:0/2353438171 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb454003970 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 10 client.5946 fetch_fsmap learned FSMap version 9 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bf91d32670 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb439ffb640 1 -- 172.21.15.139:0/2353438171 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45001b050 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb439ffb640 1 -- 172.21.15.139:0/2353438171 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb454003b10 con 0x55bf9213cae0 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 10 client.5946 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 10 client.5946 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 20 client.5946 populate_metadata read hostname 'smithi139' 2024-04-26T18:25:19.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf921345d0 0x55bf9214e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 4 client.5946 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf9206e990 con 0x55bf921345d0 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.570+0000 7fb45affd640 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf921345d0 0x55bf9214e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb439ffb640 10 client.5946 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb45affd640 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf921345d0 0x55bf9214e290 crc :-1 s=READY pgs=607 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d610ef2b0b4b8f7f server_cookie=37e31a015df7d7c in_seq=0 out_seq=0 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb439ffb640 1 -- 172.21.15.139:0/2353438171 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf9206e990 con 0x55bf921345d0 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb439ffb640 10 client.5946 handle_command_reply: tid=0 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb4643d9740 1 client.5946 shutdown 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf9213cae0 msgr2=0x55bf92137a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf9213cae0 0x55bf92137a40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb4540128c0 tx=0x7fb454012d80 comp rx=0 tx=0).stop 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 shutdown_connections 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf9213cae0 0x55bf92137a40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.571+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf921345d0 0x55bf9214e290 crc :-1 s=READY pgs=607 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.572+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920feb40 0x55bf92127a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.572+0000 7fb439ffb640 0 client.5946 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.572+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2353438171 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920fd5e0 0x55bf92136150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.572+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 >> 172.21.15.139:0/2353438171 conn(0x55bf920c4740 msgr2=0x55bf92141a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.572+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 shutdown_connections 2024-04-26T18:25:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.572+0000 7fb4643d9740 1 -- 172.21.15.139:0/2353438171 wait complete. 2024-04-26T18:25:19.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.572+0000 7fb4643d9740 20 client.5946 trim_cache size 0 max 16384 2024-04-26T18:25:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 Processor -- start 2024-04-26T18:25:19.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 -- start start 2024-04-26T18:25:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920fd5e0 0x55bf921515f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920feb40 0x55bf92125a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf921345d0 0x55bf92125f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c200690 con 0x55bf920fd5e0 2024-04-26T18:25:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1ff570 con 0x55bf920feb40 2024-04-26T18:25:19.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c0ce730 con 0x55bf921345d0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb45affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920fd5e0 0x55bf921515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb45affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920fd5e0 0x55bf921515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49200/0 (socket says 172.21.15.139:49200) 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.589+0000 7fb45affd640 1 -- 172.21.15.139:0/2047269304 learned_addr learned my addr 172.21.15.139:0/2047269304 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920feb40 0x55bf92125a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45b7fe640 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf921345d0 0x55bf92125f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45affd640 1 -- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf921345d0 msgr2=0x55bf92125f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45affd640 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf921345d0 0x55bf92125f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45affd640 1 -- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920feb40 msgr2=0x55bf92125a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45affd640 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920feb40 0x55bf92125a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45affd640 1 -- 172.21.15.139:0/2047269304 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9213b310 con 0x55bf920fd5e0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb45affd640 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920fd5e0 0x55bf921515f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb450020000 tx=0x7fb450014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e8e87fe64d6c85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb43bfff640 1 -- 172.21.15.139:0/2047269304 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450037070 con 0x55bf920fd5e0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb43bfff640 1 -- 172.21.15.139:0/2047269304 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb450031030 con 0x55bf920fd5e0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.590+0000 7fb43bfff640 1 -- 172.21.15.139:0/2047269304 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450025040 con 0x55bf920fd5e0 2024-04-26T18:25:19.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 -- 172.21.15.139:0/2047269304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920fd5e0 msgr2=0x55bf921515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920fd5e0 0x55bf921515f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb450020000 tx=0x7fb450014000 comp rx=0 tx=0).stop 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 -- 172.21.15.139:0/2047269304 shutdown_connections 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf921345d0 0x55bf92125f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf920feb40 0x55bf92125a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 --2- 172.21.15.139:0/2047269304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920fd5e0 0x55bf921515f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 -- 172.21.15.139:0/2047269304 >> 172.21.15.139:0/2047269304 conn(0x55bf920c4740 msgr2=0x55bf92127760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 -- 172.21.15.139:0/2047269304 shutdown_connections 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 -- 172.21.15.139:0/2047269304 wait complete. 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 -- start start 2024-04-26T18:25:19.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.591+0000 7fb4643d9740 1 Processor -- start 2024-04-26T18:25:19.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920fd5e0 0x55bf9213aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf921517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb4643d9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf921345d0 0x55bf92147860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb4643d9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1fe120 con 0x55bf920feb40 2024-04-26T18:25:19.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c1feea0 con 0x55bf921345d0 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb4643d9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb45c1fe7d0 con 0x55bf920fd5e0 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb4643d9740 10 client.0 _ll_register_callbacks cb 0x7fb454001a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf921517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf921517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:49202/0 (socket says 172.21.15.139:49202) 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 -- 172.21.15.139:0/3345158448 learned_addr learned my addr 172.21.15.139:0/3345158448 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45affd640 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920fd5e0 0x55bf9213aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45b7fe640 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf921345d0 0x55bf92147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 -- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920fd5e0 msgr2=0x55bf9213aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920fd5e0 0x55bf9213aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 -- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf921345d0 msgr2=0x55bf92147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf921345d0 0x55bf92147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 -- 172.21.15.139:0/3345158448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf920f7b60 con 0x55bf920feb40 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb45a7fc640 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf921517a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb44c079cf0 tx=0x7fb44c0ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03e69b8e228030b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:19.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.592+0000 7fb439ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb439ffb640 1 -- 172.21.15.139:0/3345158448 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0aa1b0 con 0x55bf920feb40 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb439ffb640 1 -- 172.21.15.139:0/3345158448 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb44c0763d0 con 0x55bf920feb40 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb450031030 con 0x55bf920feb40 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb439ffb640 1 -- 172.21.15.139:0/3345158448 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb44c098050 con 0x55bf920feb40 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 10 client.5952 fetch_fsmap learned FSMap version 9 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bf92161490 con 0x55bf920feb40 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb439ffb640 1 -- 172.21.15.139:0/3345158448 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb450031030 con 0x55bf920feb40 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb439ffb640 1 -- 172.21.15.139:0/3345158448 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb44c03a030 con 0x55bf920feb40 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 10 client.5952 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 10 client.5952 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 20 client.5952 populate_metadata read hostname 'smithi139' 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf9213cae0 0x55bf92147da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 4 client.5952 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}] 2024-04-26T18:25:19.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}) -- 0x55bf92141660 con 0x55bf9213cae0 2024-04-26T18:25:19.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.593+0000 7fb45affd640 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf9213cae0 0x55bf92147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:19.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.594+0000 7fb439ffb640 10 client.5952 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:19.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:19.594+0000 7fb45affd640 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf9213cae0 0x55bf92147da0 crc :-1 s=READY pgs=608 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce9b714543eb853 server_cookie=abaf0f62357c559f in_seq=0 out_seq=0 2024-04-26T18:25:20.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb439ffb640 1 -- 172.21.15.139:0/3345158448 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55bf92141660 con 0x55bf9213cae0 2024-04-26T18:25:20.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb439ffb640 10 client.5952 handle_command_reply: tid=0 2024-04-26T18:25:20.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 client.5952 shutdown 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 msgr2=0x55bf921517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf921517a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb44c079cf0 tx=0x7fb44c0ac040 comp rx=0 tx=0).stop 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 shutdown_connections 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf921345d0 0x55bf92147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf920feb40 0x55bf921517a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf9213cae0 0x55bf92147da0 crc :-1 s=READY pgs=608 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 --2- 172.21.15.139:0/3345158448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf920fd5e0 0x55bf9213aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb439ffb640 0 client.5952 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 >> 172.21.15.139:0/3345158448 conn(0x55bf920c4740 msgr2=0x55bf920fafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 shutdown_connections 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 1 -- 172.21.15.139:0/3345158448 wait complete. 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.135+0000 7fb4643d9740 20 client.5952 trim_cache size 0 max 16384 2024-04-26T18:25:20.137 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 90, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "75b8c65": { 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 90, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.0, 2024-04-26T18:25:20.138 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:20.139 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb44806c8f0 msgr2=0x7fb44806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb44806c8f0 0x7fb44806edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb4500017e0 tx=0x7fb450001610 comp rx=0 tx=0).stop 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb45c0cd520 msgr2=0x7fb45c0cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb45c0cd520 0x7fb45c0cbe40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb44c035040 tx=0x7fb44c0046c0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 shutdown_connections 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb44806c8f0 0x7fb44806edb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb45c155f60 0x7fb45c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb45c0cd520 0x7fb45c0cbe40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 --2- 172.21.15.139:0/1655515056 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb45c0c63a0 0x7fb45c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:20.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 >> 172.21.15.139:0/1655515056 conn(0x7fb45c072930 msgr2=0x7fb45c150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:20.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 shutdown_connections 2024-04-26T18:25:20.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:20.136+0000 7fb4615e7640 1 -- 172.21.15.139:0/1655515056 wait complete. 2024-04-26T18:25:20.147 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '75b8c65', quiesce took 1.0 seconds. Will release after: 21.05 2024-04-26T18:25:31.162 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:25:31.166 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:25:41.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:25:41.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.307+0000 7ff6da551640 1 Processor -- start 2024-04-26T18:25:41.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.307+0000 7ff6da551640 1 -- start start 2024-04-26T18:25:41.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6da551640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff6d40cb210 0x7ff6d4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6da551640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d40c95b0 con 0x7ff6d40c8a30 2024-04-26T18:25:41.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6da551640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d40c9820 con 0x7ff6d40cae30 2024-04-26T18:25:41.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6da551640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d4071b90 con 0x7ff6d40cb210 2024-04-26T18:25:41.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6d8aee640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7ff6d40c8a30 0x7ff6d4073bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34574/0 (socket says 172.21.15.139:34574) 2024-04-26T18:25:41.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6d37fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7ff6d40cb210 0x7ff6d4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6d8aee640 1 -- 172.21.15.139:0/2172393342 learned_addr learned my addr 172.21.15.139:0/2172393342 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:25:41.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6d37fe640 1 -- 172.21.15.139:0/2172393342 >> v1:172.21.15.143:6789/0 conn(0x7ff6d40cae30 legacy=0x7ff6d4071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6d37fe640 1 -- 172.21.15.139:0/2172393342 >> v1:172.21.15.139:6789/0 conn(0x7ff6d40c8a30 legacy=0x7ff6d4073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.308+0000 7ff6d37fe640 1 -- 172.21.15.139:0/2172393342 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d40c9b00 con 0x7ff6d40cb210 2024-04-26T18:25:41.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.309+0000 7ff6d37fe640 1 --2- 172.21.15.139:0/2172393342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d4155d10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80097a0 tx=0x7ff6c802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76af735c16c12e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.309+0000 7ff6d2ffd640 1 -- 172.21.15.139:0/2172393342 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8037070 con 0x7ff6d40cb210 2024-04-26T18:25:41.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.309+0000 7ff6d2ffd640 1 -- 172.21.15.139:0/2172393342 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c8032440 con 0x7ff6d40cb210 2024-04-26T18:25:41.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.309+0000 7ff6d2ffd640 1 -- 172.21.15.139:0/2172393342 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8032810 con 0x7ff6d40cb210 2024-04-26T18:25:41.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.310+0000 7ff6da551640 1 -- 172.21.15.139:0/2172393342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 msgr2=0x7ff6d4155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.310+0000 7ff6da551640 1 --2- 172.21.15.139:0/2172393342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d4155d10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80097a0 tx=0x7ff6c802a230 comp rx=0 tx=0).stop 2024-04-26T18:25:41.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.310+0000 7ff6da551640 1 -- 172.21.15.139:0/2172393342 shutdown_connections 2024-04-26T18:25:41.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.310+0000 7ff6da551640 1 --2- 172.21.15.139:0/2172393342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d4155d10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.310+0000 7ff6da551640 1 -- 172.21.15.139:0/2172393342 >> 172.21.15.139:0/2172393342 conn(0x7ff6d4068090 msgr2=0x7ff6d4068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.310+0000 7ff6da551640 1 -- 172.21.15.139:0/2172393342 shutdown_connections 2024-04-26T18:25:41.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.310+0000 7ff6da551640 1 -- 172.21.15.139:0/2172393342 wait complete. 2024-04-26T18:25:41.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.311+0000 7ff6da551640 1 Processor -- start 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.311+0000 7ff6da551640 1 -- start start 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6da551640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d40c8a30 0x7ff6d40ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6da551640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d40cae30 0x7ff6d41f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6da551640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d41f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6da551640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d4070f60 con 0x7ff6d40cb210 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6da551640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d4070d10 con 0x7ff6d40c8a30 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6da551640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d415f340 con 0x7ff6d40cae30 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d41f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d41f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43342/0 (socket says 172.21.15.139:43342) 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 -- 172.21.15.139:0/1679708413 learned_addr learned my addr 172.21.15.139:0/1679708413 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d37fe640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d40cae30 0x7ff6d41f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d3fff640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d40c8a30 0x7ff6d40ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 -- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d40cae30 msgr2=0x7ff6d41f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d40cae30 0x7ff6d41f1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 -- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d40c8a30 msgr2=0x7ff6d40ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d40c8a30 0x7ff6d40ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 -- 172.21.15.139:0/1679708413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d40c7240 con 0x7ff6d40cb210 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d3fff640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d40c8a30 0x7ff6d40ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d8aee640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d41f21e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00caa0 tx=0x7ff6cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d0ff9640 1 -- 172.21.15.139:0/1679708413 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc017070 con 0x7ff6d40cb210 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d0ff9640 1 -- 172.21.15.139:0/1679708413 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc00ab40 con 0x7ff6d40cb210 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d40c74e0 con 0x7ff6d40cb210 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.312+0000 7ff6d0ff9640 1 -- 172.21.15.139:0/1679708413 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc012400 con 0x7ff6d40cb210 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.313+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d41f5490 con 0x7ff6d40cb210 2024-04-26T18:25:41.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.314+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d4076d20 con 0x7ff6d40cb210 2024-04-26T18:25:41.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.314+0000 7ff6d0ff9640 1 -- 172.21.15.139:0/1679708413 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6cc01a070 con 0x7ff6d40cb210 2024-04-26T18:25:41.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.314+0000 7ff6d0ff9640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff6c006c8f0 0x7ff6c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.314+0000 7ff6d0ff9640 1 -- 172.21.15.139:0/1679708413 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7ff6cc08bb70 con 0x7ff6d40cb210 2024-04-26T18:25:41.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.314+0000 7ff6d3fff640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff6c006c8f0 0x7ff6c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.315+0000 7ff6d3fff640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff6c006c8f0 0x7ff6c006edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4001680 tx=0x7ff6c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.319+0000 7ff6d0ff9640 1 -- 172.21.15.139:0/1679708413 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff6cc059480 con 0x7ff6d40cb210 2024-04-26T18:25:41.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.531+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6d415f660 con 0x7ff6d40cb210 2024-04-26T18:25:41.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.531+0000 7ff6d0ff9640 1 -- 172.21.15.139:0/1679708413 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7ff6cc05d780 con 0x7ff6d40cb210 2024-04-26T18:25:41.532 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:25:41.532 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:25:41.532 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff6c006c8f0 msgr2=0x7ff6c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff6c006c8f0 0x7ff6c006edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4001680 tx=0x7ff6c4009040 comp rx=0 tx=0).stop 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 msgr2=0x7ff6d41f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d41f21e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00caa0 tx=0x7ff6cc00cf60 comp rx=0 tx=0).stop 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 shutdown_connections 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7ff6c006c8f0 0x7ff6c006edb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6d40cb210 0x7ff6d41f21e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7ff6d40cae30 0x7ff6d41f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 --2- 172.21.15.139:0/1679708413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff6d40c8a30 0x7ff6d40ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.533+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 >> 172.21.15.139:0/1679708413 conn(0x7ff6d4068090 msgr2=0x7ff6d41e81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.534+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 shutdown_connections 2024-04-26T18:25:41.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.534+0000 7ff6da551640 1 -- 172.21.15.139:0/1679708413 wait complete. 2024-04-26T18:25:41.544 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 75b8c65 --release --await' 2024-04-26T18:25:41.545 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 75b8c65 --release --await 2024-04-26T18:25:41.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.648+0000 7f8eaf37f640 1 Processor -- start 2024-04-26T18:25:41.649 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.649+0000 7f8eaf37f640 1 -- start start 2024-04-26T18:25:41.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.649+0000 7f8eaf37f640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8ea8155c80 0x7f8ea8073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.649+0000 7f8eaf37f640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8ea80cedc0 0x7f8ea80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.650 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.649+0000 7f8eaf37f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea8073870 con 0x7f8ea80cb730 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.649+0000 7f8eaf37f640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea8073b10 con 0x7f8ea8155c80 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.649+0000 7f8eaf37f640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea80cca30 con 0x7f8ea80cedc0 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8ead91c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f8ea80cb730 0x7f8ea815bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34588/0 (socket says 172.21.15.139:34588) 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8ead91c640 1 -- 172.21.15.139:0/1534314782 learned_addr learned my addr 172.21.15.139:0/1534314782 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8ead11b640 1 --2- 172.21.15.139:0/1534314782 >> v2:172.21.15.139:3300/0 conn(0x7f8ea8155c80 0x7f8ea8073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8eac91a640 1 --2- 172.21.15.139:0/1534314782 >> v2:172.21.15.143:3300/0 conn(0x7f8ea80cedc0 0x7f8ea80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8ead11b640 1 -- 172.21.15.139:0/1534314782 >> v2:172.21.15.143:3300/0 conn(0x7f8ea80cedc0 msgr2=0x7f8ea80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8ead11b640 1 --2- 172.21.15.139:0/1534314782 >> v2:172.21.15.143:3300/0 conn(0x7f8ea80cedc0 0x7f8ea80cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8ead11b640 1 -- 172.21.15.139:0/1534314782 >> v1:172.21.15.139:6789/0 conn(0x7f8ea80cb730 legacy=0x7f8ea815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.650+0000 7f8ead11b640 1 -- 172.21.15.139:0/1534314782 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea80ccd10 con 0x7f8ea8155c80 2024-04-26T18:25:41.651 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.651+0000 7f8ead11b640 1 --2- 172.21.15.139:0/1534314782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea8155c80 0x7f8ea8073280 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8068c30 tx=0x7f8ea402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9507e89c229d6d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.652 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8e9ffff640 1 -- 172.21.15.139:0/1534314782 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4037070 con 0x7f8ea8155c80 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8e9ffff640 1 -- 172.21.15.139:0/1534314782 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4032440 con 0x7f8ea8155c80 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8e9ffff640 1 -- 172.21.15.139:0/1534314782 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4032810 con 0x7f8ea8155c80 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 -- 172.21.15.139:0/1534314782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea8155c80 msgr2=0x7f8ea8073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/1534314782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea8155c80 0x7f8ea8073280 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8068c30 tx=0x7f8ea402a230 comp rx=0 tx=0).stop 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 -- 172.21.15.139:0/1534314782 shutdown_connections 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/1534314782 >> v2:172.21.15.143:3300/0 conn(0x7f8ea80cedc0 0x7f8ea80cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/1534314782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea8155c80 0x7f8ea8073280 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 -- 172.21.15.139:0/1534314782 >> 172.21.15.139:0/1534314782 conn(0x7f8ea806ef00 msgr2=0x7f8ea806f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 -- 172.21.15.139:0/1534314782 shutdown_connections 2024-04-26T18:25:41.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.652+0000 7f8eaf37f640 1 -- 172.21.15.139:0/1534314782 wait complete. 2024-04-26T18:25:41.655 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.653+0000 7f8eaf37f640 1 Processor -- start 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eaf37f640 1 -- start start 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eaf37f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ea80cb730 0x7f8ea81f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eaf37f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea80cedc0 0x7f8ea814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eaf37f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ea8155c80 0x7f8ea81f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eaf37f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea80cd5b0 con 0x7f8ea80cedc0 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eaf37f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea80cd2d0 con 0x7f8ea80cb730 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eaf37f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea8156060 con 0x7f8ea8155c80 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eac91a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea80cedc0 0x7f8ea814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eac91a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea80cedc0 0x7f8ea814a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43356/0 (socket says 172.21.15.139:43356) 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8eac91a640 1 -- 172.21.15.139:0/3630324384 learned_addr learned my addr 172.21.15.139:0/3630324384 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8ead11b640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ea80cb730 0x7f8ea81f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.654+0000 7f8ead91c640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ea8155c80 0x7f8ea81f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.656 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eac91a640 1 -- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ea8155c80 msgr2=0x7f8ea81f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eac91a640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ea8155c80 0x7f8ea81f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eac91a640 1 -- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ea80cb730 msgr2=0x7f8ea81f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eac91a640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ea80cb730 0x7f8ea81f24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eac91a640 1 -- 172.21.15.139:0/3630324384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea8156d60 con 0x7f8ea80cedc0 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eac91a640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea80cedc0 0x7f8ea814a9b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9e0 tx=0x7f8e9800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8e9dffb640 1 -- 172.21.15.139:0/3630324384 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98017070 con 0x7f8ea80cedc0 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8e9dffb640 1 -- 172.21.15.139:0/3630324384 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9800c9d0 con 0x7f8ea80cedc0 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8e9dffb640 1 -- 172.21.15.139:0/3630324384 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800cdc0 con 0x7f8ea80cedc0 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea8157040 con 0x7f8ea80cedc0 2024-04-26T18:25:41.657 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.655+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea8157600 con 0x7f8ea80cedc0 2024-04-26T18:25:41.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.656+0000 7f8e9dffb640 1 -- 172.21.15.139:0/3630324384 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e9801a070 con 0x7f8ea80cedc0 2024-04-26T18:25:41.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.657+0000 7f8e9dffb640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.657+0000 7f8e9dffb640 1 -- 172.21.15.139:0/3630324384 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8e9808c2c0 con 0x7f8ea80cedc0 2024-04-26T18:25:41.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.657+0000 7f8ead11b640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.658 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.657+0000 7f8ead11b640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4034000 tx=0x7f8ea402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.658+0000 7f8eb2174740 1 Processor -- start 2024-04-26T18:25:41.659 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.658+0000 7f8eb2174740 1 -- start start 2024-04-26T18:25:41.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e97972470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e97933890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97933dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eb2174740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560e97898040 con 0x560e979729b0 2024-04-26T18:25:41.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560e97833b60 con 0x560e979334b0 2024-04-26T18:25:41.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560e97894000 con 0x560e97934a10 2024-04-26T18:25:41.661 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e97933890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e97933890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43372/0 (socket says 172.21.15.139:43372) 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 -- 172.21.15.139:0/3501512821 learned_addr learned my addr 172.21.15.139:0/3501512821 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8ead11b640 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e97972470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8ead91c640 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97933dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 -- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 msgr2=0x560e97933dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97933dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 -- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 msgr2=0x560e97972470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e97972470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 -- 172.21.15.139:0/3501512821 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e978289c0 con 0x560e979729b0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.659+0000 7f8eac91a640 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e97933890 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8e9808a350 tx=0x7f8e98059bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a287e86a87efb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8e8affd640 1 -- 172.21.15.139:0/3501512821 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98021040 con 0x560e979729b0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8e8affd640 1 -- 172.21.15.139:0/3501512821 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9805ae50 con 0x560e979729b0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8e8affd640 1 -- 172.21.15.139:0/3501512821 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98057ed0 con 0x560e979729b0 2024-04-26T18:25:41.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 -- 172.21.15.139:0/3501512821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 msgr2=0x560e97933890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e97933890 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8e9808a350 tx=0x7f8e98059bd0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 -- 172.21.15.139:0/3501512821 shutdown_connections 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97933dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e97933890 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3501512821 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e97972470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 -- 172.21.15.139:0/3501512821 >> 172.21.15.139:0/3501512821 conn(0x560e978fa930 msgr2=0x560e97977450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 -- 172.21.15.139:0/3501512821 shutdown_connections 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.660+0000 7f8eb2174740 1 -- 172.21.15.139:0/3501512821 wait complete. 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.661+0000 7f8eb2174740 1 -- start start 2024-04-26T18:25:41.663 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.661+0000 7f8eb2174740 1 Processor -- start 2024-04-26T18:25:41.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979334b0 0x560e97970900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e97934a10 0x560e9795dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e979872d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eb2174740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560e97931af0 con 0x560e979334b0 2024-04-26T18:25:41.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x560e978314f0 con 0x560e97934a10 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x560e97935040 con 0x560e979729b0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eb2174740 10 client.0 _ll_register_callbacks cb 0x560e9788ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979334b0 0x560e97970900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979334b0 0x560e97970900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43380/0 (socket says 172.21.15.139:43380) 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 -- 172.21.15.139:0/4182578480 learned_addr learned my addr 172.21.15.139:0/4182578480 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eac91a640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e97934a10 0x560e9795dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead91c640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e979872d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 -- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 msgr2=0x560e979872d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e979872d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 -- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e97934a10 msgr2=0x560e9795dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e97934a10 0x560e9795dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 -- 172.21.15.139:0/4182578480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e975a9920 con 0x560e979334b0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8eac91a640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e97934a10 0x560e9795dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8ead11b640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979334b0 0x560e97970900 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009560 tx=0x7f8ea4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bb401965efa4e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.662+0000 7f8e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:25:41.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8e83fff640 1 -- 172.21.15.139:0/4182578480 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea404f020 con 0x560e979334b0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8e83fff640 1 -- 172.21.15.139:0/4182578480 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8ea404b870 con 0x560e979334b0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e9805ae50 con 0x560e979334b0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8e83fff640 1 -- 172.21.15.139:0/4182578480 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8ea4037040 con 0x560e979334b0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 10 client.5973 fetch_fsmap learned FSMap version 9 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560e97675d30 con 0x560e979334b0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8e83fff640 1 -- 172.21.15.139:0/4182578480 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9805ae50 con 0x560e979334b0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8e83fff640 1 -- 172.21.15.139:0/4182578480 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f8ea404ba70 con 0x560e979334b0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 10 client.5973 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 10 client.5973 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 20 client.5973 populate_metadata read hostname 'smithi139' 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e97987810 0x560e9795a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 4 client.5973 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e9786ba00 con 0x560e97987810 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.663+0000 7f8eac91a640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e97987810 0x560e9795a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.664+0000 7f8e83fff640 10 client.5973 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:41.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.664+0000 7f8eac91a640 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e97987810 0x560e9795a780 crc :-1 s=READY pgs=609 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb4cc16c6b48ac9 server_cookie=a9603d1cb519faaa in_seq=0 out_seq=0 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.664+0000 7f8e83fff640 1 -- 172.21.15.139:0/4182578480 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560e9786ba00 con 0x560e97987810 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.664+0000 7f8e83fff640 10 client.5973 handle_command_reply: tid=0 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.664+0000 7f8eb2174740 1 client.5973 shutdown 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.664+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979334b0 msgr2=0x560e97970900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979334b0 0x560e97970900 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009560 tx=0x7f8ea4004730 comp rx=0 tx=0).stop 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 shutdown_connections 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e97987810 0x560e9795a780 crc :-1 s=READY pgs=609 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e979872d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8e83fff640 0 client.5973 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e97934a10 0x560e9795dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4182578480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979334b0 0x560e97970900 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 >> 172.21.15.139:0/4182578480 conn(0x560e978fa930 msgr2=0x560e9792d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 shutdown_connections 2024-04-26T18:25:41.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 1 -- 172.21.15.139:0/4182578480 wait complete. 2024-04-26T18:25:41.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.665+0000 7f8eb2174740 20 client.5973 trim_cache size 0 max 16384 2024-04-26T18:25:41.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 Processor -- start 2024-04-26T18:25:41.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 -- start start 2024-04-26T18:25:41.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e9795a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e97934a10 0x560e97973450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e97973990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8200720 con 0x560e97934a10 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81ff600 con 0x560e979334b0 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea81474b0 con 0x560e979729b0 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eac91a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e97934a10 0x560e97973450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eac91a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e97934a10 0x560e97973450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43386/0 (socket says 172.21.15.139:43386) 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.682+0000 7f8eac91a640 1 -- 172.21.15.139:0/4121339969 learned_addr learned my addr 172.21.15.139:0/4121339969 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8ead11b640 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e9795a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8ead91c640 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e97973990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eac91a640 1 -- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 msgr2=0x560e97973990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eac91a640 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e97973990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eac91a640 1 -- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 msgr2=0x560e9795a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eac91a640 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e9795a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eac91a640 1 -- 172.21.15.139:0/4121339969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e979777d0 con 0x560e97934a10 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8ead11b640 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e9795a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eac91a640 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e97934a10 0x560e97973450 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9b0 tx=0x7f8e9801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bc5775e7360881 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8e8a7fc640 1 -- 172.21.15.139:0/4121339969 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98021040 con 0x560e97934a10 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8e8a7fc640 1 -- 172.21.15.139:0/4121339969 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9805ae50 con 0x560e97934a10 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8e8a7fc640 1 -- 172.21.15.139:0/4121339969 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98056240 con 0x560e97934a10 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eb2174740 1 -- 172.21.15.139:0/4121339969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e97934a10 msgr2=0x560e97973450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.683+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e97934a10 0x560e97973450 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9b0 tx=0x7f8e9801d000 comp rx=0 tx=0).stop 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 -- 172.21.15.139:0/4121339969 shutdown_connections 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e979729b0 0x560e97973990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e97934a10 0x560e97973450 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 --2- 172.21.15.139:0/4121339969 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e9795a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 -- 172.21.15.139:0/4121339969 >> 172.21.15.139:0/4121339969 conn(0x560e978fa930 msgr2=0x560e9795ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 -- 172.21.15.139:0/4121339969 shutdown_connections 2024-04-26T18:25:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 -- 172.21.15.139:0/4121339969 wait complete. 2024-04-26T18:25:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 -- start start 2024-04-26T18:25:41.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.684+0000 7f8eb2174740 1 Processor -- start 2024-04-26T18:25:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e979e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97957700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eb2174740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e9796ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eb2174740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81fe1c0 con 0x560e979729b0 2024-04-26T18:25:41.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81fef60 con 0x560e979334b0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eb2174740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea81fe890 con 0x560e97934a10 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eb2174740 10 client.0 _ll_register_callbacks cb 0x7f8ea4009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e9796ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e9796ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43392/0 (socket says 172.21.15.139:43392) 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 -- 172.21.15.139:0/3768125613 learned_addr learned my addr 172.21.15.139:0/3768125613 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead11b640 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e979e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8eac91a640 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97957700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 -- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 msgr2=0x560e97957700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97957700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 -- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 msgr2=0x560e979e79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e979e79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.685+0000 7f8ead91c640 1 -- 172.21.15.139:0/3768125613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e97957c40 con 0x560e979729b0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8ead91c640 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e9796ecb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x560e9795b690 tx=0x7f8ea0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535c5d9cdc9bc27d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:25:41.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8e83fff640 1 -- 172.21.15.139:0/3768125613 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0016890 con 0x560e979729b0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8e83fff640 1 -- 172.21.15.139:0/3768125613 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8ea0016a30 con 0x560e979729b0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e9805ae50 con 0x560e979729b0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8e83fff640 1 -- 172.21.15.139:0/3768125613 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8ea0027050 con 0x560e979729b0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 10 client.5979 fetch_fsmap learned FSMap version 9 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560e97956f00 con 0x560e979729b0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8e83fff640 1 -- 172.21.15.139:0/3768125613 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9805ae50 con 0x560e979729b0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8e83fff640 1 -- 172.21.15.139:0/3768125613 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f8ea002a020 con 0x560e979729b0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 10 client.5979 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 10 client.5979 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 20 client.5979 populate_metadata read hostname 'smithi139' 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e9796f1f0 0x560e9795c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 4 client.5979 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "75b8c65", "release": true, "await": true}] 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "75b8c65", "release": true, "await": true}) -- 0x560e97932720 con 0x560e9796f1f0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.686+0000 7f8ead11b640 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e9796f1f0 0x560e9795c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:25:41.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8e83fff640 10 client.5979 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8ead11b640 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e9796f1f0 0x560e9795c010 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a655f3581084fe1 server_cookie=fe06b01e5a125b05 in_seq=0 out_seq=0 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8e83fff640 1 -- 172.21.15.139:0/3768125613 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x560e97932720 con 0x560e9796f1f0 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8e83fff640 10 client.5979 handle_command_reply: tid=0 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 client.5979 shutdown 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 msgr2=0x560e9796ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e9796ecb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x560e9795b690 tx=0x7f8ea0007780 comp rx=0 tx=0).stop 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 shutdown_connections 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560e979729b0 0x560e9796ecb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x560e9796f1f0 0x560e9795c010 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x560e97934a10 0x560e97957700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 --2- 172.21.15.139:0/3768125613 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x560e979334b0 0x560e979e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8e83fff640 0 client.5979 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 >> 172.21.15.139:0/3768125613 conn(0x560e978fa930 msgr2=0x560e97970750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 shutdown_connections 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 1 -- 172.21.15.139:0/3768125613 wait complete. 2024-04-26T18:25:41.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.687+0000 7f8eb2174740 20 client.5979 trim_cache size 0 max 16384 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 92, 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "75b8c65": { 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 92, 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:25:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 81.0, 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:25:41.695 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:25:41.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8e8c06c8f0 msgr2=0x7f8e8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4034000 tx=0x7f8ea402e000 comp rx=0 tx=0).stop 2024-04-26T18:25:41.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea80cedc0 msgr2=0x7f8ea814a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:25:41.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea80cedc0 0x7f8ea814a9b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9e0 tx=0x7f8e9800eea0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 shutdown_connections 2024-04-26T18:25:41.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8ea8155c80 0x7f8ea81f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ea80cedc0 0x7f8ea814a9b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 --2- 172.21.15.139:0/3630324384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8ea80cb730 0x7f8ea81f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:25:41.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 >> 172.21.15.139:0/3630324384 conn(0x7f8ea806ef00 msgr2=0x7f8ea814bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:25:41.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 shutdown_connections 2024-04-26T18:25:41.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:25:41.688+0000 7f8eaf37f640 1 -- 172.21.15.139:0/3630324384 wait complete. 2024-04-26T18:25:41.699 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '75b8c65', seconds elapsed: 22.6 2024-04-26T18:25:42.612 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 29% (45/155) Updating files: 30% (47/155) Updating files: 31% (49/155) Updating files: 32% (50/155) Updating files: 33% (52/155) Updating files: 34% (53/155) Updating files: 35% (55/155) Updating files: 36% (56/155) Updating files: 37% (58/155) Updating files: 38% (59/155) Updating files: 39% (61/155) Updating files: 40% (62/155) Updating files: 41% (64/155) Updating files: 42% (66/155) Updating files: 43% (67/155) Updating files: 44% (69/155) Updating files: 45% (70/155) Updating files: 46% (72/155) Updating files: 47% (73/155) Updating files: 48% (75/155) Updating files: 49% (76/155) Updating files: 50% (78/155) Updating files: 51% (80/155) Updating files: 52% (81/155) Updating files: 53% (83/155) Updating files: 54% (84/155) Updating files: 55% (86/155) Updating files: 56% (87/155) Updating files: 57% (89/155) Updating files: 58% (90/155) Updating files: 59% (92/155) Updating files: 60% (93/155) Updating files: 61% (95/155) Updating files: 62% (97/155) Updating files: 63% (98/155) Updating files: 64% (100/155) Updating files: 65% (101/155) Updating files: 66% (103/155) Updating files: 67% (104/155) Updating files: 68% (106/155) Updating files: 69% (107/155) Updating files: 70% (109/155) Updating files: 71% (111/155) Updating files: 72% (112/155) Updating files: 73% (114/155) Updating files: 74% (115/155) Updating files: 75% (117/155) Updating files: 76% (118/155) Updating files: 77% (120/155) Updating files: 78% (121/155) Updating files: 79% (123/155) Updating files: 80% (124/155) Updating files: 81% (126/155) Updating files: 82% (128/155) Updating files: 83% (129/155) Updating files: 84% (131/155) Updating files: 85% (132/155) Updating files: 86% (134/155) Updating files: 87% (135/155) Updating files: 88% (137/155) Updating files: 89% (138/155) Updating files: 90% (140/155) Updating files: 91% (142/155) Updating files: 92% (143/155) Updating files: 93% (145/155) Updating files: 94% (146/155) Updating files: 95% (148/155) Updating files: 96% (149/155) Updating files: 97% (151/155) Updating files: 98% (152/155) Updating files: 99% (154/155) Updating files: 100% (155/155) Updating files: 100% (155/155), done. 2024-04-26T18:25:42.723 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 6ca6f2f9f75 v0.69 2024-04-26T18:25:42.750 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.69 2024-04-26T18:25:42.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:25:42.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 70 -eq 48 ']' 2024-04-26T18:25:42.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.70 2024-04-26T18:25:42.761 INFO:tasks.workunit.client.0.smithi139.stdout:v0.70 2024-04-26T18:25:42.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.70 2024-04-26T18:25:42.761 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.70 2024-04-26T18:25:51.727 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at e3bb0656d92 v0.70 2024-04-26T18:25:51.728 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.70 2024-04-26T18:25:51.743 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:25:51.743 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 71 -eq 48 ']' 2024-04-26T18:25:51.743 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.71 2024-04-26T18:25:51.743 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.71 2024-04-26T18:25:51.744 INFO:tasks.workunit.client.0.smithi139.stdout:v0.71 2024-04-26T18:25:51.744 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.71 2024-04-26T18:25:55.348 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 16% (68/405) Updating files: 17% (69/405) Updating files: 18% (73/405) Updating files: 19% (77/405) Updating files: 20% (81/405) Updating files: 21% (86/405) Updating files: 22% (90/405) Updating files: 23% (94/405) Updating files: 24% (98/405) Updating files: 25% (102/405) Updating files: 26% (106/405) Updating files: 27% (110/405) Updating files: 28% (114/405) Updating files: 29% (118/405) Updating files: 30% (122/405) Updating files: 31% (126/405) Updating files: 32% (130/405) Updating files: 33% (134/405) Updating files: 34% (138/405) Updating files: 35% (142/405) Updating files: 36% (146/405) Updating files: 37% (150/405) Updating files: 38% (154/405) Updating files: 39% (158/405) Updating files: 40% (162/405) Updating files: 41% (167/405) Updating files: 42% (171/405) Updating files: 43% (175/405) Updating files: 44% (179/405) Updating files: 45% (183/405) Updating files: 46% (187/405) Updating files: 47% (191/405) Updating files: 48% (195/405) Updating files: 49% (199/405) Updating files: 50% (203/405) Updating files: 51% (207/405) Updating files: 52% (211/405) Updating files: 53% (215/405) Updating files: 53% (217/405) Updating files: 54% (219/405) Updating files: 55% (223/405) Updating files: 56% (227/405) Updating files: 57% (231/405) Updating files: 58% (235/405) Updating files: 59% (239/405) Updating files: 60% (243/405) Updating files: 61% (248/405) Updating files: 62% (252/405) Updating files: 63% (256/405) Updating files: 64% (260/405) Updating files: 65% (264/405) Updating files: 66% (268/405) Updating files: 67% (272/405) Updating files: 68% (276/405) Updating files: 69% (280/405) Updating files: 70% (284/405) Updating files: 71% (288/405) Updating files: 72% (292/405) Updating files: 73% (296/405) Updating files: 74% (300/405) Updating files: 75% (304/405) Updating files: 76% (308/405) Updating files: 77% (312/405) Updating files: 78% (316/405) Updating files: 79% (320/405) Updating files: 80% (324/405) Updating files: 80% (328/405) Updating files: 81% (329/405) Updating files: 82% (333/405) Updating files: 83% (337/405) Updating files: 84% (341/405) Updating files: 85% (345/405) Updating files: 86% (349/405) Updating files: 87% (353/405) Updating files: 88% (357/405) Updating files: 89% (361/405) Updating files: 90% (365/405) Updating files: 91% (369/405) Updating files: 92% (373/405) Updating files: 93% (377/405) Updating files: 94% (381/405) Updating files: 95% (385/405) Updating files: 96% (389/405) Updating files: 97% (393/405) Updating files: 98% (397/405) Updating files: 99% (401/405) Updating files: 100% (405/405) Updating files: 100% (405/405), done. 2024-04-26T18:25:55.382 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at e509cb1e69c v0.71 2024-04-26T18:25:55.385 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.71 2024-04-26T18:25:55.473 INFO:tasks.workunit.client.0.smithi139.stdout:v0.72 2024-04-26T18:25:55.474 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:25:55.474 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 72 -eq 48 ']' 2024-04-26T18:25:55.474 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.72 2024-04-26T18:25:55.474 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.72 2024-04-26T18:25:55.474 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.72 2024-04-26T18:25:57.920 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 65% (125/191) Updating files: 66% (127/191) Updating files: 67% (128/191) Updating files: 68% (130/191) Updating files: 69% (132/191) Updating files: 70% (134/191) Updating files: 71% (136/191) Updating files: 72% (138/191) Updating files: 73% (140/191) Updating files: 74% (142/191) Updating files: 75% (144/191) Updating files: 76% (146/191) Updating files: 77% (148/191) Updating files: 78% (149/191) Updating files: 79% (151/191) Updating files: 80% (153/191) Updating files: 81% (155/191) Updating files: 82% (157/191) Updating files: 83% (159/191) Updating files: 84% (161/191) Updating files: 85% (163/191) Updating files: 86% (165/191) Updating files: 87% (167/191) Updating files: 88% (169/191) Updating files: 89% (170/191) Updating files: 90% (172/191) Updating files: 91% (174/191) Updating files: 92% (176/191) Updating files: 93% (178/191) Updating files: 94% (180/191) Updating files: 95% (182/191) Updating files: 96% (184/191) Updating files: 97% (186/191) Updating files: 98% (188/191) Updating files: 99% (190/191) Updating files: 100% (191/191) Updating files: 100% (191/191), done. 2024-04-26T18:25:57.958 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 5832e2603c7 v0.72 2024-04-26T18:25:57.961 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.72 2024-04-26T18:25:58.040 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:25:58.040 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 73 -eq 48 ']' 2024-04-26T18:25:58.041 INFO:tasks.workunit.client.0.smithi139.stdout:v0.73 2024-04-26T18:25:58.041 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.73 2024-04-26T18:25:58.041 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.73 2024-04-26T18:25:58.041 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.73 2024-04-26T18:26:00.311 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 27% (40/148) Updating files: 28% (42/148) Updating files: 29% (43/148) Updating files: 30% (45/148) Updating files: 31% (46/148) Updating files: 32% (48/148) Updating files: 33% (49/148) Updating files: 34% (51/148) Updating files: 35% (52/148) Updating files: 36% (54/148) Updating files: 37% (55/148) Updating files: 38% (57/148) Updating files: 39% (58/148) Updating files: 40% (60/148) Updating files: 41% (61/148) Updating files: 42% (63/148) Updating files: 43% (64/148) Updating files: 44% (66/148) Updating files: 45% (67/148) Updating files: 46% (69/148) Updating files: 47% (70/148) Updating files: 48% (72/148) Updating files: 49% (73/148) Updating files: 50% (74/148) Updating files: 51% (76/148) Updating files: 52% (77/148) Updating files: 53% (79/148) Updating files: 54% (80/148) Updating files: 55% (82/148) Updating files: 56% (83/148) Updating files: 57% (85/148) Updating files: 58% (86/148) Updating files: 59% (88/148) Updating files: 60% (89/148) Updating files: 61% (91/148) Updating files: 62% (92/148) Updating files: 63% (94/148) Updating files: 64% (95/148) Updating files: 65% (97/148) Updating files: 66% (98/148) Updating files: 67% (100/148) Updating files: 68% (101/148) Updating files: 69% (103/148) Updating files: 70% (104/148) Updating files: 71% (106/148) Updating files: 72% (107/148) Updating files: 73% (109/148) Updating files: 74% (110/148) Updating files: 75% (111/148) Updating files: 76% (113/148) Updating files: 77% (114/148) Updating files: 78% (116/148) Updating files: 79% (117/148) Updating files: 80% (119/148) Updating files: 81% (120/148) Updating files: 82% (122/148) Updating files: 83% (123/148) Updating files: 84% (125/148) Updating files: 85% (126/148) Updating files: 86% (128/148) Updating files: 87% (129/148) Updating files: 88% (131/148) Updating files: 89% (132/148) Updating files: 90% (134/148) Updating files: 91% (135/148) Updating files: 92% (137/148) Updating files: 93% (138/148) Updating files: 94% (140/148) Updating files: 95% (141/148) Updating files: 96% (143/148) Updating files: 97% (144/148) Updating files: 98% (146/148) Updating files: 99% (147/148) Updating files: 100% (148/148) Updating files: 100% (148/148), done. 2024-04-26T18:26:00.347 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at d8ad51ee8ab v0.73 2024-04-26T18:26:00.349 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.73 2024-04-26T18:26:00.402 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:26:00.402 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 74 -eq 48 ']' 2024-04-26T18:26:00.402 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.74 2024-04-26T18:26:00.403 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.74 2024-04-26T18:26:00.403 INFO:tasks.workunit.client.0.smithi139.stdout:v0.74 2024-04-26T18:26:00.403 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.74 2024-04-26T18:26:01.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:26:01.295 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:26:02.761 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 55% (106/192) Updating files: 56% (108/192) Updating files: 57% (110/192) Updating files: 58% (112/192) Updating files: 59% (114/192) Updating files: 60% (116/192) Updating files: 61% (118/192) Updating files: 62% (120/192) Updating files: 63% (121/192) Updating files: 64% (123/192) Updating files: 65% (125/192) Updating files: 66% (127/192) Updating files: 67% (129/192) Updating files: 68% (131/192) Updating files: 69% (133/192) Updating files: 70% (135/192) Updating files: 71% (137/192) Updating files: 72% (139/192) Updating files: 73% (141/192) Updating files: 74% (143/192) Updating files: 75% (144/192) Updating files: 76% (146/192) Updating files: 77% (148/192) Updating files: 78% (150/192) Updating files: 79% (152/192) Updating files: 80% (154/192) Updating files: 81% (156/192) Updating files: 82% (158/192) Updating files: 83% (160/192) Updating files: 84% (162/192) Updating files: 85% (164/192) Updating files: 86% (166/192) Updating files: 87% (168/192) Updating files: 88% (169/192) Updating files: 89% (171/192) Updating files: 90% (173/192) Updating files: 91% (175/192) Updating files: 92% (177/192) Updating files: 93% (179/192) Updating files: 94% (181/192) Updating files: 95% (183/192) Updating files: 96% (185/192) Updating files: 97% (187/192) Updating files: 98% (189/192) Updating files: 99% (191/192) Updating files: 100% (192/192) Updating files: 100% (192/192), done. 2024-04-26T18:26:02.794 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at c165483bc72 v0.74 2024-04-26T18:26:02.796 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.74 2024-04-26T18:26:02.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:26:02.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 75 -eq 48 ']' 2024-04-26T18:26:02.881 INFO:tasks.workunit.client.0.smithi139.stdout:v0.75 2024-04-26T18:26:02.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.75 2024-04-26T18:26:02.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.75 2024-04-26T18:26:02.881 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.75 2024-04-26T18:26:20.558 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 8% (26/291) Updating files: 9% (27/291) Updating files: 10% (30/291) Updating files: 11% (33/291) Updating files: 12% (35/291) Updating files: 13% (38/291) Updating files: 14% (41/291) Updating files: 15% (44/291) Updating files: 16% (47/291) Updating files: 16% (49/291) Updating files: 17% (50/291) Updating files: 18% (53/291) Updating files: 19% (56/291) Updating files: 20% (59/291) Updating files: 21% (62/291) Updating files: 22% (65/291) Updating files: 23% (67/291) Updating files: 24% (70/291) Updating files: 25% (73/291) Updating files: 26% (76/291) Updating files: 27% (79/291) Updating files: 28% (82/291) Updating files: 29% (85/291) Updating files: 30% (88/291) Updating files: 31% (91/291) Updating files: 32% (94/291) Updating files: 33% (97/291) Updating files: 34% (99/291) Updating files: 34% (101/291) Updating files: 35% (102/291) Updating files: 36% (105/291) Updating files: 37% (108/291) Updating files: 38% (111/291) Updating files: 39% (114/291) Updating files: 40% (117/291) Updating files: 41% (120/291) Updating files: 42% (123/291) Updating files: 43% (126/291) Updating files: 44% (129/291) Updating files: 45% (131/291) Updating files: 46% (134/291) Updating files: 47% (137/291) Updating files: 48% (140/291) Updating files: 49% (143/291) Updating files: 50% (146/291) Updating files: 51% (149/291) Updating files: 52% (152/291) Updating files: 53% (155/291) Updating files: 54% (158/291) Updating files: 55% (161/291) Updating files: 56% (163/291) Updating files: 57% (166/291) Updating files: 58% (169/291) Updating files: 59% (172/291) Updating files: 60% (175/291) Updating files: 61% (178/291) Updating files: 62% (181/291) Updating files: 63% (184/291) Updating files: 64% (187/291) Updating files: 65% (190/291) Updating files: 66% (193/291) Updating files: 67% (195/291) Updating files: 68% (198/291) Updating files: 69% (201/291) Updating files: 70% (204/291) Updating files: 71% (207/291) Updating files: 72% (210/291) Updating files: 73% (213/291) Updating files: 74% (216/291) Updating files: 75% (219/291) Updating files: 76% (222/291) Updating files: 77% (225/291) Updating files: 78% (227/291) Updating files: 79% (230/291) Updating files: 80% (233/291) Updating files: 80% (234/291) Updating files: 81% (236/291) Updating files: 82% (239/291) Updating files: 83% (242/291) Updating files: 84% (245/291) Updating files: 85% (248/291) Updating files: 86% (251/291) Updating files: 87% (254/291) Updating files: 88% (257/291) Updating files: 89% (259/291) Updating files: 90% (262/291) Updating files: 91% (265/291) Updating files: 92% (268/291) Updating files: 92% (269/291) Updating files: 93% (271/291) Updating files: 94% (274/291) Updating files: 95% (277/291) Updating files: 96% (280/291) Updating files: 97% (283/291) Updating files: 98% (286/291) Updating files: 99% (289/291) Updating files: 100% (291/291) Updating files: 100% (291/291), done. 2024-04-26T18:26:20.617 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 946d6036958 v0.75 2024-04-26T18:26:20.620 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.75 2024-04-26T18:26:20.634 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:26:20.634 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 76 -eq 48 ']' 2024-04-26T18:26:20.635 INFO:tasks.workunit.client.0.smithi139.stdout:v0.76 2024-04-26T18:26:20.635 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.76 2024-04-26T18:26:20.635 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.76 2024-04-26T18:26:20.635 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.76 2024-04-26T18:26:23.691 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 46% (78/168) Updating files: 47% (79/168) Updating files: 48% (81/168) Updating files: 49% (83/168) Updating files: 50% (84/168) Updating files: 51% (86/168) Updating files: 52% (88/168) Updating files: 53% (90/168) Updating files: 54% (91/168) Updating files: 55% (93/168) Updating files: 56% (95/168) Updating files: 57% (96/168) Updating files: 58% (98/168) Updating files: 59% (100/168) Updating files: 60% (101/168) Updating files: 61% (103/168) Updating files: 62% (105/168) Updating files: 63% (106/168) Updating files: 64% (108/168) Updating files: 65% (110/168) Updating files: 66% (111/168) Updating files: 67% (113/168) Updating files: 68% (115/168) Updating files: 69% (116/168) Updating files: 70% (118/168) Updating files: 71% (120/168) Updating files: 72% (121/168) Updating files: 73% (123/168) Updating files: 74% (125/168) Updating files: 75% (126/168) Updating files: 76% (128/168) Updating files: 77% (130/168) Updating files: 78% (132/168) Updating files: 79% (133/168) Updating files: 80% (135/168) Updating files: 81% (137/168) Updating files: 82% (138/168) Updating files: 83% (140/168) Updating files: 84% (142/168) Updating files: 85% (143/168) Updating files: 86% (145/168) Updating files: 87% (147/168) Updating files: 88% (148/168) Updating files: 89% (150/168) Updating files: 90% (152/168) Updating files: 91% (153/168) Updating files: 92% (155/168) Updating files: 93% (157/168) Updating files: 94% (158/168) Updating files: 95% (160/168) Updating files: 96% (162/168) Updating files: 97% (163/168) Updating files: 98% (165/168) Updating files: 99% (167/168) Updating files: 100% (168/168) Updating files: 100% (168/168), done. 2024-04-26T18:26:23.710 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 3b990136bfa v0.76 2024-04-26T18:26:23.712 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.76 2024-04-26T18:26:23.767 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:26:23.767 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 77 -eq 48 ']' 2024-04-26T18:26:23.768 INFO:tasks.workunit.client.0.smithi139.stdout:v0.77 2024-04-26T18:26:23.768 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.77 2024-04-26T18:26:23.768 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.77 2024-04-26T18:26:23.768 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.77 2024-04-26T18:26:31.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:26:31.380 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:26:36.548 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 43% (129/298) Updating files: 44% (132/298) Updating files: 45% (135/298) Updating files: 46% (138/298) Updating files: 47% (141/298) Updating files: 48% (144/298) Updating files: 49% (147/298) Updating files: 50% (149/298) Updating files: 51% (152/298) Updating files: 52% (155/298) Updating files: 53% (158/298) Updating files: 54% (161/298) Updating files: 55% (164/298) Updating files: 56% (167/298) Updating files: 57% (170/298) Updating files: 58% (173/298) Updating files: 59% (176/298) Updating files: 60% (179/298) Updating files: 61% (182/298) Updating files: 62% (185/298) Updating files: 63% (188/298) Updating files: 64% (191/298) Updating files: 65% (194/298) Updating files: 66% (197/298) Updating files: 67% (200/298) Updating files: 68% (203/298) Updating files: 69% (206/298) Updating files: 70% (209/298) Updating files: 71% (212/298) Updating files: 72% (215/298) Updating files: 73% (218/298) Updating files: 74% (221/298) Updating files: 75% (224/298) Updating files: 76% (227/298) Updating files: 77% (230/298) Updating files: 78% (233/298) Updating files: 79% (236/298) Updating files: 80% (239/298) Updating files: 81% (242/298) Updating files: 82% (245/298) Updating files: 83% (248/298) Updating files: 84% (251/298) Updating files: 85% (254/298) Updating files: 86% (257/298) Updating files: 87% (260/298) Updating files: 88% (263/298) Updating files: 89% (266/298) Updating files: 90% (269/298) Updating files: 91% (272/298) Updating files: 92% (275/298) Updating files: 93% (278/298) Updating files: 94% (281/298) Updating files: 95% (284/298) Updating files: 96% (287/298) Updating files: 97% (290/298) Updating files: 98% (293/298) Updating files: 99% (296/298) Updating files: 100% (298/298) Updating files: 100% (298/298), done. 2024-04-26T18:26:36.581 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 1bca9c5c412 v0.77 2024-04-26T18:26:36.584 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.77 2024-04-26T18:26:36.613 INFO:tasks.workunit.client.0.smithi139.stdout:v0.78 2024-04-26T18:26:36.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:26:36.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 78 -eq 48 ']' 2024-04-26T18:26:36.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.78 2024-04-26T18:26:36.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.78 2024-04-26T18:26:36.614 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.78 2024-04-26T18:26:43.938 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 13% (68/496) Updating files: 14% (70/496) Updating files: 15% (75/496) Updating files: 16% (80/496) Updating files: 17% (85/496) Updating files: 18% (90/496) Updating files: 19% (95/496) Updating files: 20% (100/496) Updating files: 20% (101/496) Updating files: 21% (105/496) Updating files: 22% (110/496) Updating files: 23% (115/496) Updating files: 24% (120/496) Updating files: 25% (124/496) Updating files: 26% (129/496) Updating files: 27% (134/496) Updating files: 28% (139/496) Updating files: 29% (144/496) Updating files: 30% (149/496) Updating files: 31% (154/496) Updating files: 32% (159/496) Updating files: 33% (164/496) Updating files: 34% (169/496) Updating files: 35% (174/496) Updating files: 36% (179/496) Updating files: 37% (184/496) Updating files: 38% (189/496) Updating files: 39% (194/496) Updating files: 39% (196/496) Updating files: 40% (199/496) Updating files: 41% (204/496) Updating files: 42% (209/496) Updating files: 43% (214/496) Updating files: 44% (219/496) Updating files: 45% (224/496) Updating files: 45% (228/496) Updating files: 46% (229/496) Updating files: 47% (234/496) Updating files: 48% (239/496) Updating files: 49% (244/496) Updating files: 50% (248/496) Updating files: 51% (253/496) Updating files: 52% (258/496) Updating files: 53% (263/496) Updating files: 54% (268/496) Updating files: 55% (273/496) Updating files: 56% (278/496) Updating files: 57% (283/496) Updating files: 58% (288/496) Updating files: 59% (293/496) Updating files: 60% (298/496) Updating files: 61% (303/496) Updating files: 62% (308/496) Updating files: 63% (313/496) Updating files: 64% (318/496) Updating files: 65% (323/496) Updating files: 66% (328/496) Updating files: 67% (333/496) Updating files: 68% (338/496) Updating files: 69% (343/496) Updating files: 70% (348/496) Updating files: 70% (352/496) Updating files: 71% (353/496) Updating files: 72% (358/496) Updating files: 73% (363/496) Updating files: 74% (368/496) Updating files: 75% (372/496) Updating files: 76% (377/496) Updating files: 77% (382/496) Updating files: 78% (387/496) Updating files: 78% (391/496) Updating files: 79% (392/496) Updating files: 80% (397/496) Updating files: 81% (402/496) Updating files: 82% (407/496) Updating files: 83% (412/496) Updating files: 84% (417/496) Updating files: 85% (422/496) Updating files: 86% (427/496) Updating files: 87% (432/496) Updating files: 88% (437/496) Updating files: 89% (442/496) Updating files: 90% (447/496) Updating files: 91% (452/496) Updating files: 92% (457/496) Updating files: 93% (462/496) Updating files: 94% (467/496) Updating files: 95% (472/496) Updating files: 96% (477/496) Updating files: 97% (482/496) Updating files: 98% (487/496) Updating files: 99% (492/496) Updating files: 100% (496/496) Updating files: 100% (496/496), done. 2024-04-26T18:26:44.288 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at f6c746c314d 0.78 2024-04-26T18:26:44.291 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.78 2024-04-26T18:26:44.389 INFO:tasks.workunit.client.0.smithi139.stdout:v0.79 2024-04-26T18:26:44.389 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:26:44.389 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 79 -eq 48 ']' 2024-04-26T18:26:44.389 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.79 2024-04-26T18:26:44.389 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.79 2024-04-26T18:26:44.389 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.79 2024-04-26T18:26:59.134 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 21% (70/329) Updating files: 22% (73/329) Updating files: 23% (76/329) Updating files: 24% (79/329) Updating files: 25% (83/329) Updating files: 26% (86/329) Updating files: 27% (89/329) Updating files: 28% (93/329) Updating files: 29% (96/329) Updating files: 30% (99/329) Updating files: 31% (102/329) Updating files: 32% (106/329) Updating files: 33% (109/329) Updating files: 34% (112/329) Updating files: 35% (116/329) Updating files: 36% (119/329) Updating files: 37% (122/329) Updating files: 38% (126/329) Updating files: 39% (129/329) Updating files: 40% (132/329) Updating files: 41% (135/329) Updating files: 42% (139/329) Updating files: 43% (142/329) Updating files: 44% (145/329) Updating files: 45% (149/329) Updating files: 46% (152/329) Updating files: 47% (155/329) Updating files: 48% (158/329) Updating files: 49% (162/329) Updating files: 50% (165/329) Updating files: 51% (168/329) Updating files: 52% (172/329) Updating files: 53% (175/329) Updating files: 54% (178/329) Updating files: 55% (181/329) Updating files: 55% (182/329) Updating files: 56% (185/329) Updating files: 57% (188/329) Updating files: 58% (191/329) Updating files: 59% (195/329) Updating files: 60% (198/329) Updating files: 61% (201/329) Updating files: 62% (204/329) Updating files: 63% (208/329) Updating files: 64% (211/329) Updating files: 65% (214/329) Updating files: 66% (218/329) Updating files: 67% (221/329) Updating files: 68% (224/329) Updating files: 69% (228/329) Updating files: 70% (231/329) Updating files: 71% (234/329) Updating files: 71% (236/329) Updating files: 72% (237/329) Updating files: 73% (241/329) Updating files: 74% (244/329) Updating files: 75% (247/329) Updating files: 76% (251/329) Updating files: 77% (254/329) Updating files: 78% (257/329) Updating files: 79% (260/329) Updating files: 80% (264/329) Updating files: 81% (267/329) Updating files: 82% (270/329) Updating files: 83% (274/329) Updating files: 84% (277/329) Updating files: 85% (280/329) Updating files: 86% (283/329) Updating files: 87% (287/329) Updating files: 88% (290/329) Updating files: 89% (293/329) Updating files: 90% (297/329) Updating files: 91% (300/329) Updating files: 92% (303/329) Updating files: 93% (306/329) Updating files: 94% (310/329) Updating files: 95% (313/329) Updating files: 96% (316/329) Updating files: 97% (320/329) Updating files: 98% (323/329) Updating files: 99% (326/329) Updating files: 100% (329/329) Updating files: 100% (329/329), done. 2024-04-26T18:26:59.202 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 4c2d73a5095 0.79 2024-04-26T18:26:59.204 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.79 2024-04-26T18:26:59.220 INFO:tasks.workunit.client.0.smithi139.stdout:v0.80 2024-04-26T18:26:59.220 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:26:59.220 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 80 -eq 48 ']' 2024-04-26T18:26:59.220 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.80 2024-04-26T18:26:59.220 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.80 2024-04-26T18:26:59.221 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.80 2024-04-26T18:26:59.886 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.4 2024-04-26T18:26:59.886 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:26:59.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.989+0000 7f28dcc62640 1 Processor -- start 2024-04-26T18:26:59.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.989+0000 7f28dcc62640 1 -- start start 2024-04-26T18:26:59.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28dcc62640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f28d8155da0 0x7f28d815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:59.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28dcc62640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d80c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:59.992 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28dcc62640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d815f2a0 con 0x7f28d8156180 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28dcc62640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f28d815cbc0 con 0x7f28d8155da0 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28dcc62640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f28d80cc730 con 0x7f28d80cd840 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28d659c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f28d8155da0 0x7f28d815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28d5d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f28d8156180 0x7f28d80d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35098/0 (socket says 172.21.15.139:35098) 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.990+0000 7f28d5d9b640 1 -- 172.21.15.139:0/157287742 learned_addr learned my addr 172.21.15.139:0/157287742 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d6d9d640 1 --2- 172.21.15.139:0/157287742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d80c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d659c640 1 -- 172.21.15.139:0/157287742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 msgr2=0x7f28d80c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d659c640 1 --2- 172.21.15.139:0/157287742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d80c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d659c640 1 -- 172.21.15.139:0/157287742 >> v1:172.21.15.139:6789/0 conn(0x7f28d8156180 legacy=0x7f28d80d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d659c640 1 -- 172.21.15.139:0/157287742 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d815f580 con 0x7f28d8155da0 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d559a640 1 -- 172.21.15.139:0/157287742 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861775787 0 0) 0x7f28d815f2a0 con 0x7f28d8156180 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d6d9d640 1 --2- 172.21.15.139:0/157287742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d80c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d659c640 1 --2- 172.21.15.139:0/157287742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d815c680 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009d90 tx=0x7f28c802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f396f6b2aa7308 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:59.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.991+0000 7f28d559a640 1 -- 172.21.15.139:0/157287742 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8031600 con 0x7f28d8155da0 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28d559a640 1 -- 172.21.15.139:0/157287742 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c80317a0 con 0x7f28d8155da0 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28d559a640 1 -- 172.21.15.139:0/157287742 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8031b70 con 0x7f28d8155da0 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 -- 172.21.15.139:0/157287742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 msgr2=0x7f28d815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 --2- 172.21.15.139:0/157287742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d815c680 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009d90 tx=0x7f28c802a5d0 comp rx=0 tx=0).stop 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 -- 172.21.15.139:0/157287742 shutdown_connections 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 --2- 172.21.15.139:0/157287742 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d80c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 --2- 172.21.15.139:0/157287742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d815c680 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 -- 172.21.15.139:0/157287742 >> 172.21.15.139:0/157287742 conn(0x7f28d8068090 msgr2=0x7f28d80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 -- 172.21.15.139:0/157287742 shutdown_connections 2024-04-26T18:26:59.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.992+0000 7f28dcc62640 1 -- 172.21.15.139:0/157287742 wait complete. 2024-04-26T18:26:59.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.993+0000 7f28dcc62640 1 Processor -- start 2024-04-26T18:26:59.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.993+0000 7f28dcc62640 1 -- start start 2024-04-26T18:26:59.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28dcc62640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d81f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28dcc62640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28dcc62640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28d80cdc40 0x7f28d8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28dcc62640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f28d80d19d0 con 0x7f28d8155da0 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28dcc62640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f28d815fb40 con 0x7f28d80cdc40 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28dcc62640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f28d80d1b50 con 0x7f28d80cd840 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d5d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d5d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:58870/0 (socket says 172.21.15.139:58870) 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d5d9b640 1 -- 172.21.15.139:0/843455885 learned_addr learned my addr 172.21.15.139:0/843455885 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d659c640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d81f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d6d9d640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28d80cdc40 0x7f28d8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d5d9b640 1 -- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 msgr2=0x7f28d81f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d5d9b640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d81f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d5d9b640 1 -- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28d80cdc40 msgr2=0x7f28d8159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:26:59.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.994+0000 7f28d5d9b640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28d80cdc40 0x7f28d8159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28d5d9b640 1 -- 172.21.15.139:0/843455885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d814ac90 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28d6d9d640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28d80cdc40 0x7f28d8159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28d5d9b640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d814a750 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00c410 tx=0x7f28cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28c6ffd640 1 -- 172.21.15.139:0/843455885 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0074e0 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28c6ffd640 1 -- 172.21.15.139:0/843455885 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28cc0047e0 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d81e7dd0 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28c6ffd640 1 -- 172.21.15.139:0/843455885 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc004bd0 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.995+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d80d09f0 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.996+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d8076d20 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.996+0000 7f28c6ffd640 1 -- 172.21.15.139:0/843455885 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28cc011070 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.996+0000 7f28c6ffd640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f28b806c920 0x7f28b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.997+0000 7f28c6ffd640 1 -- 172.21.15.139:0/843455885 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f28cc08bc10 con 0x7f28d8155da0 2024-04-26T18:26:59.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.997+0000 7f28d659c640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f28b806c920 0x7f28b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:26:59.997+0000 7f28d659c640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f28b806c920 0x7f28b806ede0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28c8034000 tx=0x7f28c802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.001+0000 7f28c6ffd640 1 -- 172.21.15.139:0/843455885 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28cc00e280 con 0x7f28d8155da0 2024-04-26T18:27:00.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.226+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28d8149fc0 con 0x7f28d8155da0 2024-04-26T18:27:00.227 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.227+0000 7f28c6ffd640 1 -- 172.21.15.139:0/843455885 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f28cc08f020 con 0x7f28d8155da0 2024-04-26T18:27:00.227 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:27:00.227 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:27:00.227 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:27:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f28b806c920 msgr2=0x7f28b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f28b806c920 0x7f28b806ede0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f28c8034000 tx=0x7f28c802f000 comp rx=0 tx=0).stop 2024-04-26T18:27:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 msgr2=0x7f28d814a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d814a750 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00c410 tx=0x7f28cc00c8d0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 shutdown_connections 2024-04-26T18:27:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f28b806c920 0x7f28b806ede0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f28d80cdc40 0x7f28d8159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d8155da0 0x7f28d814a750 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 --2- 172.21.15.139:0/843455885 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f28d80cd840 0x7f28d81f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 >> 172.21.15.139:0/843455885 conn(0x7f28d8068090 msgr2=0x7f28d815c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:00.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 shutdown_connections 2024-04-26T18:27:00.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.229+0000 7f28dcc62640 1 -- 172.21.15.139:0/843455885 wait complete. 2024-04-26T18:27:00.240 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 75.4 --await-for 42.0' 2024-04-26T18:27:00.240 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 75.4 --await-for 42.0 2024-04-26T18:27:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.347+0000 7fb942628640 1 Processor -- start 2024-04-26T18:27:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.347+0000 7fb942628640 1 -- start start 2024-04-26T18:27:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb942628640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb942628640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb93c0c8db0 0x7fb93c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb942628640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fb93c0c9490 0x7fb93c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb942628640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb93c0c3c10 con 0x7fb93c0c8db0 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb942628640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fb93c0c3240 con 0x7fb93c0c9490 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb942628640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c158c00 con 0x7fb93c152200 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb93c0c8db0 0x7fb93c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb93c0c8db0 0x7fb93c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:58872/0 (socket says 172.21.15.139:58872) 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 -- 172.21.15.139:0/1230359719 learned_addr learned my addr 172.21.15.139:0/1230359719 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93bfff640 1 --2- 172.21.15.139:0/1230359719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb940bc5640 1 --2- 172.21.15.139:0/1230359719 >> v2:172.21.15.143:3300/0 conn(0x7fb93c0c9490 0x7fb93c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 -- 172.21.15.139:0/1230359719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 msgr2=0x7fb93c0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/1230359719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c0c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 -- 172.21.15.139:0/1230359719 >> v2:172.21.15.143:3300/0 conn(0x7fb93c0c9490 msgr2=0x7fb93c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/1230359719 >> v2:172.21.15.143:3300/0 conn(0x7fb93c0c9490 0x7fb93c0cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93b7fe640 1 -- 172.21.15.139:0/1230359719 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c0c2930 con 0x7fb93c0c8db0 2024-04-26T18:27:00.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb940bc5640 1 --2- 172.21.15.139:0/1230359719 >> v2:172.21.15.143:3300/0 conn(0x7fb93c0c9490 0x7fb93c0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:00.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.348+0000 7fb93bfff640 1 --2- 172.21.15.139:0/1230359719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:00.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.349+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/1230359719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c8db0 0x7fb93c0ccf90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb93000bb10 tx=0x7fb93002c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a074528a67df2baa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.349+0000 7fb93affd640 1 -- 172.21.15.139:0/1230359719 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930036020 con 0x7fb93c0c8db0 2024-04-26T18:27:00.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.349+0000 7fb93affd640 1 -- 172.21.15.139:0/1230359719 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb930032820 con 0x7fb93c0c8db0 2024-04-26T18:27:00.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.349+0000 7fb93affd640 1 -- 172.21.15.139:0/1230359719 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930032bf0 con 0x7fb93c0c8db0 2024-04-26T18:27:00.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 -- 172.21.15.139:0/1230359719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c8db0 msgr2=0x7fb93c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 --2- 172.21.15.139:0/1230359719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c8db0 0x7fb93c0ccf90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb93000bb10 tx=0x7fb93002c960 comp rx=0 tx=0).stop 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 -- 172.21.15.139:0/1230359719 shutdown_connections 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 --2- 172.21.15.139:0/1230359719 >> v2:172.21.15.143:3300/0 conn(0x7fb93c0c9490 0x7fb93c0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 --2- 172.21.15.139:0/1230359719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c8db0 0x7fb93c0ccf90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 --2- 172.21.15.139:0/1230359719 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 -- 172.21.15.139:0/1230359719 >> 172.21.15.139:0/1230359719 conn(0x7fb93c06dd40 msgr2=0x7fb93c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 -- 172.21.15.139:0/1230359719 shutdown_connections 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.350+0000 7fb942628640 1 -- 172.21.15.139:0/1230359719 wait complete. 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.351+0000 7fb942628640 1 Processor -- start 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.351+0000 7fb942628640 1 -- start start 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb942628640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb93c0c8db0 0x7fb93c1f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb942628640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c9490 0x7fb93c157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb942628640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb942628640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c0c2ed0 con 0x7fb93c0c9490 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb942628640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c0c2bf0 con 0x7fb93c0c8db0 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb942628640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c0c8660 con 0x7fb93c152200 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c9490 0x7fb93c157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c9490 0x7fb93c157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:58882/0 (socket says 172.21.15.139:58882) 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 -- 172.21.15.139:0/3975006468 learned_addr learned my addr 172.21.15.139:0/3975006468 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93bfff640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb93c0c8db0 0x7fb93c1f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb940bc5640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 -- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 msgr2=0x7fb93c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 -- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb93c0c8db0 msgr2=0x7fb93c1f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb93c0c8db0 0x7fb93c1f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 -- 172.21.15.139:0/3975006468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c153fb0 con 0x7fb93c0c9490 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb940bc5640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:00.356 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c9490 0x7fb93c157b20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb93002c9a0 tx=0x7fb9300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb938ff9640 1 -- 172.21.15.139:0/3975006468 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930036040 con 0x7fb93c0c9490 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb938ff9640 1 -- 172.21.15.139:0/3975006468 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb930031c30 con 0x7fb93c0c9490 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c1f61d0 con 0x7fb93c0c9490 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.352+0000 7fb938ff9640 1 -- 172.21.15.139:0/3975006468 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930044480 con 0x7fb93c0c9490 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.353+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c0afd60 con 0x7fb93c0c9490 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.354+0000 7fb938ff9640 1 -- 172.21.15.139:0/3975006468 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb930039020 con 0x7fb93c0c9490 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.354+0000 7fb938ff9640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb92806c8f0 0x7fb92806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.354+0000 7fb938ff9640 1 -- 172.21.15.139:0/3975006468 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb9300ace10 con 0x7fb93c0c9490 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.354+0000 7fb93bfff640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb92806c8f0 0x7fb92806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.355+0000 7fb93bfff640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb92806c8f0 0x7fb92806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006e80 tx=0x7fb92c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.355+0000 7fb945416740 1 Processor -- start 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.355+0000 7fb945416740 1 -- start start 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb945416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b9659695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96592a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96592af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb945416740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b96588dd80 con 0x55b96592a5e0 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b965829c20 con 0x55b965969ae0 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b965889d40 con 0x55b96592bb40 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b9659695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b9659695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:58896/0 (socket says 172.21.15.139:58896) 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 -- 172.21.15.139:0/1861664253 learned_addr learned my addr 172.21.15.139:0/1861664253 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96592a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb940bc5640 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96592af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 -- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 msgr2=0x55b96592af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96592af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 -- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 msgr2=0x55b96592a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96592a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 -- 172.21.15.139:0/1861664253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96566bd80 con 0x55b96592a5e0 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.356+0000 7fb93bfff640 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b9659695a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0041b0 tx=0x7fb92c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3150e43aa62c9e4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb921ffb640 1 -- 172.21.15.139:0/1861664253 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c027070 con 0x55b96592a5e0 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb921ffb640 1 -- 172.21.15.139:0/1861664253 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92c003820 con 0x55b96592a5e0 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb921ffb640 1 -- 172.21.15.139:0/1861664253 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c003bf0 con 0x55b96592a5e0 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 -- 172.21.15.139:0/1861664253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 msgr2=0x55b9659695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b9659695a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0041b0 tx=0x7fb92c013000 comp rx=0 tx=0).stop 2024-04-26T18:27:00.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 -- 172.21.15.139:0/1861664253 shutdown_connections 2024-04-26T18:27:00.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96592af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96592a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 --2- 172.21.15.139:0/1861664253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b9659695a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 -- 172.21.15.139:0/1861664253 >> 172.21.15.139:0/1861664253 conn(0x55b9658f1740 msgr2=0x55b96596e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 -- 172.21.15.139:0/1861664253 shutdown_connections 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.357+0000 7fb945416740 1 -- 172.21.15.139:0/1861664253 wait complete. 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.358+0000 7fb945416740 1 -- start start 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.358+0000 7fb945416740 1 Processor -- start 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592a5e0 0x55b965952210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b965967550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b965962020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b965928c20 con 0x55b965969ae0 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b965827840 con 0x55b96592a5e0 2024-04-26T18:27:00.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b96592c170 con 0x55b96592bb40 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 10 client.0 _ll_register_callbacks cb 0x55b96582b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b965962020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b965962020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:58908/0 (socket says 172.21.15.139:58908) 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb93b7fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b965967550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 -- 172.21.15.139:0/2471727128 learned_addr learned my addr 172.21.15.139:0/2471727128 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb93bfff640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592a5e0 0x55b965952210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 -- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 msgr2=0x55b965967550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b965967550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 -- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592a5e0 msgr2=0x55b965952210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592a5e0 0x55b965952210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 -- 172.21.15.139:0/2471727128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9656cc510 con 0x55b965969ae0 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b965967550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb93bfff640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592a5e0 0x55b965952210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb940bc5640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b965962020 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb9340043c0 tx=0x7fb934004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aab70ecf05a55b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb91affd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb91affd640 1 -- 172.21.15.139:0/2471727128 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93401a020 con 0x55b965969ae0 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb91affd640 1 -- 172.21.15.139:0/2471727128 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb934007d80 con 0x55b965969ae0 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb92c003820 con 0x55b965969ae0 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.359+0000 7fb91affd640 1 -- 172.21.15.139:0/2471727128 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb934024050 con 0x55b965969ae0 2024-04-26T18:27:00.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 10 client.6000 fetch_fsmap learned FSMap version 9 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b96555f670 con 0x55b965969ae0 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb91affd640 1 -- 172.21.15.139:0/2471727128 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92c003820 con 0x55b965969ae0 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb91affd640 1 -- 172.21.15.139:0/2471727128 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb934027020 con 0x55b965969ae0 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 10 client.6000 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 10 client.6000 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 20 client.6000 populate_metadata read hostname 'smithi139' 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b965962a30 0x55b96597acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 4 client.6000 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b96589b990 con 0x55b965962a30 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb93bfff640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b965962a30 0x55b96597acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb93bfff640 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b965962a30 0x55b96597acc0 crc :-1 s=READY pgs=656 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfca2705227dc9d server_cookie=3bb1073657ddb9c8 in_seq=0 out_seq=0 2024-04-26T18:27:00.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.360+0000 7fb91affd640 10 client.6000 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb91affd640 1 -- 172.21.15.139:0/2471727128 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b96589b990 con 0x55b965962a30 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb91affd640 10 client.6000 handle_command_reply: tid=0 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 client.6000 shutdown 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 msgr2=0x55b965962020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b965962020 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb9340043c0 tx=0x7fb934004880 comp rx=0 tx=0).stop 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 shutdown_connections 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b965962020 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b965962a30 0x55b96597acc0 crc :-1 s=READY pgs=656 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b965967550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 --2- 172.21.15.139:0/2471727128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592a5e0 0x55b965952210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb91affd640 0 client.6000 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 >> 172.21.15.139:0/2471727128 conn(0x55b9658f1740 msgr2=0x55b96592b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:00.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 shutdown_connections 2024-04-26T18:27:00.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 1 -- 172.21.15.139:0/2471727128 wait complete. 2024-04-26T18:27:00.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.361+0000 7fb945416740 20 client.6000 trim_cache size 0 max 16384 2024-04-26T18:27:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.378+0000 7fb945416740 1 Processor -- start 2024-04-26T18:27:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.378+0000 7fb945416740 1 -- start start 2024-04-26T18:27:00.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592a5e0 0x55b9659202c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592bb40 0x55b96596e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb945416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b96596eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb945416740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c2008b0 con 0x55b965969ae0 2024-04-26T18:27:00.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c1ff790 con 0x55b96592bb40 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c1f26e0 con 0x55b96592a5e0 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b96596eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b96596eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:58920/0 (socket says 172.21.15.139:58920) 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 -- 172.21.15.139:0/4001578669 learned_addr learned my addr 172.21.15.139:0/4001578669 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592bb40 0x55b96596e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 -- 172.21.15.139:0/4001578669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592a5e0 msgr2=0x55b9659202c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592a5e0 0x55b9659202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 -- 172.21.15.139:0/4001578669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592bb40 msgr2=0x55b96596e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592bb40 0x55b96596e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 -- 172.21.15.139:0/4001578669 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96597ed50 con 0x55b965969ae0 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb940bc5640 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b96596eec0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb934008010 tx=0x7fb93400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9784e2d0cca5b08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.379+0000 7fb9217fa640 1 -- 172.21.15.139:0/4001578669 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93401a040 con 0x55b965969ae0 2024-04-26T18:27:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb9217fa640 1 -- 172.21.15.139:0/4001578669 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb934003f70 con 0x55b965969ae0 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb9217fa640 1 -- 172.21.15.139:0/4001578669 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934007dc0 con 0x55b965969ae0 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 -- 172.21.15.139:0/4001578669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 msgr2=0x55b96596eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b96596eec0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb934008010 tx=0x7fb93400d000 comp rx=0 tx=0).stop 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 -- 172.21.15.139:0/4001578669 shutdown_connections 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b965969ae0 0x55b96596eec0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b96592bb40 0x55b96596e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 --2- 172.21.15.139:0/4001578669 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592a5e0 0x55b9659202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 -- 172.21.15.139:0/4001578669 >> 172.21.15.139:0/4001578669 conn(0x55b9658f1740 msgr2=0x55b965923ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 -- 172.21.15.139:0/4001578669 shutdown_connections 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.380+0000 7fb945416740 1 -- 172.21.15.139:0/4001578669 wait complete. 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.381+0000 7fb945416740 1 -- start start 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.381+0000 7fb945416740 1 Processor -- start 2024-04-26T18:27:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.381+0000 7fb945416740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b965960300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.381+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96597ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.381+0000 7fb945416740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96597b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.381+0000 7fb945416740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c1fe3b0 con 0x55b96592a5e0 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.381+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c1ff0e0 con 0x55b965969ae0 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb945416740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c1fea30 con 0x55b96592bb40 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb945416740 10 client.0 _ll_register_callbacks cb 0x7fb934009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b965960300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b965960300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:58930/0 (socket says 172.21.15.139:58930) 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 -- 172.21.15.139:0/310176940 learned_addr learned my addr 172.21.15.139:0/310176940 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb940bc5640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96597b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96597ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 -- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 msgr2=0x55b96597ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96597ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 -- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 msgr2=0x55b96597b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96597b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 -- 172.21.15.139:0/310176940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b965927da0 con 0x55b96592a5e0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb940bc5640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96597b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb93bfff640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b965960300 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb92c007760 tx=0x7fb92c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b576db1b467d2fc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb91affd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb91affd640 1 -- 172.21.15.139:0/310176940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c039060 con 0x55b96592a5e0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb91affd640 1 -- 172.21.15.139:0/310176940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb92c005990 con 0x55b96592a5e0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb934003f70 con 0x55b96592a5e0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb91affd640 1 -- 172.21.15.139:0/310176940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fb92c03f050 con 0x55b96592a5e0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb945416740 10 client.6006 fetch_fsmap learned FSMap version 9 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b965926200 con 0x55b96592a5e0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb91affd640 1 -- 172.21.15.139:0/310176940 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb934003f70 con 0x55b96592a5e0 2024-04-26T18:27:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb91affd640 1 -- 172.21.15.139:0/310176940 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fb92c042020 con 0x55b96592a5e0 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb945416740 10 client.6006 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.382+0000 7fb945416740 10 client.6006 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.383+0000 7fb945416740 20 client.6006 populate_metadata read hostname 'smithi139' 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.383+0000 7fb945416740 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b9659e8170 0x55b96597b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.383+0000 7fb945416740 4 client.6006 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.4, "await_for": 42.0}] 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.383+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.4, "await_for": 42.0}) -- 0x55b965895800 con 0x55b9659e8170 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.383+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b9659e8170 0x55b96597b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.383+0000 7fb93b7fe640 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b9659e8170 0x55b96597b6c0 crc :-1 s=READY pgs=657 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73336b169ce110a server_cookie=6faf552581428825 in_seq=0 out_seq=0 2024-04-26T18:27:00.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:00.383+0000 7fb91affd640 10 client.6006 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:01.834 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:27:01.837 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:27:04.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb91affd640 1 -- 172.21.15.139:0/310176940 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x7fb930091070 con 0x55b9659e8170 2024-04-26T18:27:04.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb91affd640 10 client.6006 handle_command_reply: tid=0 2024-04-26T18:27:04.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 client.6006 shutdown 2024-04-26T18:27:04.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 msgr2=0x55b965960300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:04.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b965960300 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb92c007760 tx=0x7fb92c0046c0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 shutdown_connections 2024-04-26T18:27:04.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b965969ae0 0x55b96597b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b9659e8170 0x55b96597b6c0 crc :-1 s=READY pgs=657 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b96592bb40 0x55b96597ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 --2- 172.21.15.139:0/310176940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b96592a5e0 0x55b965960300 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb91affd640 0 client.6006 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:04.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 >> 172.21.15.139:0/310176940 conn(0x55b9658f1740 msgr2=0x55b96596a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:04.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 shutdown_connections 2024-04-26T18:27:04.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.557+0000 7fb945416740 1 -- 172.21.15.139:0/310176940 wait complete. 2024-04-26T18:27:04.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb945416740 20 client.6006 trim_cache size 0 max 16384 2024-04-26T18:27:04.562 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:27:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:27:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:27:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 94, 2024-04-26T18:27:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:27:04.562 INFO:teuthology.orchestra.run.smithi139.stdout: "cff4f8ae": { 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 94, 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:27:04.563 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 75.4, 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:04.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:04.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:04.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:04.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:04.565 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb92806c8f0 msgr2=0x7fb92806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb92806c8f0 0x7fb92806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006e80 tx=0x7fb92c008040 comp rx=0 tx=0).stop 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c9490 msgr2=0x7fb93c157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c9490 0x7fb93c157b20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb93002c9a0 tx=0x7fb9300046c0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 shutdown_connections 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb92806c8f0 0x7fb92806edb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb93c152200 0x7fb93c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb93c0c9490 0x7fb93c157b20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 --2- 172.21.15.139:0/3975006468 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb93c0c8db0 0x7fb93c1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 >> 172.21.15.139:0/3975006468 conn(0x7fb93c06dd40 msgr2=0x7fb93c06e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:04.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 shutdown_connections 2024-04-26T18:27:04.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:04.558+0000 7fb942628640 1 -- 172.21.15.139:0/3975006468 wait complete. 2024-04-26T18:27:04.570 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cff4f8ae', quiesce took 4.7 seconds. Will release after: 15.4 2024-04-26T18:27:19.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:27:20.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.079+0000 7f44c4015640 1 Processor -- start 2024-04-26T18:27:20.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.079+0000 7f44c4015640 1 -- start start 2024-04-26T18:27:20.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c4015640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f44bc153b10 0x7f44bc0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c4015640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44bc0c7d30 con 0x7f44bc15ce60 2024-04-26T18:27:20.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c4015640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44bc0c7ff0 con 0x7f44bc06e240 2024-04-26T18:27:20.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c4015640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f44bc06e8d0 con 0x7f44bc153b10 2024-04-26T18:27:20.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c1db1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f44bc153b10 0x7f44bc0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c25b2640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f44bc15ce60 0x7f44bc15d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49264/0 (socket says 172.21.15.139:49264) 2024-04-26T18:27:20.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c25b2640 1 -- 172.21.15.139:0/1502348079 learned_addr learned my addr 172.21.15.139:0/1502348079 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:27:20.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.080+0000 7f44c1db1640 1 -- 172.21.15.139:0/1502348079 >> v1:172.21.15.143:6789/0 conn(0x7f44bc06e240 legacy=0x7f44bc0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.081+0000 7f44c1db1640 1 -- 172.21.15.139:0/1502348079 >> v1:172.21.15.139:6789/0 conn(0x7f44bc15ce60 legacy=0x7f44bc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.081+0000 7f44c1db1640 1 -- 172.21.15.139:0/1502348079 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc072fe0 con 0x7f44bc153b10 2024-04-26T18:27:20.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.081+0000 7f44c0daf640 1 -- 172.21.15.139:0/1502348079 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789165317 0 0) 0x7f44bc0c7d30 con 0x7f44bc15ce60 2024-04-26T18:27:20.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.081+0000 7f44c1db1640 1 --2- 172.21.15.139:0/1502348079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc153b10 0x7f44bc0c96d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009d90 tx=0x7f44b802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd29126f5263fac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.081+0000 7f44c0daf640 1 -- 172.21.15.139:0/1502348079 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8037070 con 0x7f44bc153b10 2024-04-26T18:27:20.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.081+0000 7f44c0daf640 1 -- 172.21.15.139:0/1502348079 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b8007740 con 0x7f44bc153b10 2024-04-26T18:27:20.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.081+0000 7f44c0daf640 1 -- 172.21.15.139:0/1502348079 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8007b10 con 0x7f44bc153b10 2024-04-26T18:27:20.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.082+0000 7f44c4015640 1 -- 172.21.15.139:0/1502348079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc153b10 msgr2=0x7f44bc0c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.082+0000 7f44c4015640 1 --2- 172.21.15.139:0/1502348079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc153b10 0x7f44bc0c96d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009d90 tx=0x7f44b802a780 comp rx=0 tx=0).stop 2024-04-26T18:27:20.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.082+0000 7f44c4015640 1 -- 172.21.15.139:0/1502348079 shutdown_connections 2024-04-26T18:27:20.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.082+0000 7f44c4015640 1 --2- 172.21.15.139:0/1502348079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc153b10 0x7f44bc0c96d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.082+0000 7f44c4015640 1 -- 172.21.15.139:0/1502348079 >> 172.21.15.139:0/1502348079 conn(0x7f44bc068270 msgr2=0x7f44bc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.082+0000 7f44c4015640 1 -- 172.21.15.139:0/1502348079 shutdown_connections 2024-04-26T18:27:20.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.082+0000 7f44c4015640 1 -- 172.21.15.139:0/1502348079 wait complete. 2024-04-26T18:27:20.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.083+0000 7f44c4015640 1 Processor -- start 2024-04-26T18:27:20.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.083+0000 7f44c4015640 1 -- start start 2024-04-26T18:27:20.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c4015640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44bc06e240 0x7f44bc156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c4015640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44bc153b10 0x7f44bc1e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c4015640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc15ce60 0x7f44bc1e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c4015640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc0735a0 con 0x7f44bc15ce60 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c4015640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f44bc073910 con 0x7f44bc153b10 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c4015640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f44bc153ef0 con 0x7f44bc06e240 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc15ce60 0x7f44bc1e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc15ce60 0x7f44bc1e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:50992/0 (socket says 172.21.15.139:50992) 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 -- 172.21.15.139:0/757282166 learned_addr learned my addr 172.21.15.139:0/757282166 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c1db1640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44bc06e240 0x7f44bc156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c15b0640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44bc153b10 0x7f44bc1e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 -- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44bc06e240 msgr2=0x7f44bc156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44bc06e240 0x7f44bc156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 -- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44bc153b10 msgr2=0x7f44bc1e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44bc153b10 0x7f44bc1e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.084+0000 7f44c25b2640 1 -- 172.21.15.139:0/757282166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44bc1f3950 con 0x7f44bc15ce60 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.085+0000 7f44c25b2640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc15ce60 0x7f44bc1e3770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c440 tx=0x7f44b400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.085+0000 7f44b27fc640 1 -- 172.21.15.139:0/757282166 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b40074e0 con 0x7f44bc15ce60 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.085+0000 7f44b27fc640 1 -- 172.21.15.139:0/757282166 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b40047e0 con 0x7f44bc15ce60 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.085+0000 7f44b27fc640 1 -- 172.21.15.139:0/757282166 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b4004bd0 con 0x7f44bc15ce60 2024-04-26T18:27:20.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.085+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44bc154ba0 con 0x7f44bc15ce60 2024-04-26T18:27:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.085+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44bc1f2e70 con 0x7f44bc15ce60 2024-04-26T18:27:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.086+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44bc076d20 con 0x7f44bc15ce60 2024-04-26T18:27:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.087+0000 7f44b27fc640 1 -- 172.21.15.139:0/757282166 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f44b4011070 con 0x7f44bc15ce60 2024-04-26T18:27:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.087+0000 7f44b27fc640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f44a006c8f0 0x7f44a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.087+0000 7f44b27fc640 1 -- 172.21.15.139:0/757282166 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f44b408ba10 con 0x7f44bc15ce60 2024-04-26T18:27:20.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.087+0000 7f44c1db1640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f44a006c8f0 0x7f44a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.087+0000 7f44c1db1640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f44a006c8f0 0x7f44a006edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44b8034000 tx=0x7f44b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.091+0000 7f44b27fc640 1 -- 172.21.15.139:0/757282166 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f44b40593b0 con 0x7f44bc15ce60 2024-04-26T18:27:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.304+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44bc06eab0 con 0x7f44bc15ce60 2024-04-26T18:27:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.304+0000 7f44b27fc640 1 -- 172.21.15.139:0/757282166 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f44b405d6b0 con 0x7f44bc15ce60 2024-04-26T18:27:20.304 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:27:20.305 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:27:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f44a006c8f0 msgr2=0x7f44a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f44a006c8f0 0x7f44a006edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44b8034000 tx=0x7f44b802e000 comp rx=0 tx=0).stop 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc15ce60 msgr2=0x7f44bc1e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc15ce60 0x7f44bc1e3770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c440 tx=0x7f44b400c900 comp rx=0 tx=0).stop 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 shutdown_connections 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f44a006c8f0 0x7f44a006edb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44bc15ce60 0x7f44bc1e3770 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f44bc153b10 0x7f44bc1e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 --2- 172.21.15.139:0/757282166 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f44bc06e240 0x7f44bc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 >> 172.21.15.139:0/757282166 conn(0x7f44bc068270 msgr2=0x7f44bc149dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 shutdown_connections 2024-04-26T18:27:20.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.306+0000 7f44c4015640 1 -- 172.21.15.139:0/757282166 wait complete. 2024-04-26T18:27:20.317 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id cff4f8ae --release --await' 2024-04-26T18:27:20.318 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id cff4f8ae --release --await 2024-04-26T18:27:20.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.420+0000 7fa545178640 1 Processor -- start 2024-04-26T18:27:20.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.420+0000 7fa545178640 1 -- start start 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa545178640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa54015f050 0x7fa54015c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa545178640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa540071c20 0x7fa540072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa545178640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54015f6c0 con 0x7fa540155cd0 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa545178640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fa54015f470 con 0x7fa540071c20 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa545178640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa54015f9a0 con 0x7fa54015f050 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53f59e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa540071c20 0x7fa540072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53f59e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa540071c20 0x7fa540072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51004/0 (socket says 172.21.15.139:51004) 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53ed9d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa540155cd0 0x7fa5400cabf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:49266/0 (socket says 172.21.15.139:49266) 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53f59e640 1 -- 172.21.15.139:0/266807471 learned_addr learned my addr 172.21.15.139:0/266807471 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53e59c640 1 --2- 172.21.15.139:0/266807471 >> v2:172.21.15.143:3300/0 conn(0x7fa54015f050 0x7fa54015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53f59e640 1 -- 172.21.15.139:0/266807471 >> v2:172.21.15.143:3300/0 conn(0x7fa54015f050 msgr2=0x7fa54015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53f59e640 1 --2- 172.21.15.139:0/266807471 >> v2:172.21.15.143:3300/0 conn(0x7fa54015f050 0x7fa54015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53f59e640 1 -- 172.21.15.139:0/266807471 >> v1:172.21.15.139:6789/0 conn(0x7fa540155cd0 legacy=0x7fa5400cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.422+0000 7fa53f59e640 1 -- 172.21.15.139:0/266807471 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54015fc80 con 0x7fa540071c20 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.421+0000 7fa53dd9b640 1 -- 172.21.15.139:0/266807471 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194298051 0 0) 0x7fa54015f6c0 con 0x7fa540155cd0 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.422+0000 7fa53e59c640 1 --2- 172.21.15.139:0/266807471 >> v2:172.21.15.143:3300/0 conn(0x7fa54015f050 0x7fa54015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.422+0000 7fa53f59e640 1 --2- 172.21.15.139:0/266807471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540071c20 0x7fa540072050 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa5400cce30 tx=0x7fa53802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff0c9fab2f8a5a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.422+0000 7fa53dd9b640 1 -- 172.21.15.139:0/266807471 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538037070 con 0x7fa540071c20 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.422+0000 7fa53dd9b640 1 -- 172.21.15.139:0/266807471 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53802ae50 con 0x7fa540071c20 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.422+0000 7fa53dd9b640 1 -- 172.21.15.139:0/266807471 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538032860 con 0x7fa540071c20 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 -- 172.21.15.139:0/266807471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540071c20 msgr2=0x7fa540072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 --2- 172.21.15.139:0/266807471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540071c20 0x7fa540072050 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa5400cce30 tx=0x7fa53802a300 comp rx=0 tx=0).stop 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 -- 172.21.15.139:0/266807471 shutdown_connections 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 --2- 172.21.15.139:0/266807471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540071c20 0x7fa540072050 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 --2- 172.21.15.139:0/266807471 >> v2:172.21.15.143:3300/0 conn(0x7fa54015f050 0x7fa54015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 -- 172.21.15.139:0/266807471 >> 172.21.15.139:0/266807471 conn(0x7fa54006feb0 msgr2=0x7fa540070290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 -- 172.21.15.139:0/266807471 shutdown_connections 2024-04-26T18:27:20.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.423+0000 7fa545178640 1 -- 172.21.15.139:0/266807471 wait complete. 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.424+0000 7fa545178640 1 Processor -- start 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.424+0000 7fa545178640 1 -- start start 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa545178640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa540071c20 0x7fa540154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa545178640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540155cd0 0x7fa54015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa545178640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54015f050 0x7fa540147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa545178640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa54015be50 con 0x7fa540155cd0 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa545178640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa54015bb70 con 0x7fa54015f050 2024-04-26T18:27:20.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa545178640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5401560b0 con 0x7fa540071c20 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540155cd0 0x7fa54015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540155cd0 0x7fa54015ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51006/0 (socket says 172.21.15.139:51006) 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 -- 172.21.15.139:0/1240786723 learned_addr learned my addr 172.21.15.139:0/1240786723 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53f59e640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54015f050 0x7fa540147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa540071c20 0x7fa540154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 -- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa540071c20 msgr2=0x7fa540154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa540071c20 0x7fa540154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 -- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54015f050 msgr2=0x7fa540147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54015f050 0x7fa540147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53e59c640 1 -- 172.21.15.139:0/1240786723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5401554e0 con 0x7fa540155cd0 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.425+0000 7fa53f59e640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54015f050 0x7fa540147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.426+0000 7fa53e59c640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540155cd0 0x7fa54015ab20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa53400d7d0 tx=0x7fa53400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.426+0000 7fa5277fe640 1 -- 172.21.15.139:0/1240786723 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534004030 con 0x7fa540155cd0 2024-04-26T18:27:20.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.426+0000 7fa5277fe640 1 -- 172.21.15.139:0/1240786723 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5340041d0 con 0x7fa540155cd0 2024-04-26T18:27:20.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.426+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa540150f50 con 0x7fa540155cd0 2024-04-26T18:27:20.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.426+0000 7fa5277fe640 1 -- 172.21.15.139:0/1240786723 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53400b6c0 con 0x7fa540155cd0 2024-04-26T18:27:20.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.426+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5401506b0 con 0x7fa540155cd0 2024-04-26T18:27:20.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.427+0000 7fa5277fe640 1 -- 172.21.15.139:0/1240786723 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa53400b860 con 0x7fa540155cd0 2024-04-26T18:27:20.431 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.428+0000 7fa5277fe640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa52c06c8f0 0x7fa52c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.428+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa52c06c8f0 0x7fa52c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.428+0000 7fa5277fe640 1 -- 172.21.15.139:0/1240786723 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa53408c2d0 con 0x7fa540155cd0 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.428+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa52c06c8f0 0x7fa52c06edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa5300012e0 tx=0x7fa530007ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.429+0000 7fa547f69740 1 Processor -- start 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.429+0000 7fa547f69740 1 -- start start 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf079aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa547f69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf0796b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796ca10 0x55bf0796bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa547f69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf078d0040 con 0x55bf079aa9b0 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55bf0786bb60 con 0x55bf0796ca10 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55bf078cc000 con 0x55bf0796b4b0 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf0796b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf0796b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51014/0 (socket says 172.21.15.139:51014) 2024-04-26T18:27:20.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 -- 172.21.15.139:0/545785688 learned_addr learned my addr 172.21.15.139:0/545785688 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 -- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 msgr2=0x55bf079aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf079aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf079aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53f59e640 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796ca10 0x55bf0796bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 -- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796ca10 msgr2=0x55bf0796bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796ca10 0x55bf0796bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 -- 172.21.15.139:0/545785688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf078609c0 con 0x55bf079aa9b0 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53f59e640 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796ca10 0x55bf0796bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa53e59c640 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf0796b890 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa534006de0 tx=0x7fa5340595b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d087281970ab38c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa524ff9640 1 -- 172.21.15.139:0/545785688 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53408c0c0 con 0x55bf079aa9b0 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa524ff9640 1 -- 172.21.15.139:0/545785688 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53405ae50 con 0x55bf079aa9b0 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.430+0000 7fa524ff9640 1 -- 172.21.15.139:0/545785688 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5340720d0 con 0x55bf079aa9b0 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 -- 172.21.15.139:0/545785688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 msgr2=0x55bf0796b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf0796b890 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa534006de0 tx=0x7fa5340595b0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 -- 172.21.15.139:0/545785688 shutdown_connections 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796ca10 0x55bf0796bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf0796b890 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 --2- 172.21.15.139:0/545785688 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf079aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 -- 172.21.15.139:0/545785688 >> 172.21.15.139:0/545785688 conn(0x55bf07932930 msgr2=0x55bf079af450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 -- 172.21.15.139:0/545785688 shutdown_connections 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 -- 172.21.15.139:0/545785688 wait complete. 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.431+0000 7fa547f69740 1 -- start start 2024-04-26T18:27:20.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 1 Processor -- start 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf0796bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf079bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf079aa9b0 0x55bf07995ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bf07969af0 con 0x55bf0796ca10 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55bf078694f0 con 0x55bf079aa9b0 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55bf0796d040 con 0x55bf0796b4b0 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa547f69740 10 client.0 _ll_register_callbacks cb 0x55bf078c6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf079bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf079bc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51028/0 (socket says 172.21.15.139:51028) 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa53e59c640 1 -- 172.21.15.139:0/208404598 learned_addr learned my addr 172.21.15.139:0/208404598 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:20.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf0796bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.432+0000 7fa53f59e640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf079aa9b0 0x55bf07995ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa53e59c640 1 -- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 msgr2=0x55bf0796bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa53e59c640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf0796bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa53e59c640 1 -- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf079aa9b0 msgr2=0x55bf07995ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa53e59c640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf079aa9b0 0x55bf07995ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa53e59c640 1 -- 172.21.15.139:0/208404598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf075e1920 con 0x55bf0796ca10 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa53f59e640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf079aa9b0 0x55bf07995ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa53e59c640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf079bc330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa534059ce0 tx=0x7fa53405c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2106ad27f6befe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa51dffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa51dffb640 1 -- 172.21.15.139:0/208404598 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534088030 con 0x55bf0796ca10 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa51dffb640 1 -- 172.21.15.139:0/208404598 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa534056190 con 0x55bf0796ca10 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa53405ae50 con 0x55bf0796ca10 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa51dffb640 1 -- 172.21.15.139:0/208404598 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa53407e050 con 0x55bf0796ca10 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 10 client.6030 fetch_fsmap learned FSMap version 9 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bf076add30 con 0x55bf0796ca10 2024-04-26T18:27:20.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa51dffb640 1 -- 172.21.15.139:0/208404598 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53405ae50 con 0x55bf0796ca10 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa51dffb640 1 -- 172.21.15.139:0/208404598 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa534013070 con 0x55bf0796ca10 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 10 client.6030 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 10 client.6030 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 20 client.6030 populate_metadata read hostname 'smithi139' 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07996220 0x55bf07992900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 4 client.6030 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.433+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf078a3a00 con 0x55bf07996220 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.434+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07996220 0x55bf07992900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.434+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07996220 0x55bf07992900 crc :-1 s=READY pgs=661 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0205fe61a71c00c server_cookie=acd1d23dd33f3e62 in_seq=0 out_seq=0 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.434+0000 7fa51dffb640 10 client.6030 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa51dffb640 1 -- 172.21.15.139:0/208404598 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf078a3a00 con 0x55bf07996220 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa51dffb640 10 client.6030 handle_command_reply: tid=0 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 client.6030 shutdown 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 msgr2=0x55bf079bc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf079bc330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa534059ce0 tx=0x7fa53405c070 comp rx=0 tx=0).stop 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 shutdown_connections 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf079aa9b0 0x55bf07995ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf079bc330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07996220 0x55bf07992900 crc :-1 s=READY pgs=661 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 --2- 172.21.15.139:0/208404598 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796b4b0 0x55bf0796bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa51dffb640 0 client.6030 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 >> 172.21.15.139:0/208404598 conn(0x55bf07932930 msgr2=0x55bf079949b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 shutdown_connections 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 1 -- 172.21.15.139:0/208404598 wait complete. 2024-04-26T18:27:20.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.435+0000 7fa547f69740 20 client.6030 trim_cache size 0 max 16384 2024-04-26T18:27:20.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.452+0000 7fa547f69740 1 Processor -- start 2024-04-26T18:27:20.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.452+0000 7fa547f69740 1 -- start start 2024-04-26T18:27:20.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf079a8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796ca10 0x55bf079ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa547f69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf079aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa547f69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa540200610 con 0x55bf079aa9b0 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401ff4f0 con 0x55bf0796b4b0 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5401f5b60 con 0x55bf0796ca10 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf079aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf079aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51040/0 (socket says 172.21.15.139:51040) 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 -- 172.21.15.139:0/3951889327 learned_addr learned my addr 172.21.15.139:0/3951889327 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 -- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796ca10 msgr2=0x55bf079ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796ca10 0x55bf079ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf079a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 -- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 msgr2=0x55bf079a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf079a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 -- 172.21.15.139:0/3951889327 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf079a30a0 con 0x55bf079aa9b0 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf079a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa53f59e640 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf079aeb80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa53802a8f0 tx=0x7fa53802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a21e8bf47e95d71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa51ffff640 1 -- 172.21.15.139:0/3951889327 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538037040 con 0x55bf079aa9b0 2024-04-26T18:27:20.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa51ffff640 1 -- 172.21.15.139:0/3951889327 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53802ae50 con 0x55bf079aa9b0 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.453+0000 7fa51ffff640 1 -- 172.21.15.139:0/3951889327 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538032960 con 0x55bf079aa9b0 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 -- 172.21.15.139:0/3951889327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 msgr2=0x55bf079aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf079aeb80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa53802a8f0 tx=0x7fa53802c000 comp rx=0 tx=0).stop 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 -- 172.21.15.139:0/3951889327 shutdown_connections 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf079aa9b0 0x55bf079aeb80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf0796ca10 0x55bf079ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 --2- 172.21.15.139:0/3951889327 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf079a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 -- 172.21.15.139:0/3951889327 >> 172.21.15.139:0/3951889327 conn(0x55bf07932930 msgr2=0x55bf079af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 -- 172.21.15.139:0/3951889327 shutdown_connections 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 -- 172.21.15.139:0/3951889327 wait complete. 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 -- start start 2024-04-26T18:27:20.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.454+0000 7fa547f69740 1 Processor -- start 2024-04-26T18:27:20.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf07a25eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa547f69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf0798fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa547f69740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf079aa9b0 0x55bf07a1f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa547f69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401fe080 con 0x55bf0796ca10 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401fee20 con 0x55bf0796b4b0 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa547f69740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa5401fe750 con 0x55bf079aa9b0 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa547f69740 10 client.0 _ll_register_callbacks cb 0x7fa534059480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf0798fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf0798fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51056/0 (socket says 172.21.15.139:51056) 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 -- 172.21.15.139:0/2447453104 learned_addr learned my addr 172.21.15.139:0/2447453104 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53f59e640 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf079aa9b0 0x55bf07a1f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf07a25eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 -- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf079aa9b0 msgr2=0x55bf07a1f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf079aa9b0 0x55bf07a1f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 -- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 msgr2=0x55bf07a25eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf07a25eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.455+0000 7fa53e59c640 1 -- 172.21.15.139:0/2447453104 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf079cfe90 con 0x55bf0796ca10 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa53e59c640 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf0798fa20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa534055f80 tx=0x7fa53408a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9559f72eb580e554 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa51dffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa51dffb640 1 -- 172.21.15.139:0/2447453104 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53400bd50 con 0x55bf0796ca10 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa51dffb640 1 -- 172.21.15.139:0/2447453104 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa534058f70 con 0x55bf0796ca10 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa53802ae50 con 0x55bf0796ca10 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa51dffb640 1 -- 172.21.15.139:0/2447453104 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa534088070 con 0x55bf0796ca10 2024-04-26T18:27:20.461 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 10 client.6036 fetch_fsmap learned FSMap version 9 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55bf079ce7f0 con 0x55bf0796ca10 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa51dffb640 1 -- 172.21.15.139:0/2447453104 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53802ae50 con 0x55bf0796ca10 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa51dffb640 1 -- 172.21.15.139:0/2447453104 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa534055870 con 0x55bf0796ca10 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 10 client.6036 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 10 client.6036 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 20 client.6036 populate_metadata read hostname 'smithi139' 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07a1f730 0x55bf079ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 4 client.6036 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cff4f8ae", "release": true, "await": true}] 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cff4f8ae", "release": true, "await": true}) -- 0x55bf078ddc50 con 0x55bf07a1f730 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.456+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07a1f730 0x55bf079ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa51dffb640 10 client.6036 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa53ed9d640 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07a1f730 0x55bf079ad630 crc :-1 s=READY pgs=662 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888c6c77541a9701 server_cookie=a28e8b48ee7d1063 in_seq=0 out_seq=0 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa51dffb640 1 -- 172.21.15.139:0/2447453104 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55bf078ddc50 con 0x55bf07a1f730 2024-04-26T18:27:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa51dffb640 10 client.6036 handle_command_reply: tid=0 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 client.6036 shutdown 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 msgr2=0x55bf0798fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf0798fa20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa534055f80 tx=0x7fa53408a1f0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 shutdown_connections 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55bf07a1f730 0x55bf079ad630 crc :-1 s=READY pgs=662 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55bf079aa9b0 0x55bf07a1f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa51dffb640 0 client.6036 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bf0796ca10 0x55bf0798fa20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 --2- 172.21.15.139:0/2447453104 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55bf0796b4b0 0x55bf07a25eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 >> 172.21.15.139:0/2447453104 conn(0x55bf07932930 msgr2=0x55bf079aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 shutdown_connections 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 1 -- 172.21.15.139:0/2447453104 wait complete. 2024-04-26T18:27:20.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.457+0000 7fa547f69740 20 client.6036 trim_cache size 0 max 16384 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 96, 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "cff4f8ae": { 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 96, 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:27:20.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 75.4, 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:20.465 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:20.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:20.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:20.466 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa52c06c8f0 msgr2=0x7fa52c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa52c06c8f0 0x7fa52c06edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa5300012e0 tx=0x7fa530007ed0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540155cd0 msgr2=0x7fa54015ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540155cd0 0x7fa54015ab20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa53400d7d0 tx=0x7fa53400dc90 comp rx=0 tx=0).stop 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 shutdown_connections 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa52c06c8f0 0x7fa52c06edb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54015f050 0x7fa540147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa540155cd0 0x7fa54015ab20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 --2- 172.21.15.139:0/1240786723 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa540071c20 0x7fa540154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 >> 172.21.15.139:0/1240786723 conn(0x7fa54006feb0 msgr2=0x7fa5400c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 shutdown_connections 2024-04-26T18:27:20.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:20.458+0000 7fa545178640 1 -- 172.21.15.139:0/1240786723 wait complete. 2024-04-26T18:27:20.468 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cff4f8ae', seconds elapsed: 20.6 2024-04-26T18:27:24.574 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 5% (10/176) Updating files: 6% (11/176) Updating files: 7% (13/176) Updating files: 8% (15/176) Updating files: 9% (16/176) Updating files: 10% (18/176) Updating files: 11% (20/176) Updating files: 12% (22/176) Updating files: 13% (23/176) Updating files: 14% (25/176) Updating files: 15% (27/176) Updating files: 16% (29/176) Updating files: 17% (30/176) Updating files: 18% (32/176) Updating files: 19% (34/176) Updating files: 20% (36/176) Updating files: 21% (37/176) Updating files: 22% (39/176) Updating files: 23% (41/176) Updating files: 24% (43/176) Updating files: 25% (44/176) Updating files: 26% (46/176) Updating files: 27% (48/176) Updating files: 27% (49/176) Updating files: 28% (50/176) Updating files: 29% (52/176) Updating files: 30% (53/176) Updating files: 31% (55/176) Updating files: 32% (57/176) Updating files: 33% (59/176) Updating files: 34% (60/176) Updating files: 35% (62/176) Updating files: 36% (64/176) Updating files: 37% (66/176) Updating files: 38% (67/176) Updating files: 39% (69/176) Updating files: 40% (71/176) Updating files: 41% (73/176) Updating files: 42% (74/176) Updating files: 43% (76/176) Updating files: 44% (78/176) Updating files: 45% (80/176) Updating files: 46% (81/176) Updating files: 47% (83/176) Updating files: 48% (85/176) Updating files: 49% (87/176) Updating files: 50% (88/176) Updating files: 51% (90/176) Updating files: 52% (92/176) Updating files: 53% (94/176) Updating files: 54% (96/176) Updating files: 55% (97/176) Updating files: 56% (99/176) Updating files: 57% (101/176) Updating files: 58% (103/176) Updating files: 59% (104/176) Updating files: 60% (106/176) Updating files: 61% (108/176) Updating files: 62% (110/176) Updating files: 63% (111/176) Updating files: 64% (113/176) Updating files: 65% (115/176) Updating files: 66% (117/176) Updating files: 67% (118/176) Updating files: 68% (120/176) Updating files: 69% (122/176) Updating files: 70% (124/176) Updating files: 71% (125/176) Updating files: 72% (127/176) Updating files: 73% (129/176) Updating files: 74% (131/176) Updating files: 75% (132/176) Updating files: 76% (134/176) Updating files: 77% (136/176) Updating files: 78% (138/176) Updating files: 79% (140/176) Updating files: 80% (141/176) Updating files: 81% (143/176) Updating files: 82% (145/176) Updating files: 83% (147/176) Updating files: 84% (148/176) Updating files: 85% (150/176) Updating files: 86% (152/176) Updating files: 87% (154/176) Updating files: 88% (155/176) Updating files: 89% (157/176) Updating files: 90% (159/176) Updating files: 91% (161/176) Updating files: 92% (162/176) Updating files: 93% (164/176) Updating files: 94% (166/176) Updating files: 95% (168/176) Updating files: 96% (169/176) Updating files: 97% (171/176) Updating files: 98% (173/176) Updating files: 99% (175/176) Updating files: 100% (176/176) Updating files: 100% (176/176), done. 2024-04-26T18:27:24.648 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at b78644e7dee 0.80 2024-04-26T18:27:24.680 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.80 2024-04-26T18:27:24.691 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:27:24.692 INFO:tasks.workunit.client.0.smithi139.stdout:v0.81 2024-04-26T18:27:24.692 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 81 -eq 48 ']' 2024-04-26T18:27:24.692 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.81 2024-04-26T18:27:24.692 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.81 2024-04-26T18:27:24.692 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.81 2024-04-26T18:27:31.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:27:31.892 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:27:38.275 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 22% (71/309) Updating files: 23% (72/309) Updating files: 24% (75/309) Updating files: 25% (78/309) Updating files: 26% (81/309) Updating files: 27% (84/309) Updating files: 28% (87/309) Updating files: 29% (90/309) Updating files: 30% (93/309) Updating files: 31% (96/309) Updating files: 32% (99/309) Updating files: 33% (102/309) Updating files: 34% (106/309) Updating files: 35% (109/309) Updating files: 36% (112/309) Updating files: 37% (115/309) Updating files: 38% (118/309) Updating files: 39% (121/309) Updating files: 40% (124/309) Updating files: 41% (127/309) Updating files: 42% (130/309) Updating files: 43% (133/309) Updating files: 44% (136/309) Updating files: 45% (140/309) Updating files: 46% (143/309) Updating files: 47% (146/309) Updating files: 48% (149/309) Updating files: 49% (152/309) Updating files: 50% (155/309) Updating files: 51% (158/309) Updating files: 52% (161/309) Updating files: 53% (164/309) Updating files: 54% (167/309) Updating files: 55% (170/309) Updating files: 56% (174/309) Updating files: 57% (177/309) Updating files: 58% (180/309) Updating files: 59% (183/309) Updating files: 60% (186/309) Updating files: 61% (189/309) Updating files: 62% (192/309) Updating files: 63% (195/309) Updating files: 64% (198/309) Updating files: 65% (201/309) Updating files: 66% (204/309) Updating files: 67% (208/309) Updating files: 68% (211/309) Updating files: 69% (214/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 96% (297/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2024-04-26T18:27:38.311 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 8de9501df27 0.81 2024-04-26T18:27:38.313 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.81 2024-04-26T18:27:38.350 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:27:38.350 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 82 -eq 48 ']' 2024-04-26T18:27:38.350 INFO:tasks.workunit.client.0.smithi139.stdout:v0.82 2024-04-26T18:27:38.351 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.82 2024-04-26T18:27:38.351 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.82 2024-04-26T18:27:38.351 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.82 2024-04-26T18:27:42.032 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 24% (49/204) Updating files: 25% (51/204) Updating files: 26% (54/204) Updating files: 27% (56/204) Updating files: 28% (58/204) Updating files: 29% (60/204) Updating files: 30% (62/204) Updating files: 31% (64/204) Updating files: 32% (66/204) Updating files: 33% (68/204) Updating files: 34% (70/204) Updating files: 35% (72/204) Updating files: 36% (74/204) Updating files: 37% (76/204) Updating files: 38% (78/204) Updating files: 39% (80/204) Updating files: 40% (82/204) Updating files: 41% (84/204) Updating files: 42% (86/204) Updating files: 43% (88/204) Updating files: 44% (90/204) Updating files: 45% (92/204) Updating files: 46% (94/204) Updating files: 47% (96/204) Updating files: 48% (98/204) Updating files: 49% (100/204) Updating files: 50% (102/204) Updating files: 50% (104/204) Updating files: 51% (105/204) Updating files: 52% (107/204) Updating files: 53% (109/204) Updating files: 54% (111/204) Updating files: 55% (113/204) Updating files: 56% (115/204) Updating files: 57% (117/204) Updating files: 58% (119/204) Updating files: 59% (121/204) Updating files: 60% (123/204) Updating files: 61% (125/204) Updating files: 62% (127/204) Updating files: 63% (129/204) Updating files: 64% (131/204) Updating files: 65% (133/204) Updating files: 66% (135/204) Updating files: 67% (137/204) Updating files: 68% (139/204) Updating files: 69% (141/204) Updating files: 70% (143/204) Updating files: 71% (145/204) Updating files: 72% (147/204) Updating files: 73% (149/204) Updating files: 74% (151/204) Updating files: 75% (153/204) Updating files: 76% (156/204) Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2024-04-26T18:27:42.077 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 14085f42ddd 0.82 2024-04-26T18:27:42.080 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.82 2024-04-26T18:27:42.703 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:27:42.704 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 83 -eq 48 ']' 2024-04-26T18:27:42.704 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.83 2024-04-26T18:27:42.704 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.83 2024-04-26T18:27:42.704 INFO:tasks.workunit.client.0.smithi139.stdout:v0.83 2024-04-26T18:27:42.704 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.83 2024-04-26T18:27:46.597 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 59% (129/218) Updating files: 60% (131/218) Updating files: 61% (133/218) Updating files: 62% (136/218) Updating files: 63% (138/218) Updating files: 64% (140/218) Updating files: 65% (142/218) Updating files: 66% (144/218) Updating files: 67% (147/218) Updating files: 68% (149/218) Updating files: 69% (151/218) Updating files: 70% (153/218) Updating files: 71% (155/218) Updating files: 72% (157/218) Updating files: 73% (160/218) Updating files: 74% (162/218) Updating files: 75% (164/218) Updating files: 76% (166/218) Updating files: 77% (168/218) Updating files: 78% (171/218) Updating files: 79% (173/218) Updating files: 80% (175/218) Updating files: 81% (177/218) Updating files: 82% (179/218) Updating files: 83% (181/218) Updating files: 84% (184/218) Updating files: 85% (186/218) Updating files: 86% (188/218) Updating files: 87% (190/218) Updating files: 88% (192/218) Updating files: 89% (195/218) Updating files: 90% (197/218) Updating files: 91% (199/218) Updating files: 92% (201/218) Updating files: 93% (203/218) Updating files: 93% (204/218) Updating files: 94% (205/218) Updating files: 95% (208/218) Updating files: 96% (210/218) Updating files: 97% (212/218) Updating files: 98% (214/218) Updating files: 99% (216/218) Updating files: 100% (218/218) Updating files: 100% (218/218), done. 2024-04-26T18:27:46.630 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 78ff1f0a5df 0.83 2024-04-26T18:27:46.633 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.83 2024-04-26T18:27:47.519 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:27:47.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 84 -eq 48 ']' 2024-04-26T18:27:47.520 INFO:tasks.workunit.client.0.smithi139.stdout:v0.84 2024-04-26T18:27:47.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.84 2024-04-26T18:27:47.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.84 2024-04-26T18:27:47.520 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.84 2024-04-26T18:27:49.069 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:27:49.069 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T18:27:49.070 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:27:49.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.167+0000 7effdd4d1640 1 Processor -- start 2024-04-26T18:27:49.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.167+0000 7effdd4d1640 1 -- start start 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effdd4d1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7effd8070fc0 0x7effd80c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effdd4d1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7effd8159960 0x7effd8159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effdd4d1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd8071410 con 0x7effd8153de0 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effdd4d1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7effd8070990 con 0x7effd8070fc0 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effdd4d1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7effd8070c70 con 0x7effd8159960 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd67fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7effd8070fc0 0x7effd80c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd67fc640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7effd8070fc0 0x7effd80c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41180/0 (socket says 172.21.15.139:41180) 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd67fc640 1 -- 172.21.15.139:0/284537940 learned_addr learned my addr 172.21.15.139:0/284537940 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd77fe640 1 --2- 172.21.15.139:0/284537940 >> v2:172.21.15.143:3300/0 conn(0x7effd8159960 0x7effd8159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd67fc640 1 -- 172.21.15.139:0/284537940 >> v2:172.21.15.143:3300/0 conn(0x7effd8159960 msgr2=0x7effd8159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd67fc640 1 --2- 172.21.15.139:0/284537940 >> v2:172.21.15.143:3300/0 conn(0x7effd8159960 0x7effd8159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd67fc640 1 -- 172.21.15.139:0/284537940 >> v1:172.21.15.143:6789/0 conn(0x7effd8153de0 legacy=0x7effd80cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.168+0000 7effd67fc640 1 -- 172.21.15.139:0/284537940 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd80ca670 con 0x7effd8070fc0 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.169+0000 7effd67fc640 1 --2- 172.21.15.139:0/284537940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8070fc0 0x7effd80c9cf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7effd8068f00 tx=0x7effcc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a54bfd85ae6858 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.169+0000 7effd5ffb640 1 -- 172.21.15.139:0/284537940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc037070 con 0x7effd8070fc0 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.169+0000 7effd5ffb640 1 -- 172.21.15.139:0/284537940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effcc02ae50 con 0x7effd8070fc0 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.169+0000 7effd5ffb640 1 -- 172.21.15.139:0/284537940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc032860 con 0x7effd8070fc0 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.169+0000 7effdd4d1640 1 -- 172.21.15.139:0/284537940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8070fc0 msgr2=0x7effd80c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.169+0000 7effdd4d1640 1 --2- 172.21.15.139:0/284537940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8070fc0 0x7effd80c9cf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7effd8068f00 tx=0x7effcc02a300 comp rx=0 tx=0).stop 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.170+0000 7effdd4d1640 1 -- 172.21.15.139:0/284537940 shutdown_connections 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.170+0000 7effdd4d1640 1 --2- 172.21.15.139:0/284537940 >> v2:172.21.15.143:3300/0 conn(0x7effd8159960 0x7effd8159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.170+0000 7effdd4d1640 1 --2- 172.21.15.139:0/284537940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8070fc0 0x7effd80c9cf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.170+0000 7effdd4d1640 1 -- 172.21.15.139:0/284537940 >> 172.21.15.139:0/284537940 conn(0x7effd8076730 msgr2=0x7effd8068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.170+0000 7effdd4d1640 1 -- 172.21.15.139:0/284537940 shutdown_connections 2024-04-26T18:27:49.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.170+0000 7effdd4d1640 1 -- 172.21.15.139:0/284537940 wait complete. 2024-04-26T18:27:49.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 Processor -- start 2024-04-26T18:27:49.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 -- start start 2024-04-26T18:27:49.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effd8070fc0 0x7effd806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8153de0 0x7effd815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effd8159960 0x7effd8158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7effd80caf10 con 0x7effd8153de0 2024-04-26T18:27:49.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7effd80cac30 con 0x7effd8070fc0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.171+0000 7effdd4d1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7effd815a2b0 con 0x7effd8159960 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8153de0 0x7effd815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8153de0 0x7effd815ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41184/0 (socket says 172.21.15.139:41184) 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 -- 172.21.15.139:0/2688513214 learned_addr learned my addr 172.21.15.139:0/2688513214 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd6ffd640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effd8070fc0 0x7effd806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd77fe640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effd8159960 0x7effd8158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 -- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effd8159960 msgr2=0x7effd8158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effd8159960 0x7effd8158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 -- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effd8070fc0 msgr2=0x7effd806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effd8070fc0 0x7effd806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 -- 172.21.15.139:0/2688513214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd815d130 con 0x7effd8153de0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effd67fc640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8153de0 0x7effd815ab20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7effcc000c00 tx=0x7effcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effbf7fe640 1 -- 172.21.15.139:0/2688513214 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc041020 con 0x7effd8153de0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effbf7fe640 1 -- 172.21.15.139:0/2688513214 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effcc03c670 con 0x7effd8153de0 2024-04-26T18:27:49.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd815b1d0 con 0x7effd8153de0 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effbf7fe640 1 -- 172.21.15.139:0/2688513214 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc037040 con 0x7effd8153de0 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.172+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd815d9c0 con 0x7effd8153de0 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.173+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd815dc00 con 0x7effd8153de0 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.174+0000 7effbf7fe640 1 -- 172.21.15.139:0/2688513214 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effcc044020 con 0x7effd8153de0 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.174+0000 7effbf7fe640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7effc406c8f0 0x7effc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.174+0000 7effbf7fe640 1 -- 172.21.15.139:0/2688513214 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7effcc0ac740 con 0x7effd8153de0 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.174+0000 7effd6ffd640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7effc406c8f0 0x7effc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.176 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.175+0000 7effd6ffd640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7effc406c8f0 0x7effc406edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7effc8001d40 tx=0x7effc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.179+0000 7effbf7fe640 1 -- 172.21.15.139:0/2688513214 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effcc04b030 con 0x7effd8153de0 2024-04-26T18:27:49.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.391+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effd8076d20 con 0x7effd8153de0 2024-04-26T18:27:49.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.391+0000 7effbf7fe640 1 -- 172.21.15.139:0/2688513214 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7effcc07a6a0 con 0x7effd8153de0 2024-04-26T18:27:49.392 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:27:49.392 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:27:49.393 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:27:49.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7effc406c8f0 msgr2=0x7effc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7effc406c8f0 0x7effc406edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7effc8001d40 tx=0x7effc8009040 comp rx=0 tx=0).stop 2024-04-26T18:27:49.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8153de0 msgr2=0x7effd815ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8153de0 0x7effd815ab20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7effcc000c00 tx=0x7effcc0046c0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 shutdown_connections 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7effc406c8f0 0x7effc406edb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7effd8159960 0x7effd8158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effd8153de0 0x7effd815ab20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 --2- 172.21.15.139:0/2688513214 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7effd8070fc0 0x7effd806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 >> 172.21.15.139:0/2688513214 conn(0x7effd8076730 msgr2=0x7effd80cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 shutdown_connections 2024-04-26T18:27:49.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.394+0000 7effdd4d1640 1 -- 172.21.15.139:0/2688513214 wait complete. 2024-04-26T18:27:49.405 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T18:27:49.405 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T18:27:49.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.513+0000 7fd5a77bf640 1 Processor -- start 2024-04-26T18:27:49.513 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.513+0000 7fd5a77bf640 1 -- start start 2024-04-26T18:27:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a77bf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd5a0153e40 0x7fd5a015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a77bf640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a00c8c90 con 0x7fd5a006d0b0 2024-04-26T18:27:49.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a77bf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a00c8f30 con 0x7fd5a0072f40 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a77bf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a00c9210 con 0x7fd5a0153e40 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a4d5a640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fd5a006d0b0 0x7fd5a006c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:41644/0 (socket says 172.21.15.139:41644) 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/3076446573 learned_addr learned my addr 172.21.15.139:0/3076446573 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a555b640 1 --2- 172.21.15.139:0/3076446573 >> v2:172.21.15.143:3300/0 conn(0x7fd5a0153e40 0x7fd5a015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd597fff640 1 -- 172.21.15.139:0/3076446573 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468671233 0 0) 0x7fd5a00c8c90 con 0x7fd5a006d0b0 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd597fff640 1 -- 172.21.15.139:0/3076446573 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd58c003520 con 0x7fd5a006d0b0 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd597fff640 1 -- 172.21.15.139:0/3076446573 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927057260 0 0) 0x7fd5a00c8f30 con 0x7fd5a0072f40 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd597fff640 1 -- 172.21.15.139:0/3076446573 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5a00c8c90 con 0x7fd5a0072f40 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a555b640 1 -- 172.21.15.139:0/3076446573 >> v1:172.21.15.143:6789/0 conn(0x7fd5a0072f40 legacy=0x7fd5a0164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a555b640 1 -- 172.21.15.139:0/3076446573 >> v1:172.21.15.139:6789/0 conn(0x7fd5a006d0b0 legacy=0x7fd5a006c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.514+0000 7fd5a555b640 1 -- 172.21.15.139:0/3076446573 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a00c94f0 con 0x7fd5a0153e40 2024-04-26T18:27:49.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.515+0000 7fd5a555b640 1 --2- 172.21.15.139:0/3076446573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0153e40 0x7fd5a015dc40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0097a0 tx=0x7fd59c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd20eb3903f72dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.515+0000 7fd597fff640 1 -- 172.21.15.139:0/3076446573 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c037070 con 0x7fd5a0153e40 2024-04-26T18:27:49.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.515+0000 7fd597fff640 1 -- 172.21.15.139:0/3076446573 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c032440 con 0x7fd5a0153e40 2024-04-26T18:27:49.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.515+0000 7fd597fff640 1 -- 172.21.15.139:0/3076446573 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c032810 con 0x7fd5a0153e40 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.516+0000 7fd5a77bf640 1 -- 172.21.15.139:0/3076446573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0153e40 msgr2=0x7fd5a015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.516+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/3076446573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0153e40 0x7fd5a015dc40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0097a0 tx=0x7fd59c02a230 comp rx=0 tx=0).stop 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.516+0000 7fd5a77bf640 1 -- 172.21.15.139:0/3076446573 shutdown_connections 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.516+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/3076446573 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0153e40 0x7fd5a015dc40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.516+0000 7fd5a77bf640 1 -- 172.21.15.139:0/3076446573 >> 172.21.15.139:0/3076446573 conn(0x7fd5a0070a50 msgr2=0x7fd5a0070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.516+0000 7fd5a77bf640 1 -- 172.21.15.139:0/3076446573 shutdown_connections 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.516+0000 7fd5a77bf640 1 -- 172.21.15.139:0/3076446573 wait complete. 2024-04-26T18:27:49.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.517+0000 7fd5a77bf640 1 Processor -- start 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.517+0000 7fd5a77bf640 1 -- start start 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a77bf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5a006d0b0 0x7fd5a0149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a77bf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0072f40 0x7fd5a01e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a77bf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5a0153e40 0x7fd5a0148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a77bf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a015d720 con 0x7fd5a0153e40 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a77bf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a015d440 con 0x7fd5a0072f40 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a77bf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a00b3b50 con 0x7fd5a006d0b0 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5a0153e40 0x7fd5a0148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5a0153e40 0x7fd5a0148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54126/0 (socket says 172.21.15.139:54126) 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 -- 172.21.15.139:0/969411901 learned_addr learned my addr 172.21.15.139:0/969411901 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:49.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0072f40 0x7fd5a01e49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a555b640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5a006d0b0 0x7fd5a0149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 -- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5a006d0b0 msgr2=0x7fd5a0149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5a006d0b0 0x7fd5a0149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 -- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0072f40 msgr2=0x7fd5a01e49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0072f40 0x7fd5a01e49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.518+0000 7fd5a5d5c640 1 -- 172.21.15.139:0/969411901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a0148620 con 0x7fd5a0153e40 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.519+0000 7fd5a5d5c640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5a0153e40 0x7fd5a0148ba0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c7c0 tx=0x7fd59800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.519+0000 7fd595ffb640 1 -- 172.21.15.139:0/969411901 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598003b70 con 0x7fd5a0153e40 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.519+0000 7fd595ffb640 1 -- 172.21.15.139:0/969411901 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd598003d10 con 0x7fd5a0153e40 2024-04-26T18:27:49.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.519+0000 7fd595ffb640 1 -- 172.21.15.139:0/969411901 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59800aa50 con 0x7fd5a0153e40 2024-04-26T18:27:49.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.519+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a01488c0 con 0x7fd5a0153e40 2024-04-26T18:27:49.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.519+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a01e41e0 con 0x7fd5a0153e40 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.520+0000 7fd595ffb640 1 -- 172.21.15.139:0/969411901 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd59800abf0 con 0x7fd5a0153e40 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.521+0000 7fd595ffb640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58406c920 0x7fd58406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.521+0000 7fd595ffb640 1 -- 172.21.15.139:0/969411901 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fd59808bd70 con 0x7fd5a0153e40 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.521+0000 7fd5a555b640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58406c920 0x7fd58406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.521+0000 7fd5a555b640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58406c920 0x7fd58406ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd59c034000 tx=0x7fd59c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.522+0000 7fd5aa5b9740 1 Processor -- start 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.522+0000 7fd5aa5b9740 1 -- start start 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d565a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d561b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561cb40 0x55a5d561bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a5d557ed80 con 0x55a5d565aae0 2024-04-26T18:27:49.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a5d551ac20 con 0x55a5d561b5e0 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a5d557ad40 con 0x55a5d561cb40 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d561b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d561b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54134/0 (socket says 172.21.15.139:54134) 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/3140423537 learned_addr learned my addr 172.21.15.139:0/3140423537 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a555b640 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d565a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a5d5c640 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561cb40 0x55a5d561bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561cb40 msgr2=0x55a5d561bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561cb40 0x55a5d561bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 msgr2=0x55a5d565a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d565a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/3140423537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d535cd80 con 0x55a5d565aae0 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a555b640 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d565a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d561b9c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00c8e60 tx=0x7fd590007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fd007c4063e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd582ffd640 1 -- 172.21.15.139:0/3140423537 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590005b80 con 0x55a5d565aae0 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd582ffd640 1 -- 172.21.15.139:0/3140423537 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590018070 con 0x55a5d565aae0 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.523+0000 7fd582ffd640 1 -- 172.21.15.139:0/3140423537 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5900070d0 con 0x55a5d565aae0 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3140423537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 msgr2=0x55a5d561b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d561b9c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00c8e60 tx=0x7fd590007d30 comp rx=0 tx=0).stop 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3140423537 shutdown_connections 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561cb40 0x55a5d561bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d561b9c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3140423537 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d565a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3140423537 >> 172.21.15.139:0/3140423537 conn(0x55a5d55e2740 msgr2=0x55a5d565f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3140423537 shutdown_connections 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.524+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3140423537 wait complete. 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.525+0000 7fd5aa5b9740 1 -- start start 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.525+0000 7fd5aa5b9740 1 Processor -- start 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561b5e0 0x55a5d566f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561cb40 0x55a5d5642ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d566c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a5d5619c20 con 0x55a5d565aae0 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a5d5518840 con 0x55a5d561cb40 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a5d561d170 con 0x55a5d561b5e0 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 10 client.0 _ll_register_callbacks cb 0x55a5d551c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d566c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a555b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561b5e0 0x55a5d566f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561cb40 0x55a5d5642ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561cb40 0x55a5d5642ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:57748/0 (socket says 172.21.15.139:57748) 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d566c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54144/0 (socket says 172.21.15.139:54144) 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/2656297443 learned_addr learned my addr 172.21.15.139:0/2656297443 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 -- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561b5e0 msgr2=0x55a5d566f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561b5e0 0x55a5d566f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 -- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561cb40 msgr2=0x55a5d5642ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561cb40 0x55a5d5642ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 -- 172.21.15.139:0/2656297443 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d53bd510 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561cb40 0x55a5d5642ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5a5d5c640 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d566c400 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd598089e30 tx=0x7fd59805da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77614a674b8c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd57bfff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd57bfff640 1 -- 172.21.15.139:0/2656297443 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59805eda0 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd57bfff640 1 -- 172.21.15.139:0/2656297443 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fd598058b60 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.526+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd590018070 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd57bfff640 1 -- 172.21.15.139:0/2656297443 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd598057ad0 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 10 client.6054 fetch_fsmap learned FSMap version 9 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a5d5250670 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd57bfff640 1 -- 172.21.15.139:0/2656297443 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd590018070 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd57bfff640 1 -- 172.21.15.139:0/2656297443 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fd598055460 con 0x55a5d565aae0 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 10 client.6054 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 10 client.6054 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:27:49.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 20 client.6054 populate_metadata read hostname 'smithi139' 2024-04-26T18:27:49.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d5614ba0 0x55a5d5614fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 4 client.6054 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:27:49.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5d558c990 con 0x55a5d5614ba0 2024-04-26T18:27:49.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5a555b640 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d5614ba0 0x55a5d5614fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd5a555b640 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d5614ba0 0x55a5d5614fb0 crc :-1 s=READY pgs=672 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f75ab383ea184004 server_cookie=8eef259cb16252e5 in_seq=0 out_seq=0 2024-04-26T18:27:49.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.527+0000 7fd57bfff640 10 client.6054 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:49.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd57bfff640 1 -- 172.21.15.139:0/2656297443 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a5d558c990 con 0x55a5d5614ba0 2024-04-26T18:27:49.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd57bfff640 10 client.6054 handle_command_reply: tid=0 2024-04-26T18:27:49.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 client.6054 shutdown 2024-04-26T18:27:49.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 msgr2=0x55a5d566c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d566c400 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd598089e30 tx=0x7fd59805da10 comp rx=0 tx=0).stop 2024-04-26T18:27:49.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 shutdown_connections 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d565aae0 0x55a5d566c400 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561cb40 0x55a5d5642ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d5614ba0 0x55a5d5614fb0 crc :-1 s=READY pgs=672 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/2656297443 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d561b5e0 0x55a5d566f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd57bfff640 0 client.6054 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 >> 172.21.15.139:0/2656297443 conn(0x55a5d55e2740 msgr2=0x55a5d561c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 shutdown_connections 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/2656297443 wait complete. 2024-04-26T18:27:49.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.530+0000 7fd5aa5b9740 20 client.6054 trim_cache size 0 max 16384 2024-04-26T18:27:49.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.547+0000 7fd5aa5b9740 1 Processor -- start 2024-04-26T18:27:49.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.547+0000 7fd5aa5b9740 1 -- start start 2024-04-26T18:27:49.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d5639000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d5639540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d5644870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a01fe580 con 0x55a5d561cb40 2024-04-26T18:27:49.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a01fd460 con 0x55a5d561b5e0 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a01f3bd0 con 0x55a5d565aae0 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d5639540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5a555b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d5639000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5a555b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d5639000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:57760/0 (socket says 172.21.15.139:57760) 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5a5d5c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d5644870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5a555b640 1 -- 172.21.15.139:0/3715632002 learned_addr learned my addr 172.21.15.139:0/3715632002 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d5639540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54160/0 (socket says 172.21.15.139:54160) 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.548+0000 7fd5a555b640 1 -- 172.21.15.139:0/3715632002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 msgr2=0x55a5d5644870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5a555b640 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d5644870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5a555b640 1 -- 172.21.15.139:0/3715632002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 msgr2=0x55a5d5639540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5a555b640 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d5639540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5a555b640 1 -- 172.21.15.139:0/3715632002 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d56112c0 con 0x55a5d561b5e0 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d5639540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5a555b640 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d5639000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0098c0 tx=0x7fd59c02c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f39042293992abd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5827fc640 1 -- 172.21.15.139:0/3715632002 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c037040 con 0x55a5d561b5e0 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5827fc640 1 -- 172.21.15.139:0/3715632002 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c03c440 con 0x55a5d561b5e0 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5827fc640 1 -- 172.21.15.139:0/3715632002 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c03c7f0 con 0x55a5d561b5e0 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3715632002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 msgr2=0x55a5d5639000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d5639000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0098c0 tx=0x7fd59c02c000 comp rx=0 tx=0).stop 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3715632002 shutdown_connections 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d5644870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d5639540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/3715632002 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d5639000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.549+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3715632002 >> 172.21.15.139:0/3715632002 conn(0x55a5d55e2740 msgr2=0x55a5d5645730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.550+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3715632002 shutdown_connections 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.550+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/3715632002 wait complete. 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.550+0000 7fd5aa5b9740 1 -- start start 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.550+0000 7fd5aa5b9740 1 Processor -- start 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d563bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d565bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5aa5b9740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d56d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a01fc040 con 0x55a5d561cb40 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a01fcd90 con 0x55a5d561b5e0 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5aa5b9740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a01fc6c0 con 0x55a5d565aae0 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5aa5b9740 10 client.0 _ll_register_callbacks cb 0x7fd5980595b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d565bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a555b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d563bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d565bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54168/0 (socket says 172.21.15.139:54168) 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/968325803 learned_addr learned my addr 172.21.15.139:0/968325803 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a5d5c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d56d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 msgr2=0x55a5d56d7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d56d7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 msgr2=0x55a5d563bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d563bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 -- 172.21.15.139:0/968325803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d565c9d0 con 0x55a5d561cb40 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a555b640 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d563bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd5a4d5a640 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d565bfb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd590014000 tx=0x7fd590000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a3342ccee1ddf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.551+0000 7fd57bfff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd57bfff640 1 -- 172.21.15.139:0/968325803 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd590007a30 con 0x55a5d561cb40 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd57bfff640 1 -- 172.21.15.139:0/968325803 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fd5900070d0 con 0x55a5d561cb40 2024-04-26T18:27:49.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd59c03c440 con 0x55a5d561cb40 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd57bfff640 1 -- 172.21.15.139:0/968325803 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fd590031050 con 0x55a5d561cb40 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 10 client.6060 fetch_fsmap learned FSMap version 9 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a5d5655c10 con 0x55a5d561cb40 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd57bfff640 1 -- 172.21.15.139:0/968325803 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c03c440 con 0x55a5d561cb40 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd57bfff640 1 -- 172.21.15.139:0/968325803 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fd590034020 con 0x55a5d561cb40 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 10 client.6060 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 10 client.6060 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 20 client.6060 populate_metadata read hostname 'smithi139' 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d56d8190 0x55a5d56e14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 4 client.6060 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T18:27:49.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55a5d5586800 con 0x55a5d56d8190 2024-04-26T18:27:49.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.552+0000 7fd5a555b640 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d56d8190 0x55a5d56e14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:27:49.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.553+0000 7fd57bfff640 10 client.6060 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:49.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:49.553+0000 7fd5a555b640 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d56d8190 0x55a5d56e14f0 crc :-1 s=READY pgs=673 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a23852ebb6b92e29 server_cookie=275edbc2ebe0fb0d in_seq=0 out_seq=0 2024-04-26T18:27:53.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd57bfff640 1 -- 172.21.15.139:0/968325803 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55a5d5586800 con 0x55a5d56d8190 2024-04-26T18:27:53.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd57bfff640 10 client.6060 handle_command_reply: tid=0 2024-04-26T18:27:53.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 client.6060 shutdown 2024-04-26T18:27:53.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 msgr2=0x55a5d565bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:53.254 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d565bfb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd590014000 tx=0x7fd590000ed0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 shutdown_connections 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a5d56d8190 0x55a5d56e14f0 crc :-1 s=READY pgs=673 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a5d565aae0 0x55a5d56d7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a5d561cb40 0x55a5d565bfb0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd57bfff640 0 client.6060 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 --2- 172.21.15.139:0/968325803 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a5d561b5e0 0x55a5d563bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 >> 172.21.15.139:0/968325803 conn(0x55a5d55e2740 msgr2=0x55a5d5644870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 shutdown_connections 2024-04-26T18:27:53.257 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.254+0000 7fd5aa5b9740 1 -- 172.21.15.139:0/968325803 wait complete. 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5aa5b9740 20 client.6060 trim_cache size 0 max 16384 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 98, 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout: "7db9bb90": { 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 98, 2024-04-26T18:27:53.258 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:53.259 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:53.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:53.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:53.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:27:53.260 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58406c920 msgr2=0x7fd58406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58406c920 0x7fd58406ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd59c034000 tx=0x7fd59c02e000 comp rx=0 tx=0).stop 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5a0153e40 msgr2=0x7fd5a0148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5a0153e40 0x7fd5a0148ba0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c7c0 tx=0x7fd59800cc80 comp rx=0 tx=0).stop 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 shutdown_connections 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd58406c920 0x7fd58406ede0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5a0153e40 0x7fd5a0148ba0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd5a0072f40 0x7fd5a01e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 --2- 172.21.15.139:0/969411901 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd5a006d0b0 0x7fd5a0149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:27:53.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 >> 172.21.15.139:0/969411901 conn(0x7fd5a0070a50 msgr2=0x7fd5a00b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:27:53.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 shutdown_connections 2024-04-26T18:27:53.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:27:53.255+0000 7fd5a77bf640 1 -- 172.21.15.139:0/969411901 wait complete. 2024-04-26T18:27:53.266 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7db9bb90', quiesce took 4.2 seconds. Will release after: 30.0 2024-04-26T18:28:02.011 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:28:02.014 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:28:23.267 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:28:23.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.376+0000 7f2d73d12640 1 Processor -- start 2024-04-26T18:28:23.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.377+0000 7f2d73d12640 1 -- start start 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.377+0000 7f2d73d12640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2d6c155da0 0x7f2d6c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.377+0000 7f2d73d12640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d6c15f2a0 con 0x7f2d6c0cd840 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.377+0000 7f2d73d12640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d6c15f580 con 0x7f2d6c156180 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.377+0000 7f2d73d12640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6c15cbc0 con 0x7f2d6c155da0 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.377+0000 7f2d722af640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f2d6c0cd840 0x7f2d6c0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60976/0 (socket says 172.21.15.139:60976) 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.377+0000 7f2d722af640 1 -- 172.21.15.139:0/273243659 learned_addr learned my addr 172.21.15.139:0/273243659 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d71aae640 1 --2- 172.21.15.139:0/273243659 >> v2:172.21.15.143:3300/0 conn(0x7f2d6c155da0 0x7f2d6c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d70aac640 1 -- 172.21.15.139:0/273243659 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982029715 0 0) 0x7f2d6c15f2a0 con 0x7f2d6c0cd840 2024-04-26T18:28:23.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d70aac640 1 -- 172.21.15.139:0/273243659 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d58003520 con 0x7f2d6c0cd840 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d70aac640 1 -- 172.21.15.139:0/273243659 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 184354760 0 0) 0x7f2d6c15f580 con 0x7f2d6c156180 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d70aac640 1 -- 172.21.15.139:0/273243659 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d6c15f2a0 con 0x7f2d6c156180 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d71aae640 1 -- 172.21.15.139:0/273243659 >> v1:172.21.15.143:6789/0 conn(0x7f2d6c156180 legacy=0x7f2d6c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d71aae640 1 -- 172.21.15.139:0/273243659 >> v1:172.21.15.139:6789/0 conn(0x7f2d6c0cd840 legacy=0x7f2d6c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.378+0000 7f2d71aae640 1 -- 172.21.15.139:0/273243659 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c15f860 con 0x7f2d6c155da0 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d71aae640 1 --2- 172.21.15.139:0/273243659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c155da0 0x7f2d6c15c680 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009d90 tx=0x7f2d6802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2c8566db226cf52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d70aac640 1 -- 172.21.15.139:0/273243659 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68007740 con 0x7f2d6c155da0 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d70aac640 1 -- 172.21.15.139:0/273243659 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d680078e0 con 0x7f2d6c155da0 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d70aac640 1 -- 172.21.15.139:0/273243659 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68007c90 con 0x7f2d6c155da0 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d73d12640 1 -- 172.21.15.139:0/273243659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c155da0 msgr2=0x7f2d6c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d73d12640 1 --2- 172.21.15.139:0/273243659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c155da0 0x7f2d6c15c680 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009d90 tx=0x7f2d6802a660 comp rx=0 tx=0).stop 2024-04-26T18:28:23.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d73d12640 1 -- 172.21.15.139:0/273243659 shutdown_connections 2024-04-26T18:28:23.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d73d12640 1 --2- 172.21.15.139:0/273243659 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c155da0 0x7f2d6c15c680 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.379+0000 7f2d73d12640 1 -- 172.21.15.139:0/273243659 >> 172.21.15.139:0/273243659 conn(0x7f2d6c068090 msgr2=0x7f2d6c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.380+0000 7f2d73d12640 1 -- 172.21.15.139:0/273243659 shutdown_connections 2024-04-26T18:28:23.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.380+0000 7f2d73d12640 1 -- 172.21.15.139:0/273243659 wait complete. 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 Processor -- start 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 -- start start 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d6c0cd840 0x7f2d6c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d6c155da0 0x7f2d6c1e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c15b3c0 0x7f2d6c1f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0d19d0 con 0x7f2d6c0cd840 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0cc730 con 0x7f2d6c15b3c0 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.381+0000 7f2d73d12640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c0d1b50 con 0x7f2d6c155da0 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d6c0cd840 0x7f2d6c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d6c0cd840 0x7f2d6c156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54286/0 (socket says 172.21.15.139:54286) 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 -- 172.21.15.139:0/3893507206 learned_addr learned my addr 172.21.15.139:0/3893507206 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d722af640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c15b3c0 0x7f2d6c1f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d712ad640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d6c155da0 0x7f2d6c1e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 -- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d6c155da0 msgr2=0x7f2d6c1e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d6c155da0 0x7f2d6c1e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 -- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c15b3c0 msgr2=0x7f2d6c1f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c15b3c0 0x7f2d6c1f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 -- 172.21.15.139:0/3893507206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c15a640 con 0x7f2d6c0cd840 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d722af640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c15b3c0 0x7f2d6c1f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d712ad640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d6c155da0 0x7f2d6c1e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d71aae640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d6c0cd840 0x7f2d6c156830 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009d90 tx=0x7f2d68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d627fc640 1 -- 172.21.15.139:0/3893507206 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68040070 con 0x7f2d6c0cd840 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d627fc640 1 -- 172.21.15.139:0/3893507206 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d68031c40 con 0x7f2d6c0cd840 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d627fc640 1 -- 172.21.15.139:0/3893507206 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68009450 con 0x7f2d6c0cd840 2024-04-26T18:28:23.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c15a8e0 con 0x7f2d6c0cd840 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.382+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c15da90 con 0x7f2d6c0cd840 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.383+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c076d20 con 0x7f2d6c0cd840 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.384+0000 7f2d627fc640 1 -- 172.21.15.139:0/3893507206 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d68039040 con 0x7f2d6c0cd840 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.384+0000 7f2d627fc640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d5006c8f0 0x7f2d5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.384+0000 7f2d627fc640 1 -- 172.21.15.139:0/3893507206 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2d680ad0b0 con 0x7f2d6c0cd840 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.384+0000 7f2d712ad640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d5006c8f0 0x7f2d5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.385+0000 7f2d712ad640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d5006c8f0 0x7f2d5006edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0cb520 tx=0x7f2d5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.389+0000 7f2d627fc640 1 -- 172.21.15.139:0/3893507206 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d6807b010 con 0x7f2d6c0cd840 2024-04-26T18:28:23.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.601+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d6c0cd330 con 0x7f2d6c0cd840 2024-04-26T18:28:23.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.602+0000 7f2d627fc640 1 -- 172.21.15.139:0/3893507206 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f2d6807a910 con 0x7f2d6c0cd840 2024-04-26T18:28:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:28:23.602 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:28:23.603 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:28:23.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d5006c8f0 msgr2=0x7f2d5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d5006c8f0 0x7f2d5006edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0cb520 tx=0x7f2d5c009040 comp rx=0 tx=0).stop 2024-04-26T18:28:23.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d6c0cd840 msgr2=0x7f2d6c156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d6c0cd840 0x7f2d6c156830 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009d90 tx=0x7f2d68004a40 comp rx=0 tx=0).stop 2024-04-26T18:28:23.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 shutdown_connections 2024-04-26T18:28:23.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d5006c8f0 0x7f2d5006edb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d6c15b3c0 0x7f2d6c1f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d6c155da0 0x7f2d6c1e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 --2- 172.21.15.139:0/3893507206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d6c0cd840 0x7f2d6c156830 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 >> 172.21.15.139:0/3893507206 conn(0x7f2d6c068090 msgr2=0x7f2d6c1535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 shutdown_connections 2024-04-26T18:28:23.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.604+0000 7f2d73d12640 1 -- 172.21.15.139:0/3893507206 wait complete. 2024-04-26T18:28:23.615 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 7db9bb90 --release --await' 2024-04-26T18:28:23.615 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 7db9bb90 --release --await 2024-04-26T18:28:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.718+0000 7f0fab8b0640 1 Processor -- start 2024-04-26T18:28:23.719 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fab8b0640 1 -- start start 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fab8b0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0fa4155f00 0x7f0fa40cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fab8b0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa40c9be0 0x7f0fa40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fab8b0640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa415bc10 con 0x7f0fa4070850 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fab8b0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa415bef0 con 0x7f0fa4155f00 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fab8b0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa415c1d0 con 0x7f0fa40c9be0 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fa964c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0fa4155f00 0x7f0fa40cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.719+0000 7f0fa9e4d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f0fa4070850 0x7f0fa415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60980/0 (socket says 172.21.15.139:60980) 2024-04-26T18:28:23.720 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0fa9e4d640 1 -- 172.21.15.139:0/1378379147 learned_addr learned my addr 172.21.15.139:0/1378379147 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:28:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/1378379147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa40c9be0 0x7f0fa40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0fa964c640 1 -- 172.21.15.139:0/1378379147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa40c9be0 msgr2=0x7f0fa40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0fa964c640 1 --2- 172.21.15.139:0/1378379147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa40c9be0 0x7f0fa40cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0fa964c640 1 -- 172.21.15.139:0/1378379147 >> v1:172.21.15.139:6789/0 conn(0x7f0fa4070850 legacy=0x7f0fa415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0fa964c640 1 -- 172.21.15.139:0/1378379147 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa415c4b0 con 0x7f0fa4155f00 2024-04-26T18:28:23.721 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0f9bfff640 1 -- 172.21.15.139:0/1378379147 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153703477 0 0) 0x7f0fa415bc10 con 0x7f0fa4070850 2024-04-26T18:28:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.720+0000 7f0fa964c640 1 --2- 172.21.15.139:0/1378379147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa4155f00 0x7f0fa40cf170 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00097a0 tx=0x7f0fa002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e11b2f0ffb90b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0f9bfff640 1 -- 172.21.15.139:0/1378379147 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0037070 con 0x7f0fa4155f00 2024-04-26T18:28:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0f9bfff640 1 -- 172.21.15.139:0/1378379147 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa0032440 con 0x7f0fa4155f00 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0f9bfff640 1 -- 172.21.15.139:0/1378379147 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0032810 con 0x7f0fa4155f00 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 -- 172.21.15.139:0/1378379147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa4155f00 msgr2=0x7f0fa40cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/1378379147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa4155f00 0x7f0fa40cf170 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00097a0 tx=0x7f0fa002a180 comp rx=0 tx=0).stop 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 -- 172.21.15.139:0/1378379147 shutdown_connections 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/1378379147 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa40c9be0 0x7f0fa40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/1378379147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa4155f00 0x7f0fa40cf170 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 -- 172.21.15.139:0/1378379147 >> 172.21.15.139:0/1378379147 conn(0x7f0fa4068090 msgr2=0x7f0fa4068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 -- 172.21.15.139:0/1378379147 shutdown_connections 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.721+0000 7f0fab8b0640 1 -- 172.21.15.139:0/1378379147 wait complete. 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.722+0000 7f0fab8b0640 1 Processor -- start 2024-04-26T18:28:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.722+0000 7f0fab8b0640 1 -- start start 2024-04-26T18:28:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fab8b0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fa4070850 0x7f0fa414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fab8b0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa40c9be0 0x7f0fa415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fab8b0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa4155f00 0x7f0fa4152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fab8b0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa4071030 con 0x7f0fa40c9be0 2024-04-26T18:28:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fab8b0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa4070eb0 con 0x7f0fa4070850 2024-04-26T18:28:23.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fab8b0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa406e160 con 0x7f0fa4155f00 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa40c9be0 0x7f0fa415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa40c9be0 0x7f0fa415ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54294/0 (socket says 172.21.15.139:54294) 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3597898767 learned_addr learned my addr 172.21.15.139:0/3597898767 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa4155f00 msgr2=0x7f0fa4152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa9e4d640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa4155f00 0x7f0fa4152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa964c640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fa4070850 0x7f0fa414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa4155f00 0x7f0fa4152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fa4070850 msgr2=0x7f0fa414dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fa4070850 0x7f0fa414dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3597898767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa40cd160 con 0x7f0fa40c9be0 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.723+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa40c9be0 0x7f0fa415ccc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400d7d0 tx=0x7f0f9400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.724+0000 7f0f99ffb640 1 -- 172.21.15.139:0/3597898767 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400b6c0 con 0x7f0fa40c9be0 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.724+0000 7f0f99ffb640 1 -- 172.21.15.139:0/3597898767 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f94019070 con 0x7f0fa40c9be0 2024-04-26T18:28:23.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.724+0000 7f0f99ffb640 1 -- 172.21.15.139:0/3597898767 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400bac0 con 0x7f0fa40c9be0 2024-04-26T18:28:23.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.724+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa40cd6e0 con 0x7f0fa40c9be0 2024-04-26T18:28:23.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.724+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa4151d80 con 0x7f0fa40c9be0 2024-04-26T18:28:23.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.725+0000 7f0f99ffb640 1 -- 172.21.15.139:0/3597898767 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f9400bc60 con 0x7f0fa40c9be0 2024-04-26T18:28:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.726+0000 7f0f99ffb640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f8806c8f0 0x7f0f8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.726+0000 7f0f99ffb640 1 -- 172.21.15.139:0/3597898767 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f0f9408c460 con 0x7f0fa40c9be0 2024-04-26T18:28:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.726+0000 7f0fa964c640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f8806c8f0 0x7f0f8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.726+0000 7f0fa964c640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f8806c8f0 0x7f0f8806edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0034000 tx=0x7f0fa002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 Processor -- start 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 -- start start 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d297470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d2979b0 0x55d50d258890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d259a10 0x55d50d258dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d50d1bd040 con 0x55d50d2979b0 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d50d158b60 con 0x55d50d2584b0 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d50d1b9000 con 0x55d50d259a10 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d2979b0 0x55d50d258890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d2979b0 0x55d50d258890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54304/0 (socket says 172.21.15.139:54304) 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3183580604 learned_addr learned my addr 172.21.15.139:0/3183580604 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fa9e4d640 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d259a10 0x55d50d258dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.727+0000 7f0fa964c640 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d297470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d259a10 msgr2=0x55d50d258dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d259a10 0x55d50d258dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 msgr2=0x55d50d297470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d297470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3183580604 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50d14d9c0 con 0x55d50d2979b0 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d2979b0 0x55d50d258890 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0f94056120 tx=0x7f0f94059750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64d6e09b1b36305 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0f86ffd640 1 -- 172.21.15.139:0/3183580604 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94088070 con 0x55d50d2979b0 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0f86ffd640 1 -- 172.21.15.139:0/3183580604 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f94062930 con 0x55d50d2979b0 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0f86ffd640 1 -- 172.21.15.139:0/3183580604 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94056330 con 0x55d50d2979b0 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3183580604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d2979b0 msgr2=0x55d50d258890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d2979b0 0x55d50d258890 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0f94056120 tx=0x7f0f94059750 comp rx=0 tx=0).stop 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3183580604 shutdown_connections 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d259a10 0x55d50d258dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d2979b0 0x55d50d258890 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3183580604 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d297470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3183580604 >> 172.21.15.139:0/3183580604 conn(0x55d50d21f930 msgr2=0x55d50d29c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3183580604 shutdown_connections 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.728+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3183580604 wait complete. 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.729+0000 7f0fae5c8740 1 -- start start 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.729+0000 7f0fae5c8740 1 Processor -- start 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2584b0 0x55d50d2957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d2ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2979b0 0x55d50d27f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d50d256af0 con 0x55d50d259a10 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55d50d1564f0 con 0x55d50d2979b0 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55d50d25a040 con 0x55d50d2584b0 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fae5c8740 10 client.0 _ll_register_callbacks cb 0x55d50d1b3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:28:23.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d2ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d2ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54314/0 (socket says 172.21.15.139:54314) 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3618936567 learned_addr learned my addr 172.21.15.139:0/3618936567 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa964c640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2584b0 0x55d50d2957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa9e4d640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2979b0 0x55d50d27f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2584b0 msgr2=0x55d50d2957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2584b0 0x55d50d2957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2979b0 msgr2=0x55d50d27f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2979b0 0x55d50d27f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/3618936567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50cece920 con 0x55d50d259a10 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa9e4d640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2979b0 0x55d50d27f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d2ac1d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0f9408a5a0 tx=0x7f0f94000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0517f4b2c1e55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0f7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:28:23.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0f7ffff640 1 -- 172.21.15.139:0/3618936567 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94077060 con 0x55d50d259a10 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.730+0000 7f0f7ffff640 1 -- 172.21.15.139:0/3618936567 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f0f94059f20 con 0x55d50d259a10 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f94062930 con 0x55d50d259a10 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0f7ffff640 1 -- 172.21.15.139:0/3618936567 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0f9407e050 con 0x55d50d259a10 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 10 client.6081 fetch_fsmap learned FSMap version 9 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d50cf9ad30 con 0x55d50d259a10 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0f7ffff640 1 -- 172.21.15.139:0/3618936567 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f94062930 con 0x55d50d259a10 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0f7ffff640 1 -- 172.21.15.139:0/3618936567 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f0f94013070 con 0x55d50d259a10 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 10 client.6081 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 10 client.6081 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 20 client.6081 populate_metadata read hostname 'smithi139' 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2983e0 0x55d50d27fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 4 client.6081 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:28:23.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d50d190a00 con 0x55d50d2983e0 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.731+0000 7f0fa964c640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2983e0 0x55d50d27fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0f7ffff640 10 client.6081 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fa964c640 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2983e0 0x55d50d27fc20 crc :-1 s=READY pgs=686 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32809c5ae9307a68 server_cookie=11eb9cbebf51603f in_seq=0 out_seq=0 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0f7ffff640 1 -- 172.21.15.139:0/3618936567 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d50d190a00 con 0x55d50d2983e0 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0f7ffff640 10 client.6081 handle_command_reply: tid=0 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 client.6081 shutdown 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 msgr2=0x55d50d2ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d2ac1d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0f9408a5a0 tx=0x7f0f94000bc0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 shutdown_connections 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2979b0 0x55d50d27f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d2ac1d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2983e0 0x55d50d27fc20 crc :-1 s=READY pgs=686 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/3618936567 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2584b0 0x55d50d2957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0f7ffff640 0 client.6081 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:23.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.732+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 >> 172.21.15.139:0/3618936567 conn(0x55d50d21f930 msgr2=0x55d50d280f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.733+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 shutdown_connections 2024-04-26T18:28:23.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.733+0000 7f0fae5c8740 1 -- 172.21.15.139:0/3618936567 wait complete. 2024-04-26T18:28:23.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.733+0000 7f0fae5c8740 20 client.6081 trim_cache size 0 max 16384 2024-04-26T18:28:23.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.749+0000 7f0fae5c8740 1 Processor -- start 2024-04-26T18:28:23.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fae5c8740 1 -- start start 2024-04-26T18:28:23.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d295e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d296380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d2bb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa4200750 con 0x55d50d259a10 2024-04-26T18:28:23.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa41ff630 con 0x55d50d2584b0 2024-04-26T18:28:23.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa41fdb80 con 0x55d50d2979b0 2024-04-26T18:28:23.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d296380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d296380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54316/0 (socket says 172.21.15.139:54316) 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.750+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/2957820753 learned_addr learned my addr 172.21.15.139:0/2957820753 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 msgr2=0x55d50d2bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa964c640 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d295e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa9e4d640 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d2bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d2bb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 msgr2=0x55d50d295e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d295e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/2957820753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50d2aca50 con 0x55d50d259a10 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d296380 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0f940565b0 tx=0x7f0f94023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6c0a9e8aab3144 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0f867fc640 1 -- 172.21.15.139:0/2957820753 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94088070 con 0x55d50d259a10 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0f867fc640 1 -- 172.21.15.139:0/2957820753 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f94062930 con 0x55d50d259a10 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0f867fc640 1 -- 172.21.15.139:0/2957820753 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94059620 con 0x55d50d259a10 2024-04-26T18:28:23.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 -- 172.21.15.139:0/2957820753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 msgr2=0x55d50d296380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d296380 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0f940565b0 tx=0x7f0f94023000 comp rx=0 tx=0).stop 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 -- 172.21.15.139:0/2957820753 shutdown_connections 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d2bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d296380 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/2957820753 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d295e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 -- 172.21.15.139:0/2957820753 >> 172.21.15.139:0/2957820753 conn(0x55d50d21f930 msgr2=0x55d50d251e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 -- 172.21.15.139:0/2957820753 shutdown_connections 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.751+0000 7f0fae5c8740 1 -- 172.21.15.139:0/2957820753 wait complete. 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.752+0000 7f0fae5c8740 1 -- start start 2024-04-26T18:28:23.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.752+0000 7f0fae5c8740 1 Processor -- start 2024-04-26T18:28:23.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d296240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d278890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d278dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa41fe1c0 con 0x55d50d259a10 2024-04-26T18:28:23.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa41fef60 con 0x55d50d2584b0 2024-04-26T18:28:23.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa41fe890 con 0x55d50d2979b0 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 10 client.0 _ll_register_callbacks cb 0x7f0f94086070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d278890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d278890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54330/0 (socket says 172.21.15.139:54330) 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/1715635060 learned_addr learned my addr 172.21.15.139:0/1715635060 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa964c640 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d296240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa9e4d640 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d278dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 msgr2=0x55d50d278dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d278dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 msgr2=0x55d50d296240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d296240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 -- 172.21.15.139:0/1715635060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50d255c70 con 0x55d50d259a10 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fa8e4b640 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d278890 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0f9408a5a0 tx=0x7f0f94056090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d192d878b93ba3ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0f7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0f7ffff640 1 -- 172.21.15.139:0/1715635060 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94088040 con 0x55d50d259a10 2024-04-26T18:28:23.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0f7ffff640 1 -- 172.21.15.139:0/1715635060 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f0f94059f20 con 0x55d50d259a10 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.753+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f94062930 con 0x55d50d259a10 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0f7ffff640 1 -- 172.21.15.139:0/1715635060 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0f940624f0 con 0x55d50d259a10 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 10 client.6087 fetch_fsmap learned FSMap version 9 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55d50d255c70 con 0x55d50d259a10 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0f7ffff640 1 -- 172.21.15.139:0/1715635060 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f94062930 con 0x55d50d259a10 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0f7ffff640 1 -- 172.21.15.139:0/1715635060 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f0f94072070 con 0x55d50d259a10 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 10 client.6087 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 10 client.6087 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 20 client.6087 populate_metadata read hostname 'smithi139' 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2987c0 0x55d50d279310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 4 client.6087 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7db9bb90", "release": true, "await": true}] 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7db9bb90", "release": true, "await": true}) -- 0x55d50d1cac50 con 0x55d50d2987c0 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fa964c640 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2987c0 0x55d50d279310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0fa964c640 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2987c0 0x55d50d279310 crc :-1 s=READY pgs=687 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed75669db7902fe server_cookie=287774ef535ec6e4 in_seq=0 out_seq=0 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.754+0000 7f0f7ffff640 10 client.6087 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0f7ffff640 1 -- 172.21.15.139:0/1715635060 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55d50d1cac50 con 0x55d50d2987c0 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0f7ffff640 10 client.6087 handle_command_reply: tid=0 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 client.6087 shutdown 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 msgr2=0x55d50d278890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d278890 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0f9408a5a0 tx=0x7f0f94056090 comp rx=0 tx=0).stop 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 shutdown_connections 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55d50d2987c0 0x55d50d279310 crc :-1 s=READY pgs=687 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55d50d2979b0 0x55d50d278dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0f7ffff640 0 client.6087 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d50d259a10 0x55d50d278890 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 --2- 172.21.15.139:0/1715635060 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d50d2584b0 0x55d50d296240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 >> 172.21.15.139:0/1715635060 conn(0x55d50d21f930 msgr2=0x55d50d2bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 shutdown_connections 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 1 -- 172.21.15.139:0/1715635060 wait complete. 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.755+0000 7f0fae5c8740 20 client.6087 trim_cache size 0 max 16384 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 100, 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "7db9bb90": { 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 100, 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:28:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:23.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:23.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:23.764 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:28:23.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f8806c8f0 msgr2=0x7f0f8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f8806c8f0 0x7f0f8806edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0034000 tx=0x7f0fa002e000 comp rx=0 tx=0).stop 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa40c9be0 msgr2=0x7f0fa415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa40c9be0 0x7f0fa415ccc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400d7d0 tx=0x7f0f9400dc90 comp rx=0 tx=0).stop 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 shutdown_connections 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0f8806c8f0 0x7f0f8806edb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0fa4155f00 0x7f0fa4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0fa40c9be0 0x7f0fa415ccc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 --2- 172.21.15.139:0/3597898767 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0fa4070850 0x7f0fa414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 >> 172.21.15.139:0/3597898767 conn(0x7f0fa4068090 msgr2=0x7f0fa406d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 shutdown_connections 2024-04-26T18:28:23.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.756+0000 7f0fab8b0640 1 -- 172.21.15.139:0/3597898767 wait complete. 2024-04-26T18:28:23.766 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7db9bb90', seconds elapsed: 34.7 2024-04-26T18:28:23.766 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T18:28:23.767 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:28:23.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.864+0000 7f16800c8640 1 Processor -- start 2024-04-26T18:28:23.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.865+0000 7f16800c8640 1 -- start start 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.865+0000 7f16800c8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1678153e40 0x7f16780702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.865+0000 7f16800c8640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f1678071190 0x7f1678071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.865+0000 7f16800c8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16780c9090 con 0x7f167806ced0 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.865+0000 7f16800c8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f1678071b40 con 0x7f1678153e40 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.865+0000 7f16800c8640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f16780ca920 con 0x7f1678071190 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167de64640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f1678153e40 0x7f16780702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167d663640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f167806ced0 0x7f16780c7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:60996/0 (socket says 172.21.15.139:60996) 2024-04-26T18:28:23.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167d663640 1 -- 172.21.15.139:0/1227195933 learned_addr learned my addr 172.21.15.139:0/1227195933 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:28:23.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167e665640 1 --2- 172.21.15.139:0/1227195933 >> v2:172.21.15.143:3300/0 conn(0x7f1678071190 0x7f1678071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167de64640 1 -- 172.21.15.139:0/1227195933 >> v2:172.21.15.143:3300/0 conn(0x7f1678071190 msgr2=0x7f1678071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:23.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167de64640 1 --2- 172.21.15.139:0/1227195933 >> v2:172.21.15.143:3300/0 conn(0x7f1678071190 0x7f1678071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167de64640 1 -- 172.21.15.139:0/1227195933 >> v1:172.21.15.139:6789/0 conn(0x7f167806ced0 legacy=0x7f16780c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167ce62640 1 -- 172.21.15.139:0/1227195933 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585058853 0 0) 0x7f16780c9090 con 0x7f167806ced0 2024-04-26T18:28:23.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.866+0000 7f167de64640 1 -- 172.21.15.139:0/1227195933 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16780731f0 con 0x7f1678153e40 2024-04-26T18:28:23.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f167de64640 1 --2- 172.21.15.139:0/1227195933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f16780702c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f16780c4c00 tx=0x7f167002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb08c2678c06fc0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f167ce62640 1 -- 172.21.15.139:0/1227195933 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670037070 con 0x7f1678153e40 2024-04-26T18:28:23.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f167ce62640 1 -- 172.21.15.139:0/1227195933 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1670032440 con 0x7f1678153e40 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f167ce62640 1 -- 172.21.15.139:0/1227195933 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670032810 con 0x7f1678153e40 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 -- 172.21.15.139:0/1227195933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 msgr2=0x7f16780702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 --2- 172.21.15.139:0/1227195933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f16780702c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f16780c4c00 tx=0x7f167002a1a0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 -- 172.21.15.139:0/1227195933 shutdown_connections 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 --2- 172.21.15.139:0/1227195933 >> v2:172.21.15.143:3300/0 conn(0x7f1678071190 0x7f1678071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 --2- 172.21.15.139:0/1227195933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f16780702c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 -- 172.21.15.139:0/1227195933 >> 172.21.15.139:0/1227195933 conn(0x7f1678068090 msgr2=0x7f1678068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 -- 172.21.15.139:0/1227195933 shutdown_connections 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.867+0000 7f16800c8640 1 -- 172.21.15.139:0/1227195933 wait complete. 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.868+0000 7f16800c8640 1 Processor -- start 2024-04-26T18:28:23.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.868+0000 7f16800c8640 1 -- start start 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f16800c8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f167806ced0 0x7f16781f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f16800c8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1678071190 0x7f16780c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f16800c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f1678159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f16800c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16780734d0 con 0x7f1678153e40 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f16800c8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16780c8db0 con 0x7f1678071190 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f16800c8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f1678070a90 con 0x7f167806ced0 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f1678159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f1678159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54352/0 (socket says 172.21.15.139:54352) 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 -- 172.21.15.139:0/1706919204 learned_addr learned my addr 172.21.15.139:0/1706919204 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167d663640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1678071190 0x7f16780c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167de64640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f167806ced0 0x7f16781f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 -- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f167806ced0 msgr2=0x7f16781f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f167806ced0 0x7f16781f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 -- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1678071190 msgr2=0x7f16780c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1678071190 0x7f16780c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.869+0000 7f167e665640 1 -- 172.21.15.139:0/1706919204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1678158be0 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.870+0000 7f167e665640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f1678159680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1674009d20 tx=0x7f167400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.870+0000 7f166e7fc640 1 -- 172.21.15.139:0/1706919204 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674018020 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.870+0000 7f166e7fc640 1 -- 172.21.15.139:0/1706919204 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1674009b10 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.870+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16780c6a50 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.870+0000 7f166e7fc640 1 -- 172.21.15.139:0/1706919204 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16740146c0 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.870+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16780c6770 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.871+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1678076d20 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.871+0000 7f166e7fc640 1 -- 172.21.15.139:0/1706919204 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1674005d10 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.872+0000 7f166e7fc640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f165c06c8f0 0x7f165c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.872+0000 7f166e7fc640 1 -- 172.21.15.139:0/1706919204 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f167408cc60 con 0x7f1678153e40 2024-04-26T18:28:23.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.872+0000 7f167de64640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f165c06c8f0 0x7f165c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:23.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.872+0000 7f167de64640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f165c06c8f0 0x7f165c06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1670034000 tx=0x7f167002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:23.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:23.876+0000 7f166e7fc640 1 -- 172.21.15.139:0/1706919204 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1674022030 con 0x7f1678153e40 2024-04-26T18:28:24.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.108+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f167814dec0 con 0x7f1678153e40 2024-04-26T18:28:24.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.109+0000 7f166e7fc640 1 -- 172.21.15.139:0/1706919204 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f1674010040 con 0x7f1678153e40 2024-04-26T18:28:24.109 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:28:24.110 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:28:24.110 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:28:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f165c06c8f0 msgr2=0x7f165c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f165c06c8f0 0x7f165c06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1670034000 tx=0x7f167002e000 comp rx=0 tx=0).stop 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 msgr2=0x7f1678159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f1678159680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1674009d20 tx=0x7f167400c490 comp rx=0 tx=0).stop 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 shutdown_connections 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f165c06c8f0 0x7f165c06edb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1678153e40 0x7f1678159680 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1678071190 0x7f16780c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 --2- 172.21.15.139:0/1706919204 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f167806ced0 0x7f16781f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 >> 172.21.15.139:0/1706919204 conn(0x7f1678068090 msgr2=0x7f167814f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 shutdown_connections 2024-04-26T18:28:24.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.111+0000 7f16800c8640 1 -- 172.21.15.139:0/1706919204 wait complete. 2024-04-26T18:28:24.122 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T18:28:24.122 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T18:28:24.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.228+0000 7fa50031c640 1 Processor -- start 2024-04-26T18:28:24.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.228+0000 7fa50031c640 1 -- start start 2024-04-26T18:28:24.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa50031c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fa4f806ffc0 0x7fa4f80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa50031c640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f815ddd0 con 0x7fa4f8074600 2024-04-26T18:28:24.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa50031c640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f80ca830 con 0x7fa4f806fbe0 2024-04-26T18:28:24.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa50031c640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f815d8a0 con 0x7fa4f806ffc0 2024-04-26T18:28:24.229 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fe8b9640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa4f8074600 0x7fa4f8153680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:32772/0 (socket says 172.21.15.139:32772) 2024-04-26T18:28:24.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/785816739 learned_addr learned my addr 172.21.15.139:0/785816739 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:28:24.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/785816739 >> v2:172.21.15.143:3300/0 conn(0x7fa4f806ffc0 0x7fa4f80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fd0b6640 1 -- 172.21.15.139:0/785816739 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350905401 0 0) 0x7fa4f815ddd0 con 0x7fa4f8074600 2024-04-26T18:28:24.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fd0b6640 1 -- 172.21.15.139:0/785816739 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4e4003520 con 0x7fa4f8074600 2024-04-26T18:28:24.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fd8b7640 1 -- 172.21.15.139:0/785816739 >> v1:172.21.15.143:6789/0 conn(0x7fa4f806fbe0 legacy=0x7fa4f815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fd8b7640 1 -- 172.21.15.139:0/785816739 >> v1:172.21.15.139:6789/0 conn(0x7fa4f8074600 legacy=0x7fa4f8153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.229+0000 7fa4fd8b7640 1 -- 172.21.15.139:0/785816739 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f815daf0 con 0x7fa4f806ffc0 2024-04-26T18:28:24.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.230+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/785816739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806ffc0 0x7fa4f80c96f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80097a0 tx=0x7fa4e802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c77c1217a7229e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:24.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.230+0000 7fa4fd0b6640 1 -- 172.21.15.139:0/785816739 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8037070 con 0x7fa4f806ffc0 2024-04-26T18:28:24.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.230+0000 7fa4fd0b6640 1 -- 172.21.15.139:0/785816739 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8032440 con 0x7fa4f806ffc0 2024-04-26T18:28:24.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.230+0000 7fa4fd0b6640 1 -- 172.21.15.139:0/785816739 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8032810 con 0x7fa4f806ffc0 2024-04-26T18:28:24.231 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.231+0000 7fa50031c640 1 -- 172.21.15.139:0/785816739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806ffc0 msgr2=0x7fa4f80c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.231+0000 7fa50031c640 1 --2- 172.21.15.139:0/785816739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806ffc0 0x7fa4f80c96f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80097a0 tx=0x7fa4e802a230 comp rx=0 tx=0).stop 2024-04-26T18:28:24.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.231+0000 7fa50031c640 1 -- 172.21.15.139:0/785816739 shutdown_connections 2024-04-26T18:28:24.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.231+0000 7fa50031c640 1 --2- 172.21.15.139:0/785816739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806ffc0 0x7fa4f80c96f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.231+0000 7fa50031c640 1 -- 172.21.15.139:0/785816739 >> 172.21.15.139:0/785816739 conn(0x7fa4f806dd40 msgr2=0x7fa4f806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:24.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.231+0000 7fa50031c640 1 -- 172.21.15.139:0/785816739 shutdown_connections 2024-04-26T18:28:24.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.231+0000 7fa50031c640 1 -- 172.21.15.139:0/785816739 wait complete. 2024-04-26T18:28:24.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 Processor -- start 2024-04-26T18:28:24.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 -- start start 2024-04-26T18:28:24.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806fbe0 0x7fa4f81f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4f806ffc0 0x7fa4f815c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4f8074600 0x7fa4f814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f80c9460 con 0x7fa4f806ffc0 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8159db0 con 0x7fa4f806fbe0 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.232+0000 7fa50031c640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f80ca4c0 con 0x7fa4f8074600 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4f806ffc0 0x7fa4f815c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4f806ffc0 0x7fa4f815c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54360/0 (socket says 172.21.15.139:54360) 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 -- 172.21.15.139:0/4132328695 learned_addr learned my addr 172.21.15.139:0/4132328695 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806fbe0 0x7fa4f81f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4f8074600 0x7fa4f814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 -- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4f8074600 msgr2=0x7fa4f814b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4f8074600 0x7fa4f814b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 -- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806fbe0 msgr2=0x7fa4f81f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806fbe0 0x7fa4f81f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 -- 172.21.15.139:0/4132328695 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f815cfc0 con 0x7fa4f806ffc0 2024-04-26T18:28:24.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4f806ffc0 0x7fa4f815c0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8035040 tx=0x7fa4e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:24.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4eeffd640 1 -- 172.21.15.139:0/4132328695 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8037040 con 0x7fa4f806ffc0 2024-04-26T18:28:24.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4eeffd640 1 -- 172.21.15.139:0/4132328695 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8030500 con 0x7fa4f806ffc0 2024-04-26T18:28:24.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa4eeffd640 1 -- 172.21.15.139:0/4132328695 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8030910 con 0x7fa4f806ffc0 2024-04-26T18:28:24.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f815d2a0 con 0x7fa4f806ffc0 2024-04-26T18:28:24.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.233+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f815b8d0 con 0x7fa4f806ffc0 2024-04-26T18:28:24.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.235+0000 7fa4eeffd640 1 -- 172.21.15.139:0/4132328695 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4e8044020 con 0x7fa4f806ffc0 2024-04-26T18:28:24.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.235+0000 7fa4eeffd640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.235+0000 7fa4eeffd640 1 -- 172.21.15.139:0/4132328695 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa4e80ac100 con 0x7fa4f806ffc0 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.235+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.236+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40016e0 tx=0x7fa4f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.236+0000 7fa503031740 1 Processor -- start 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.236+0000 7fa503031740 1 -- start start 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e2939f0 0x55e51e2d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa503031740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e293dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e294f50 0x55e51e294310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa503031740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e51e1f2d80 con 0x55e51e2d2ef0 2024-04-26T18:28:24.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e51e18ec20 con 0x55e51e2939f0 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e51e1eed40 con 0x55e51e294f50 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe0b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e2939f0 0x55e51e2d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe8b9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e294f50 0x55e51e294310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fd8b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e293dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe0b8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e2939f0 0x55e51e2d29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:33598/0 (socket says 172.21.15.139:33598) 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe8b9640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e294f50 0x55e51e294310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:35728/0 (socket says 172.21.15.139:35728) 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe0b8640 1 -- 172.21.15.139:0/4263095458 learned_addr learned my addr 172.21.15.139:0/4263095458 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e293dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54374/0 (socket says 172.21.15.139:54374) 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e2939f0 msgr2=0x55e51e2d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e2939f0 0x55e51e2d29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.241 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/4263095458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 msgr2=0x55e51e293dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e293dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.237+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/4263095458 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51dfd0d80 con 0x55e51e294f50 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.238+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e2939f0 0x55e51e2d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.238+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e294f50 0x55e51e294310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00012e0 tx=0x7fa4f0007410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a153c84c81b97cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.238+0000 7fa4dbfff640 1 -- 172.21.15.139:0/4263095458 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00133f0 con 0x55e51e294f50 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.238+0000 7fa4dbfff640 1 -- 172.21.15.139:0/4263095458 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f0018070 con 0x55e51e294f50 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.238+0000 7fa4dbfff640 1 -- 172.21.15.139:0/4263095458 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00137b0 con 0x55e51e294f50 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.238+0000 7fa503031740 1 -- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e294f50 msgr2=0x55e51e294310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.238+0000 7fa503031740 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e294f50 0x55e51e294310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00012e0 tx=0x7fa4f0007410 comp rx=0 tx=0).stop 2024-04-26T18:28:24.242 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 -- 172.21.15.139:0/4263095458 shutdown_connections 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e294f50 0x55e51e294310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e293dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 --2- 172.21.15.139:0/4263095458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e2939f0 0x55e51e2d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 -- 172.21.15.139:0/4263095458 >> 172.21.15.139:0/4263095458 conn(0x55e51e256740 msgr2=0x55e51e2d7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 -- 172.21.15.139:0/4263095458 shutdown_connections 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 -- 172.21.15.139:0/4263095458 wait complete. 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 -- start start 2024-04-26T18:28:24.243 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.239+0000 7fa503031740 1 Processor -- start 2024-04-26T18:28:24.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa503031740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2939f0 0x55e51e2d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2d2ef0 0x55e51e2bcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa503031740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e51e292030 con 0x55e51e2939f0 2024-04-26T18:28:24.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e51e18c840 con 0x55e51e294f50 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e51e295580 con 0x55e51e2d2ef0 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa503031740 10 client.0 _ll_register_callbacks cb 0x55e51e1905b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2939f0 0x55e51e2d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2939f0 0x55e51e2d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54382/0 (socket says 172.21.15.139:54382) 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 -- 172.21.15.139:0/2196894835 learned_addr learned my addr 172.21.15.139:0/2196894835 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2d2ef0 0x55e51e2bcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 -- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2d2ef0 msgr2=0x55e51e2bcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2d2ef0 0x55e51e2bcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 -- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 msgr2=0x55e51e2e3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.240+0000 7fa4fe0b8640 1 -- 172.21.15.139:0/2196894835 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51e031510 con 0x55e51e2939f0 2024-04-26T18:28:24.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2939f0 0x55e51e2d18e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4006ab0 tx=0x7fa4f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92af656627d39d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2196894835 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4021410 con 0x55e51e2939f0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2196894835 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa4f40215b0 con 0x55e51e2939f0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f0018070 con 0x55e51e2939f0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2196894835 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa4f402e050 con 0x55e51e2939f0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 10 client.6108 fetch_fsmap learned FSMap version 9 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e51dec4670 con 0x55e51e2939f0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2196894835 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f0018070 con 0x55e51e2939f0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2196894835 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa4f4031020 con 0x55e51e2939f0 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 10 client.6108 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 10 client.6108 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 20 client.6108 populate_metadata read hostname 'smithi139' 2024-04-26T18:28:24.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2bb4b0 0x55e51e2e7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 4 client.6108 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e51e200990 con 0x55e51e2bb4b0 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.241+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2bb4b0 0x55e51e2e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.242+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2bb4b0 0x55e51e2e7410 crc :-1 s=READY pgs=689 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6dc48ff550b453d server_cookie=5523e04a782652f7 in_seq=0 out_seq=0 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.242+0000 7fa4d97fa640 10 client.6108 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.242+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2196894835 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e51e200990 con 0x55e51e2bb4b0 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.242+0000 7fa4d97fa640 10 client.6108 handle_command_reply: tid=0 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.242+0000 7fa503031740 1 client.6108 shutdown 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2939f0 msgr2=0x55e51e2d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2939f0 0x55e51e2d18e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4006ab0 tx=0x7fa4f4000ed0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 shutdown_connections 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2bb4b0 0x55e51e2e7410 crc :-1 s=READY pgs=689 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2d2ef0 0x55e51e2bcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa4d97fa640 0 client.6108 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:24.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 --2- 172.21.15.139:0/2196894835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2939f0 0x55e51e2d18e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 >> 172.21.15.139:0/2196894835 conn(0x55e51e256740 msgr2=0x55e51e2d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:24.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 shutdown_connections 2024-04-26T18:28:24.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 1 -- 172.21.15.139:0/2196894835 wait complete. 2024-04-26T18:28:24.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.243+0000 7fa503031740 20 client.6108 trim_cache size 0 max 16384 2024-04-26T18:28:24.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.260+0000 7fa503031740 1 Processor -- start 2024-04-26T18:28:24.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.260+0000 7fa503031740 1 -- start start 2024-04-26T18:28:24.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.260+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e2cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa503031740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2e0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa503031740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f81fc380 con 0x55e51e2d2ef0 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f81fb260 con 0x55e51e294f50 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f80c3ec0 con 0x55e51e2939f0 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2e0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2e0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54386/0 (socket says 172.21.15.139:54386) 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/204327555 learned_addr learned my addr 172.21.15.139:0/204327555 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fd8b7640 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e2cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 msgr2=0x55e51e2cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e2cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 msgr2=0x55e51e2e0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/204327555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51e2911b0 con 0x55e51e2d2ef0 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2e0e90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0007450 tx=0x7fa4f000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8905db779b36c2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4db7fe640 1 -- 172.21.15.139:0/204327555 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0028680 con 0x55e51e2d2ef0 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4db7fe640 1 -- 172.21.15.139:0/204327555 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f0018040 con 0x55e51e2d2ef0 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.261+0000 7fa4db7fe640 1 -- 172.21.15.139:0/204327555 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0028a80 con 0x55e51e2d2ef0 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 -- 172.21.15.139:0/204327555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 msgr2=0x55e51e2e0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2e0e90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0007450 tx=0x7fa4f000c000 comp rx=0 tx=0).stop 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 -- 172.21.15.139:0/204327555 shutdown_connections 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2e0e90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e2e0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 --2- 172.21.15.139:0/204327555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e2cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 -- 172.21.15.139:0/204327555 >> 172.21.15.139:0/204327555 conn(0x55e51e256740 msgr2=0x55e51e2e3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:24.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 -- 172.21.15.139:0/204327555 shutdown_connections 2024-04-26T18:28:24.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 -- 172.21.15.139:0/204327555 wait complete. 2024-04-26T18:28:24.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 -- start start 2024-04-26T18:28:24.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.262+0000 7fa503031740 1 Processor -- start 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e352cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa503031740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e28ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa503031740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa503031740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f81f9e20 con 0x55e51e2d2ef0 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f81fab90 con 0x55e51e294f50 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa503031740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f81fa4c0 con 0x55e51e2939f0 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa503031740 10 client.0 _ll_register_callbacks cb 0x7fa4f400fed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:28:24.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa4fe8b9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa4fd8b7640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e28ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa4fe0b8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e352cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa4fe8b9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2b7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54392/0 (socket says 172.21.15.139:54392) 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.263+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/2590357458 learned_addr learned my addr 172.21.15.139:0/2590357458 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 msgr2=0x55e51e352cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e352cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 msgr2=0x55e51e28ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e28ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4fe8b9640 1 -- 172.21.15.139:0/2590357458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51e2bbb60 con 0x55e51e2d2ef0 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e352cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:28:24.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4fe8b9640 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2b7810 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0001300 tx=0x7fa4f0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a071edad2d90ecc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2590357458 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0038060 con 0x55e51e2d2ef0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2590357458 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa4f001e820 con 0x55e51e2d2ef0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4f0018040 con 0x55e51e2d2ef0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2590357458 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa4f003e050 con 0x55e51e2d2ef0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 10 client.6114 fetch_fsmap learned FSMap version 9 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e51e294760 con 0x55e51e2d2ef0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2590357458 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f0018040 con 0x55e51e2d2ef0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2590357458 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa4f0041020 con 0x55e51e2d2ef0 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 10 client.6114 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 10 client.6114 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 20 client.6114 populate_metadata read hostname 'smithi139' 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2e0950 0x55e51e348640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 4 client.6114 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T18:28:24.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.264+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55e51e1fa800 con 0x55e51e2e0950 2024-04-26T18:28:24.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.265+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2e0950 0x55e51e348640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:24.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.265+0000 7fa4fe0b8640 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2e0950 0x55e51e348640 crc :-1 s=READY pgs=690 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931394258879e28 server_cookie=8d211b513c8eb4b8 in_seq=0 out_seq=0 2024-04-26T18:28:24.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:24.265+0000 7fa4d97fa640 10 client.6114 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa4d97fa640 1 -- 172.21.15.139:0/2590357458 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55e51e1fa800 con 0x55e51e2e0950 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa4d97fa640 10 client.6114 handle_command_reply: tid=0 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 client.6114 shutdown 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 msgr2=0x55e51e2b7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2b7810 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0001300 tx=0x7fa4f0001250 comp rx=0 tx=0).stop 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 shutdown_connections 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e51e2d2ef0 0x55e51e2b7810 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e51e294f50 0x55e51e28ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e51e2e0950 0x55e51e348640 crc :-1 s=READY pgs=690 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 --2- 172.21.15.139:0/2590357458 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e51e2939f0 0x55e51e352cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa4d97fa640 0 client.6114 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:25.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 >> 172.21.15.139:0/2590357458 conn(0x55e51e256740 msgr2=0x55e51e2cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 shutdown_connections 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 1 -- 172.21.15.139:0/2590357458 wait complete. 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.840+0000 7fa503031740 20 client.6114 trim_cache size 0 max 16384 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 102, 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:28:25.842 INFO:teuthology.orchestra.run.smithi139.stdout: "6308d6ad": { 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 102, 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:28:25.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:25.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:25.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:25.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:25.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:25.844 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4dc06c8f0 msgr2=0x7fa4dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40016e0 tx=0x7fa4f4009040 comp rx=0 tx=0).stop 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4f806ffc0 msgr2=0x7fa4f815c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4f806ffc0 0x7fa4f815c0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8035040 tx=0x7fa4e80046c0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 shutdown_connections 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa4dc06c8f0 0x7fa4dc06edb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa4f8074600 0x7fa4f814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4f806ffc0 0x7fa4f815c0d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 --2- 172.21.15.139:0/4132328695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f806fbe0 0x7fa4f81f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 >> 172.21.15.139:0/4132328695 conn(0x7fa4f806dd40 msgr2=0x7fa4f80cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 shutdown_connections 2024-04-26T18:28:25.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:25.841+0000 7fa50031c640 1 -- 172.21.15.139:0/4132328695 wait complete. 2024-04-26T18:28:25.853 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6308d6ad', quiesce took 2.1 seconds. Will release after: 30.0 2024-04-26T18:28:32.161 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:28:32.165 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:28:55.854 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:28:55.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.964+0000 7f7f01bc1640 1 Processor -- start 2024-04-26T18:28:55.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.964+0000 7f7f01bc1640 1 -- start start 2024-04-26T18:28:55.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.964+0000 7f7f01bc1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7efc156180 0x7f7efc15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.964+0000 7f7f01bc1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7efc15f2a0 con 0x7f7efc0cd840 2024-04-26T18:28:55.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.964+0000 7f7f01bc1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7efc15f580 con 0x7f7efc155da0 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.964+0000 7f7f01bc1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7efc15cbc0 con 0x7f7efc156180 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efbfff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f7efc0cd840 0x7f7efc0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:52930/0 (socket says 172.21.15.139:52930) 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efbfff640 1 -- 172.21.15.139:0/3568677245 learned_addr learned my addr 172.21.15.139:0/3568677245 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7ef3fff640 1 --2- 172.21.15.139:0/3568677245 >> v2:172.21.15.143:3300/0 conn(0x7f7efc156180 0x7f7efc15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 749105956 0 0) 0x7f7efc15f2a0 con 0x7f7efc0cd840 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ee8003520 con 0x7f7efc0cd840 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1534593979 0 0) 0x7f7ee8003520 con 0x7f7efc0cd840 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 >> v2:172.21.15.143:3300/0 conn(0x7f7efc156180 msgr2=0x7f7efc15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 --2- 172.21.15.139:0/3568677245 >> v2:172.21.15.143:3300/0 conn(0x7f7efc156180 0x7f7efc15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 >> v1:172.21.15.143:6789/0 conn(0x7f7efc155da0 legacy=0x7f7efc0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc15f860 con 0x7f7efc0cd840 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f7ef40019f0 con 0x7f7efc0cd840 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 >> v1:172.21.15.139:6789/0 conn(0x7f7efc0cd840 legacy=0x7f7efc0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:55.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ee8004800 0x7f7ee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80051c0 0x7f7ee800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc15cbc0 con 0x7f7ee80039b0 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee800c160 con 0x7f7ee80051c0 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee800c360 con 0x7f7ee8004800 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efb7fe640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7efbfff640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80051c0 0x7f7ee800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.965+0000 7f7ef3fff640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ee8004800 0x7f7ee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efb7fe640 1 -- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ee8004800 msgr2=0x7f7ee8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efb7fe640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ee8004800 0x7f7ee8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efb7fe640 1 -- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80051c0 msgr2=0x7f7ee800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efb7fe640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80051c0 0x7f7ee800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:55.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efbfff640 1 -- 172.21.15.139:0/3568677245 reap_dead start 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efb7fe640 1 -- 172.21.15.139:0/3568677245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee8003520 con 0x7f7ee80039b0 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7ef3fff640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7ee8004800 0x7f7ee8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efb7fe640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7eec001750 tx=0x7f7ee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9f030d1a889174 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec001370 con 0x7f7ee80039b0 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec0052d0 con 0x7f7ee80039b0 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.966+0000 7f7efaffd640 1 -- 172.21.15.139:0/3568677245 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec02abc0 con 0x7f7ee80039b0 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.967+0000 7f7f01bc1640 1 -- 172.21.15.139:0/3568677245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee80039b0 msgr2=0x7f7ee8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.967+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7eec001750 tx=0x7f7ee8005830 comp rx=0 tx=0).stop 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.967+0000 7f7f01bc1640 1 -- 172.21.15.139:0/3568677245 shutdown_connections 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.967+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/3568677245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.967+0000 7f7f01bc1640 1 -- 172.21.15.139:0/3568677245 >> 172.21.15.139:0/3568677245 conn(0x7f7efc068090 msgr2=0x7f7efc0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.967+0000 7f7f01bc1640 1 -- 172.21.15.139:0/3568677245 shutdown_connections 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.967+0000 7f7f01bc1640 1 -- 172.21.15.139:0/3568677245 wait complete. 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.968+0000 7f7f01bc1640 1 Processor -- start 2024-04-26T18:28:55.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.968+0000 7f7f01bc1640 1 -- start start 2024-04-26T18:28:55.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7f01bc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80039b0 0x7f7efc0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7f01bc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7efc1565e0 0x7f7efc1f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7f01bc1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7efc159d20 0x7f7efc1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7f01bc1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0cc160 con 0x7f7efc1565e0 2024-04-26T18:28:55.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7f01bc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0cc730 con 0x7f7ee80039b0 2024-04-26T18:28:55.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7f01bc1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7efc0cc2e0 con 0x7f7efc159d20 2024-04-26T18:28:55.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7efc1565e0 0x7f7efc1f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7efc1565e0 0x7f7efc1f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52364/0 (socket says 172.21.15.139:52364) 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 -- 172.21.15.139:0/395628128 learned_addr learned my addr 172.21.15.139:0/395628128 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7efbfff640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7efc159d20 0x7f7efc1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7efb7fe640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80039b0 0x7f7efc0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 -- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7efc159d20 msgr2=0x7f7efc1f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7efc159d20 0x7f7efc1f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 -- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80039b0 msgr2=0x7f7efc0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80039b0 0x7f7efc0cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.969+0000 7f7ef3fff640 1 -- 172.21.15.139:0/395628128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc0cb540 con 0x7f7efc1565e0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.970+0000 7f7ef3fff640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7efc1565e0 0x7f7efc1f5060 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40114c0 tx=0x7f7ee4011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.970+0000 7f7ef8ff9640 1 -- 172.21.15.139:0/395628128 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4015870 con 0x7f7efc1565e0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.970+0000 7f7ef8ff9640 1 -- 172.21.15.139:0/395628128 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee4015a10 con 0x7f7efc1565e0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.970+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc1f5b90 con 0x7f7efc1565e0 2024-04-26T18:28:55.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.970+0000 7f7ef8ff9640 1 -- 172.21.15.139:0/395628128 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4015e20 con 0x7f7efc1565e0 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.970+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc0d0c70 con 0x7f7efc1565e0 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.971+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc076d20 con 0x7f7efc1565e0 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.971+0000 7f7ef8ff9640 1 -- 172.21.15.139:0/395628128 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ee401d400 con 0x7f7efc1565e0 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.972+0000 7f7ef8ff9640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7edc06c920 0x7f7edc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.972+0000 7f7efb7fe640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7edc06c920 0x7f7edc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.972+0000 7f7ef8ff9640 1 -- 172.21.15.139:0/395628128 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7ee408c730 con 0x7f7efc1565e0 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.972+0000 7f7efb7fe640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7edc06c920 0x7f7edc06ede0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7eec032000 tx=0x7f7eec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:55.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:55.976+0000 7f7ef8ff9640 1 -- 172.21.15.139:0/395628128 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7efc0cb540 con 0x7f7efc1565e0 2024-04-26T18:28:56.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.188+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7efc14fe20 con 0x7f7efc1565e0 2024-04-26T18:28:56.189 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.189+0000 7f7ef8ff9640 1 -- 172.21.15.139:0/395628128 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f7ee4019030 con 0x7f7efc1565e0 2024-04-26T18:28:56.189 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:28:56.189 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:28:56.190 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:28:56.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7edc06c920 msgr2=0x7f7edc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7edc06c920 0x7f7edc06ede0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7eec032000 tx=0x7f7eec02e000 comp rx=0 tx=0).stop 2024-04-26T18:28:56.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7efc1565e0 msgr2=0x7f7efc1f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7efc1565e0 0x7f7efc1f5060 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40114c0 tx=0x7f7ee4011980 comp rx=0 tx=0).stop 2024-04-26T18:28:56.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 shutdown_connections 2024-04-26T18:28:56.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7edc06c920 0x7f7edc06ede0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7efc159d20 0x7f7efc1f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7efc1565e0 0x7f7efc1f5060 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 --2- 172.21.15.139:0/395628128 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ee80039b0 0x7f7efc0cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 >> 172.21.15.139:0/395628128 conn(0x7f7efc068090 msgr2=0x7f7efc14bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:56.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 shutdown_connections 2024-04-26T18:28:56.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.191+0000 7f7f01bc1640 1 -- 172.21.15.139:0/395628128 wait complete. 2024-04-26T18:28:56.202 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 6308d6ad --release --await' 2024-04-26T18:28:56.202 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 6308d6ad --release --await 2024-04-26T18:28:56.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.305+0000 7f13a1766640 1 Processor -- start 2024-04-26T18:28:56.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.305+0000 7f13a1766640 1 -- start start 2024-04-26T18:28:56.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f13a1766640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f139c074300 0x7f139c06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f13a1766640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f13a1766640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f139c0c8b60 con 0x7f139c0746e0 2024-04-26T18:28:56.307 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f13a1766640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f139c06d2a0 con 0x7f139c074300 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f13a1766640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f139c0c8e40 con 0x7f139c0ca6f0 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f139affd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f139c074300 0x7f139c06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f139affd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f139c074300 0x7f139c06cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52368/0 (socket says 172.21.15.139:52368) 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.306+0000 7f139affd640 1 -- 172.21.15.139:0/937598939 learned_addr learned my addr 172.21.15.139:0/937598939 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f139a7fc640 1 --2- 172.21.15.139:0/937598939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f139affd640 1 -- 172.21.15.139:0/937598939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 msgr2=0x7f139c15f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f139affd640 1 --2- 172.21.15.139:0/937598939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f139affd640 1 -- 172.21.15.139:0/937598939 >> v1:172.21.15.143:6789/0 conn(0x7f139c0746e0 legacy=0x7f139c155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f139affd640 1 -- 172.21.15.139:0/937598939 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c0b2c30 con 0x7f139c074300 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f139a7fc640 1 --2- 172.21.15.139:0/937598939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f139affd640 1 --2- 172.21.15.139:0/937598939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c06cc10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f138c009e50 tx=0x7f138c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9788cf5b4faa29ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:56.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.307+0000 7f1399ffb640 1 -- 172.21.15.139:0/937598939 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c036070 con 0x7f139c074300 2024-04-26T18:28:56.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f1399ffb640 1 -- 172.21.15.139:0/937598939 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138c031600 con 0x7f139c074300 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f1399ffb640 1 -- 172.21.15.139:0/937598939 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0319d0 con 0x7f139c074300 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 -- 172.21.15.139:0/937598939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 msgr2=0x7f139c06cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 --2- 172.21.15.139:0/937598939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c06cc10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f138c009e50 tx=0x7f138c02a730 comp rx=0 tx=0).stop 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 -- 172.21.15.139:0/937598939 shutdown_connections 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 --2- 172.21.15.139:0/937598939 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 --2- 172.21.15.139:0/937598939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c06cc10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 -- 172.21.15.139:0/937598939 >> 172.21.15.139:0/937598939 conn(0x7f139c06ed70 msgr2=0x7f139c06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 -- 172.21.15.139:0/937598939 shutdown_connections 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.308+0000 7f13a1766640 1 -- 172.21.15.139:0/937598939 wait complete. 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 Processor -- start 2024-04-26T18:28:56.310 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 -- start start 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139c0746e0 0x7f139c150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f139c0b3410 con 0x7f139c074300 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f139c0c9120 con 0x7f139c0746e0 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f13a1766640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f139c0b3590 con 0x7f139c0ca6f0 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f139affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f139affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52382/0 (socket says 172.21.15.139:52382) 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f139affd640 1 -- 172.21.15.139:0/2866906881 learned_addr learned my addr 172.21.15.139:0/2866906881 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f139a7fc640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139c0746e0 0x7f139c150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.310+0000 7f139b7fe640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f139affd640 1 -- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 msgr2=0x7f139c15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f139affd640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f139affd640 1 -- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139c0746e0 msgr2=0x7f139c150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f139affd640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139c0746e0 0x7f139c150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f139affd640 1 -- 172.21.15.139:0/2866906881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c14d2e0 con 0x7f139c074300 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f139b7fe640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f139affd640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c149b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f138c009f70 tx=0x7f138c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f13837fe640 1 -- 172.21.15.139:0/2866906881 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c036050 con 0x7f139c074300 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f13837fe640 1 -- 172.21.15.139:0/2866906881 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138c042070 con 0x7f139c074300 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c15ed00 con 0x7f139c074300 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f13837fe640 1 -- 172.21.15.139:0/2866906881 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c009510 con 0x7f139c074300 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.311+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c14a520 con 0x7f139c074300 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.312+0000 7f13837fe640 1 -- 172.21.15.139:0/2866906881 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f138c007c70 con 0x7f139c074300 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.313+0000 7f13837fe640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f138806c8f0 0x7f138806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.313+0000 7f13837fe640 1 -- 172.21.15.139:0/2866906881 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f138c0acff0 con 0x7f139c074300 2024-04-26T18:28:56.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.313+0000 7f139a7fc640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f138806c8f0 0x7f138806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.313+0000 7f139a7fc640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f138806c8f0 0x7f138806edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f139c150dd0 tx=0x7f1390008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 Processor -- start 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 -- start start 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a56470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a569b0 0x55a617a17890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a18a10 0x55a617a17dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a61797c040 con 0x55a617a174b0 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a617917b60 con 0x55a617a569b0 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a617978000 con 0x55a617a18a10 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f139affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a56470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f139affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a56470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52396/0 (socket says 172.21.15.139:52396) 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.314+0000 7f139affd640 1 -- 172.21.15.139:0/998858482 learned_addr learned my addr 172.21.15.139:0/998858482 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139a7fc640 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a569b0 0x55a617a17890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139b7fe640 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a18a10 0x55a617a17dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139affd640 1 -- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a18a10 msgr2=0x55a617a17dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139affd640 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a18a10 0x55a617a17dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139affd640 1 -- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a569b0 msgr2=0x55a617a17890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139affd640 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a569b0 0x55a617a17890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139affd640 1 -- 172.21.15.139:0/998858482 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61790c9c0 con 0x55a617a174b0 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139b7fe640 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a18a10 0x55a617a17dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f139affd640 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a56470 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f138c034040 tx=0x7f138c07a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa2a7f380f6db0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f1380ff9640 1 -- 172.21.15.139:0/998858482 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c07ec90 con 0x55a617a174b0 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f1380ff9640 1 -- 172.21.15.139:0/998858482 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138c037040 con 0x55a617a174b0 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.315+0000 7f1380ff9640 1 -- 172.21.15.139:0/998858482 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c0834c0 con 0x55a617a174b0 2024-04-26T18:28:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 -- 172.21.15.139:0/998858482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 msgr2=0x55a617a56470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a56470 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f138c034040 tx=0x7f138c07a520 comp rx=0 tx=0).stop 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 -- 172.21.15.139:0/998858482 shutdown_connections 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a18a10 0x55a617a17dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a569b0 0x55a617a17890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 --2- 172.21.15.139:0/998858482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a56470 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 -- 172.21.15.139:0/998858482 >> 172.21.15.139:0/998858482 conn(0x55a6179de930 msgr2=0x55a617a5b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 -- 172.21.15.139:0/998858482 shutdown_connections 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 -- 172.21.15.139:0/998858482 wait complete. 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 -- start start 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.316+0000 7f13a447f740 1 Processor -- start 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f13a447f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a67b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617a17c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a569b0 0x55a617a53f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f13a447f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a61797c040 con 0x55a617a174b0 2024-04-26T18:28:56.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a6179154f0 con 0x55a617a18a10 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a617a15af0 con 0x55a617a569b0 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f139affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a67b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f13a447f740 10 client.0 _ll_register_callbacks cb 0x55a617972c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f139affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a67b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52402/0 (socket says 172.21.15.139:52402) 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f139affd640 1 -- 172.21.15.139:0/1208600739 learned_addr learned my addr 172.21.15.139:0/1208600739 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f139b7fe640 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a569b0 0x55a617a53f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f139a7fc640 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617a17c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f139affd640 1 -- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a569b0 msgr2=0x55a617a53f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.317+0000 7f139affd640 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a569b0 0x55a617a53f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f139affd640 1 -- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 msgr2=0x55a617a17c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f139affd640 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617a17c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f139affd640 1 -- 172.21.15.139:0/1208600739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61768d920 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f139affd640 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a67b90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f138c02ad20 tx=0x7f138c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2428dc595ccd639 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f1379ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f1379ffb640 1 -- 172.21.15.139:0/1208600739 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c07ec90 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f1379ffb640 1 -- 172.21.15.139:0/1208600739 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f138c079d30 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f138c037040 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f1379ffb640 1 -- 172.21.15.139:0/1208600739 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f138c079f30 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 10 client.6132 fetch_fsmap learned FSMap version 9 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a617759d30 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f1379ffb640 1 -- 172.21.15.139:0/1208600739 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138c037040 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f1379ffb640 1 -- 172.21.15.139:0/1208600739 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f138c090070 con 0x55a617a174b0 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 10 client.6132 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 10 client.6132 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 20 client.6132 populate_metadata read hostname 'smithi139' 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a42310 0x55a617a3ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 4 client.6132 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a61794fa00 con 0x55a617a42310 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.318+0000 7f139a7fc640 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a42310 0x55a617a3ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.319+0000 7f1379ffb640 10 client.6132 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.319+0000 7f139a7fc640 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a42310 0x55a617a3ea20 crc :-1 s=READY pgs=691 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=658e2bf51b98c43c server_cookie=4377c9074c7ffcd3 in_seq=0 out_seq=0 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.319+0000 7f1379ffb640 1 -- 172.21.15.139:0/1208600739 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a61794fa00 con 0x55a617a42310 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.319+0000 7f1379ffb640 10 client.6132 handle_command_reply: tid=0 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 client.6132 shutdown 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 msgr2=0x55a617a67b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a67b90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f138c02ad20 tx=0x7f138c009810 comp rx=0 tx=0).stop 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 shutdown_connections 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a42310 0x55a617a3ea20 crc :-1 s=READY pgs=691 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a569b0 0x55a617a53f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617a17c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f1379ffb640 0 client.6132 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 --2- 172.21.15.139:0/1208600739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a174b0 0x55a617a67b90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 >> 172.21.15.139:0/1208600739 conn(0x55a6179de930 msgr2=0x55a617a40be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 shutdown_connections 2024-04-26T18:28:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 1 -- 172.21.15.139:0/1208600739 wait complete. 2024-04-26T18:28:56.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.320+0000 7f13a447f740 20 client.6132 trim_cache size 0 max 16384 2024-04-26T18:28:56.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 Processor -- start 2024-04-26T18:28:56.337 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 -- start start 2024-04-26T18:28:56.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a5b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617acb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617acbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f139c200720 con 0x55a617a42310 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1ff600 con 0x55a617a18a10 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.337+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f139c146250 con 0x55a617a174b0 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617acbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617acbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52406/0 (socket says 172.21.15.139:52406) 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 -- 172.21.15.139:0/614265413 learned_addr learned my addr 172.21.15.139:0/614265413 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139affd640 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a5b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139a7fc640 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617acb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 -- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 msgr2=0x55a617a5b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a5b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 -- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 msgr2=0x55a617acb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617acb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 -- 172.21.15.139:0/614265413 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a617a11bb0 con 0x55a617a42310 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139a7fc640 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617acb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:28:56.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f139b7fe640 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617acbb00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f13940055e0 tx=0x7f1394009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f1dbd6036be060 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f137bfff640 1 -- 172.21.15.139:0/614265413 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394007030 con 0x55a617a42310 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f137bfff640 1 -- 172.21.15.139:0/614265413 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13940071d0 con 0x55a617a42310 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.338+0000 7f137bfff640 1 -- 172.21.15.139:0/614265413 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394007580 con 0x55a617a42310 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 -- 172.21.15.139:0/614265413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 msgr2=0x55a617acbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617acbb00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f13940055e0 tx=0x7f1394009040 comp rx=0 tx=0).stop 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 -- 172.21.15.139:0/614265413 shutdown_connections 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617acbb00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617acb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 --2- 172.21.15.139:0/614265413 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a5b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 -- 172.21.15.139:0/614265413 >> 172.21.15.139:0/614265413 conn(0x55a6179de930 msgr2=0x55a617a14c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 -- 172.21.15.139:0/614265413 shutdown_connections 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 -- 172.21.15.139:0/614265413 wait complete. 2024-04-26T18:28:56.341 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 -- start start 2024-04-26T18:28:56.342 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.339+0000 7f13a447f740 1 Processor -- start 2024-04-26T18:28:56.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f13a447f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617ad0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f13a447f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617a63de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.345 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f13a447f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1fe190 con 0x55a617a42310 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f139c1fef30 con 0x55a617a18a10 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f13a447f740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f139c1fe860 con 0x55a617a174b0 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f13a447f740 10 client.0 _ll_register_callbacks cb 0x7f139000a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617a63de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617a63de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:52412/0 (socket says 172.21.15.139:52412) 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 -- 172.21.15.139:0/2081019716 learned_addr learned my addr 172.21.15.139:0/2081019716 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139a7fc640 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617ad0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139affd640 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 -- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 msgr2=0x55a617a574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 -- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 msgr2=0x55a617ad0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617ad0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.346 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 -- 172.21.15.139:0/2081019716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a617ad1060 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f139b7fe640 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617a63de0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1394003f10 tx=0x7f1394001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffebafad150a694d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.340+0000 7f1379ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f1379ffb640 1 -- 172.21.15.139:0/2081019716 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394005190 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f1379ffb640 1 -- 172.21.15.139:0/2081019716 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f1394006d90 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13940071d0 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f1379ffb640 1 -- 172.21.15.139:0/2081019716 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1394013550 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 10 client.6138 fetch_fsmap learned FSMap version 9 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a617a14170 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f1379ffb640 1 -- 172.21.15.139:0/2081019716 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13940071d0 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f1379ffb640 1 -- 172.21.15.139:0/2081019716 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f13940136f0 con 0x55a617a42310 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 10 client.6138 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 10 client.6138 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 20 client.6138 populate_metadata read hostname 'smithi139' 2024-04-26T18:28:56.347 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a569b0 0x55a617a64320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 4 client.6138 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6308d6ad", "release": true, "await": true}] 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6308d6ad", "release": true, "await": true}) -- 0x55a617989c50 con 0x55a617a569b0 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.341+0000 7f139affd640 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a569b0 0x55a617a64320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f1379ffb640 10 client.6138 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f139affd640 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a569b0 0x55a617a64320 crc :-1 s=READY pgs=692 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a21207a5932299c6 server_cookie=74051bc1a6afc9af in_seq=0 out_seq=0 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f1379ffb640 1 -- 172.21.15.139:0/2081019716 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a617989c50 con 0x55a617a569b0 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f1379ffb640 10 client.6138 handle_command_reply: tid=0 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 client.6138 shutdown 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 msgr2=0x55a617a63de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617a63de0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1394003f10 tx=0x7f1394001080 comp rx=0 tx=0).stop 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 shutdown_connections 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a617a42310 0x55a617a63de0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a617a18a10 0x55a617ad0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a617a569b0 0x55a617a64320 crc :-1 s=READY pgs=692 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 --2- 172.21.15.139:0/2081019716 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a617a174b0 0x55a617a574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f1379ffb640 0 client.6138 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 >> 172.21.15.139:0/2081019716 conn(0x55a6179de930 msgr2=0x55a617a652b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 shutdown_connections 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 1 -- 172.21.15.139:0/2081019716 wait complete. 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.342+0000 7f13a447f740 20 client.6138 trim_cache size 0 max 16384 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 104, 2024-04-26T18:28:56.349 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "6308d6ad": { 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 104, 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 90.0, 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:28:56.350 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:28:56.351 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:28:56.351 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:56.351 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:56.351 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:56.351 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:56.351 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:28:56.351 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f138806c8f0 msgr2=0x7f138806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f138806c8f0 0x7f138806edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f139c150dd0 tx=0x7f1390008040 comp rx=0 tx=0).stop 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 msgr2=0x7f139c149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c149b00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f138c009f70 tx=0x7f138c004a40 comp rx=0 tx=0).stop 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 shutdown_connections 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f138806c8f0 0x7f138806edb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f139c0ca6f0 0x7f139c15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f139c0746e0 0x7f139c150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 --2- 172.21.15.139:0/2866906881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f139c074300 0x7f139c149b00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:28:56.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 >> 172.21.15.139:0/2866906881 conn(0x7f139c06ed70 msgr2=0x7f139c0ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:28:56.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 shutdown_connections 2024-04-26T18:28:56.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:28:56.343+0000 7f13a1766640 1 -- 172.21.15.139:0/2866906881 wait complete. 2024-04-26T18:28:56.354 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6308d6ad', seconds elapsed: 32.6 2024-04-26T18:29:00.858 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 28% (100/356) Updating files: 29% (104/356) Updating files: 30% (107/356) Updating files: 31% (111/356) Updating files: 32% (114/356) Updating files: 32% (117/356) Updating files: 33% (118/356) Updating files: 34% (122/356) Updating files: 35% (125/356) Updating files: 36% (129/356) Updating files: 37% (132/356) Updating files: 38% (136/356) Updating files: 39% (139/356) Updating files: 39% (141/356) Updating files: 40% (143/356) Updating files: 41% (146/356) Updating files: 41% (149/356) Updating files: 42% (150/356) Updating files: 43% (154/356) Updating files: 44% (157/356) Updating files: 45% (161/356) Updating files: 46% (164/356) Updating files: 47% (168/356) Updating files: 48% (171/356) Updating files: 49% (175/356) Updating files: 50% (178/356) Updating files: 51% (182/356) Updating files: 52% (186/356) Updating files: 53% (189/356) Updating files: 54% (193/356) Updating files: 55% (196/356) Updating files: 56% (200/356) Updating files: 57% (203/356) Updating files: 58% (207/356) Updating files: 59% (211/356) Updating files: 60% (214/356) Updating files: 61% (218/356) Updating files: 62% (221/356) Updating files: 63% (225/356) Updating files: 63% (226/356) Updating files: 64% (228/356) Updating files: 65% (232/356) Updating files: 66% (235/356) Updating files: 67% (239/356) Updating files: 68% (243/356) Updating files: 69% (246/356) Updating files: 70% (250/356) Updating files: 71% (253/356) Updating files: 72% (257/356) Updating files: 73% (260/356) Updating files: 74% (264/356) Updating files: 75% (267/356) Updating files: 76% (271/356) Updating files: 77% (275/356) Updating files: 78% (278/356) Updating files: 79% (282/356) Updating files: 80% (285/356) Updating files: 81% (289/356) Updating files: 82% (292/356) Updating files: 83% (296/356) Updating files: 84% (300/356) Updating files: 85% (303/356) Updating files: 86% (307/356) Updating files: 87% (310/356) Updating files: 87% (312/356) Updating files: 88% (314/356) Updating files: 89% (317/356) Updating files: 90% (321/356) Updating files: 91% (324/356) Updating files: 92% (328/356) Updating files: 93% (332/356) Updating files: 94% (335/356) Updating files: 95% (339/356) Updating files: 96% (342/356) Updating files: 97% (346/356) Updating files: 98% (349/356) Updating files: 99% (353/356) Updating files: 100% (356/356) Updating files: 100% (356/356), done. 2024-04-26T18:29:01.196 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 8336f81c5c7 0.84 2024-04-26T18:29:01.228 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.84 2024-04-26T18:29:01.243 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:01.243 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 85 -eq 48 ']' 2024-04-26T18:29:01.243 INFO:tasks.workunit.client.0.smithi139.stdout:v0.85 2024-04-26T18:29:01.244 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.85 2024-04-26T18:29:01.244 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.85 2024-04-26T18:29:01.244 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.85 2024-04-26T18:29:02.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:29:02.312 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:29:17.562 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 21% (53/243) Updating files: 22% (54/243) Updating files: 23% (56/243) Updating files: 24% (59/243) Updating files: 25% (61/243) Updating files: 26% (64/243) Updating files: 27% (66/243) Updating files: 28% (69/243) Updating files: 29% (71/243) Updating files: 30% (73/243) Updating files: 31% (76/243) Updating files: 32% (78/243) Updating files: 33% (81/243) Updating files: 34% (83/243) Updating files: 35% (86/243) Updating files: 36% (88/243) Updating files: 37% (90/243) Updating files: 38% (93/243) Updating files: 39% (95/243) Updating files: 40% (98/243) Updating files: 41% (100/243) Updating files: 42% (103/243) Updating files: 43% (105/243) Updating files: 44% (107/243) Updating files: 45% (110/243) Updating files: 46% (112/243) Updating files: 47% (115/243) Updating files: 48% (117/243) Updating files: 49% (120/243) Updating files: 50% (122/243) Updating files: 51% (124/243) Updating files: 52% (127/243) Updating files: 53% (129/243) Updating files: 54% (132/243) Updating files: 55% (134/243) Updating files: 56% (137/243) Updating files: 57% (139/243) Updating files: 58% (141/243) Updating files: 59% (144/243) Updating files: 60% (146/243) Updating files: 61% (149/243) Updating files: 62% (151/243) Updating files: 62% (152/243) Updating files: 63% (154/243) Updating files: 64% (156/243) Updating files: 65% (158/243) Updating files: 66% (161/243) Updating files: 67% (163/243) Updating files: 68% (166/243) Updating files: 69% (168/243) Updating files: 70% (171/243) Updating files: 71% (173/243) Updating files: 72% (175/243) Updating files: 73% (178/243) Updating files: 74% (180/243) Updating files: 75% (183/243) Updating files: 76% (185/243) Updating files: 77% (188/243) Updating files: 78% (190/243) Updating files: 79% (192/243) Updating files: 80% (195/243) Updating files: 81% (197/243) Updating files: 82% (200/243) Updating files: 83% (202/243) Updating files: 84% (205/243) Updating files: 85% (207/243) Updating files: 86% (209/243) Updating files: 87% (212/243) Updating files: 88% (214/243) Updating files: 89% (217/243) Updating files: 90% (219/243) Updating files: 91% (222/243) Updating files: 92% (224/243) Updating files: 93% (226/243) Updating files: 94% (229/243) Updating files: 95% (231/243) Updating files: 96% (234/243) Updating files: 97% (236/243) Updating files: 98% (239/243) Updating files: 99% (241/243) Updating files: 100% (243/243) Updating files: 100% (243/243), done. 2024-04-26T18:29:17.621 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at a0c22842db9 0.85 2024-04-26T18:29:17.623 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.85 2024-04-26T18:29:17.677 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:17.677 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 86 -eq 48 ']' 2024-04-26T18:29:17.677 INFO:tasks.workunit.client.0.smithi139.stdout:v0.86 2024-04-26T18:29:17.678 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.86 2024-04-26T18:29:17.678 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.86 2024-04-26T18:29:17.678 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.86 2024-04-26T18:29:23.316 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 16% (75/447) Updating files: 17% (76/447) Updating files: 18% (81/447) Updating files: 19% (85/447) Updating files: 20% (90/447) Updating files: 21% (94/447) Updating files: 22% (99/447) Updating files: 23% (103/447) Updating files: 24% (108/447) Updating files: 25% (112/447) Updating files: 26% (117/447) Updating files: 27% (121/447) Updating files: 28% (126/447) Updating files: 29% (130/447) Updating files: 30% (135/447) Updating files: 31% (139/447) Updating files: 32% (144/447) Updating files: 33% (148/447) Updating files: 34% (152/447) Updating files: 35% (157/447) Updating files: 36% (161/447) Updating files: 37% (166/447) Updating files: 38% (170/447) Updating files: 39% (175/447) Updating files: 39% (176/447) Updating files: 40% (179/447) Updating files: 41% (184/447) Updating files: 42% (188/447) Updating files: 43% (193/447) Updating files: 44% (197/447) Updating files: 45% (202/447) Updating files: 46% (206/447) Updating files: 47% (211/447) Updating files: 48% (215/447) Updating files: 49% (220/447) Updating files: 50% (224/447) Updating files: 51% (228/447) Updating files: 52% (233/447) Updating files: 53% (237/447) Updating files: 54% (242/447) Updating files: 55% (246/447) Updating files: 56% (251/447) Updating files: 57% (255/447) Updating files: 58% (260/447) Updating files: 59% (264/447) Updating files: 60% (269/447) Updating files: 61% (273/447) Updating files: 62% (278/447) Updating files: 63% (282/447) Updating files: 63% (286/447) Updating files: 64% (287/447) Updating files: 65% (291/447) Updating files: 66% (296/447) Updating files: 67% (300/447) Updating files: 68% (304/447) Updating files: 69% (309/447) Updating files: 70% (313/447) Updating files: 71% (318/447) Updating files: 72% (322/447) Updating files: 73% (327/447) Updating files: 74% (331/447) Updating files: 75% (336/447) Updating files: 76% (340/447) Updating files: 77% (345/447) Updating files: 78% (349/447) Updating files: 79% (354/447) Updating files: 80% (358/447) Updating files: 81% (363/447) Updating files: 82% (367/447) Updating files: 83% (372/447) Updating files: 84% (376/447) Updating files: 85% (380/447) Updating files: 86% (385/447) Updating files: 87% (389/447) Updating files: 88% (394/447) Updating files: 88% (396/447) Updating files: 89% (398/447) Updating files: 89% (400/447) Updating files: 90% (403/447) Updating files: 91% (407/447) Updating files: 92% (412/447) Updating files: 93% (416/447) Updating files: 94% (421/447) Updating files: 95% (425/447) Updating files: 96% (430/447) Updating files: 97% (434/447) Updating files: 98% (439/447) Updating files: 99% (443/447) Updating files: 100% (447/447) Updating files: 100% (447/447), done. 2024-04-26T18:29:23.342 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 97dcc0539df 0.86 2024-04-26T18:29:23.346 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.86 2024-04-26T18:29:23.477 INFO:tasks.workunit.client.0.smithi139.stdout:v0.87 2024-04-26T18:29:23.478 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:23.478 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 87 -eq 48 ']' 2024-04-26T18:29:23.478 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.87 2024-04-26T18:29:23.478 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.87 2024-04-26T18:29:23.478 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.87 2024-04-26T18:29:23.909 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at c51c8f9d80f 0.87 2024-04-26T18:29:23.910 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.87 2024-04-26T18:29:23.981 INFO:tasks.workunit.client.0.smithi139.stdout:v0.88 2024-04-26T18:29:23.981 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:23.982 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 88 -eq 48 ']' 2024-04-26T18:29:23.982 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.88 2024-04-26T18:29:23.982 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.88 2024-04-26T18:29:23.982 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.88 2024-04-26T18:29:27.897 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 24% (82/335) Updating files: 25% (84/335) Updating files: 26% (88/335) Updating files: 27% (91/335) Updating files: 28% (94/335) Updating files: 29% (98/335) Updating files: 30% (101/335) Updating files: 31% (104/335) Updating files: 32% (108/335) Updating files: 33% (111/335) Updating files: 34% (114/335) Updating files: 35% (118/335) Updating files: 36% (121/335) Updating files: 37% (124/335) Updating files: 38% (128/335) Updating files: 39% (131/335) Updating files: 40% (134/335) Updating files: 41% (138/335) Updating files: 42% (141/335) Updating files: 43% (145/335) Updating files: 43% (147/335) Updating files: 44% (148/335) Updating files: 45% (151/335) Updating files: 46% (155/335) Updating files: 47% (158/335) Updating files: 48% (161/335) Updating files: 49% (165/335) Updating files: 50% (168/335) Updating files: 51% (171/335) Updating files: 52% (175/335) Updating files: 52% (176/335) Updating files: 53% (178/335) Updating files: 54% (181/335) Updating files: 55% (185/335) Updating files: 56% (188/335) Updating files: 57% (191/335) Updating files: 58% (195/335) Updating files: 59% (198/335) Updating files: 60% (201/335) Updating files: 61% (205/335) Updating files: 62% (208/335) Updating files: 63% (212/335) Updating files: 64% (215/335) Updating files: 65% (218/335) Updating files: 66% (222/335) Updating files: 67% (225/335) Updating files: 68% (228/335) Updating files: 69% (232/335) Updating files: 70% (235/335) Updating files: 71% (238/335) Updating files: 72% (242/335) Updating files: 73% (245/335) Updating files: 74% (248/335) Updating files: 75% (252/335) Updating files: 76% (255/335) Updating files: 77% (258/335) Updating files: 78% (262/335) Updating files: 79% (265/335) Updating files: 80% (268/335) Updating files: 81% (272/335) Updating files: 82% (275/335) Updating files: 83% (279/335) Updating files: 84% (282/335) Updating files: 85% (285/335) Updating files: 86% (289/335) Updating files: 87% (292/335) Updating files: 88% (295/335) Updating files: 89% (299/335) Updating files: 90% (302/335) Updating files: 91% (305/335) Updating files: 92% (309/335) Updating files: 93% (312/335) Updating files: 94% (315/335) Updating files: 95% (319/335) Updating files: 96% (322/335) Updating files: 97% (325/335) Updating files: 98% (329/335) Updating files: 99% (332/335) Updating files: 100% (335/335) Updating files: 100% (335/335), done. 2024-04-26T18:29:28.555 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 4be687bf448 0.88 2024-04-26T18:29:28.558 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.88 2024-04-26T18:29:28.776 INFO:tasks.workunit.client.0.smithi139.stdout:v0.89 2024-04-26T18:29:28.776 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:28.776 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 89 -eq 48 ']' 2024-04-26T18:29:28.776 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.89 2024-04-26T18:29:28.776 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.89 2024-04-26T18:29:28.776 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.89 2024-04-26T18:29:32.230 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 37% (73/197) Updating files: 38% (75/197) Updating files: 39% (77/197) Updating files: 40% (79/197) Updating files: 41% (81/197) Updating files: 42% (83/197) Updating files: 43% (85/197) Updating files: 44% (87/197) Updating files: 45% (89/197) Updating files: 46% (91/197) Updating files: 47% (93/197) Updating files: 48% (95/197) Updating files: 49% (97/197) Updating files: 50% (99/197) Updating files: 51% (101/197) Updating files: 52% (103/197) Updating files: 53% (105/197) Updating files: 54% (107/197) Updating files: 55% (109/197) Updating files: 56% (111/197) Updating files: 57% (113/197) Updating files: 58% (115/197) Updating files: 59% (117/197) Updating files: 60% (119/197) Updating files: 61% (121/197) Updating files: 62% (123/197) Updating files: 63% (125/197) Updating files: 64% (127/197) Updating files: 65% (129/197) Updating files: 66% (131/197) Updating files: 67% (132/197) Updating files: 68% (134/197) Updating files: 69% (136/197) Updating files: 70% (138/197) Updating files: 71% (140/197) Updating files: 72% (142/197) Updating files: 73% (144/197) Updating files: 74% (146/197) Updating files: 75% (148/197) Updating files: 76% (150/197) Updating files: 77% (152/197) Updating files: 78% (154/197) Updating files: 79% (156/197) Updating files: 80% (158/197) Updating files: 81% (160/197) Updating files: 82% (162/197) Updating files: 82% (163/197) Updating files: 83% (164/197) Updating files: 84% (166/197) Updating files: 85% (168/197) Updating files: 86% (170/197) Updating files: 87% (172/197) Updating files: 88% (174/197) Updating files: 89% (176/197) Updating files: 90% (178/197) Updating files: 91% (180/197) Updating files: 92% (182/197) Updating files: 93% (184/197) Updating files: 94% (186/197) Updating files: 95% (188/197) Updating files: 96% (190/197) Updating files: 97% (192/197) Updating files: 98% (194/197) Updating files: 99% (196/197) Updating files: 100% (197/197) Updating files: 100% (197/197), done. 2024-04-26T18:29:32.280 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 68fdc0f68e6 0.89 2024-04-26T18:29:32.282 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.89 2024-04-26T18:29:32.308 INFO:tasks.workunit.client.0.smithi139.stdout:v0.90 2024-04-26T18:29:32.309 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:32.309 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 90 -eq 48 ']' 2024-04-26T18:29:32.309 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.90 2024-04-26T18:29:32.309 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo v0.90 2024-04-26T18:29:32.309 INFO:tasks.workunit.client.0.smithi139.stderr:+ git reset --hard v0.90 2024-04-26T18:29:32.361 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:29:32.364 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:29:46.838 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 40% (108/265) Updating files: 41% (109/265) Updating files: 42% (112/265) Updating files: 43% (114/265) Updating files: 44% (117/265) Updating files: 45% (120/265) Updating files: 46% (122/265) Updating files: 47% (125/265) Updating files: 48% (128/265) Updating files: 49% (130/265) Updating files: 50% (133/265) Updating files: 51% (136/265) Updating files: 52% (138/265) Updating files: 53% (141/265) Updating files: 54% (144/265) Updating files: 55% (146/265) Updating files: 56% (149/265) Updating files: 57% (152/265) Updating files: 58% (154/265) Updating files: 59% (157/265) Updating files: 60% (159/265) Updating files: 61% (162/265) Updating files: 62% (165/265) Updating files: 63% (167/265) Updating files: 64% (170/265) Updating files: 65% (173/265) Updating files: 66% (175/265) Updating files: 66% (177/265) Updating files: 67% (178/265) Updating files: 68% (181/265) Updating files: 69% (183/265) Updating files: 70% (186/265) Updating files: 71% (189/265) Updating files: 72% (191/265) Updating files: 73% (194/265) Updating files: 74% (197/265) Updating files: 75% (199/265) Updating files: 76% (202/265) Updating files: 77% (205/265) Updating files: 78% (207/265) Updating files: 79% (210/265) Updating files: 80% (212/265) Updating files: 81% (215/265) Updating files: 82% (218/265) Updating files: 83% (220/265) Updating files: 84% (223/265) Updating files: 85% (226/265) Updating files: 86% (228/265) Updating files: 87% (231/265) Updating files: 88% (234/265) Updating files: 89% (236/265) Updating files: 90% (239/265) Updating files: 91% (242/265) Updating files: 92% (244/265) Updating files: 93% (247/265) Updating files: 94% (250/265) Updating files: 95% (252/265) Updating files: 96% (255/265) Updating files: 97% (258/265) Updating files: 98% (260/265) Updating files: 99% (263/265) Updating files: 100% (265/265) Updating files: 100% (265/265), done. 2024-04-26T18:29:46.873 INFO:tasks.workunit.client.0.smithi139.stdout:HEAD is now at 08bd1e1eee3 0.90 2024-04-26T18:29:46.875 INFO:tasks.workunit.client.0.smithi139.stderr:+ mkdir .snap/v0.90 2024-04-26T18:29:47.524 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.1 2024-04-26T18:29:47.524 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:47.524 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 1 -eq 48 ']' 2024-04-26T18:29:47.524 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.1 2024-04-26T18:29:47.524 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.1 2024-04-26T18:29:47.524 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.1 2024-04-26T18:29:47.934 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:29:51.841 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:29:51.841 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:51.841 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.2 2024-04-26T18:29:51.842 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 2 -eq 48 ']' 2024-04-26T18:29:51.842 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.2 2024-04-26T18:29:51.842 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.2 2024-04-26T18:29:51.842 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.2 2024-04-26T18:29:51.842 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:29:55.514 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:29:55.514 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:55.514 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 3 -eq 48 ']' 2024-04-26T18:29:55.515 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.3 2024-04-26T18:29:55.515 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.3 2024-04-26T18:29:55.515 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.3 2024-04-26T18:29:55.515 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.3 2024-04-26T18:29:55.515 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:29:58.628 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:29:58.629 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:29:58.629 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 4 -eq 48 ']' 2024-04-26T18:29:58.629 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.4 2024-04-26T18:29:58.629 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.4 2024-04-26T18:29:58.629 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.4 2024-04-26T18:29:58.629 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.4 2024-04-26T18:29:59.253 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:02.079 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:02.079 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:02.080 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.5 2024-04-26T18:30:02.080 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 5 -eq 48 ']' 2024-04-26T18:30:02.080 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.5 2024-04-26T18:30:02.081 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.5 2024-04-26T18:30:02.081 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.5 2024-04-26T18:30:02.081 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:02.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:30:02.528 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:30:06.612 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:06.612 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:06.612 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 6 -eq 48 ']' 2024-04-26T18:30:06.613 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.6 2024-04-26T18:30:06.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.6 2024-04-26T18:30:06.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.6 2024-04-26T18:30:06.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.6 2024-04-26T18:30:06.613 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:08.782 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:08.782 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:08.782 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 7 -eq 48 ']' 2024-04-26T18:30:08.782 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.7 2024-04-26T18:30:08.782 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.7 2024-04-26T18:30:08.782 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.7 2024-04-26T18:30:08.783 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.7 2024-04-26T18:30:08.783 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:11.712 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:11.712 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:11.712 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.8 2024-04-26T18:30:11.713 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 8 -eq 48 ']' 2024-04-26T18:30:11.713 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.8 2024-04-26T18:30:11.713 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.8 2024-04-26T18:30:11.713 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.8 2024-04-26T18:30:11.713 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:15.342 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:15.342 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:15.342 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 9 -eq 48 ']' 2024-04-26T18:30:15.342 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.9 2024-04-26T18:30:15.343 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.9 2024-04-26T18:30:15.343 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.9 2024-04-26T18:30:15.343 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.9 2024-04-26T18:30:15.343 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:18.331 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:18.332 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:18.332 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 10 -eq 48 ']' 2024-04-26T18:30:18.332 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.10 2024-04-26T18:30:18.332 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.10 2024-04-26T18:30:18.332 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.10 2024-04-26T18:30:18.333 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.10 2024-04-26T18:30:18.333 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:21.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:21.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:21.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 11 -eq 48 ']' 2024-04-26T18:30:21.868 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.11 2024-04-26T18:30:21.868 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.11 2024-04-26T18:30:21.869 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.11 2024-04-26T18:30:21.869 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.11 2024-04-26T18:30:21.869 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:24.951 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:24.951 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:24.952 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 12 -eq 48 ']' 2024-04-26T18:30:24.952 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.12 2024-04-26T18:30:24.952 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.12 2024-04-26T18:30:24.952 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.12 2024-04-26T18:30:24.952 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.12 2024-04-26T18:30:24.952 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:27.633 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:27.633 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:27.633 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 13 -eq 48 ']' 2024-04-26T18:30:27.633 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.13 2024-04-26T18:30:27.633 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.13 2024-04-26T18:30:27.634 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.13 2024-04-26T18:30:27.634 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.13 2024-04-26T18:30:27.634 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:32.134 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:32.134 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:32.135 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 14 -eq 48 ']' 2024-04-26T18:30:32.135 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.14 2024-04-26T18:30:32.135 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.14 2024-04-26T18:30:32.135 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.14 2024-04-26T18:30:32.135 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.14 2024-04-26T18:30:32.136 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:32.788 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:30:32.791 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:30:32.820 INFO:tasks.ceph.mds.b.smithi143.stderr:2024-04-26T18:30:32.820+0000 7fcd15b93640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42045) UID: 0 2024-04-26T18:30:32.821 INFO:tasks.ceph.mds.d.smithi143.stderr:2024-04-26T18:30:32.820+0000 7f5c36f68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42045) UID: 0 2024-04-26T18:30:32.821 INFO:tasks.ceph.mds.f.smithi143.stderr:2024-04-26T18:30:32.820+0000 7f05e3086640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42045) UID: 0 2024-04-26T18:30:36.438 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:36.438 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:36.438 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 15 -eq 48 ']' 2024-04-26T18:30:36.438 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.15 2024-04-26T18:30:36.439 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.15 2024-04-26T18:30:36.439 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.15 2024-04-26T18:30:36.439 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.15 2024-04-26T18:30:36.439 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:42.000 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:42.000 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:42.001 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.16 2024-04-26T18:30:42.001 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 16 -eq 48 ']' 2024-04-26T18:30:42.001 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.16 2024-04-26T18:30:42.001 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.16 2024-04-26T18:30:42.001 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.16 2024-04-26T18:30:42.005 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:47.783 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:30:47.784 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.35 2024-04-26T18:30:47.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:30:47.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.899+0000 7fefcce69640 1 Processor -- start 2024-04-26T18:30:47.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.899+0000 7fefcce69640 1 -- start start 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefcce69640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fefc8155d00 0x7fefc8071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefcce69640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fefc80c9cf0 0x7fefc815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefcce69640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc806c310 0x7fefc806c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefcce69640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fefc815f140 con 0x7fefc80c9cf0 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefcce69640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fefc80722e0 con 0x7fefc8155d00 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefcce69640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fefc80725a0 con 0x7fefc806c310 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefbffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fefc80c9cf0 0x7fefc815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:47.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefbffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fefc80c9cf0 0x7fefc815bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53910/0 (socket says 172.21.15.139:53910) 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefc6d9d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc806c310 0x7fefc806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefbffff640 1 -- 172.21.15.139:0/2983887967 learned_addr learned my addr 172.21.15.139:0/2983887967 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.900+0000 7fefc659c640 1 --2- 172.21.15.139:0/2983887967 >> v2:172.21.15.143:3300/0 conn(0x7fefc8155d00 0x7fefc8071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.901+0000 7fefbffff640 1 -- 172.21.15.139:0/2983887967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc806c310 msgr2=0x7fefc806c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.901+0000 7fefbffff640 1 --2- 172.21.15.139:0/2983887967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc806c310 0x7fefc806c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.901+0000 7fefbffff640 1 -- 172.21.15.139:0/2983887967 >> v2:172.21.15.143:3300/0 conn(0x7fefc8155d00 msgr2=0x7fefc8071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.901+0000 7fefbffff640 1 --2- 172.21.15.139:0/2983887967 >> v2:172.21.15.143:3300/0 conn(0x7fefc8155d00 0x7fefc8071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.901+0000 7fefbffff640 1 -- 172.21.15.139:0/2983887967 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc815f3e0 con 0x7fefc80c9cf0 2024-04-26T18:30:47.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.901+0000 7fefbffff640 1 --2- 172.21.15.139:0/2983887967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc80c9cf0 0x7fefc815bb50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fefc80d0390 tx=0x7fefb002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d23e637cb4b042 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:47.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.902+0000 7fefc5d9b640 1 -- 172.21.15.139:0/2983887967 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0037070 con 0x7fefc80c9cf0 2024-04-26T18:30:47.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.902+0000 7fefc5d9b640 1 -- 172.21.15.139:0/2983887967 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0032440 con 0x7fefc80c9cf0 2024-04-26T18:30:47.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.902+0000 7fefc5d9b640 1 -- 172.21.15.139:0/2983887967 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0032810 con 0x7fefc80c9cf0 2024-04-26T18:30:47.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 -- 172.21.15.139:0/2983887967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc80c9cf0 msgr2=0x7fefc815bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 --2- 172.21.15.139:0/2983887967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc80c9cf0 0x7fefc815bb50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fefc80d0390 tx=0x7fefb002a1e0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 -- 172.21.15.139:0/2983887967 shutdown_connections 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 --2- 172.21.15.139:0/2983887967 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc806c310 0x7fefc806c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 --2- 172.21.15.139:0/2983887967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc80c9cf0 0x7fefc815bb50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 --2- 172.21.15.139:0/2983887967 >> v2:172.21.15.143:3300/0 conn(0x7fefc8155d00 0x7fefc8071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 -- 172.21.15.139:0/2983887967 >> 172.21.15.139:0/2983887967 conn(0x7fefc8076100 msgr2=0x7fefc8070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 -- 172.21.15.139:0/2983887967 shutdown_connections 2024-04-26T18:30:47.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.903+0000 7fefcce69640 1 -- 172.21.15.139:0/2983887967 wait complete. 2024-04-26T18:30:47.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.905+0000 7fefcce69640 1 Processor -- start 2024-04-26T18:30:47.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.905+0000 7fefcce69640 1 -- start start 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.905+0000 7fefcce69640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc806c310 0x7fefc8148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.905+0000 7fefcce69640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc80c9cf0 0x7fefc81e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefcce69640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc8155d00 0x7fefc8147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefcce69640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fefc815c090 con 0x7fefc806c310 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefcce69640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fefc80ca140 con 0x7fefc8155d00 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefcce69640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fefc815c210 con 0x7fefc80c9cf0 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc80c9cf0 0x7fefc81e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefc6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc8155d00 0x7fefc8147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefc659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc806c310 0x7fefc8148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc80c9cf0 0x7fefc81e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:37198/0 (socket says 172.21.15.139:37198) 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefc6d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc8155d00 0x7fefc8147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:33360/0 (socket says 172.21.15.139:33360) 2024-04-26T18:30:47.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 -- 172.21.15.139:0/783483298 learned_addr learned my addr 172.21.15.139:0/783483298 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 -- 172.21.15.139:0/783483298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc8155d00 msgr2=0x7fefc8147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc8155d00 0x7fefc8147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 -- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc806c310 msgr2=0x7fefc8148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc806c310 0x7fefc8148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 -- 172.21.15.139:0/783483298 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc81f2000 con 0x7fefc80c9cf0 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbffff640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc80c9cf0 0x7fefc81e66e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefb002a220 tx=0x7fefb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.906+0000 7fefbeffd640 1 -- 172.21.15.139:0/783483298 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0041020 con 0x7fefc80c9cf0 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.907+0000 7fefbeffd640 1 -- 172.21.15.139:0/783483298 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb003d620 con 0x7fefc80c9cf0 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.907+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc81e5ae0 con 0x7fefc80c9cf0 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.907+0000 7fefbeffd640 1 -- 172.21.15.139:0/783483298 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0037040 con 0x7fefc80c9cf0 2024-04-26T18:30:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.907+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc81f25a0 con 0x7fefc80c9cf0 2024-04-26T18:30:47.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.908+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc80c99e0 con 0x7fefc80c9cf0 2024-04-26T18:30:47.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.908+0000 7fefbeffd640 1 -- 172.21.15.139:0/783483298 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefb0044020 con 0x7fefc80c9cf0 2024-04-26T18:30:47.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.908+0000 7fefbeffd640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefa806c8f0 0x7fefa806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:47.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.909+0000 7fefbeffd640 1 -- 172.21.15.139:0/783483298 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fefb00ac4b0 con 0x7fefc80c9cf0 2024-04-26T18:30:47.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.909+0000 7fefc659c640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefa806c8f0 0x7fefa806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:47.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.909+0000 7fefc659c640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefa806c8f0 0x7fefa806edb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009a20 tx=0x7fefb8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:47.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:47.917+0000 7fefbeffd640 1 -- 172.21.15.139:0/783483298 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fefc80c99e0 con 0x7fefc80c9cf0 2024-04-26T18:30:48.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.129+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefc8076d20 con 0x7fefc80c9cf0 2024-04-26T18:30:48.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.129+0000 7fefbeffd640 1 -- 172.21.15.139:0/783483298 <== mon.2 v2:172.21.15.143:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fefb004b030 con 0x7fefc80c9cf0 2024-04-26T18:30:48.130 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:30:48.130 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:30:48.130 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefa806c8f0 msgr2=0x7fefa806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefa806c8f0 0x7fefa806edb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009a20 tx=0x7fefb8009190 comp rx=0 tx=0).stop 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc80c9cf0 msgr2=0x7fefc81e66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc80c9cf0 0x7fefc81e66e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefb002a220 tx=0x7fefb00046c0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 shutdown_connections 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fefa806c8f0 0x7fefa806edb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fefc8155d00 0x7fefc8147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fefc80c9cf0 0x7fefc81e66e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 --2- 172.21.15.139:0/783483298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefc806c310 0x7fefc8148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 >> 172.21.15.139:0/783483298 conn(0x7fefc8076100 msgr2=0x7fefc80cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:48.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 shutdown_connections 2024-04-26T18:30:48.133 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.131+0000 7fefcce69640 1 -- 172.21.15.139:0/783483298 wait complete. 2024-04-26T18:30:48.143 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 79.35 --await-for 42.0' 2024-04-26T18:30:48.143 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 79.35 --await-for 42.0 2024-04-26T18:30:48.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.263+0000 7f56f7bc1640 1 Processor -- start 2024-04-26T18:30:48.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.263+0000 7f56f7bc1640 1 -- start start 2024-04-26T18:30:48.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.264+0000 7f56f7bc1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56f00c6210 0x7f56f0071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.264+0000 7f56f7bc1640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f00ca490 con 0x7f56f0071ad0 2024-04-26T18:30:48.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.264+0000 7f56f7bc1640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f00cb8e0 con 0x7f56f00ca8c0 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.264+0000 7f56f7bc1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f56f00cbfa0 con 0x7f56f00c6210 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.264+0000 7f56f515c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f56f00c6210 0x7f56f0071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.264+0000 7f56f595d640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f56f0071ad0 0x7f56f00c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:44968/0 (socket says 172.21.15.139:44968) 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.264+0000 7f56f595d640 1 -- 172.21.15.139:0/7653475 learned_addr learned my addr 172.21.15.139:0/7653475 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.265+0000 7f56f515c640 1 -- 172.21.15.139:0/7653475 >> v1:172.21.15.143:6789/0 conn(0x7f56f00ca8c0 legacy=0x7f56f0164510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.265+0000 7f56f515c640 1 -- 172.21.15.139:0/7653475 >> v1:172.21.15.139:6789/0 conn(0x7f56f0071ad0 legacy=0x7f56f00c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.265+0000 7f56f515c640 1 -- 172.21.15.139:0/7653475 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f00cbba0 con 0x7f56f00c6210 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.265+0000 7f56f495b640 1 -- 172.21.15.139:0/7653475 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372508727 0 0) 0x7f56f00cb8e0 con 0x7f56f00ca8c0 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.265+0000 7f56f515c640 1 --2- 172.21.15.139:0/7653475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f0071eb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f56e00097a0 tx=0x7f56e002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86f7cf8fd30e910 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.265+0000 7f56f495b640 1 -- 172.21.15.139:0/7653475 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0037070 con 0x7f56f00c6210 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.265+0000 7f56f495b640 1 -- 172.21.15.139:0/7653475 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e002adc0 con 0x7f56f00c6210 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f495b640 1 -- 172.21.15.139:0/7653475 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0032660 con 0x7f56f00c6210 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f7bc1640 1 -- 172.21.15.139:0/7653475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 msgr2=0x7f56f0071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/7653475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f0071eb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f56e00097a0 tx=0x7f56e002a130 comp rx=0 tx=0).stop 2024-04-26T18:30:48.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f7bc1640 1 -- 172.21.15.139:0/7653475 shutdown_connections 2024-04-26T18:30:48.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/7653475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f0071eb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f7bc1640 1 -- 172.21.15.139:0/7653475 >> 172.21.15.139:0/7653475 conn(0x7f56f00746d0 msgr2=0x7f56f0076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:48.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f7bc1640 1 -- 172.21.15.139:0/7653475 shutdown_connections 2024-04-26T18:30:48.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.266+0000 7f56f7bc1640 1 -- 172.21.15.139:0/7653475 wait complete. 2024-04-26T18:30:48.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.267+0000 7f56f7bc1640 1 Processor -- start 2024-04-26T18:30:48.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.267+0000 7f56f7bc1640 1 -- start start 2024-04-26T18:30:48.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f7bc1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56f0071ad0 0x7f56f0149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f7bc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f7bc1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56f00ca8c0 0x7f56f0147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f7bc1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56f00cc7b0 con 0x7f56f00c6210 2024-04-26T18:30:48.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f7bc1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f56f00cc4d0 con 0x7f56f0071ad0 2024-04-26T18:30:48.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f7bc1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f56f00cb5a0 con 0x7f56f00ca8c0 2024-04-26T18:30:48.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f00cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53942/0 (socket says 172.21.15.139:53942) 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 -- 172.21.15.139:0/2001617943 learned_addr learned my addr 172.21.15.139:0/2001617943 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f615e640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56f00ca8c0 0x7f56f0147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f595d640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56f0071ad0 0x7f56f0149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 -- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56f00ca8c0 msgr2=0x7f56f0147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56f00ca8c0 0x7f56f0147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 -- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56f0071ad0 msgr2=0x7f56f0149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56f0071ad0 0x7f56f0149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 -- 172.21.15.139:0/2001617943 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f00b3310 con 0x7f56f00c6210 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f595d640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56f0071ad0 0x7f56f0149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.268+0000 7f56f515c640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f00cdb40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f56e0000c00 tx=0x7f56e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:48.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.269+0000 7f56e67fc640 1 -- 172.21.15.139:0/2001617943 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0037040 con 0x7f56f00c6210 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.269+0000 7f56e67fc640 1 -- 172.21.15.139:0/2001617943 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0004030 con 0x7f56f00c6210 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.269+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f014b300 con 0x7f56f00c6210 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.269+0000 7f56e67fc640 1 -- 172.21.15.139:0/2001617943 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0004220 con 0x7f56f00c6210 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.269+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f014c800 con 0x7f56f00c6210 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.270+0000 7f56e67fc640 1 -- 172.21.15.139:0/2001617943 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56e003a070 con 0x7f56f00c6210 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.271+0000 7f56e67fc640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f56d406c8f0 0x7f56d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.271+0000 7f56e67fc640 1 -- 172.21.15.139:0/2001617943 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f56e00ac460 con 0x7f56f00c6210 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.271+0000 7f56f595d640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f56d406c8f0 0x7f56d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.271+0000 7f56f595d640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f56d406c8f0 0x7f56d406edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0012e0 tx=0x7f56ec005b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 Processor -- start 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 -- start start 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b81460cd80 con 0x55b8146aab40 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b8145a8c20 con 0x55b8146a95e0 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.272+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b814608d40 con 0x55b8146e8ae0 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f615e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f595d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:37218/0 (socket says 172.21.15.139:37218) 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f615e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53948/0 (socket says 172.21.15.139:53948) 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 -- 172.21.15.139:0/54004112 learned_addr learned my addr 172.21.15.139:0/54004112 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:30:48.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f595d640 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146e85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:33378/0 (socket says 172.21.15.139:33378) 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 -- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 msgr2=0x55b8146e85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146e85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 -- 172.21.15.139:0/54004112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 msgr2=0x55b8146a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 -- 172.21.15.139:0/54004112 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8143ead80 con 0x55b8146e8ae0 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56f515c640 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a99c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f56e0076260 tx=0x7f56e0079e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd1b16bec67bc380 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56d37fe640 1 -- 172.21.15.139:0/54004112 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e004a070 con 0x55b8146e8ae0 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56d37fe640 1 -- 172.21.15.139:0/54004112 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0082930 con 0x55b8146e8ae0 2024-04-26T18:30:48.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.273+0000 7f56d37fe640 1 -- 172.21.15.139:0/54004112 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e00043c0 con 0x55b8146e8ae0 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 -- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 msgr2=0x55b8146a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a99c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f56e0076260 tx=0x7f56e0079e00 comp rx=0 tx=0).stop 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 -- 172.21.15.139:0/54004112 shutdown_connections 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a99c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/54004112 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 -- 172.21.15.139:0/54004112 >> 172.21.15.139:0/54004112 conn(0x55b814670740 msgr2=0x55b8146ed580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 -- 172.21.15.139:0/54004112 shutdown_connections 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 -- 172.21.15.139:0/54004112 wait complete. 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 -- start start 2024-04-26T18:30:48.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.274+0000 7f56fa9b4740 1 Processor -- start 2024-04-26T18:30:48.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146a95e0 0x55b8146e1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146e3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146e8ae0 0x55b8146d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b8146a7c20 con 0x55b8146aab40 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55b8145a6840 con 0x55b8146e8ae0 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55b8146ab170 con 0x55b8146a95e0 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56fa9b4740 10 client.0 _ll_register_callbacks cb 0x55b8145aa5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56f515c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56f595d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146a95e0 0x55b8146e1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56f595d640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146a95e0 0x55b8146e1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:37226/0 (socket says 172.21.15.139:37226) 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56f515c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146e3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53958/0 (socket says 172.21.15.139:53958) 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56f595d640 1 -- 172.21.15.139:0/4013952215 learned_addr learned my addr 172.21.15.139:0/4013952215 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:30:48.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.275+0000 7f56f615e640 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146e8ae0 0x55b8146d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56f515c640 1 -- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146a95e0 msgr2=0x55b8146e1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56f515c640 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146a95e0 0x55b8146e1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56f515c640 1 -- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146e8ae0 msgr2=0x55b8146d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56f515c640 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146e8ae0 0x55b8146d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56f515c640 1 -- 172.21.15.139:0/4013952215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81444b510 con 0x55b8146aab40 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56f595d640 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146a95e0 0x55b8146e1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56f515c640 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146e3710 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f56e002a720 tx=0x7f56e0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378e754a7533c352 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56d0ff9640 1 -- 172.21.15.139:0/4013952215 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e00aa260 con 0x55b8146aab40 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56d0ff9640 1 -- 172.21.15.139:0/4013952215 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f56e00043c0 con 0x55b8146aab40 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e0082930 con 0x55b8146aab40 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56d0ff9640 1 -- 172.21.15.139:0/4013952215 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f56e0076470 con 0x55b8146aab40 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 10 client.6159 fetch_fsmap learned FSMap version 9 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b8142de670 con 0x55b8146aab40 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56d0ff9640 1 -- 172.21.15.139:0/4013952215 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0082930 con 0x55b8146aab40 2024-04-26T18:30:48.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56d0ff9640 1 -- 172.21.15.139:0/4013952215 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f56e00991a0 con 0x55b8146aab40 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 10 client.6159 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 10 client.6159 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 20 client.6159 populate_metadata read hostname 'smithi139' 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146d14e0 0x55b8146fd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 4 client.6159 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.276+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b81461a990 con 0x55b8146d14e0 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.277+0000 7f56f595d640 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146d14e0 0x55b8146fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.277+0000 7f56d0ff9640 10 client.6159 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.277+0000 7f56f595d640 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146d14e0 0x55b8146fd4d0 crc :-1 s=READY pgs=718 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8edf4d8995080c server_cookie=c5f7088c22cb7805 in_seq=0 out_seq=0 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.277+0000 7f56d0ff9640 1 -- 172.21.15.139:0/4013952215 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b81461a990 con 0x55b8146d14e0 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.277+0000 7f56d0ff9640 10 client.6159 handle_command_reply: tid=0 2024-04-26T18:30:48.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 client.6159 shutdown 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 msgr2=0x55b8146e3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146e3710 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f56e002a720 tx=0x7f56e0009190 comp rx=0 tx=0).stop 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 shutdown_connections 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146e8ae0 0x55b8146d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146e3710 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146d14e0 0x55b8146fd4d0 crc :-1 s=READY pgs=718 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/4013952215 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146a95e0 0x55b8146e1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56d0ff9640 0 client.6159 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 >> 172.21.15.139:0/4013952215 conn(0x55b814670740 msgr2=0x55b8146ed9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 shutdown_connections 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 1 -- 172.21.15.139:0/4013952215 wait complete. 2024-04-26T18:30:48.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.278+0000 7f56fa9b4740 20 client.6159 trim_cache size 0 max 16384 2024-04-26T18:30:48.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.295+0000 7f56fa9b4740 1 Processor -- start 2024-04-26T18:30:48.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.295+0000 7f56fa9b4740 1 -- start start 2024-04-26T18:30:48.297 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146a7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56f01fe610 con 0x55b8146aab40 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f56f01fd4f0 con 0x55b8146a95e0 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f56f0141190 con 0x55b8146e8ae0 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53964/0 (socket says 172.21.15.139:53964) 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 -- 172.21.15.139:0/1500015081 learned_addr learned my addr 172.21.15.139:0/1500015081 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f595d640 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f615e640 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.298 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 -- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 msgr2=0x55b8146a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 -- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 msgr2=0x55b8146a7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146a7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 -- 172.21.15.139:0/1500015081 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8146e3430 con 0x55b8146aab40 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56f515c640 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a2ba0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f56e0076260 tx=0x7f56e00a4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51d11415a3e9a77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56d2ffd640 1 -- 172.21.15.139:0/1500015081 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e00043c0 con 0x55b8146aab40 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56d2ffd640 1 -- 172.21.15.139:0/1500015081 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e00991a0 con 0x55b8146aab40 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.296+0000 7f56d2ffd640 1 -- 172.21.15.139:0/1500015081 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e00aa280 con 0x55b8146aab40 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 -- 172.21.15.139:0/1500015081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 msgr2=0x55b8146a2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a2ba0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f56e0076260 tx=0x7f56e00a4000 comp rx=0 tx=0).stop 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 -- 172.21.15.139:0/1500015081 shutdown_connections 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146e8ae0 0x55b8146a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146aab40 0x55b8146a2ba0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/1500015081 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b8146a7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 -- 172.21.15.139:0/1500015081 >> 172.21.15.139:0/1500015081 conn(0x55b814670740 msgr2=0x55b81470de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:48.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 -- 172.21.15.139:0/1500015081 shutdown_connections 2024-04-26T18:30:48.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 -- 172.21.15.139:0/1500015081 wait complete. 2024-04-26T18:30:48.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.297+0000 7f56fa9b4740 1 -- start start 2024-04-26T18:30:48.300 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 1 Processor -- start 2024-04-26T18:30:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b81475d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146aab40 0x55b81470cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146e8ae0 0x55b8146e2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56f01fc1e0 con 0x55b8146e8ae0 2024-04-26T18:30:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f56f01fce20 con 0x55b8146a95e0 2024-04-26T18:30:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f56f01fc750 con 0x55b8146aab40 2024-04-26T18:30:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56fa9b4740 10 client.0 _ll_register_callbacks cb 0x7f56e007c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.298+0000 7f56f615e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146e8ae0 0x55b8146e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146e8ae0 0x55b8146e2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:53980/0 (socket says 172.21.15.139:53980) 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 -- 172.21.15.139:0/3813857873 learned_addr learned my addr 172.21.15.139:0/3813857873 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f595d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b81475d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f515c640 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146aab40 0x55b81470cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 -- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146aab40 msgr2=0x55b81470cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146aab40 0x55b81470cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 -- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 msgr2=0x55b81475d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b81475d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 -- 172.21.15.139:0/3813857873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8146d44e0 con 0x55b8146e8ae0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56f615e640 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146e8ae0 0x55b8146e2140 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55b8146e9930 tx=0x7f56e8016900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf4304ec94f24a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56d0ff9640 1 -- 172.21.15.139:0/3813857873 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e80050d0 con 0x55b8146e8ae0 2024-04-26T18:30:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56d0ff9640 1 -- 172.21.15.139:0/3813857873 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f56e801cd50 con 0x55b8146e8ae0 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e00991a0 con 0x55b8146e8ae0 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56d0ff9640 1 -- 172.21.15.139:0/3813857873 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f56e8005270 con 0x55b8146e8ae0 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 10 client.6165 fetch_fsmap learned FSMap version 9 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b8146d1180 con 0x55b8146e8ae0 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56d0ff9640 1 -- 172.21.15.139:0/3813857873 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e00991a0 con 0x55b8146e8ae0 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56d0ff9640 1 -- 172.21.15.139:0/3813857873 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f56e8029070 con 0x55b8146e8ae0 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 10 client.6165 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 10 client.6165 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 20 client.6165 populate_metadata read hostname 'smithi139' 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146e2680 0x55b8146cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 4 client.6165 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.35, "await_for": 42.0}] 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.299+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.35, "await_for": 42.0}) -- 0x55b814614800 con 0x55b8146e2680 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.300+0000 7f56f595d640 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146e2680 0x55b8146cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:30:48.305 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.300+0000 7f56d0ff9640 10 client.6165 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:30:48.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:48.300+0000 7f56f595d640 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146e2680 0x55b8146cfbb0 crc :-1 s=READY pgs=719 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21317871e8ef8aa7 server_cookie=dd6407d1aeee2c49 in_seq=0 out_seq=0 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.569+0000 7f56d0ff9640 1 -- 172.21.15.139:0/3813857873 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55b814614800 con 0x55b8146e2680 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.569+0000 7f56d0ff9640 10 client.6165 handle_command_reply: tid=0 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.569+0000 7f56fa9b4740 1 client.6165 shutdown 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146e8ae0 msgr2=0x55b8146e2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146e8ae0 0x55b8146e2140 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55b8146e9930 tx=0x7f56e8016900 comp rx=0 tx=0).stop 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 shutdown_connections 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b8146e8ae0 0x55b8146e2140 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55b8146e2680 0x55b8146cfbb0 crc :-1 s=READY pgs=719 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55b8146aab40 0x55b81470cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 --2- 172.21.15.139:0/3813857873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8146a95e0 0x55b81475d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56d0ff9640 0 client.6165 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 >> 172.21.15.139:0/3813857873 conn(0x55b814670740 msgr2=0x55b8146e77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 shutdown_connections 2024-04-26T18:30:50.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 1 -- 172.21.15.139:0/3813857873 wait complete. 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.570+0000 7f56fa9b4740 20 client.6165 trim_cache size 0 max 16384 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 106, 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "664dbabb": { 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 106, 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:30:50.572 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.3, 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:30:50.573 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:30:50.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f56d406c8f0 msgr2=0x7f56d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:50.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f56d406c8f0 0x7f56d406edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0012e0 tx=0x7f56ec005b90 comp rx=0 tx=0).stop 2024-04-26T18:30:50.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 msgr2=0x7f56f00cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f00cdb40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f56e0000c00 tx=0x7f56e00046c0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 shutdown_connections 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f56d406c8f0 0x7f56d406edb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f56f00ca8c0 0x7f56f0147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56f00c6210 0x7f56f00cdb40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 --2- 172.21.15.139:0/2001617943 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f56f0071ad0 0x7f56f0149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 >> 172.21.15.139:0/2001617943 conn(0x7f56f00746d0 msgr2=0x7f56f01e5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 shutdown_connections 2024-04-26T18:30:50.575 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:30:50.571+0000 7f56f7bc1640 1 -- 172.21.15.139:0/2001617943 wait complete. 2024-04-26T18:30:50.588 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '664dbabb', quiesce took 2.8 seconds. Will release after: 19.35 2024-04-26T18:30:50.628 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:50.630 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:50.630 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 17 -eq 48 ']' 2024-04-26T18:30:50.630 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.17 2024-04-26T18:30:50.630 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.17 2024-04-26T18:30:50.630 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.17 2024-04-26T18:30:50.631 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.17 2024-04-26T18:30:50.631 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:54.006 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:54.007 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:54.007 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 18 -eq 48 ']' 2024-04-26T18:30:54.007 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.18 2024-04-26T18:30:54.007 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.18 2024-04-26T18:30:54.007 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.18 2024-04-26T18:30:54.008 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.18 2024-04-26T18:30:54.008 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:30:59.228 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:30:59.229 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:30:59.229 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 19 -eq 48 ']' 2024-04-26T18:30:59.229 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.19 2024-04-26T18:30:59.229 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.19 2024-04-26T18:30:59.230 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.19 2024-04-26T18:30:59.230 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.19 2024-04-26T18:30:59.230 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:03.587 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:03.588 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:03.588 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.20 2024-04-26T18:31:03.588 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 20 -eq 48 ']' 2024-04-26T18:31:03.588 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.20 2024-04-26T18:31:03.588 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.20 2024-04-26T18:31:03.589 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.20 2024-04-26T18:31:03.589 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:06.571 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:06.571 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:06.571 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 21 -eq 48 ']' 2024-04-26T18:31:06.571 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.21 2024-04-26T18:31:06.572 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.21 2024-04-26T18:31:06.572 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.21 2024-04-26T18:31:06.572 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.21 2024-04-26T18:31:06.572 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:09.575 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:09.575 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:09.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 22 -eq 48 ']' 2024-04-26T18:31:09.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.22 2024-04-26T18:31:09.576 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.22 2024-04-26T18:31:09.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.22 2024-04-26T18:31:09.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.22 2024-04-26T18:31:09.576 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:09.939 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:31:10.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.046+0000 7fab7fdaf640 1 Processor -- start 2024-04-26T18:31:10.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.046+0000 7fab7fdaf640 1 -- start start 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7fdaf640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fab7806e240 0x7fab780c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7fdaf640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fab7815ce60 0x7fab7815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7fdaf640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7815d830 con 0x7fab78153b10 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7fdaf640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fab7806e8d0 con 0x7fab7806e240 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7fdaf640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fab78073910 con 0x7fab7815ce60 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7d34a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fab7806e240 0x7fab780c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7db4b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fab78153b10 0x7fab780cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:44976/0 (socket says 172.21.15.139:44976) 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7db4b640 1 -- 172.21.15.139:0/688385038 learned_addr learned my addr 172.21.15.139:0/688385038 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7e34c640 1 --2- 172.21.15.139:0/688385038 >> v2:172.21.15.143:3300/0 conn(0x7fab7815ce60 0x7fab7815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7d34a640 1 -- 172.21.15.139:0/688385038 >> v2:172.21.15.143:3300/0 conn(0x7fab7815ce60 msgr2=0x7fab7815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7d34a640 1 --2- 172.21.15.139:0/688385038 >> v2:172.21.15.143:3300/0 conn(0x7fab7815ce60 0x7fab7815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7d34a640 1 -- 172.21.15.139:0/688385038 >> v1:172.21.15.139:6789/0 conn(0x7fab78153b10 legacy=0x7fab780cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7d34a640 1 -- 172.21.15.139:0/688385038 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab780c7d30 con 0x7fab7806e240 2024-04-26T18:31:10.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.047+0000 7fab7cb49640 1 -- 172.21.15.139:0/688385038 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242563289 0 0) 0x7fab7815d830 con 0x7fab78153b10 2024-04-26T18:31:10.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.048+0000 7fab7d34a640 1 --2- 172.21.15.139:0/688385038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab780c96d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fab78072640 tx=0x7fab6802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699a66e10948949b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.048+0000 7fab7cb49640 1 -- 172.21.15.139:0/688385038 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68037070 con 0x7fab7806e240 2024-04-26T18:31:10.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.048+0000 7fab7cb49640 1 -- 172.21.15.139:0/688385038 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68032440 con 0x7fab7806e240 2024-04-26T18:31:10.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.048+0000 7fab7cb49640 1 -- 172.21.15.139:0/688385038 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68032810 con 0x7fab7806e240 2024-04-26T18:31:10.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 -- 172.21.15.139:0/688385038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 msgr2=0x7fab780c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/688385038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab780c96d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fab78072640 tx=0x7fab6802a230 comp rx=0 tx=0).stop 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 -- 172.21.15.139:0/688385038 shutdown_connections 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/688385038 >> v2:172.21.15.143:3300/0 conn(0x7fab7815ce60 0x7fab7815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/688385038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab780c96d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 -- 172.21.15.139:0/688385038 >> 172.21.15.139:0/688385038 conn(0x7fab78068270 msgr2=0x7fab78068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 -- 172.21.15.139:0/688385038 shutdown_connections 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.049+0000 7fab7fdaf640 1 -- 172.21.15.139:0/688385038 wait complete. 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.050+0000 7fab7fdaf640 1 Processor -- start 2024-04-26T18:31:10.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.050+0000 7fab7fdaf640 1 -- start start 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7fdaf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab7813d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7fdaf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab78153b10 0x7fab7814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7fdaf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab7815ce60 0x7fab781f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7fdaf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fab780732c0 con 0x7fab7806e240 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7fdaf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fab78072fe0 con 0x7fab78153b10 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7fdaf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fab780735a0 con 0x7fab7815ce60 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab7813d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab7813d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40720/0 (socket says 172.21.15.139:40720) 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 -- 172.21.15.139:0/3600524500 learned_addr learned my addr 172.21.15.139:0/3600524500 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7d34a640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab78153b10 0x7fab7814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7e34c640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab7815ce60 0x7fab781f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 -- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab7815ce60 msgr2=0x7fab781f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab7815ce60 0x7fab781f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 -- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab78153b10 msgr2=0x7fab7814f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab78153b10 0x7fab7814f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 -- 172.21.15.139:0/3600524500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7813f780 con 0x7fab7806e240 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7d34a640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab78153b10 0x7fab7814f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7e34c640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab7815ce60 0x7fab781f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.051+0000 7fab7db4b640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab7813d0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c4d0 tx=0x7fab7400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.052+0000 7fab6e7fc640 1 -- 172.21.15.139:0/3600524500 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74018070 con 0x7fab7806e240 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.052+0000 7fab6e7fc640 1 -- 172.21.15.139:0/3600524500 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74007500 con 0x7fab7806e240 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.052+0000 7fab6e7fc640 1 -- 172.21.15.139:0/3600524500 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74004a20 con 0x7fab7806e240 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.052+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab780cbad0 con 0x7fab7806e240 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.052+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab781f53d0 con 0x7fab7806e240 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.053+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab78076d20 con 0x7fab7806e240 2024-04-26T18:31:10.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.053+0000 7fab6e7fc640 1 -- 172.21.15.139:0/3600524500 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab7401b070 con 0x7fab7806e240 2024-04-26T18:31:10.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.053+0000 7fab6e7fc640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab5c06c920 0x7fab5c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.054+0000 7fab7d34a640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab5c06c920 0x7fab5c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.054+0000 7fab6e7fc640 1 -- 172.21.15.139:0/3600524500 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fab7408b240 con 0x7fab7806e240 2024-04-26T18:31:10.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.054+0000 7fab7d34a640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab5c06c920 0x7fab5c06ede0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab68034000 tx=0x7fab6802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.058+0000 7fab6e7fc640 1 -- 172.21.15.139:0/3600524500 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab74058be0 con 0x7fab7806e240 2024-04-26T18:31:10.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.282+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab7806eab0 con 0x7fab7806e240 2024-04-26T18:31:10.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.283+0000 7fab6e7fc640 1 -- 172.21.15.139:0/3600524500 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fab7405cee0 con 0x7fab7806e240 2024-04-26T18:31:10.283 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:10.283 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:31:10.284 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:31:10.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab5c06c920 msgr2=0x7fab5c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab5c06c920 0x7fab5c06ede0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab68034000 tx=0x7fab6802e000 comp rx=0 tx=0).stop 2024-04-26T18:31:10.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 msgr2=0x7fab7813d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab7813d0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c4d0 tx=0x7fab7400c990 comp rx=0 tx=0).stop 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 shutdown_connections 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fab5c06c920 0x7fab5c06ede0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fab7815ce60 0x7fab781f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fab78153b10 0x7fab7814f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 --2- 172.21.15.139:0/3600524500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab7806e240 0x7fab7813d0c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 >> 172.21.15.139:0/3600524500 conn(0x7fab78068270 msgr2=0x7fab780720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 shutdown_connections 2024-04-26T18:31:10.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.285+0000 7fab7fdaf640 1 -- 172.21.15.139:0/3600524500 wait complete. 2024-04-26T18:31:10.296 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 664dbabb --release --await' 2024-04-26T18:31:10.297 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 664dbabb --release --await 2024-04-26T18:31:10.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc460e2a640 1 Processor -- start 2024-04-26T18:31:10.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc460e2a640 1 -- start start 2024-04-26T18:31:10.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc460e2a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc45c15d730 0x7fc45c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc460e2a640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc45c159a30 con 0x7fc45c1504b0 2024-04-26T18:31:10.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc460e2a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc45c0ce2f0 con 0x7fc45c0c6520 2024-04-26T18:31:10.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc460e2a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc45c159cf0 con 0x7fc45c15d730 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc45a59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc45c1504b0 0x7fc45c0c8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:44986/0 (socket says 172.21.15.139:44986) 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.400+0000 7fc45a59c640 1 -- 172.21.15.139:0/1441530126 learned_addr learned my addr 172.21.15.139:0/1441530126 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.401+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/1441530126 >> v2:172.21.15.143:3300/0 conn(0x7fc45c15d730 0x7fc45c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.401+0000 7fc459d9b640 1 -- 172.21.15.139:0/1441530126 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416430242 0 0) 0x7fc45c159a30 con 0x7fc45c1504b0 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.401+0000 7fc459d9b640 1 -- 172.21.15.139:0/1441530126 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc448003520 con 0x7fc45c1504b0 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.401+0000 7fc45ad9d640 1 -- 172.21.15.139:0/1441530126 >> v1:172.21.15.143:6789/0 conn(0x7fc45c0c6520 legacy=0x7fc45c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.401+0000 7fc45ad9d640 1 -- 172.21.15.139:0/1441530126 >> v1:172.21.15.139:6789/0 conn(0x7fc45c1504b0 legacy=0x7fc45c0c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.401+0000 7fc45ad9d640 1 -- 172.21.15.139:0/1441530126 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45c159fd0 con 0x7fc45c15d730 2024-04-26T18:31:10.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/1441530126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c15d730 0x7fc45c0cdbb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc454009d90 tx=0x7fc45402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b532242c8904016a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc459d9b640 1 -- 172.21.15.139:0/1441530126 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454007740 con 0x7fc45c15d730 2024-04-26T18:31:10.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc459d9b640 1 -- 172.21.15.139:0/1441530126 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4540078e0 con 0x7fc45c15d730 2024-04-26T18:31:10.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc459d9b640 1 -- 172.21.15.139:0/1441530126 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454007cb0 con 0x7fc45c15d730 2024-04-26T18:31:10.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc460e2a640 1 -- 172.21.15.139:0/1441530126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c15d730 msgr2=0x7fc45c0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1441530126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c15d730 0x7fc45c0cdbb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc454009d90 tx=0x7fc45402a660 comp rx=0 tx=0).stop 2024-04-26T18:31:10.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc460e2a640 1 -- 172.21.15.139:0/1441530126 shutdown_connections 2024-04-26T18:31:10.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1441530126 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c15d730 0x7fc45c0cdbb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc460e2a640 1 -- 172.21.15.139:0/1441530126 >> 172.21.15.139:0/1441530126 conn(0x7fc45c06e500 msgr2=0x7fc45c06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc460e2a640 1 -- 172.21.15.139:0/1441530126 shutdown_connections 2024-04-26T18:31:10.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.402+0000 7fc460e2a640 1 -- 172.21.15.139:0/1441530126 wait complete. 2024-04-26T18:31:10.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 Processor -- start 2024-04-26T18:31:10.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 -- start start 2024-04-26T18:31:10.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c0c6520 0x7fc45c15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc45c1504b0 0x7fc45c15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc45c15d730 0x7fc45c151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c0c6950 con 0x7fc45c15d730 2024-04-26T18:31:10.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c15a590 con 0x7fc45c0c6520 2024-04-26T18:31:10.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc460e2a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc45c150890 con 0x7fc45c1504b0 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.404+0000 7fc45ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc45c15d730 0x7fc45c151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc453fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc45c1504b0 0x7fc45c15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45a59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c0c6520 0x7fc45c15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc45c15d730 0x7fc45c151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40726/0 (socket says 172.21.15.139:40726) 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 -- 172.21.15.139:0/1142569191 learned_addr learned my addr 172.21.15.139:0/1142569191 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 -- 172.21.15.139:0/1142569191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc45c1504b0 msgr2=0x7fc45c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc45c1504b0 0x7fc45c15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 -- 172.21.15.139:0/1142569191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c0c6520 msgr2=0x7fc45c15b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c0c6520 0x7fc45c15b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 -- 172.21.15.139:0/1142569191 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45c1f2430 con 0x7fc45c15d730 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45a59c640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c0c6520 0x7fc45c15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc45c15d730 0x7fc45c151ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc454009d90 tx=0x7fc454004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc452ffd640 1 -- 172.21.15.139:0/1142569191 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45403f070 con 0x7fc45c15d730 2024-04-26T18:31:10.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc452ffd640 1 -- 172.21.15.139:0/1142569191 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc454031c40 con 0x7fc45c15d730 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc452ffd640 1 -- 172.21.15.139:0/1142569191 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454009450 con 0x7fc45c15d730 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45c1f26d0 con 0x7fc45c15d730 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.405+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc45c15b120 con 0x7fc45c15d730 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.407+0000 7fc452ffd640 1 -- 172.21.15.139:0/1142569191 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc454003990 con 0x7fc45c15d730 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.407+0000 7fc452ffd640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc43c06c8f0 0x7fc43c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.407+0000 7fc45a59c640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc43c06c8f0 0x7fc43c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.407+0000 7fc452ffd640 1 -- 172.21.15.139:0/1142569191 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc4540acc90 con 0x7fc45c15d730 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.408+0000 7fc45a59c640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc43c06c8f0 0x7fc43c06edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0011e0 tx=0x7fc44c007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.408+0000 7fc463c29740 1 Processor -- start 2024-04-26T18:31:10.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.408+0000 7fc463c29740 1 -- start start 2024-04-26T18:31:10.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448498470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc463c29740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e448459890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e448459dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc463c29740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e4483be040 con 0x55e4484989b0 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e448359b60 con 0x55e44845aa10 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e4483ba000 con 0x55e4484594b0 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448498470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448498470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:51800/0 (socket says 172.21.15.139:51800) 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc453fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e448459890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 -- 172.21.15.139:0/1495719287 learned_addr learned my addr 172.21.15.139:0/1495719287 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e448459dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 -- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 msgr2=0x55e448459dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e448459dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 -- 172.21.15.139:0/1495719287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 msgr2=0x55e448459890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e448459890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc45a59c640 1 -- 172.21.15.139:0/1495719287 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44834e9c0 con 0x55e4484594b0 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.409+0000 7fc453fff640 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e448459890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc45a59c640 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448498470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007610 tx=0x7fc44c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e50a043e5537d2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc43bfff640 1 -- 172.21.15.139:0/1495719287 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c025070 con 0x55e4484594b0 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc43bfff640 1 -- 172.21.15.139:0/1495719287 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c01b050 con 0x55e4484594b0 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc43bfff640 1 -- 172.21.15.139:0/1495719287 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c020610 con 0x55e4484594b0 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 -- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 msgr2=0x55e448498470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448498470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007610 tx=0x7fc44c012000 comp rx=0 tx=0).stop 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 -- 172.21.15.139:0/1495719287 shutdown_connections 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e448459dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e448459890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 --2- 172.21.15.139:0/1495719287 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448498470 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 -- 172.21.15.139:0/1495719287 >> 172.21.15.139:0/1495719287 conn(0x55e448420930 msgr2=0x55e44849d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.410+0000 7fc463c29740 1 -- 172.21.15.139:0/1495719287 shutdown_connections 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.411+0000 7fc463c29740 1 -- 172.21.15.139:0/1495719287 wait complete. 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.411+0000 7fc463c29740 1 -- start start 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.411+0000 7fc463c29740 1 Processor -- start 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc463c29740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e448496340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e448480290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc463c29740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e448457af0 con 0x55e44845aa10 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55e4483574f0 con 0x55e4484989b0 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55e44845b040 con 0x55e4484594b0 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc463c29740 10 client.0 _ll_register_callbacks cb 0x55e4483b4c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc453fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e448496340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:51810/0 (socket says 172.21.15.139:51810) 2024-04-26T18:31:10.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc453fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e448496340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40736/0 (socket says 172.21.15.139:40736) 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 -- 172.21.15.139:0/404770314 learned_addr learned my addr 172.21.15.139:0/404770314 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e448480290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 -- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 msgr2=0x55e448480290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e448480290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 -- 172.21.15.139:0/404770314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 msgr2=0x55e448496340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e448496340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45a59c640 1 -- 172.21.15.139:0/404770314 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55e4480cf920 con 0x55e4484594b0 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc453fff640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e448496340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.412+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e448480290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc45a59c640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484ad2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc44c014cb0 tx=0x7fc44c000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a505cee9acb41dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc4397fa640 10 client.0 ms_handle_connect on v2:172.21.15.143:3301/0 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc4397fa640 1 -- 172.21.15.139:0/404770314 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c025070 con 0x55e4484594b0 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc44c01b050 con 0x55e4484594b0 2024-04-26T18:31:10.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc4397fa640 1 -- 172.21.15.139:0/404770314 <== mon.2 v2:172.21.15.143:3301/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc44c020dd0 con 0x55e4484594b0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc4397fa640 1 -- 172.21.15.139:0/404770314 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc44c038050 con 0x55e4484594b0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 10 client.5486 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e44819bd30 con 0x55e4484594b0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc4397fa640 1 -- 172.21.15.139:0/404770314 <== mon.2 v2:172.21.15.143:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c01b050 con 0x55e4484594b0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc4397fa640 1 -- 172.21.15.139:0/404770314 <== mon.2 v2:172.21.15.143:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc44c03b020 con 0x55e4484594b0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 10 client.5486 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 10 client.5486 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 20 client.5486 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484807d0 0x55e4484a9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 4 client.5486 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e448391a00 con 0x55e4484807d0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.413+0000 7fc453fff640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484807d0 0x55e4484a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.414+0000 7fc453fff640 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484807d0 0x55e4484a9960 crc :-1 s=READY pgs=720 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9fbdd80852a8aca server_cookie=c108cf144e866e46 in_seq=0 out_seq=0 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.414+0000 7fc4397fa640 10 client.5486 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:10.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.414+0000 7fc4397fa640 1 -- 172.21.15.139:0/404770314 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e448391a00 con 0x55e4484807d0 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.414+0000 7fc4397fa640 10 client.5486 handle_command_reply: tid=0 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.414+0000 7fc463c29740 1 client.5486 shutdown 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.414+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 msgr2=0x55e4484ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484ad2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc44c014cb0 tx=0x7fc44c000ed0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 shutdown_connections 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e448480290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e448496340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484807d0 0x55e4484a9960 crc :-1 s=READY pgs=720 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 --2- 172.21.15.139:0/404770314 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484ad2d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc4397fa640 0 client.5486 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 >> 172.21.15.139:0/404770314 conn(0x55e448420930 msgr2=0x55e4484829d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 shutdown_connections 2024-04-26T18:31:10.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 1 -- 172.21.15.139:0/404770314 wait complete. 2024-04-26T18:31:10.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.415+0000 7fc463c29740 20 client.5486 trim_cache size 0 max 16384 2024-04-26T18:31:10.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 Processor -- start 2024-04-26T18:31:10.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 -- start start 2024-04-26T18:31:10.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448459a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e4484bd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e4484bda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c2006e0 con 0x55e4484989b0 2024-04-26T18:31:10.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c1ff5c0 con 0x55e44845aa10 2024-04-26T18:31:10.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc45c1f5cb0 con 0x55e4484594b0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.432+0000 7fc45ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e4484bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e4484bda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40752/0 (socket says 172.21.15.139:40752) 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 -- 172.21.15.139:0/2128849588 learned_addr learned my addr 172.21.15.139:0/2128849588 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45a59c640 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448459a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc453fff640 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e4484bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 -- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 msgr2=0x55e448459a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448459a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 -- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 msgr2=0x55e4484bd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e4484bd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 -- 172.21.15.139:0/2128849588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e448497c10 con 0x55e4484989b0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e4484bda80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc45407a5b0 tx=0x7fc454009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c972d8e680340541 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc43b7fe640 1 -- 172.21.15.139:0/2128849588 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4540a9070 con 0x55e4484989b0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc43b7fe640 1 -- 172.21.15.139:0/2128849588 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4540aadf0 con 0x55e4484989b0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.433+0000 7fc43b7fe640 1 -- 172.21.15.139:0/2128849588 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc454048040 con 0x55e4484989b0 2024-04-26T18:31:10.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 -- 172.21.15.139:0/2128849588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 msgr2=0x55e4484bda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e4484bda80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc45407a5b0 tx=0x7fc454009b70 comp rx=0 tx=0).stop 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 -- 172.21.15.139:0/2128849588 shutdown_connections 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e4484989b0 0x55e4484bda80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e44845aa10 0x55e4484bd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 --2- 172.21.15.139:0/2128849588 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e448459a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 -- 172.21.15.139:0/2128849588 >> 172.21.15.139:0/2128849588 conn(0x55e448420930 msgr2=0x55e448496320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 -- 172.21.15.139:0/2128849588 shutdown_connections 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 -- 172.21.15.139:0/2128849588 wait complete. 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 -- start start 2024-04-26T18:31:10.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.434+0000 7fc463c29740 1 Processor -- start 2024-04-26T18:31:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc463c29740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e4484bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc463c29740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e4484bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc463c29740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c1fe150 con 0x55e44845aa10 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c1feef0 con 0x55e4484989b0 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc463c29740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc45c1fe820 con 0x55e4484594b0 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc463c29740 10 client.0 _ll_register_callbacks cb 0x7fc44c023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e4484bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc45a59c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e4484bd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40754/0 (socket says 172.21.15.139:40754) 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 -- 172.21.15.139:0/2769073918 learned_addr learned my addr 172.21.15.139:0/2769073918 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc45ad9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e4484bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 -- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 msgr2=0x55e4484acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 -- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 msgr2=0x55e4484bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e4484bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.435+0000 7fc453fff640 1 -- 172.21.15.139:0/2769073918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4484917f0 con 0x55e44845aa10 2024-04-26T18:31:10.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc45ad9d640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e4484bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc45a59c640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc453fff640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e4484bd130 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc444000f60 tx=0x7fc444007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ba5771ae9e09d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc4397fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc4397fa640 1 -- 172.21.15.139:0/2769073918 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44401e920 con 0x55e44845aa10 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc4397fa640 1 -- 172.21.15.139:0/2769073918 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc4440052e0 con 0x55e44845aa10 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4540aadf0 con 0x55e44845aa10 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc4397fa640 1 -- 172.21.15.139:0/2769073918 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc44402f050 con 0x55e44845aa10 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 10 client.6192 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e4484bc9a0 con 0x55e44845aa10 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc4397fa640 1 -- 172.21.15.139:0/2769073918 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4540aadf0 con 0x55e44845aa10 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc4397fa640 1 -- 172.21.15.139:0/2769073918 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc444032020 con 0x55e44845aa10 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 10 client.6192 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 10 client.6192 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 20 client.6192 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 0x55e448479330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 4 client.6192 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "664dbabb", "release": true, "await": true}] 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "664dbabb", "release": true, "await": true}) -- 0x55e4483cbc50 con 0x55e4484bc530 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.436+0000 7fc45a59c640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 0x55e448479330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.437+0000 7fc45a59c640 1 -- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 msgr2=0x55e448479330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 17 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.437+0000 7fc45a59c640 1 -- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 msgr2=0x55e448479330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.437+0000 7fc45a59c640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 0x55e448479330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:31:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.437+0000 7fc45a59c640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 0x55e448479330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:31:10.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.638+0000 7fc45a59c640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 0x55e448479330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.638+0000 7fc4397fa640 10 client.6192 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:10.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.638+0000 7fc45a59c640 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 0x55e448479330 crc :-1 s=READY pgs=721 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c38766ecd13ffd server_cookie=856f2c7675e8e60 in_seq=0 out_seq=0 2024-04-26T18:31:10.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.638+0000 7fc4397fa640 1 -- 172.21.15.139:0/2769073918 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55e4483cbc50 con 0x55e4484bc530 2024-04-26T18:31:10.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.638+0000 7fc4397fa640 10 client.6192 handle_command_reply: tid=0 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.638+0000 7fc463c29740 1 client.6192 shutdown 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 msgr2=0x55e4484bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e4484bd130 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc444000f60 tx=0x7fc444007e30 comp rx=0 tx=0).stop 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 shutdown_connections 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55e4484989b0 0x55e4484bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e44845aa10 0x55e4484bd130 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55e4484bc530 0x55e448479330 crc :-1 s=READY pgs=721 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 --2- 172.21.15.139:0/2769073918 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55e4484594b0 0x55e4484acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc4397fa640 0 client.6192 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 >> 172.21.15.139:0/2769073918 conn(0x55e448420930 msgr2=0x55e4484962d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 shutdown_connections 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 1 -- 172.21.15.139:0/2769073918 wait complete. 2024-04-26T18:31:10.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc463c29740 20 client.6192 trim_cache size 0 max 16384 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 108, 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "664dbabb": { 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 108, 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:31:10.641 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.3, 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:10.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:10.643 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:10.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc43c06c8f0 msgr2=0x7fc43c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc43c06c8f0 0x7fc43c06edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0011e0 tx=0x7fc44c007d30 comp rx=0 tx=0).stop 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc45c15d730 msgr2=0x7fc45c151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc45c15d730 0x7fc45c151ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc454009d90 tx=0x7fc454004a40 comp rx=0 tx=0).stop 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 shutdown_connections 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc43c06c8f0 0x7fc43c06edb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc45c15d730 0x7fc45c151ee0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc45c1504b0 0x7fc45c15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 --2- 172.21.15.139:0/1142569191 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc45c0c6520 0x7fc45c15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 >> 172.21.15.139:0/1142569191 conn(0x7fc45c06e500 msgr2=0x7fc45c076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 shutdown_connections 2024-04-26T18:31:10.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.639+0000 7fc460e2a640 1 -- 172.21.15.139:0/1142569191 wait complete. 2024-04-26T18:31:10.651 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '664dbabb', seconds elapsed: 22.9 2024-04-26T18:31:10.651 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.35 2024-04-26T18:31:10.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:31:10.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.747+0000 7fbdbc10a640 1 Processor -- start 2024-04-26T18:31:10.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.747+0000 7fbdbc10a640 1 -- start start 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdbc10a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fbdb4155da0 0x7fbdb415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdbc10a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbdb4156180 0x7fbdb40d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdbc10a640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdb415f2a0 con 0x7fbdb40cd840 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdbc10a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb415cbc0 con 0x7fbdb4156180 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdbc10a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fbdb40cc730 con 0x7fbdb4155da0 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdb96a5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbdb4156180 0x7fbdb40d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdb96a5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fbdb4156180 0x7fbdb40d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40758/0 (socket says 172.21.15.139:40758) 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdb96a5640 1 -- 172.21.15.139:0/884898506 learned_addr learned my addr 172.21.15.139:0/884898506 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.748+0000 7fbdb9ea6640 1 --2- 172.21.15.139:0/884898506 >> v2:172.21.15.143:3300/0 conn(0x7fbdb4155da0 0x7fbdb415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb96a5640 1 -- 172.21.15.139:0/884898506 >> v2:172.21.15.143:3300/0 conn(0x7fbdb4155da0 msgr2=0x7fbdb415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:10.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb96a5640 1 --2- 172.21.15.139:0/884898506 >> v2:172.21.15.143:3300/0 conn(0x7fbdb4155da0 0x7fbdb415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb96a5640 1 -- 172.21.15.139:0/884898506 >> v1:172.21.15.143:6789/0 conn(0x7fbdb40cd840 legacy=0x7fbdb40c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb96a5640 1 -- 172.21.15.139:0/884898506 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb415f580 con 0x7fbdb4156180 2024-04-26T18:31:10.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb96a5640 1 --2- 172.21.15.139:0/884898506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb4156180 0x7fbdb40d12c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40d2150 tx=0x7fbda402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24a8ad32e99e4a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb8ea4640 1 -- 172.21.15.139:0/884898506 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda4037070 con 0x7fbdb4156180 2024-04-26T18:31:10.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb8ea4640 1 -- 172.21.15.139:0/884898506 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda4032440 con 0x7fbdb4156180 2024-04-26T18:31:10.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.749+0000 7fbdb8ea4640 1 -- 172.21.15.139:0/884898506 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda4032810 con 0x7fbdb4156180 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 -- 172.21.15.139:0/884898506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb4156180 msgr2=0x7fbdb40d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/884898506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb4156180 0x7fbdb40d12c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40d2150 tx=0x7fbda402a1e0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 -- 172.21.15.139:0/884898506 shutdown_connections 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/884898506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb4156180 0x7fbdb40d12c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/884898506 >> v2:172.21.15.143:3300/0 conn(0x7fbdb4155da0 0x7fbdb415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 -- 172.21.15.139:0/884898506 >> 172.21.15.139:0/884898506 conn(0x7fbdb4068090 msgr2=0x7fbdb40684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 -- 172.21.15.139:0/884898506 shutdown_connections 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.750+0000 7fbdbc10a640 1 -- 172.21.15.139:0/884898506 wait complete. 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.751+0000 7fbdbc10a640 1 Processor -- start 2024-04-26T18:31:10.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.751+0000 7fbdbc10a640 1 -- start start 2024-04-26T18:31:10.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdbc10a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdb40cd840 0x7fbdb41e5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdbc10a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdb4155da0 0x7fbdb41e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdbc10a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb40d05c0 0x7fbdb415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdbc10a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb40c69b0 con 0x7fbdb40d05c0 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdbc10a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb415fb40 con 0x7fbdb40cd840 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdbc10a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb40c6b30 con 0x7fbdb4155da0 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb40d05c0 0x7fbdb415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdb9ea6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdb40cd840 0x7fbdb41e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb40d05c0 0x7fbdb415ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40768/0 (socket says 172.21.15.139:40768) 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 -- 172.21.15.139:0/1961005522 learned_addr learned my addr 172.21.15.139:0/1961005522 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdb96a5640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdb4155da0 0x7fbdb41e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 -- 172.21.15.139:0/1961005522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdb4155da0 msgr2=0x7fbdb41e57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdb4155da0 0x7fbdb41e57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 -- 172.21.15.139:0/1961005522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdb40cd840 msgr2=0x7fbdb41e5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdb40cd840 0x7fbdb41e5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 -- 172.21.15.139:0/1961005522 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb40c7a40 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.752+0000 7fbdba6a7640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb40d05c0 0x7fbdb415ae60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c3c0 tx=0x7fbdac00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.753+0000 7fbdaa7fc640 1 -- 172.21.15.139:0/1961005522 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac017070 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.753+0000 7fbdaa7fc640 1 -- 172.21.15.139:0/1961005522 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdac0052d0 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.753+0000 7fbdaa7fc640 1 -- 172.21.15.139:0/1961005522 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac003830 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.753+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb40c77a0 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.753+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb40d10f0 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.754+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb4076d20 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.754+0000 7fbdaa7fc640 1 -- 172.21.15.139:0/1961005522 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdac01a070 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.754+0000 7fbdaa7fc640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbd9806c920 0x7fbd9806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.755+0000 7fbdaa7fc640 1 -- 172.21.15.139:0/1961005522 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fbdac08b210 con 0x7fbdb40d05c0 2024-04-26T18:31:10.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.755+0000 7fbdb9ea6640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbd9806c920 0x7fbd9806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:10.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.755+0000 7fbdb9ea6640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbd9806c920 0x7fbd9806ede0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00113e0 tx=0x7fbdb000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:10.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.759+0000 7fbdaa7fc640 1 -- 172.21.15.139:0/1961005522 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbdac058bb0 con 0x7fbdb40d05c0 2024-04-26T18:31:10.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.979+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdb41e4fd0 con 0x7fbdb40d05c0 2024-04-26T18:31:10.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.980+0000 7fbdaa7fc640 1 -- 172.21.15.139:0/1961005522 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fbdac05ceb0 con 0x7fbdb40d05c0 2024-04-26T18:31:10.980 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:10.980 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:31:10.981 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:31:10.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbd9806c920 msgr2=0x7fbd9806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbd9806c920 0x7fbd9806ede0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00113e0 tx=0x7fbdb000b040 comp rx=0 tx=0).stop 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb40d05c0 msgr2=0x7fbdb415ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb40d05c0 0x7fbdb415ae60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c3c0 tx=0x7fbdac00c7c0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 shutdown_connections 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fbd9806c920 0x7fbd9806ede0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbdb40d05c0 0x7fbdb415ae60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fbdb4155da0 0x7fbdb41e57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 --2- 172.21.15.139:0/1961005522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbdb40cd840 0x7fbdb41e5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 >> 172.21.15.139:0/1961005522 conn(0x7fbdb4068090 msgr2=0x7fbdb4154040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 shutdown_connections 2024-04-26T18:31:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:10.982+0000 7fbdbc10a640 1 -- 172.21.15.139:0/1961005522 wait complete. 2024-04-26T18:31:10.994 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db / --timeout 60 --expiration 79.35 --await-for 42.0' 2024-04-26T18:31:10.994 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db / --timeout 60 --expiration 79.35 --await-for 42.0 2024-04-26T18:31:11.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.100+0000 7f30b5447640 1 Processor -- start 2024-04-26T18:31:11.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.100+0000 7f30b5447640 1 -- start start 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30b5447640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00c4f50 0x7f30b0158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30b5447640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f30b0159020 0x7f30b00ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30b5447640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b00745e0 con 0x7f30b00ca4a0 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30b5447640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f30b00c5370 con 0x7f30b0159020 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30b5447640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30b015ca20 con 0x7f30b00c4f50 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30af7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f30b0159020 0x7f30b00ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30af7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f30b0159020 0x7f30b00ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40784/0 (socket says 172.21.15.139:40784) 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30af7fe640 1 -- 172.21.15.139:0/287645562 learned_addr learned my addr 172.21.15.139:0/287645562 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/287645562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00c4f50 0x7f30b0158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30af7fe640 1 -- 172.21.15.139:0/287645562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00c4f50 msgr2=0x7f30b0158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30af7fe640 1 --2- 172.21.15.139:0/287645562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00c4f50 0x7f30b0158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30af7fe640 1 -- 172.21.15.139:0/287645562 >> v1:172.21.15.143:6789/0 conn(0x7f30b00ca4a0 legacy=0x7f30b0072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.101+0000 7f30af7fe640 1 -- 172.21.15.139:0/287645562 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b015c0f0 con 0x7f30b0159020 2024-04-26T18:31:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.102+0000 7f30af7fe640 1 --2- 172.21.15.139:0/287645562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b00ca880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009870 tx=0x7f30a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43e9ca00442e282 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.102+0000 7f30adffb640 1 -- 172.21.15.139:0/287645562 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8037070 con 0x7f30b0159020 2024-04-26T18:31:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.102+0000 7f30adffb640 1 -- 172.21.15.139:0/287645562 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a8032440 con 0x7f30b0159020 2024-04-26T18:31:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.102+0000 7f30adffb640 1 -- 172.21.15.139:0/287645562 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8032810 con 0x7f30b0159020 2024-04-26T18:31:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 -- 172.21.15.139:0/287645562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 msgr2=0x7f30b00ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.104 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 --2- 172.21.15.139:0/287645562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b00ca880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009870 tx=0x7f30a802a270 comp rx=0 tx=0).stop 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 -- 172.21.15.139:0/287645562 shutdown_connections 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 --2- 172.21.15.139:0/287645562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b00ca880 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 --2- 172.21.15.139:0/287645562 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00c4f50 0x7f30b0158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 -- 172.21.15.139:0/287645562 >> 172.21.15.139:0/287645562 conn(0x7f30b0070a50 msgr2=0x7f30b0070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 -- 172.21.15.139:0/287645562 shutdown_connections 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.103+0000 7f30b5447640 1 -- 172.21.15.139:0/287645562 wait complete. 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.104+0000 7f30b5447640 1 Processor -- start 2024-04-26T18:31:11.105 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.104+0000 7f30b5447640 1 -- start start 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30b5447640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30b00c4f50 0x7f30b01eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30b5447640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00ca4a0 0x7f30b0157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30b5447640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b0151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30b5447640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30b015ceb0 con 0x7f30b0159020 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30b5447640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f30b015c6b0 con 0x7f30b00c4f50 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30b5447640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30b00748c0 con 0x7f30b00ca4a0 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b0151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.107 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b0151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40786/0 (socket says 172.21.15.139:40786) 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 -- 172.21.15.139:0/1567904050 learned_addr learned my addr 172.21.15.139:0/1567904050 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30b00c4f50 0x7f30b01eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00ca4a0 0x7f30b0157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 -- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00ca4a0 msgr2=0x7f30b0157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00ca4a0 0x7f30b0157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 -- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30b00c4f50 msgr2=0x7f30b01eeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30b00c4f50 0x7f30b01eeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 -- 172.21.15.139:0/1567904050 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b00cbfb0 con 0x7f30b0159020 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30af7fe640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b0151540 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009870 tx=0x7f30a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.105+0000 7f30977fe640 1 -- 172.21.15.139:0/1567904050 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8041020 con 0x7f30b0159020 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.106+0000 7f30977fe640 1 -- 172.21.15.139:0/1567904050 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a803d640 con 0x7f30b0159020 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.106+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b00cc250 con 0x7f30b0159020 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.106+0000 7f30977fe640 1 -- 172.21.15.139:0/1567904050 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8037040 con 0x7f30b0159020 2024-04-26T18:31:11.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.106+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b00cc810 con 0x7f30b0159020 2024-04-26T18:31:11.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.107+0000 7f30977fe640 1 -- 172.21.15.139:0/1567904050 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30a8044020 con 0x7f30b0159020 2024-04-26T18:31:11.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.108+0000 7f30977fe640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f309c06c8f0 0x7f309c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.108+0000 7f30977fe640 1 -- 172.21.15.139:0/1567904050 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f30a80ac590 con 0x7f30b0159020 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.108+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f309c06c8f0 0x7f309c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.108+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f309c06c8f0 0x7f309c06edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f30a0001f10 tx=0x7f30a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.108+0000 7f30b8165740 1 Processor -- start 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30b8165740 1 -- start start 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30b8165740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x5570731119c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x557073111f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30b8165740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557073074d80 con 0x557073150ae0 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x557073010c20 con 0x557073112b40 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x557073070d40 con 0x5570731115e0 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30ae7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x5570731119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30aeffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30ae7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x5570731119c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40796/0 (socket says 172.21.15.139:40796) 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30ae7fc640 1 -- 172.21.15.139:0/1842115397 learned_addr learned my addr 172.21.15.139:0/1842115397 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.109+0000 7f30af7fe640 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x557073111f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30aeffd640 1 -- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 msgr2=0x557073111f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x557073111f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30aeffd640 1 -- 172.21.15.139:0/1842115397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 msgr2=0x5570731119c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x5570731119c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30aeffd640 1 -- 172.21.15.139:0/1842115397 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557072e52d80 con 0x5570731115e0 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x5570731119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30af7fe640 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x557073111f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731505a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30a000fde0 tx=0x7f30a0012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76b539830d0a10a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f3094ff9640 1 -- 172.21.15.139:0/1842115397 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0026070 con 0x5570731115e0 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f3094ff9640 1 -- 172.21.15.139:0/1842115397 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a00075b0 con 0x5570731115e0 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.110+0000 7f3094ff9640 1 -- 172.21.15.139:0/1842115397 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0007960 con 0x5570731115e0 2024-04-26T18:31:11.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 -- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 msgr2=0x5570731505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731505a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30a000fde0 tx=0x7f30a0012000 comp rx=0 tx=0).stop 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 -- 172.21.15.139:0/1842115397 shutdown_connections 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x557073111f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x5570731119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 --2- 172.21.15.139:0/1842115397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731505a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 -- 172.21.15.139:0/1842115397 >> 172.21.15.139:0/1842115397 conn(0x5570730d8740 msgr2=0x557073155580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 -- 172.21.15.139:0/1842115397 shutdown_connections 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 -- 172.21.15.139:0/1842115397 wait complete. 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 -- start start 2024-04-26T18:31:11.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.111+0000 7f30b8165740 1 Processor -- start 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5570731115e0 0x55707314ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30b8165740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073112b40 0x557073149020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073150ae0 0x557073149560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30b8165740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55707310fc20 con 0x557073112b40 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55707300e840 con 0x5570731115e0 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x557073113170 con 0x557073150ae0 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30b8165740 10 client.0 _ll_register_callbacks cb 0x5570730125b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073112b40 0x557073149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30aeffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5570731115e0 0x55707314ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073112b40 0x557073149020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40798/0 (socket says 172.21.15.139:40798) 2024-04-26T18:31:11.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 -- 172.21.15.139:0/1201315036 learned_addr learned my addr 172.21.15.139:0/1201315036 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30af7fe640 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073150ae0 0x557073149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 -- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073150ae0 msgr2=0x557073149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073150ae0 0x557073149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 -- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5570731115e0 msgr2=0x55707314ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5570731115e0 0x55707314ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30ae7fc640 1 -- 172.21.15.139:0/1201315036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557072eb3510 con 0x557073112b40 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.112+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5570731115e0 0x55707314ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073112b40 0x557073149020 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f30a40149e0 tx=0x7f30a4014de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac724b63d5a0b4fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f308dffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f308dffb640 1 -- 172.21.15.139:0/1201315036 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4004240 con 0x557073112b40 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f308dffb640 1 -- 172.21.15.139:0/1201315036 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f30a40043e0 con 0x557073112b40 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a00075b0 con 0x557073112b40 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f308dffb640 1 -- 172.21.15.139:0/1201315036 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f30a4005990 con 0x557073112b40 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 10 client.6210 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:11.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557072d46670 con 0x557073112b40 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f308dffb640 1 -- 172.21.15.139:0/1201315036 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a00075b0 con 0x557073112b40 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f308dffb640 1 -- 172.21.15.139:0/1201315036 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f30a402a080 con 0x557073112b40 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 10 client.6210 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 10 client.6210 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 20 client.6210 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557073148b20 0x557073161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 4 client.6210 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557073082990 con 0x557073148b20 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.113+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557073148b20 0x557073161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f308dffb640 10 client.6210 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30aeffd640 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557073148b20 0x557073161dc0 crc :-1 s=READY pgs=722 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c98e92c238531150 server_cookie=1017592f99636863 in_seq=0 out_seq=0 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f308dffb640 1 -- 172.21.15.139:0/1201315036 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557073082990 con 0x557073148b20 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f308dffb640 10 client.6210 handle_command_reply: tid=0 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 client.6210 shutdown 2024-04-26T18:31:11.120 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073112b40 msgr2=0x557073149020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073112b40 0x557073149020 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f30a40149e0 tx=0x7f30a4014de0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 shutdown_connections 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x557073148b20 0x557073161dc0 crc :-1 s=READY pgs=722 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073150ae0 0x557073149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f308dffb640 0 client.6210 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073112b40 0x557073149020 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 --2- 172.21.15.139:0/1201315036 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5570731115e0 0x55707314ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.114+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 >> 172.21.15.139:0/1201315036 conn(0x5570730d8740 msgr2=0x557073112250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.115+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 shutdown_connections 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.115+0000 7f30b8165740 1 -- 172.21.15.139:0/1201315036 wait complete. 2024-04-26T18:31:11.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.115+0000 7f30b8165740 20 client.6210 trim_cache size 0 max 16384 2024-04-26T18:31:11.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.131+0000 7f30b8165740 1 Processor -- start 2024-04-26T18:31:11.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30b8165740 1 -- start start 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30b8165740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570731115e0 0x55707310ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073112b40 0x557073152750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073150ae0 0x557073152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30b8165740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01fe560 con 0x5570731115e0 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01fd440 con 0x557073150ae0 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0068c30 con 0x557073112b40 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30aeffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570731115e0 0x55707310ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30aeffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570731115e0 0x55707310ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40800/0 (socket says 172.21.15.139:40800) 2024-04-26T18:31:11.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30aeffd640 1 -- 172.21.15.139:0/25015513 learned_addr learned my addr 172.21.15.139:0/25015513 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073112b40 0x557073152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.132+0000 7f30af7fe640 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073150ae0 0x557073152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30aeffd640 1 -- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073112b40 msgr2=0x557073152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30aeffd640 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073112b40 0x557073152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30aeffd640 1 -- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073150ae0 msgr2=0x557073152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30aeffd640 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073150ae0 0x557073152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30aeffd640 1 -- 172.21.15.139:0/25015513 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557073077220 con 0x5570731115e0 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30aeffd640 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570731115e0 0x55707310ad90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007400 tx=0x7f30a0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812c1cc06978df8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f308ffff640 1 -- 172.21.15.139:0/25015513 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0032030 con 0x5570731115e0 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f308ffff640 1 -- 172.21.15.139:0/25015513 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0038020 con 0x5570731115e0 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f308ffff640 1 -- 172.21.15.139:0/25015513 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0026040 con 0x5570731115e0 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 -- 172.21.15.139:0/25015513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570731115e0 msgr2=0x55707310ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570731115e0 0x55707310ad90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007400 tx=0x7f30a0013000 comp rx=0 tx=0).stop 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 -- 172.21.15.139:0/25015513 shutdown_connections 2024-04-26T18:31:11.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073150ae0 0x557073152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x557073112b40 0x557073152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 --2- 172.21.15.139:0/25015513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5570731115e0 0x55707310ad90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 -- 172.21.15.139:0/25015513 >> 172.21.15.139:0/25015513 conn(0x5570730d8740 msgr2=0x55707310f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 -- 172.21.15.139:0/25015513 shutdown_connections 2024-04-26T18:31:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.133+0000 7f30b8165740 1 -- 172.21.15.139:0/25015513 wait complete. 2024-04-26T18:31:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.134+0000 7f30b8165740 1 -- start start 2024-04-26T18:31:11.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.134+0000 7f30b8165740 1 Processor -- start 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x55707310ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x55707310b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01fbfd0 con 0x557073150ae0 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01fcd70 con 0x557073112b40 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f30b01fc6a0 con 0x5570731115e0 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 10 client.0 _ll_register_callbacks cb 0x7f30a40098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x55707310b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x55707310b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40806/0 (socket says 172.21.15.139:40806) 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 -- 172.21.15.139:0/4208619442 learned_addr learned my addr 172.21.15.139:0/4208619442 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:11.139 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30aeffd640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30ae7fc640 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x55707310ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 -- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 msgr2=0x5570731ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 -- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 msgr2=0x55707310ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x55707310ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 -- 172.21.15.139:0/4208619442 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55707310eda0 con 0x557073150ae0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30aeffd640 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30af7fe640 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x55707310b2d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f30a8079ed0 tx=0x7f30a80761e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e1d46736fc2cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f308dffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f308dffb640 1 -- 172.21.15.139:0/4208619442 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8078300 con 0x557073150ae0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f308dffb640 1 -- 172.21.15.139:0/4208619442 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f30a8092170 con 0x557073150ae0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a0038020 con 0x557073150ae0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f308dffb640 1 -- 172.21.15.139:0/4208619442 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f30a8092370 con 0x557073150ae0 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 10 client.6216 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:11.140 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.135+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x557073147920 con 0x557073150ae0 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f308dffb640 1 -- 172.21.15.139:0/4208619442 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0038020 con 0x557073150ae0 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f308dffb640 1 -- 172.21.15.139:0/4208619442 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f30a803a030 con 0x557073150ae0 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30b8165740 10 client.6216 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30b8165740 10 client.6216 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30b8165740 20 client.6216 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30b8165740 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5570731c2450 0x557073137040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30b8165740 4 client.6216 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.35, "await_for": 42.0}] 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.35, "await_for": 42.0}) -- 0x55707307c800 con 0x5570731c2450 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30aeffd640 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5570731c2450 0x557073137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f308dffb640 10 client.6216 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:11.141 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.136+0000 7f30aeffd640 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5570731c2450 0x557073137040 crc :-1 s=READY pgs=723 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65d284de28d9b2dc server_cookie=212f73af5feaa2ec in_seq=0 out_seq=0 2024-04-26T18:31:11.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f308dffb640 1 -- 172.21.15.139:0/4208619442 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55707307c800 con 0x5570731c2450 2024-04-26T18:31:11.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f308dffb640 10 client.6216 handle_command_reply: tid=0 2024-04-26T18:31:11.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 client.6216 shutdown 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 msgr2=0x55707310b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x55707310b2d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f30a8079ed0 tx=0x7f30a80761e0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 shutdown_connections 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557073150ae0 0x55707310b2d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x557073112b40 0x55707310ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x5570731c2450 0x557073137040 crc :-1 s=READY pgs=723 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 --2- 172.21.15.139:0/4208619442 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x5570731115e0 0x5570731ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f308dffb640 0 client.6216 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 >> 172.21.15.139:0/4208619442 conn(0x5570730d8740 msgr2=0x557073138410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 shutdown_connections 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.674+0000 7f30b8165740 1 -- 172.21.15.139:0/4208619442 wait complete. 2024-04-26T18:31:11.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b8165740 20 client.6216 trim_cache size 0 max 16384 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 110, 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "93e6e300": { 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 110, 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:31:11.677 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.3, 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "QUIESCED", 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:31:11.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:11.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:11.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:11.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:11.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:11.679 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:11.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f309c06c8f0 msgr2=0x7f309c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f309c06c8f0 0x7f309c06edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f30a0001f10 tx=0x7f30a0009040 comp rx=0 tx=0).stop 2024-04-26T18:31:11.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 msgr2=0x7f30b0151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:11.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b0151540 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009870 tx=0x7f30a80046c0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 shutdown_connections 2024-04-26T18:31:11.680 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f309c06c8f0 0x7f309c06edb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30b0159020 0x7f30b0151540 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f30b00ca4a0 0x7f30b0157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 --2- 172.21.15.139:0/1567904050 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f30b00c4f50 0x7f30b01eeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:11.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 >> 172.21.15.139:0/1567904050 conn(0x7f30b0070a50 msgr2=0x7f30b015b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:11.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 shutdown_connections 2024-04-26T18:31:11.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:11.675+0000 7f30b5447640 1 -- 172.21.15.139:0/1567904050 wait complete. 2024-04-26T18:31:11.687 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '93e6e300', quiesce took 1.0 seconds. Will release after: 19.35 2024-04-26T18:31:12.114 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:12.115 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:12.115 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 23 -eq 48 ']' 2024-04-26T18:31:12.115 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.23 2024-04-26T18:31:12.115 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.23 2024-04-26T18:31:12.116 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.23 2024-04-26T18:31:12.116 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.23 2024-04-26T18:31:12.116 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:15.291 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:15.292 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:15.292 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 24 -eq 48 ']' 2024-04-26T18:31:15.292 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.24 2024-04-26T18:31:15.292 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.24 2024-04-26T18:31:15.292 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.24 2024-04-26T18:31:15.293 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.24 2024-04-26T18:31:15.293 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:18.619 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:18.619 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:18.619 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 25 -eq 48 ']' 2024-04-26T18:31:18.619 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.25 2024-04-26T18:31:18.619 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.25 2024-04-26T18:31:18.620 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.25 2024-04-26T18:31:18.620 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.25 2024-04-26T18:31:18.620 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:20.696 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:20.696 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:20.696 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 26 -eq 48 ']' 2024-04-26T18:31:20.696 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.26 2024-04-26T18:31:20.697 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.26 2024-04-26T18:31:20.697 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.26 2024-04-26T18:31:20.697 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.26 2024-04-26T18:31:20.697 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:23.918 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:23.918 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:23.918 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 27 -eq 48 ']' 2024-04-26T18:31:23.918 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.27 2024-04-26T18:31:23.919 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.27 2024-04-26T18:31:23.920 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.27 2024-04-26T18:31:23.920 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.27 2024-04-26T18:31:23.920 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:25.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:25.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:25.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 28 -eq 48 ']' 2024-04-26T18:31:25.894 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.28 2024-04-26T18:31:25.895 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.28 2024-04-26T18:31:25.896 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.28 2024-04-26T18:31:25.896 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.28 2024-04-26T18:31:25.896 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:28.792 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:28.792 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:28.792 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 29 -eq 48 ']' 2024-04-26T18:31:28.792 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.29 2024-04-26T18:31:28.792 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.29 2024-04-26T18:31:28.793 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.29 2024-04-26T18:31:28.793 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.29 2024-04-26T18:31:28.793 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:31.039 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:31:31.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.144+0000 7f7ca11a4640 1 Processor -- start 2024-04-26T18:31:31.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.144+0000 7f7ca11a4640 1 -- start start 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7ca11a4640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c9c151f80 0x7f7c9c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7ca11a4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7c9c15c210 0x7f7c9c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7ca11a4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c157f70 0x7f7c9c0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7ca11a4640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9c0ce9e0 con 0x7f7c9c151f80 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7ca11a4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9c15b560 con 0x7f7c9c15c210 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7ca11a4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c15b840 con 0x7f7c9c157f70 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c9c151f80 0x7f7c9c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7c9c151f80 0x7f7c9c15bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60886/0 (socket says 172.21.15.139:60886) 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 -- 172.21.15.139:0/1311770106 learned_addr learned my addr 172.21.15.139:0/1311770106 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c93fff640 1 --2- 172.21.15.139:0/1311770106 >> v2:172.21.15.143:3300/0 conn(0x7f7c9c15c210 0x7f7c9c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9b59e640 1 --2- 172.21.15.139:0/1311770106 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c157f70 0x7f7c9c0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.147 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 -- 172.21.15.139:0/1311770106 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c157f70 msgr2=0x7f7c9c0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 --2- 172.21.15.139:0/1311770106 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c157f70 0x7f7c9c0c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 -- 172.21.15.139:0/1311770106 >> v2:172.21.15.143:3300/0 conn(0x7f7c9c15c210 msgr2=0x7f7c9c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 --2- 172.21.15.139:0/1311770106 >> v2:172.21.15.143:3300/0 conn(0x7f7c9c15c210 0x7f7c9c0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.145+0000 7f7c9ad9d640 1 -- 172.21.15.139:0/1311770106 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c158420 con 0x7f7c9c151f80 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7c9ad9d640 1 --2- 172.21.15.139:0/1311770106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c151f80 0x7f7c9c15bcd0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c15b9c0 tx=0x7f7c8c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91212f23eee5ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7c9a59c640 1 -- 172.21.15.139:0/1311770106 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c03a070 con 0x7f7c9c151f80 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7c9a59c640 1 -- 172.21.15.139:0/1311770106 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8c032480 con 0x7f7c9c151f80 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7c9a59c640 1 -- 172.21.15.139:0/1311770106 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c032850 con 0x7f7c9c151f80 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7ca11a4640 1 -- 172.21.15.139:0/1311770106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c151f80 msgr2=0x7f7c9c15bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/1311770106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c151f80 0x7f7c9c15bcd0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c15b9c0 tx=0x7f7c8c02c650 comp rx=0 tx=0).stop 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7ca11a4640 1 -- 172.21.15.139:0/1311770106 shutdown_connections 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/1311770106 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c157f70 0x7f7c9c0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/1311770106 >> v2:172.21.15.143:3300/0 conn(0x7f7c9c15c210 0x7f7c9c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.146+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/1311770106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c151f80 0x7f7c9c15bcd0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.147+0000 7f7ca11a4640 1 -- 172.21.15.139:0/1311770106 >> 172.21.15.139:0/1311770106 conn(0x7f7c9c06e570 msgr2=0x7f7c9c06e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.147+0000 7f7ca11a4640 1 -- 172.21.15.139:0/1311770106 shutdown_connections 2024-04-26T18:31:31.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.147+0000 7f7ca11a4640 1 -- 172.21.15.139:0/1311770106 wait complete. 2024-04-26T18:31:31.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.148+0000 7f7ca11a4640 1 Processor -- start 2024-04-26T18:31:31.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.148+0000 7f7ca11a4640 1 -- start start 2024-04-26T18:31:31.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c151f80 0x7f7c9c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c157f70 0x7f7c9c0cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c9c15c210 0x7f7c9c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c158cc0 con 0x7f7c9c157f70 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1589e0 con 0x7f7c9c15c210 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c073370 con 0x7f7c9c151f80 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c157f70 0x7f7c9c0cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c157f70 0x7f7c9c0cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60888/0 (socket says 172.21.15.139:60888) 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 -- 172.21.15.139:0/74618757 learned_addr learned my addr 172.21.15.139:0/74618757 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c9ad9d640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c151f80 0x7f7c9c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c9b59e640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c9c15c210 0x7f7c9c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 -- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c151f80 msgr2=0x7f7c9c0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c151f80 0x7f7c9c0cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 -- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c9c15c210 msgr2=0x7f7c9c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c9c15c210 0x7f7c9c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 -- 172.21.15.139:0/74618757 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c14ff20 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c93fff640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c157f70 0x7f7c9c0cc800 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400e8a0 tx=0x7f7c8400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c937fe640 1 -- 172.21.15.139:0/74618757 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84017070 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c937fe640 1 -- 172.21.15.139:0/74618757 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8400c940 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c1507a0 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7c937fe640 1 -- 172.21.15.139:0/74618757 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400cd30 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.149+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c1504c0 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.150+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c076d20 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.151+0000 7f7c937fe640 1 -- 172.21.15.139:0/74618757 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c8401a070 con 0x7f7c9c157f70 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.151+0000 7f7c937fe640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7c7c06c920 0x7f7c7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.151+0000 7f7c9ad9d640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7c7c06c920 0x7f7c7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.151+0000 7f7c937fe640 1 -- 172.21.15.139:0/74618757 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7c8408bc40 con 0x7f7c9c157f70 2024-04-26T18:31:31.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.152+0000 7f7c9ad9d640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7c7c06c920 0x7f7c7c06ede0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c037000 tx=0x7f7c8c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.156+0000 7f7c937fe640 1 -- 172.21.15.139:0/74618757 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c84059670 con 0x7f7c9c157f70 2024-04-26T18:31:31.370 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.370+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c9c0c9860 con 0x7f7c9c157f70 2024-04-26T18:31:31.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.370+0000 7f7c937fe640 1 -- 172.21.15.139:0/74618757 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f7c8405d970 con 0x7f7c9c157f70 2024-04-26T18:31:31.371 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:31.371 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:31:31.371 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7c7c06c920 msgr2=0x7f7c7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7c7c06c920 0x7f7c7c06ede0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c037000 tx=0x7f7c8c030000 comp rx=0 tx=0).stop 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c157f70 msgr2=0x7f7c9c0cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c157f70 0x7f7c9c0cc800 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400e8a0 tx=0x7f7c8400ed60 comp rx=0 tx=0).stop 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 shutdown_connections 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7c7c06c920 0x7f7c7c06ede0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7c9c15c210 0x7f7c9c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c9c157f70 0x7f7c9c0cc800 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 --2- 172.21.15.139:0/74618757 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7c9c151f80 0x7f7c9c0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 >> 172.21.15.139:0/74618757 conn(0x7f7c9c06e570 msgr2=0x7f7c9c14a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 shutdown_connections 2024-04-26T18:31:31.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.372+0000 7f7ca11a4640 1 -- 172.21.15.139:0/74618757 wait complete. 2024-04-26T18:31:31.384 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --set-id 93e6e300 --release --await' 2024-04-26T18:31:31.384 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --set-id 93e6e300 --release --await 2024-04-26T18:31:31.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc388d03640 1 Processor -- start 2024-04-26T18:31:31.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc388d03640 1 -- start start 2024-04-26T18:31:31.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc388d03640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc3841560e0 0x7fc3840cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc388d03640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fc3840c8d30 0x7fc38415d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc388d03640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3840731e0 con 0x7fc3840ce0f0 2024-04-26T18:31:31.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc388d03640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fc3840734a0 con 0x7fc3841560e0 2024-04-26T18:31:31.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc388d03640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fc384073780 con 0x7fc3840c8d30 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.488+0000 7fc38259c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc3841560e0 0x7fc3840cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc38259c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fc3841560e0 0x7fc3840cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60900/0 (socket says 172.21.15.139:60900) 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc38259c640 1 -- 172.21.15.139:0/1402229212 learned_addr learned my addr 172.21.15.139:0/1402229212 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc382d9d640 1 --2- 172.21.15.139:0/1402229212 >> v2:172.21.15.143:3300/0 conn(0x7fc3840c8d30 0x7fc38415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc38259c640 1 -- 172.21.15.139:0/1402229212 >> v2:172.21.15.143:3300/0 conn(0x7fc3840c8d30 msgr2=0x7fc38415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc38259c640 1 --2- 172.21.15.139:0/1402229212 >> v2:172.21.15.143:3300/0 conn(0x7fc3840c8d30 0x7fc38415d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc38259c640 1 -- 172.21.15.139:0/1402229212 >> v1:172.21.15.143:6789/0 conn(0x7fc3840ce0f0 legacy=0x7fc3840c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc38259c640 1 -- 172.21.15.139:0/1402229212 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc384073a60 con 0x7fc3841560e0 2024-04-26T18:31:31.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.489+0000 7fc38259c640 1 --2- 172.21.15.139:0/1402229212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc3840cdbb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc3840728a0 tx=0x7fc37402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61055f97cbbd88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc381d9b640 1 -- 172.21.15.139:0/1402229212 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374037070 con 0x7fc3841560e0 2024-04-26T18:31:31.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc381d9b640 1 -- 172.21.15.139:0/1402229212 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37402ae50 con 0x7fc3841560e0 2024-04-26T18:31:31.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc381d9b640 1 -- 172.21.15.139:0/1402229212 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374032860 con 0x7fc3841560e0 2024-04-26T18:31:31.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 -- 172.21.15.139:0/1402229212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 msgr2=0x7fc3840cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 --2- 172.21.15.139:0/1402229212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc3840cdbb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc3840728a0 tx=0x7fc37402a300 comp rx=0 tx=0).stop 2024-04-26T18:31:31.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 -- 172.21.15.139:0/1402229212 shutdown_connections 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 --2- 172.21.15.139:0/1402229212 >> v2:172.21.15.143:3300/0 conn(0x7fc3840c8d30 0x7fc38415d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 --2- 172.21.15.139:0/1402229212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc3840cdbb0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 -- 172.21.15.139:0/1402229212 >> 172.21.15.139:0/1402229212 conn(0x7fc38406e500 msgr2=0x7fc38406e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 -- 172.21.15.139:0/1402229212 shutdown_connections 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.490+0000 7fc388d03640 1 -- 172.21.15.139:0/1402229212 wait complete. 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.491+0000 7fc388d03640 1 Processor -- start 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc388d03640 1 -- start start 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc388d03640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3840c8d30 0x7fc384154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc388d03640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3840ce0f0 0x7fc38415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc388d03640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc384158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc388d03640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc38415ca40 con 0x7fc3841560e0 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc388d03640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc384074020 con 0x7fc3840ce0f0 2024-04-26T18:31:31.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc388d03640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc38415cbc0 con 0x7fc3840c8d30 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc382d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc384158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc382d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc384158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60914/0 (socket says 172.21.15.139:60914) 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc382d9d640 1 -- 172.21.15.139:0/4275458743 learned_addr learned my addr 172.21.15.139:0/4275458743 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc38259c640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3840c8d30 0x7fc384154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.492+0000 7fc37bfff640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3840ce0f0 0x7fc38415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc382d9d640 1 -- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3840c8d30 msgr2=0x7fc384154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc382d9d640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3840c8d30 0x7fc384154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc382d9d640 1 -- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3840ce0f0 msgr2=0x7fc38415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc382d9d640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3840ce0f0 0x7fc38415adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc382d9d640 1 -- 172.21.15.139:0/4275458743 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38415b990 con 0x7fc3841560e0 2024-04-26T18:31:31.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc382d9d640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc384158100 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00efc0 tx=0x7fc37c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc37affd640 1 -- 172.21.15.139:0/4275458743 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c018020 con 0x7fc3841560e0 2024-04-26T18:31:31.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc37affd640 1 -- 172.21.15.139:0/4275458743 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37c014480 con 0x7fc3841560e0 2024-04-26T18:31:31.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc37affd640 1 -- 172.21.15.139:0/4275458743 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c014870 con 0x7fc3841560e0 2024-04-26T18:31:31.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3841f1730 con 0x7fc3841560e0 2024-04-26T18:31:31.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.493+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3841f1cf0 con 0x7fc3841560e0 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.495+0000 7fc37affd640 1 -- 172.21.15.139:0/4275458743 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc37c005d10 con 0x7fc3841560e0 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.495+0000 7fc37affd640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc36406c8f0 0x7fc36406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.495+0000 7fc37affd640 1 -- 172.21.15.139:0/4275458743 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc37c08ccf0 con 0x7fc3841560e0 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.495+0000 7fc38259c640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc36406c8f0 0x7fc36406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.496+0000 7fc38259c640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc36406c8f0 0x7fc36406edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc374034000 tx=0x7fc37402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.496+0000 7fc38ba18740 1 Processor -- start 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.496+0000 7fc38ba18740 1 -- start start 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9466d6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466d69b0 0x55a946697890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a946697dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38ba18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a9465fc040 con 0x55a9466974b0 2024-04-26T18:31:31.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a946597b60 con 0x55a9466d69b0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a9465f8000 con 0x55a946698a10 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9466d6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9466d6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60918/0 (socket says 172.21.15.139:60918) 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 -- 172.21.15.139:0/1098782841 learned_addr learned my addr 172.21.15.139:0/1098782841 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc37bfff640 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466d69b0 0x55a946697890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc382d9d640 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a946697dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 -- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 msgr2=0x55a946697dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a946697dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 -- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466d69b0 msgr2=0x55a946697890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466d69b0 0x55a946697890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 -- 172.21.15.139:0/1098782841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a94658c9c0 con 0x55a9466974b0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.497+0000 7fc38259c640 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9466d6470 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc374000c00 tx=0x7fc37402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f20c1092244982 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc363fff640 1 -- 172.21.15.139:0/1098782841 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374037040 con 0x55a9466974b0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc363fff640 1 -- 172.21.15.139:0/1098782841 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37404d070 con 0x55a9466974b0 2024-04-26T18:31:31.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc363fff640 1 -- 172.21.15.139:0/1098782841 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374032db0 con 0x55a9466974b0 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 -- 172.21.15.139:0/1098782841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 msgr2=0x55a9466d6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9466d6470 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc374000c00 tx=0x7fc37402c000 comp rx=0 tx=0).stop 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 -- 172.21.15.139:0/1098782841 shutdown_connections 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a946697dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466d69b0 0x55a946697890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1098782841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9466d6470 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 -- 172.21.15.139:0/1098782841 >> 172.21.15.139:0/1098782841 conn(0x55a94665e930 msgr2=0x55a9466db450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 -- 172.21.15.139:0/1098782841 shutdown_connections 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.498+0000 7fc38ba18740 1 -- 172.21.15.139:0/1098782841 wait complete. 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.499+0000 7fc38ba18740 1 -- start start 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.499+0000 7fc38ba18740 1 Processor -- start 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466974b0 0x55a9466bee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a9466d46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466d69b0 0x55a9466eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38ba18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a946695af0 con 0x55a9466d69b0 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x55a9465954f0 con 0x55a9466974b0 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x55a946699040 con 0x55a946698a10 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38ba18740 10 client.0 _ll_register_callbacks cb 0x55a9465f2c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466d69b0 0x55a9466eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466d69b0 0x55a9466eaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60922/0 (socket says 172.21.15.139:60922) 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 -- 172.21.15.139:0/86169384 learned_addr learned my addr 172.21.15.139:0/86169384 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc37bfff640 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a9466d46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc38259c640 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466974b0 0x55a9466bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 -- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 msgr2=0x55a9466d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a9466d46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 -- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466974b0 msgr2=0x55a9466bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466974b0 0x55a9466bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 -- 172.21.15.139:0/86169384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a94630d920 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc382d9d640 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466d69b0 0x55a9466eaed0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c990 tx=0x7fc37c05a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1f93391d77be25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc3617fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc3617fa640 1 -- 172.21.15.139:0/86169384 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c088070 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.500+0000 7fc3617fa640 1 -- 172.21.15.139:0/86169384 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc37c059c50 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc37404d070 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc3617fa640 1 -- 172.21.15.139:0/86169384 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc37c056350 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 10 client.6234 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a9463d9d30 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc3617fa640 1 -- 172.21.15.139:0/86169384 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37404d070 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc3617fa640 1 -- 172.21.15.139:0/86169384 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc37c0564f0 con 0x55a9466d69b0 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 10 client.6234 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 10 client.6234 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 20 client.6234 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:31.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a9466d5430 0x55a9466eb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 4 client.6234 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9465cfa00 con 0x55a9466d5430 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38259c640 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a9466d5430 0x55a9466eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc3617fa640 10 client.6234 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.501+0000 7fc38259c640 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a9466d5430 0x55a9466eb410 crc :-1 s=READY pgs=724 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b8d4ef126744c6 server_cookie=bc29a88db54e313f in_seq=0 out_seq=0 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc3617fa640 1 -- 172.21.15.139:0/86169384 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a9465cfa00 con 0x55a9466d5430 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc3617fa640 10 client.6234 handle_command_reply: tid=0 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 client.6234 shutdown 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466d69b0 msgr2=0x55a9466eaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466d69b0 0x55a9466eaed0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c990 tx=0x7fc37c05a720 comp rx=0 tx=0).stop 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 shutdown_connections 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466d69b0 0x55a9466eaed0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a9466d5430 0x55a9466eb410 crc :-1 s=READY pgs=724 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a946698a10 0x55a9466d46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 --2- 172.21.15.139:0/86169384 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a9466974b0 0x55a9466bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc3617fa640 0 client.6234 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:31.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 >> 172.21.15.139:0/86169384 conn(0x55a94665e930 msgr2=0x55a9466c09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 shutdown_connections 2024-04-26T18:31:31.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 1 -- 172.21.15.139:0/86169384 wait complete. 2024-04-26T18:31:31.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.502+0000 7fc38ba18740 20 client.6234 trim_cache size 0 max 16384 2024-04-26T18:31:31.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.519+0000 7fc38ba18740 1 Processor -- start 2024-04-26T18:31:31.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.519+0000 7fc38ba18740 1 -- start start 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a946691020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466e4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466e4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38ba18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc384200770 con 0x55a9466974b0 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc3841ff650 con 0x55a946698a10 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc3841f5460 con 0x55a9466d69b0 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a946691020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a946691020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60938/0 (socket says 172.21.15.139:60938) 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 -- 172.21.15.139:0/1001983555 learned_addr learned my addr 172.21.15.139:0/1001983555 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc37bfff640 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466e4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc382d9d640 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466e4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 -- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 msgr2=0x55a9466e4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466e4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 -- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 msgr2=0x55a9466e4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466e4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.520+0000 7fc38259c640 1 -- 172.21.15.139:0/1001983555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9466e5760 con 0x55a9466974b0 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38259c640 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a946691020 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc37402a8f0 tx=0x7fc37403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f209f96f9189f323 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc3637fe640 1 -- 172.21.15.139:0/1001983555 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37405abc0 con 0x55a9466974b0 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc3637fe640 1 -- 172.21.15.139:0/1001983555 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37404d040 con 0x55a9466974b0 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc3637fe640 1 -- 172.21.15.139:0/1001983555 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37405a260 con 0x55a9466974b0 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 -- 172.21.15.139:0/1001983555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 msgr2=0x55a946691020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a946691020 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc37402a8f0 tx=0x7fc37403c000 comp rx=0 tx=0).stop 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 -- 172.21.15.139:0/1001983555 shutdown_connections 2024-04-26T18:31:31.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466e4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466e4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 --2- 172.21.15.139:0/1001983555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a946691020 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 -- 172.21.15.139:0/1001983555 >> 172.21.15.139:0/1001983555 conn(0x55a94665e930 msgr2=0x55a946697890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 -- 172.21.15.139:0/1001983555 shutdown_connections 2024-04-26T18:31:31.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.521+0000 7fc38ba18740 1 -- 172.21.15.139:0/1001983555 wait complete. 2024-04-26T18:31:31.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.522+0000 7fc38ba18740 1 -- start start 2024-04-26T18:31:31.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.522+0000 7fc38ba18740 1 Processor -- start 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9467522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466bdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38ba18740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38ba18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc3841fe200 con 0x55a9466974b0 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc3841fef80 con 0x55a946698a10 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38ba18740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc3841fe8b0 con 0x55a9466d69b0 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38ba18740 10 client.0 _ll_register_callbacks cb 0x7fc37c05a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9467522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9467522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:60946/0 (socket says 172.21.15.139:60946) 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 -- 172.21.15.139:0/3003662087 learned_addr learned my addr 172.21.15.139:0/3003662087 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc382d9d640 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc37bfff640 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466bdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 -- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 msgr2=0x55a9466ec7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466ec7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 -- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 msgr2=0x55a9466bdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466bdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.523+0000 7fc38259c640 1 -- 172.21.15.139:0/3003662087 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a946752800 con 0x55a9466974b0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38259c640 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9467522c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc3740090b0 tx=0x7fc374004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff5aa1f93140d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc3617fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc3617fa640 1 -- 172.21.15.139:0/3003662087 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374032bc0 con 0x55a9466974b0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc3617fa640 1 -- 172.21.15.139:0/3003662087 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc374032d60 con 0x55a9466974b0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc37404d040 con 0x55a9466974b0 2024-04-26T18:31:31.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc3617fa640 1 -- 172.21.15.139:0/3003662087 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fc37403c440 con 0x55a9466974b0 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 10 client.6240 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a9466e6640 con 0x55a9466974b0 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc3617fa640 1 -- 172.21.15.139:0/3003662087 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37404d040 con 0x55a9466974b0 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc3617fa640 1 -- 172.21.15.139:0/3003662087 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fc37403c5e0 con 0x55a9466974b0 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 10 client.6240 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 10 client.6240 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 20 client.6240 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a94673b1a0 0x55a94673b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 4 client.6240 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "93e6e300", "release": true, "await": true}] 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "set_id": "93e6e300", "release": true, "await": true}) -- 0x55a946609c50 con 0x55a94673b1a0 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.524+0000 7fc37bfff640 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a94673b1a0 0x55a94673b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.525+0000 7fc37bfff640 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a94673b1a0 0x55a94673b580 crc :-1 s=READY pgs=725 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a12cabba744c27 server_cookie=c4d92f610a09af72 in_seq=0 out_seq=0 2024-04-26T18:31:31.530 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.525+0000 7fc3617fa640 10 client.6240 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.525+0000 7fc3617fa640 1 -- 172.21.15.139:0/3003662087 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a946609c50 con 0x55a94673b1a0 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.525+0000 7fc3617fa640 10 client.6240 handle_command_reply: tid=0 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.525+0000 7fc38ba18740 1 client.6240 shutdown 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 msgr2=0x55a9467522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9467522c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc3740090b0 tx=0x7fc374004730 comp rx=0 tx=0).stop 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 shutdown_connections 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x55a94673b1a0 0x55a94673b580 crc :-1 s=READY pgs=725 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x55a9466d69b0 0x55a9466ec7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55a946698a10 0x55a9466bdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 --2- 172.21.15.139:0/3003662087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9466974b0 0x55a9467522c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc3617fa640 0 client.6240 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 >> 172.21.15.139:0/3003662087 conn(0x55a94665e930 msgr2=0x55a94668d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 shutdown_connections 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 1 -- 172.21.15.139:0/3003662087 wait complete. 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc38ba18740 20 client.6240 trim_cache size 0 max 16384 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 112, 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": { 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout: "93e6e300": { 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout: "version": 112, 2024-04-26T18:31:31.532 INFO:teuthology.orchestra.run.smithi139.stdout: "age_ref": 0.0, 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "timeout": 60.0, 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "expiration": 79.3, 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "members": { 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "file:/": { 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "excluded": false, 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "state": { 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RELEASED", 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:31.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:31.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:31.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:31.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-26T18:31:31.534 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc36406c8f0 msgr2=0x7fc36406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc36406c8f0 0x7fc36406edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc374034000 tx=0x7fc37402e000 comp rx=0 tx=0).stop 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 msgr2=0x7fc384158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc384158100 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00efc0 tx=0x7fc37c00c490 comp rx=0 tx=0).stop 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 shutdown_connections 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc36406c8f0 0x7fc36406edb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3841560e0 0x7fc384158100 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc3840ce0f0 0x7fc38415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 --2- 172.21.15.139:0/4275458743 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc3840c8d30 0x7fc384154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:31.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 >> 172.21.15.139:0/4275458743 conn(0x7fc38406e500 msgr2=0x7fc3841e3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:31.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 shutdown_connections 2024-04-26T18:31:31.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:31.526+0000 7fc388d03640 1 -- 172.21.15.139:0/4275458743 wait complete. 2024-04-26T18:31:31.537 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '93e6e300', seconds elapsed: 20.9 2024-04-26T18:31:32.348 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:32.348 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:32.349 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 30 -eq 48 ']' 2024-04-26T18:31:32.349 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.30 2024-04-26T18:31:32.349 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.30 2024-04-26T18:31:32.349 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.30 2024-04-26T18:31:32.349 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.30 2024-04-26T18:31:32.349 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:36.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:36.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:36.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 31 -eq 48 ']' 2024-04-26T18:31:36.911 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.31 2024-04-26T18:31:36.911 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.31 2024-04-26T18:31:36.912 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.31 2024-04-26T18:31:36.912 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.31 2024-04-26T18:31:36.912 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:39.294 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:39.294 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:39.294 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 32 -eq 48 ']' 2024-04-26T18:31:39.294 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.32 2024-04-26T18:31:39.294 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.32 2024-04-26T18:31:39.295 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.32 2024-04-26T18:31:39.295 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.32 2024-04-26T18:31:39.295 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:42.428 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd ../.. 2024-04-26T18:31:42.428 INFO:tasks.workunit.client.0.smithi139.stderr:+ for v in $versions 2024-04-26T18:31:42.428 INFO:tasks.workunit.client.0.smithi139.stderr:+ '[' 33 -eq 48 ']' 2024-04-26T18:31:42.428 INFO:tasks.workunit.client.0.smithi139.stderr:+ ver=v0.33 2024-04-26T18:31:42.428 INFO:tasks.workunit.client.0.smithi139.stderr:+ echo checking v0.33 2024-04-26T18:31:42.429 INFO:tasks.workunit.client.0.smithi139.stdout:checking v0.33 2024-04-26T18:31:42.429 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .snap/v0.33 2024-04-26T18:31:42.429 INFO:tasks.workunit.client.0.smithi139.stderr:+ git diff --exit-code 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:diff --git a/src/common/admin_socket_client.cc b/src/common/admin_socket_client.cc 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:index 9efedf8b5a3..e69de29bb2d 100644 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:--- a/src/common/admin_socket_client.cc 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:+++ b/src/common/admin_socket_client.cc 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:@@ -1,211 +0,0 @@ 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:-// -*- mode:C++; tab-width:8; c-basic-offset:2; indent-tabs-mode:t -*- 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:-// vim: ts=8 sw=2 smarttab 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:-/* 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:- * Ceph - scalable distributed file system 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:- * 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:- * Copyright (C) 2011 New Dream Network 2024-04-26T18:31:50.027 INFO:tasks.workunit.client.0.smithi139.stdout:- * 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:- * This is free software; you can redistribute it and/or 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:- * modify it under the terms of the GNU Lesser General Public 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:- * License version 2.1, as published by the Free Software 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:- * Foundation. See file COPYING. 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:- * 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:- */ 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:-#include "common/admin_socket.h" 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:-#include "common/ceph_context.h" 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:-#include "common/errno.h" 2024-04-26T18:31:50.028 INFO:tasks.workunit.client.0.smithi139.stdout:-#include "common/safe_io.h" 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include "common/admin_socket_client.h" 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.029 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-#include 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-using std::ostringstream; 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.030 INFO:tasks.workunit.client.0.smithi139.stdout:-const char* get_rand_socket_path() 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- static char *g_socket_path = NULL; 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- if (g_socket_path == NULL) { 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- char buf[512]; 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- const char *tdir = getenv("TMPDIR"); 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- if (tdir == NULL) { 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- tdir = "/tmp"; 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- snprintf(buf, sizeof(((struct sockaddr_un*)0)->sun_path), 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- "%s/perfcounters_test_socket.%ld.%ld", 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- tdir, (long int)getpid(), time(NULL)); 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- g_socket_path = (char*)strdup(buf); 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.031 INFO:tasks.workunit.client.0.smithi139.stdout:- return g_socket_path; 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:-static std::string asok_connect(const std::string &path, int *fd) 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- int socket_fd = socket(PF_UNIX, SOCK_STREAM, 0); 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- if(socket_fd < 0) { 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- int err = errno; 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "socket(PF_UNIX, SOCK_STREAM, 0) failed: " << cpp_strerror(err); 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- return oss.str(); 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- struct sockaddr_un address; 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- memset(&address, 0, sizeof(struct sockaddr_un)); 2024-04-26T18:31:50.032 INFO:tasks.workunit.client.0.smithi139.stdout:- address.sun_family = AF_UNIX; 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- snprintf(address.sun_path, sizeof(address.sun_path), "%s", path.c_str()); 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- if (::connect(socket_fd, (struct sockaddr *) &address, 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- sizeof(struct sockaddr_un)) != 0) { 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- int err = errno; 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "connect(" << socket_fd << ") failed: " << cpp_strerror(err); 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- close(socket_fd); 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- return oss.str(); 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- struct timeval timer; 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- timer.tv_sec = 5; 2024-04-26T18:31:50.033 INFO:tasks.workunit.client.0.smithi139.stdout:- timer.tv_usec = 0; 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- if (::setsockopt(socket_fd, SOL_SOCKET, SO_RCVTIMEO, &timer, sizeof(timer))) { 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- int err = errno; 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "setsockopt(" << socket_fd << ", SO_RCVTIMEO) failed: " 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- << cpp_strerror(err); 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- close(socket_fd); 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- return oss.str(); 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- timer.tv_sec = 5; 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- timer.tv_usec = 0; 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- if (::setsockopt(socket_fd, SOL_SOCKET, SO_SNDTIMEO, &timer, sizeof(timer))) { 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- int err = errno; 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.034 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "setsockopt(" << socket_fd << ", SO_SNDTIMEO) failed: " 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- << cpp_strerror(err); 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- close(socket_fd); 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- return oss.str(); 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- *fd = socket_fd; 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- return ""; 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:-static std::string asok_request(int socket_fd, uint32_t request_id) 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- uint32_t request_id_raw = htonl(request_id); 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- ssize_t res = safe_write(socket_fd, &request_id_raw, sizeof(request_id_raw)); 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- if (res < 0) { 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- int err = res; 2024-04-26T18:31:50.035 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "safe_write(" << socket_fd << ") failed to write request code: " 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- << cpp_strerror(err); 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- return oss.str(); 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- return ""; 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:-AdminSocketClient:: 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:-AdminSocketClient(const std::string &path) 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- : m_path(path) 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:-std::string AdminSocketClient:: 2024-04-26T18:31:50.036 INFO:tasks.workunit.client.0.smithi139.stdout:-get_version(uint32_t *version) 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- uint32_t version_raw; 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- int socket_fd, res; 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- std::string err = asok_connect(m_path, &socket_fd); 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- if (!err.empty()) { 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- goto done; 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- err = asok_request(socket_fd, 0x0); 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- if (!err.empty()) { 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- goto done; 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- res = safe_read_exact(socket_fd, &version_raw, 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- sizeof(version_raw)); 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- if (res < 0) { 2024-04-26T18:31:50.037 INFO:tasks.workunit.client.0.smithi139.stdout:- int e = res; 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "safe_read(" << socket_fd << ") failed to read version_raw: " 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- << cpp_strerror(e); 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- err = oss.str(); 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- goto done; 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- *version = ntohl(version_raw); 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:-done: 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- close(socket_fd); 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- return err; 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.038 INFO:tasks.workunit.client.0.smithi139.stdout:-std::string AdminSocketClient:: 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-get_schema(std::string *message) 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:- return get_json(message, 0x2); 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-std::string AdminSocketClient:: 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-get_message(std::string *message) 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:- return get_json(message, 0x1); 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-std::string AdminSocketClient:: 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-get_json(std::string *message, uint32_t request_code) 2024-04-26T18:31:50.039 INFO:tasks.workunit.client.0.smithi139.stdout:-{ 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- int socket_fd, res; 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- std::vector vec(65536, 0); 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- uint8_t *buffer = &vec[0]; 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- uint32_t message_size_raw, message_size; 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- std::string err = asok_connect(m_path, &socket_fd); 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- if (!err.empty()) { 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- goto done; 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- err = asok_request(socket_fd, request_code); 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- if (!err.empty()) { 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- goto done; 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- res = safe_read_exact(socket_fd, &message_size_raw, 2024-04-26T18:31:50.040 INFO:tasks.workunit.client.0.smithi139.stdout:- sizeof(message_size_raw)); 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- if (res < 0) { 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- int e = res; 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "safe_read(" << socket_fd << ") failed to read message size: " 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- << cpp_strerror(e); 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- err = oss.str(); 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- goto done; 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- message_size = ntohl(message_size_raw); 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- res = safe_read_exact(socket_fd, buffer, message_size); 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- if (res < 0) { 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- int e = res; 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- ostringstream oss; 2024-04-26T18:31:50.041 INFO:tasks.workunit.client.0.smithi139.stdout:- oss << "safe_read(" << socket_fd << ") failed: " << cpp_strerror(e); 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:- err = oss.str(); 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:- goto done; 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:- } 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:- //printf("MESSAGE FROM SERVER: %s\n", buffer); 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:- message->assign((const char*)buffer); 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:-done: 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:- close(socket_fd); 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:- return err; 2024-04-26T18:31:50.042 INFO:tasks.workunit.client.0.smithi139.stdout:-} 2024-04-26T18:31:50.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:31:50.043 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2024-04-26T18:31:50.044 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T18:31:50.306 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-26T18:31:50.552 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9a565719221a4f9f8d4dc491f0b7d91f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-26T18:31:50.555 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-26T18:31:50.565 INFO:tasks.quiescer:joining Quiescers 2024-04-26T18:31:50.565 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-26T18:31:50.565 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:31:50.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.666+0000 7f6acb779640 1 Processor -- start 2024-04-26T18:31:50.666 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.666+0000 7f6acb779640 1 -- start start 2024-04-26T18:31:50.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6acb779640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6ac406ca20 0x7f6ac4167410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:50.667 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6acb779640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac415f490 con 0x7f6ac40cf620 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6acb779640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac415f770 con 0x7f6ac40cf240 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6acb779640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac4160010 con 0x7f6ac406ca20 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6ac8d14640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6ac40cf620 0x7f6ac406c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53298/0 (socket says 172.21.15.139:53298) 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6ac8d14640 1 -- 172.21.15.139:0/629560444 learned_addr learned my addr 172.21.15.139:0/629560444 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6ac9d16640 1 --2- 172.21.15.139:0/629560444 >> v2:172.21.15.143:3300/0 conn(0x7f6ac406ca20 0x7f6ac4167410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6abbfff640 1 -- 172.21.15.139:0/629560444 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 169241625 0 0) 0x7f6ac415f490 con 0x7f6ac40cf620 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6abbfff640 1 -- 172.21.15.139:0/629560444 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab0003520 con 0x7f6ac40cf620 2024-04-26T18:31:50.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6ac9d16640 1 -- 172.21.15.139:0/629560444 >> v1:172.21.15.143:6789/0 conn(0x7f6ac40cf240 legacy=0x7f6ac415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:50.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6ac9d16640 1 -- 172.21.15.139:0/629560444 >> v1:172.21.15.139:6789/0 conn(0x7f6ac40cf620 legacy=0x7f6ac406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:50.669 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.667+0000 7f6ac9d16640 1 -- 172.21.15.139:0/629560444 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac415fa50 con 0x7f6ac406ca20 2024-04-26T18:31:50.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.668+0000 7f6ac9d16640 1 --2- 172.21.15.139:0/629560444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 0x7f6ac4167410 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4160190 tx=0x7f6abc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=647e3a6924624cad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:50.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.668+0000 7f6abbfff640 1 -- 172.21.15.139:0/629560444 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007740 con 0x7f6ac406ca20 2024-04-26T18:31:50.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.668+0000 7f6abbfff640 1 -- 172.21.15.139:0/629560444 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc0078e0 con 0x7f6ac406ca20 2024-04-26T18:31:50.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.668+0000 7f6abbfff640 1 -- 172.21.15.139:0/629560444 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc007c90 con 0x7f6ac406ca20 2024-04-26T18:31:50.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.669+0000 7f6acb779640 1 -- 172.21.15.139:0/629560444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 msgr2=0x7f6ac4167410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:50.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.669+0000 7f6acb779640 1 --2- 172.21.15.139:0/629560444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 0x7f6ac4167410 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4160190 tx=0x7f6abc02a6f0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.669+0000 7f6acb779640 1 -- 172.21.15.139:0/629560444 shutdown_connections 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.669+0000 7f6acb779640 1 --2- 172.21.15.139:0/629560444 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 0x7f6ac4167410 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.669+0000 7f6acb779640 1 -- 172.21.15.139:0/629560444 >> 172.21.15.139:0/629560444 conn(0x7f6ac4076730 msgr2=0x7f6ac4068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.669+0000 7f6acb779640 1 -- 172.21.15.139:0/629560444 shutdown_connections 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.669+0000 7f6acb779640 1 -- 172.21.15.139:0/629560444 wait complete. 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.670+0000 7f6acb779640 1 Processor -- start 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.670+0000 7f6acb779640 1 -- start start 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.670+0000 7f6acb779640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 0x7f6ac40ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:50.673 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.670+0000 7f6acb779640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac40cf240 0x7f6ac41f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.670+0000 7f6acb779640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ac40cf620 0x7f6ac414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6acb779640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac406e2a0 con 0x7f6ac40cf240 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6acb779640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac415bcb0 con 0x7f6ac406ca20 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6acb779640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40cfa20 con 0x7f6ac40cf620 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac40cf240 0x7f6ac41f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac40cf240 0x7f6ac41f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51018/0 (socket says 172.21.15.139:51018) 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 -- 172.21.15.139:0/707424652 learned_addr learned my addr 172.21.15.139:0/707424652 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac9515640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 0x7f6ac40ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:50.674 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac9d16640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ac40cf620 0x7f6ac414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 -- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ac40cf620 msgr2=0x7f6ac414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ac40cf620 0x7f6ac414b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 -- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 msgr2=0x7f6ac40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 0x7f6ac40ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 -- 172.21.15.139:0/707424652 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac4156cb0 con 0x7f6ac40cf240 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ac8d14640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac40cf240 0x7f6ac41f2390 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c410 tx=0x7f6ab400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ab9ffb640 1 -- 172.21.15.139:0/707424652 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4017070 con 0x7f6ac40cf240 2024-04-26T18:31:50.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ab9ffb640 1 -- 172.21.15.139:0/707424652 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab4005ce0 con 0x7f6ac40cf240 2024-04-26T18:31:50.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac4156f90 con 0x7f6ac40cf240 2024-04-26T18:31:50.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6ab9ffb640 1 -- 172.21.15.139:0/707424652 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40072f0 con 0x7f6ac40cf240 2024-04-26T18:31:50.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.671+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac4157550 con 0x7f6ac40cf240 2024-04-26T18:31:50.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.673+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac406c840 con 0x7f6ac40cf240 2024-04-26T18:31:50.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.673+0000 7f6ab9ffb640 1 -- 172.21.15.139:0/707424652 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ab401a070 con 0x7f6ac40cf240 2024-04-26T18:31:50.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.673+0000 7f6ab9ffb640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6aa806c8f0 0x7f6aa806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:50.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.673+0000 7f6ab9ffb640 1 -- 172.21.15.139:0/707424652 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f6ab408b3d0 con 0x7f6ac40cf240 2024-04-26T18:31:50.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.673+0000 7f6ac9515640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6aa806c8f0 0x7f6aa806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:50.677 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.673+0000 7f6ac9515640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6aa806c8f0 0x7f6aa806edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0001780 tx=0x7f6ac0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:50.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.678+0000 7f6ab9ffb640 1 -- 172.21.15.139:0/707424652 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6ac406c840 con 0x7f6ac40cf240 2024-04-26T18:31:50.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.890+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ac4157750 con 0x7f6ac40cf240 2024-04-26T18:31:50.890 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.890+0000 7f6ab9ffb640 1 -- 172.21.15.139:0/707424652 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f6ab4058d90 con 0x7f6ac40cf240 2024-04-26T18:31:50.891 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:50.891 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:31:50.891 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:31:50.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.892+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6aa806c8f0 msgr2=0x7f6aa806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:50.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.892+0000 7f6acb779640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6aa806c8f0 0x7f6aa806edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0001780 tx=0x7f6ac0009040 comp rx=0 tx=0).stop 2024-04-26T18:31:50.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.892+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac40cf240 msgr2=0x7f6ac41f2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:50.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.892+0000 7f6acb779640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac40cf240 0x7f6ac41f2390 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c410 tx=0x7f6ab400c8d0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.893 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 shutdown_connections 2024-04-26T18:31:50.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6aa806c8f0 0x7f6aa806edb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6ac40cf620 0x7f6ac414b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ac40cf240 0x7f6ac41f2390 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 --2- 172.21.15.139:0/707424652 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6ac406ca20 0x7f6ac40ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:50.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 >> 172.21.15.139:0/707424652 conn(0x7f6ac4076730 msgr2=0x7f6ac40c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:50.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 shutdown_connections 2024-04-26T18:31:50.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:50.893+0000 7f6acb779640 1 -- 172.21.15.139:0/707424652 wait complete. 2024-04-26T18:31:50.904 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4309 quiesce db --cancel --all' 2024-04-26T18:31:50.904 DEBUG:teuthology.orchestra.run.smithi139:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4309 quiesce db --cancel --all 2024-04-26T18:31:51.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.005+0000 7f0842f14640 1 Processor -- start 2024-04-26T18:31:51.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.005+0000 7f0842f14640 1 -- start start 2024-04-26T18:31:51.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f0842f14640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f083c0cc210 0x7f083c0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f0842f14640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f083c0cd830 0x7f083c0d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f0842f14640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c15f2d0 con 0x7f083c155f30 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f0842f14640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f083c15fe70 con 0x7f083c0cd830 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f0842f14640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f083c15f540 con 0x7f083c0cc210 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f0840cb0640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f083c155f30 0x7f083c15c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53304/0 (socket says 172.21.15.139:53304) 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f08414b1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f083c0cd830 0x7f083c0d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f0840cb0640 1 -- 172.21.15.139:0/1096590975 learned_addr learned my addr 172.21.15.139:0/1096590975 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.006+0000 7f083bfff640 1 --2- 172.21.15.139:0/1096590975 >> v2:172.21.15.143:3300/0 conn(0x7f083c0cc210 0x7f083c0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f083b7fe640 1 -- 172.21.15.139:0/1096590975 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377978660 0 0) 0x7f083c15f2d0 con 0x7f083c155f30 2024-04-26T18:31:51.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f083b7fe640 1 -- 172.21.15.139:0/1096590975 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0824003520 con 0x7f083c155f30 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f08414b1640 1 -- 172.21.15.139:0/1096590975 >> v2:172.21.15.143:3300/0 conn(0x7f083c0cc210 msgr2=0x7f083c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f08414b1640 1 --2- 172.21.15.139:0/1096590975 >> v2:172.21.15.143:3300/0 conn(0x7f083c0cc210 0x7f083c0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f08414b1640 1 -- 172.21.15.139:0/1096590975 >> v1:172.21.15.139:6789/0 conn(0x7f083c155f30 legacy=0x7f083c15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f08414b1640 1 -- 172.21.15.139:0/1096590975 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c15f820 con 0x7f083c0cd830 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f08414b1640 1 --2- 172.21.15.139:0/1096590975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c0cd830 0x7f083c0d1800 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f083c0cf1e0 tx=0x7f083402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a7ea25375dfd08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.007+0000 7f083b7fe640 1 -- 172.21.15.139:0/1096590975 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834007740 con 0x7f083c0cd830 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f083b7fe640 1 -- 172.21.15.139:0/1096590975 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08340078e0 con 0x7f083c0cd830 2024-04-26T18:31:51.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f083b7fe640 1 -- 172.21.15.139:0/1096590975 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834007cb0 con 0x7f083c0cd830 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 -- 172.21.15.139:0/1096590975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c0cd830 msgr2=0x7f083c0d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 --2- 172.21.15.139:0/1096590975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c0cd830 0x7f083c0d1800 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f083c0cf1e0 tx=0x7f083402a680 comp rx=0 tx=0).stop 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 -- 172.21.15.139:0/1096590975 shutdown_connections 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 --2- 172.21.15.139:0/1096590975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c0cd830 0x7f083c0d1800 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 --2- 172.21.15.139:0/1096590975 >> v2:172.21.15.143:3300/0 conn(0x7f083c0cc210 0x7f083c0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 -- 172.21.15.139:0/1096590975 >> 172.21.15.139:0/1096590975 conn(0x7f083c068090 msgr2=0x7f083c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 -- 172.21.15.139:0/1096590975 shutdown_connections 2024-04-26T18:31:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.008+0000 7f0842f14640 1 -- 172.21.15.139:0/1096590975 wait complete. 2024-04-26T18:31:51.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.009+0000 7f0842f14640 1 Processor -- start 2024-04-26T18:31:51.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.009+0000 7f0842f14640 1 -- start start 2024-04-26T18:31:51.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f0842f14640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f083c0cc210 0x7f083c1f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f0842f14640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cd830 0x7f083c0d0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f0842f14640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c155f30 0x7f083c1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f0842f14640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f083c0cc730 con 0x7f083c155f30 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f0842f14640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f083c156310 con 0x7f083c0cd830 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f0842f14640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f083c0c6210 con 0x7f083c0cc210 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c155f30 0x7f083c1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c155f30 0x7f083c1f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51030/0 (socket says 172.21.15.139:51030) 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f0840cb0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f083c0cc210 0x7f083c1f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 -- 172.21.15.139:0/1389337732 learned_addr learned my addr 172.21.15.139:0/1389337732 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:51.017 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f083bfff640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cd830 0x7f083c0d0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 -- 172.21.15.139:0/1389337732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f083c0cc210 msgr2=0x7f083c1f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f083c0cc210 0x7f083c1f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 -- 172.21.15.139:0/1389337732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cd830 msgr2=0x7f083c0d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cd830 0x7f083c0d0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.010+0000 7f08414b1640 1 -- 172.21.15.139:0/1389337732 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c0cf5b0 con 0x7f083c155f30 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.011+0000 7f08414b1640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c155f30 0x7f083c1f2e80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f083402ac70 tx=0x7f0834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.011+0000 7f08397fa640 1 -- 172.21.15.139:0/1389337732 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834040070 con 0x7f083c155f30 2024-04-26T18:31:51.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.011+0000 7f08397fa640 1 -- 172.21.15.139:0/1389337732 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0834031bc0 con 0x7f083c155f30 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.011+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c0cf890 con 0x7f083c155f30 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.011+0000 7f08397fa640 1 -- 172.21.15.139:0/1389337732 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834009450 con 0x7f083c155f30 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.011+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c0cfe50 con 0x7f083c155f30 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.012+0000 7f08397fa640 1 -- 172.21.15.139:0/1389337732 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0834039040 con 0x7f083c155f30 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.013+0000 7f08397fa640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f082806c8f0 0x7f082806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.013+0000 7f08397fa640 1 -- 172.21.15.139:0/1389337732 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f08340ad6b0 con 0x7f083c155f30 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.013+0000 7f0840cb0640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f082806c8f0 0x7f082806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.013+0000 7f0840cb0640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f082806c8f0 0x7f082806edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f082c005880 tx=0x7f082c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 Processor -- start 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 -- start start 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ea2e40 0x558ec3ee29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ea3220 0x558ec3ea8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ee24a0 0x558ec3ed0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558ec3e0bc70 con 0x558ec3ea3220 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x558ec3da7690 con 0x558ec3ee24a0 2024-04-26T18:31:51.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.014+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x558ec3e07c30 con 0x558ec3ea2e40 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ea3220 0x558ec3ea8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f0840cb0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ea2e40 0x558ec3ee29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ea3220 0x558ec3ea8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51042/0 (socket says 172.21.15.139:51042) 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 -- 172.21.15.139:0/878022513 learned_addr learned my addr 172.21.15.139:0/878022513 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f08414b1640 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ee24a0 0x558ec3ed0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 -- 172.21.15.139:0/878022513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ea2e40 msgr2=0x558ec3ee29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ea2e40 0x558ec3ee29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 -- 172.21.15.139:0/878022513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ee24a0 msgr2=0x558ec3ed0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ee24a0 0x558ec3ed0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 -- 172.21.15.139:0/878022513 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec3be9a20 con 0x558ec3ea3220 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f083bfff640 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ea3220 0x558ec3ea8230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0830009bc0 tx=0x7f08300112c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaf99ca9a787888 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f08227fc640 1 -- 172.21.15.139:0/878022513 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830011d00 con 0x558ec3ea3220 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f08227fc640 1 -- 172.21.15.139:0/878022513 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830004030 con 0x558ec3ea3220 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.015+0000 7f08227fc640 1 -- 172.21.15.139:0/878022513 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830011ea0 con 0x558ec3ea3220 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 -- 172.21.15.139:0/878022513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ea3220 msgr2=0x558ec3ea8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ea3220 0x558ec3ea8230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0830009bc0 tx=0x7f08300112c0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 -- 172.21.15.139:0/878022513 shutdown_connections 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ee24a0 0x558ec3ed0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ea3220 0x558ec3ea8230 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 --2- 172.21.15.139:0/878022513 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ea2e40 0x558ec3ee29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 -- 172.21.15.139:0/878022513 >> 172.21.15.139:0/878022513 conn(0x558ec3ea4410 msgr2=0x558ec3ea6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 -- 172.21.15.139:0/878022513 shutdown_connections 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 -- 172.21.15.139:0/878022513 wait complete. 2024-04-26T18:31:51.023 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 -- start start 2024-04-26T18:31:51.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.016+0000 7f0845c2b740 1 Processor -- start 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ecdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ea6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ef94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0845c2b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558ec3ee7690 con 0x558ec3ee24a0 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x558ec3da5030 con 0x558ec3ea3220 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x558ec3ee7970 con 0x558ec3ee4310 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0845c2b740 10 client.0 _ll_register_callbacks cb 0x558ec3e18c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:51.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ea6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ea6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51054/0 (socket says 172.21.15.139:51054) 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f083bfff640 1 -- 172.21.15.139:0/945101150 learned_addr learned my addr 172.21.15.139:0/945101150 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f0840cb0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ecdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.017+0000 7f08414b1640 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ef94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f083bfff640 1 -- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 msgr2=0x558ec3ef94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f083bfff640 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ef94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f083bfff640 1 -- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 msgr2=0x558ec3ecdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f083bfff640 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ecdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f083bfff640 1 -- 172.21.15.139:0/945101150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ec3c4a1b0 con 0x558ec3ee24a0 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0840cb0640 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ecdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f083bfff640 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ea6d10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x558ec3ea4860 tx=0x7f0830004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d69a55d5040ff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f081b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f081b7fe640 1 -- 172.21.15.139:0/945101150 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830004510 con 0x558ec3ee24a0 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f081b7fe640 1 -- 172.21.15.139:0/945101150 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f0830003820 con 0x558ec3ee24a0 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0830004030 con 0x558ec3ee24a0 2024-04-26T18:31:51.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f081b7fe640 1 -- 172.21.15.139:0/945101150 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0830006dd0 con 0x558ec3ee24a0 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 10 client.6261 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558ec3add310 con 0x558ec3ee24a0 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f081b7fe640 1 -- 172.21.15.139:0/945101150 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830004030 con 0x558ec3ee24a0 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f081b7fe640 1 -- 172.21.15.139:0/945101150 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f0830003a40 con 0x558ec3ee24a0 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 10 client.6261 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 10 client.6261 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 20 client.6261 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3ec8a50 0x558ec3ec8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 4 client.6261 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ec3e19880 con 0x558ec3ec8a50 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.018+0000 7f0840cb0640 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3ec8a50 0x558ec3ec8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.019+0000 7f081b7fe640 10 client.6261 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.019+0000 7f0840cb0640 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3ec8a50 0x558ec3ec8ee0 crc :-1 s=READY pgs=726 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=801300b03eda91ca server_cookie=be9911516c1e86c1 in_seq=0 out_seq=0 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f081b7fe640 1 -- 172.21.15.139:0/945101150 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558ec3e19880 con 0x558ec3ec8a50 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f081b7fe640 10 client.6261 handle_command_reply: tid=0 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 client.6261 shutdown 2024-04-26T18:31:51.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 msgr2=0x558ec3ea6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ea6d10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x558ec3ea4860 tx=0x7f0830004730 comp rx=0 tx=0).stop 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 shutdown_connections 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3ec8a50 0x558ec3ec8ee0 crc :-1 s=READY pgs=726 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ef94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ea6d10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 --2- 172.21.15.139:0/945101150 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ecdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f081b7fe640 0 client.6261 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 >> 172.21.15.139:0/945101150 conn(0x558ec3ea2e40 msgr2=0x558ec3eccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 shutdown_connections 2024-04-26T18:31:51.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 1 -- 172.21.15.139:0/945101150 wait complete. 2024-04-26T18:31:51.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.020+0000 7f0845c2b740 20 client.6261 trim_cache size 0 max 16384 2024-04-26T18:31:51.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.037+0000 7f0845c2b740 1 Processor -- start 2024-04-26T18:31:51.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.037+0000 7f0845c2b740 1 -- start start 2024-04-26T18:31:51.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ea1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ee4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ee4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0845c2b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f083c200690 con 0x558ec3ee24a0 2024-04-26T18:31:51.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f083c1ff570 con 0x558ec3ea3220 2024-04-26T18:31:51.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f083c1f5cf0 con 0x558ec3ee4310 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ee4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ee4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51058/0 (socket says 172.21.15.139:51058) 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 -- 172.21.15.139:0/3475845305 learned_addr learned my addr 172.21.15.139:0/3475845305 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f08414b1640 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ee4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0840cb0640 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ea1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 -- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 msgr2=0x558ec3ee4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ee4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 -- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 msgr2=0x558ec3ea1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ea1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 -- 172.21.15.139:0/3475845305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec3e1fd60 con 0x558ec3ee24a0 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f083bfff640 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ee4790 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0830009ae0 tx=0x7f0830024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff645e61af53466f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0821ffb640 1 -- 172.21.15.139:0/3475845305 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300117c0 con 0x558ec3ee24a0 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0821ffb640 1 -- 172.21.15.139:0/3475845305 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830003820 con 0x558ec3ee24a0 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.038+0000 7f0821ffb640 1 -- 172.21.15.139:0/3475845305 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830003c10 con 0x558ec3ee24a0 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 -- 172.21.15.139:0/3475845305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 msgr2=0x558ec3ee4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.042 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ee4790 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0830009ae0 tx=0x7f0830024000 comp rx=0 tx=0).stop 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 -- 172.21.15.139:0/3475845305 shutdown_connections 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3ee4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3ee4790 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3475845305 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ea1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 -- 172.21.15.139:0/3475845305 >> 172.21.15.139:0/3475845305 conn(0x558ec3ea2e40 msgr2=0x558ec3eec120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 -- 172.21.15.139:0/3475845305 shutdown_connections 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.039+0000 7f0845c2b740 1 -- 172.21.15.139:0/3475845305 wait complete. 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 -- start start 2024-04-26T18:31:51.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 Processor -- start 2024-04-26T18:31:51.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ef5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3f5c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3f5c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f083c1fe120 con 0x558ec3ee24a0 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f083c1feea0 con 0x558ec3ea3220 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f083c1fe7d0 con 0x558ec3ee4310 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.040+0000 7f0845c2b740 10 client.0 _ll_register_callbacks cb 0x7f0834009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3f5c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3f5c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51074/0 (socket says 172.21.15.139:51074) 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 -- 172.21.15.139:0/3258494356 learned_addr learned my addr 172.21.15.139:0/3258494356 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:51.048 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f0840cb0640 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ef5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f08414b1640 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3f5c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 -- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 msgr2=0x558ec3f5c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3f5c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 -- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 msgr2=0x558ec3ef5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ef5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 -- 172.21.15.139:0/3258494356 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ec3ea1ab0 con 0x558ec3ee24a0 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f083bfff640 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3f5c3f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0830003f60 tx=0x7f0830009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2685bbf792a06b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f081b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f081b7fe640 1 -- 172.21.15.139:0/3258494356 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830042060 con 0x558ec3ee24a0 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f081b7fe640 1 -- 172.21.15.139:0/3258494356 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f08300041f0 con 0x558ec3ee24a0 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0830003820 con 0x558ec3ee24a0 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f081b7fe640 1 -- 172.21.15.139:0/3258494356 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f0830048050 con 0x558ec3ee24a0 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f0845c2b740 10 client.6267 fetch_fsmap learned FSMap version 9 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x558ec3ea4fb0 con 0x558ec3ee24a0 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f081b7fe640 1 -- 172.21.15.139:0/3258494356 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830003820 con 0x558ec3ee24a0 2024-04-26T18:31:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f081b7fe640 1 -- 172.21.15.139:0/3258494356 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f083004b020 con 0x558ec3ee24a0 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f0845c2b740 10 client.6267 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.041+0000 7f0845c2b740 10 client.6267 resolve_mds: validated gid 4309 aka daemon mds.f 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 20 client.6267 populate_metadata read hostname 'smithi139' 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3f65c70 0x558ec3ea56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 4 client.6267 mds_command: new command op to 4309 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 --> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x558ec3e136f0 con 0x558ec3f65c70 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0840cb0640 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3f65c70 0x558ec3ea56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0840cb0640 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3f65c70 0x558ec3ea56d0 crc :-1 s=READY pgs=727 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efbde0c476eb4e5a server_cookie=2b87f0b12576d61d in_seq=0 out_seq=0 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f081b7fe640 10 client.6267 ms_handle_connect on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f081b7fe640 1 -- 172.21.15.139:0/3258494356 <== mds.0 v2:172.21.15.143:6832/19919207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x558ec3e136f0 con 0x558ec3f65c70 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f081b7fe640 10 client.6267 handle_command_reply: tid=0 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 client.6267 shutdown 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 msgr2=0x558ec3f5c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3f5c3f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0830003f60 tx=0x7f0830009190 comp rx=0 tx=0).stop 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 shutdown_connections 2024-04-26T18:31:51.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:6832/19919207,v1:172.21.15.143:6834/19919207] conn(0x558ec3f65c70 0x558ec3ea56d0 crc :-1 s=READY pgs=727 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x558ec3ee4310 0x558ec3f5c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f081b7fe640 0 client.6267 ms_handle_reset on v2:172.21.15.143:6832/19919207 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558ec3ee24a0 0x558ec3f5c3f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 --2- 172.21.15.139:0/3258494356 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x558ec3ea3220 0x558ec3ef5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.042+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 >> 172.21.15.139:0/3258494356 conn(0x558ec3ea2e40 msgr2=0x558ec3eebb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 shutdown_connections 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0845c2b740 1 -- 172.21.15.139:0/3258494356 wait complete. 2024-04-26T18:31:51.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0845c2b740 20 client.6267 trim_cache size 0 max 16384 2024-04-26T18:31:51.054 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:51.054 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 9, 2024-04-26T18:31:51.054 INFO:teuthology.orchestra.run.smithi139.stdout: "leader": 4309, 2024-04-26T18:31:51.054 INFO:teuthology.orchestra.run.smithi139.stdout: "set_version": 112, 2024-04-26T18:31:51.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sets": {} 2024-04-26T18:31:51.054 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:51.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f082806c8f0 msgr2=0x7f082806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f082806c8f0 0x7f082806edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f082c005880 tx=0x7f082c009040 comp rx=0 tx=0).stop 2024-04-26T18:31:51.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c155f30 msgr2=0x7f083c1f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c155f30 0x7f083c1f2e80 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f083402ac70 tx=0x7f0834004a40 comp rx=0 tx=0).stop 2024-04-26T18:31:51.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 shutdown_connections 2024-04-26T18:31:51.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f082806c8f0 0x7f082806edb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f083c155f30 0x7f083c1f2e80 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f083c0cd830 0x7f083c0d0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 --2- 172.21.15.139:0/1389337732 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f083c0cc210 0x7f083c1f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 >> 172.21.15.139:0/1389337732 conn(0x7f083c068090 msgr2=0x7f083c1530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 shutdown_connections 2024-04-26T18:31:51.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.043+0000 7f0842f14640 1 -- 172.21.15.139:0/1389337732 wait complete. 2024-04-26T18:31:51.058 INFO:tasks.quiescer:done joining Quiescers 2024-04-26T18:31:51.058 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T18:31:51.067 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T18:31:51.067 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T18:31:51.067 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T18:31:51.083 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-26T18:31:51.083 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T18:31:51.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T18:31:51.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.276+0000 7fad7ccb0640 1 Processor -- start 2024-04-26T18:31:51.276 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.276+0000 7fad7ccb0640 1 -- start start 2024-04-26T18:31:51.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.276+0000 7fad7ccb0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fad78155a70 0x7fad78155e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.276+0000 7fad7ccb0640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fad780c9df0 0x7fad780cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.276+0000 7fad7ccb0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad78071890 con 0x7fad780b1ed0 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.276+0000 7fad7ccb0640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fad780cab10 con 0x7fad780c9df0 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.276+0000 7fad7ccb0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fad7815bcc0 con 0x7fad78155a70 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad76d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fad780c9df0 0x7fad780cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad76d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fad780c9df0 0x7fad780cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51082/0 (socket says 172.21.15.139:51082) 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad76d9d640 1 -- 172.21.15.139:0/894935902 learned_addr learned my addr 172.21.15.139:0/894935902 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad7659c640 1 --2- 172.21.15.139:0/894935902 >> v2:172.21.15.143:3300/0 conn(0x7fad78155a70 0x7fad78155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad76d9d640 1 -- 172.21.15.139:0/894935902 >> v2:172.21.15.143:3300/0 conn(0x7fad78155a70 msgr2=0x7fad78155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad76d9d640 1 --2- 172.21.15.139:0/894935902 >> v2:172.21.15.143:3300/0 conn(0x7fad78155a70 0x7fad78155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad76d9d640 1 -- 172.21.15.139:0/894935902 >> v1:172.21.15.143:6789/0 conn(0x7fad780b1ed0 legacy=0x7fad7806ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad76d9d640 1 -- 172.21.15.139:0/894935902 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad780ca570 con 0x7fad780c9df0 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.277+0000 7fad7659c640 1 --2- 172.21.15.139:0/894935902 >> v2:172.21.15.143:3300/0 conn(0x7fad78155a70 0x7fad78155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad76d9d640 1 --2- 172.21.15.139:0/894935902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780cbe60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fad78072a30 tx=0x7fad6802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b10049684fbbb02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7559a640 1 -- 172.21.15.139:0/894935902 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68037070 con 0x7fad780c9df0 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7559a640 1 -- 172.21.15.139:0/894935902 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6802ae50 con 0x7fad780c9df0 2024-04-26T18:31:51.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7559a640 1 -- 172.21.15.139:0/894935902 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68032860 con 0x7fad780c9df0 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 -- 172.21.15.139:0/894935902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 msgr2=0x7fad780cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/894935902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780cbe60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fad78072a30 tx=0x7fad6802a300 comp rx=0 tx=0).stop 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 -- 172.21.15.139:0/894935902 shutdown_connections 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/894935902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780cbe60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/894935902 >> v2:172.21.15.143:3300/0 conn(0x7fad78155a70 0x7fad78155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 -- 172.21.15.139:0/894935902 >> 172.21.15.139:0/894935902 conn(0x7fad78071de0 msgr2=0x7fad780721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 -- 172.21.15.139:0/894935902 shutdown_connections 2024-04-26T18:31:51.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.278+0000 7fad7ccb0640 1 -- 172.21.15.139:0/894935902 wait complete. 2024-04-26T18:31:51.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 Processor -- start 2024-04-26T18:31:51.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 -- start start 2024-04-26T18:31:51.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad780b1ed0 0x7fad781f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad78155a70 0x7fad780c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fad7815c240 con 0x7fad780c9df0 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fad7815bf60 con 0x7fad78155a70 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7ccb0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fad7815c520 con 0x7fad780b1ed0 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad75d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad75d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51096/0 (socket says 172.21.15.139:51096) 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad76d9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad78155a70 0x7fad780c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad75d9b640 1 -- 172.21.15.139:0/1662506222 learned_addr learned my addr 172.21.15.139:0/1662506222 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.280+0000 7fad7659c640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad780b1ed0 0x7fad781f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad75d9b640 1 -- 172.21.15.139:0/1662506222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad780b1ed0 msgr2=0x7fad781f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad75d9b640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad780b1ed0 0x7fad781f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad75d9b640 1 -- 172.21.15.139:0/1662506222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad78155a70 msgr2=0x7fad780c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad75d9b640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad78155a70 0x7fad780c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad75d9b640 1 -- 172.21.15.139:0/1662506222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad780c67d0 con 0x7fad780c9df0 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad75d9b640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780c83e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c400 tx=0x7fad6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad6effd640 1 -- 172.21.15.139:0/1662506222 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60017070 con 0x7fad780c9df0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad6effd640 1 -- 172.21.15.139:0/1662506222 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad600052d0 con 0x7fad780c9df0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad6effd640 1 -- 172.21.15.139:0/1662506222 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60003830 con 0x7fad780c9df0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad780c6ab0 con 0x7fad780c9df0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.281+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7814f4f0 con 0x7fad780c9df0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.282+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad78076d20 con 0x7fad780c9df0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.283+0000 7fad6effd640 1 -- 172.21.15.139:0/1662506222 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad6001a070 con 0x7fad780c9df0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.283+0000 7fad6effd640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fad5806c8f0 0x7fad5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.283+0000 7fad7659c640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fad5806c8f0 0x7fad5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:51.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.283+0000 7fad6effd640 1 -- 172.21.15.139:0/1662506222 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fad6008b170 con 0x7fad780c9df0 2024-04-26T18:31:51.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.283+0000 7fad7659c640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fad5806c8f0 0x7fad5806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fad70003b80 tx=0x7fad70009890 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:51.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.287+0000 7fad6effd640 1 -- 172.21.15.139:0/1662506222 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad60058ba0 con 0x7fad780c9df0 2024-04-26T18:31:51.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.476+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fad7806e150 con 0x7fad780c9df0 2024-04-26T18:31:51.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.476+0000 7fad6effd640 1 -- 172.21.15.139:0/1662506222 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7fad6005cea0 con 0x7fad780c9df0 2024-04-26T18:31:51.477 INFO:teuthology.orchestra.run.smithi139.stderr:listed 0 entries 2024-04-26T18:31:51.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fad5806c8f0 msgr2=0x7fad5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fad5806c8f0 0x7fad5806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fad70003b80 tx=0x7fad70009890 comp rx=0 tx=0).stop 2024-04-26T18:31:51.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 msgr2=0x7fad780c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:51.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780c83e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c400 tx=0x7fad6000c8c0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 shutdown_connections 2024-04-26T18:31:51.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fad5806c8f0 0x7fad5806edb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fad78155a70 0x7fad780c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad780c9df0 0x7fad780c83e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 --2- 172.21.15.139:0/1662506222 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fad780b1ed0 0x7fad781f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:51.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 >> 172.21.15.139:0/1662506222 conn(0x7fad78071de0 msgr2=0x7fad7815b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:51.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 shutdown_connections 2024-04-26T18:31:51.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:51.478+0000 7fad7ccb0640 1 -- 172.21.15.139:0/1662506222 wait complete. 2024-04-26T18:31:51.490 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T18:31:51.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:31:51.490 DEBUG:teuthology.orchestra.run.smithi139:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T18:31:51.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T18:31:51.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:31:51.647 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T18:31:51.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:31:51.662 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-04-26T18:31:51.716 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T18:31:51.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:31:51.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T18:31:51.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:31:51.781 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-04-26T18:31:51.892 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T18:31:51.902 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T18:31:51.902 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:31:52.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.001+0000 7efcbb938640 1 Processor -- start 2024-04-26T18:31:52.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.001+0000 7efcbb938640 1 -- start start 2024-04-26T18:31:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.001+0000 7efcbb938640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb40c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcbb938640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efcb40ca8a0 0x7efcb4155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcbb938640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb406f0d0 con 0x7efcb40cd6d0 2024-04-26T18:31:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcbb938640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7efcb40c8160 con 0x7efcb40ca8a0 2024-04-26T18:31:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcbb938640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efcb40c9b80 con 0x7efcb40cdab0 2024-04-26T18:31:52.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb9ed5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efcb40ca8a0 0x7efcb4155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb9ed5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efcb40ca8a0 0x7efcb4155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51100/0 (socket says 172.21.15.139:51100) 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb9ed5640 1 -- 172.21.15.139:0/3943165768 learned_addr learned my addr 172.21.15.139:0/3943165768 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb8ed3640 1 --2- 172.21.15.139:0/3943165768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb40c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb9ed5640 1 -- 172.21.15.139:0/3943165768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 msgr2=0x7efcb40c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb9ed5640 1 --2- 172.21.15.139:0/3943165768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb40c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb9ed5640 1 -- 172.21.15.139:0/3943165768 >> v1:172.21.15.143:6789/0 conn(0x7efcb40cd6d0 legacy=0x7efcb415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcabfff640 1 -- 172.21.15.139:0/3943165768 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565653680 0 0) 0x7efcb406f0d0 con 0x7efcb40cd6d0 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.002+0000 7efcb9ed5640 1 -- 172.21.15.139:0/3943165768 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb406f3b0 con 0x7efcb40ca8a0 2024-04-26T18:31:52.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcb9ed5640 1 --2- 172.21.15.139:0/3943165768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4155950 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efcac009e50 tx=0x7efcac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1a4d2b4b19fbb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcabfff640 1 -- 172.21.15.139:0/3943165768 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac036070 con 0x7efcb40ca8a0 2024-04-26T18:31:52.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcabfff640 1 -- 172.21.15.139:0/3943165768 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcac031600 con 0x7efcb40ca8a0 2024-04-26T18:31:52.005 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcabfff640 1 -- 172.21.15.139:0/3943165768 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac0319d0 con 0x7efcb40ca8a0 2024-04-26T18:31:52.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcbb938640 1 -- 172.21.15.139:0/3943165768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 msgr2=0x7efcb4155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcbb938640 1 --2- 172.21.15.139:0/3943165768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4155950 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efcac009e50 tx=0x7efcac02a710 comp rx=0 tx=0).stop 2024-04-26T18:31:52.008 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcbb938640 1 -- 172.21.15.139:0/3943165768 shutdown_connections 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcbb938640 1 --2- 172.21.15.139:0/3943165768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4155950 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcbb938640 1 --2- 172.21.15.139:0/3943165768 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb40c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.003+0000 7efcbb938640 1 -- 172.21.15.139:0/3943165768 >> 172.21.15.139:0/3943165768 conn(0x7efcb4068270 msgr2=0x7efcb4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.004+0000 7efcbb938640 1 -- 172.21.15.139:0/3943165768 shutdown_connections 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.004+0000 7efcbb938640 1 -- 172.21.15.139:0/3943165768 wait complete. 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 Processor -- start 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 -- start start 2024-04-26T18:31:52.009 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcb40cd6d0 0x7efcb415c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb4156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40ca380 con 0x7efcb40ca8a0 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40ca0a0 con 0x7efcb40cd6d0 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcbb938640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efcb4072260 con 0x7efcb40cdab0 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcb96d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.005+0000 7efcb96d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51116/0 (socket says 172.21.15.139:51116) 2024-04-26T18:31:52.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb96d4640 1 -- 172.21.15.139:0/2334003346 learned_addr learned my addr 172.21.15.139:0/2334003346 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb8ed3640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcb40cd6d0 0x7efcb415c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb9ed5640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb4156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb96d4640 1 -- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 msgr2=0x7efcb4156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb96d4640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb4156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb96d4640 1 -- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcb40cd6d0 msgr2=0x7efcb415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb96d4640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcb40cd6d0 0x7efcb415c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb96d4640 1 -- 172.21.15.139:0/2334003346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb414e040 con 0x7efcb40ca8a0 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcb96d4640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4157860 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efca400c4e0 tx=0x7efca400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efca9ffb640 1 -- 172.21.15.139:0/2334003346 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4017070 con 0x7efcb40ca8a0 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efca9ffb640 1 -- 172.21.15.139:0/2334003346 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca40035f0 con 0x7efcb40ca8a0 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb41f5730 con 0x7efcb40ca8a0 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efca9ffb640 1 -- 172.21.15.139:0/2334003346 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40039e0 con 0x7efcb40ca8a0 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.006+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb41f5cf0 con 0x7efcb40ca8a0 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.007+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb4076d20 con 0x7efcb40ca8a0 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.008+0000 7efca9ffb640 1 -- 172.21.15.139:0/2334003346 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efca401a070 con 0x7efcb40ca8a0 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.008+0000 7efca9ffb640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efc9806c920 0x7efc9806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.008+0000 7efca9ffb640 1 -- 172.21.15.139:0/2334003346 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efca408b1a0 con 0x7efcb40ca8a0 2024-04-26T18:31:52.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.008+0000 7efcb8ed3640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efc9806c920 0x7efc9806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.008+0000 7efcb8ed3640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efc9806c920 0x7efc9806ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efcb41595f0 tx=0x7efcb0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.013 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.012+0000 7efca9ffb640 1 -- 172.21.15.139:0/2334003346 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efca4058bd0 con 0x7efcb40ca8a0 2024-04-26T18:31:52.188 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.188+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efcb4144710 con 0x7efc9806c920 2024-04-26T18:31:52.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.196+0000 7efca9ffb640 1 -- 172.21.15.139:0/2334003346 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+337848 (secure 0 0 0) 0x7efcb00119d0 con 0x7efc9806c920 2024-04-26T18:31:52.200 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:52.202 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T18:31:52.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efc9806c920 msgr2=0x7efc9806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efc9806c920 0x7efc9806ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efcb41595f0 tx=0x7efcb0009190 comp rx=0 tx=0).stop 2024-04-26T18:31:52.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 msgr2=0x7efcb4157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4157860 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efca400c4e0 tx=0x7efca400c9a0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 shutdown_connections 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efc9806c920 0x7efc9806ede0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efcb40cdab0 0x7efcb4156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efcb40cd6d0 0x7efcb415c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 --2- 172.21.15.139:0/2334003346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efcb40ca8a0 0x7efcb4157860 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 >> 172.21.15.139:0/2334003346 conn(0x7efcb4068270 msgr2=0x7efcb40cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:52.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 shutdown_connections 2024-04-26T18:31:52.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.200+0000 7efcbb938640 1 -- 172.21.15.139:0/2334003346 wait complete. 2024-04-26T18:31:52.211 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":1053,"stamp":"2024-04-26T18:31:51.588383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1981266339,"num_objects":44241,"num_object_clones":19129,"num_object_copies":167018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44241,"num_whiteouts":18953,"num_read":8532,"num_read_kb":5970244,"num_write":113436,"num_write_kb":4242584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162245,"ondisk_log_size":162245,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6300488,"kb_used_data":4074952,"kb_used_omap":12,"kb_used_meta":2225459,"kb_avail":748674232,"statfs":{"total":773094113280,"available":766642413568,"internally_reserved":0,"allocated":4172750848,"data_stored":4172124006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2278870580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":222,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004567"},"pg_stats":[{"pgid":"2.1f","version":"41'522","reported_seq":594,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:40.758347+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T18:31:40.758347+0000","last_peered":"2024-04-26T18:31:40.758347+0000","last_clean":"2024-04-26T18:31:40.758347+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T18:31:40.758347+0000","last_undegraded":"2024-04-26T18:31:40.758347+0000","last_fullsized":"2024-04-26T18:31:40.758347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37228914,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":590,"num_write_kb":74511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"41'601","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.380741+0000","last_change":"2024-04-26T18:03:00.448985+0000","last_active":"2024-04-26T18:29:46.380741+0000","last_peered":"2024-04-26T18:29:46.380741+0000","last_clean":"2024-04-26T18:29:46.380741+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T18:29:46.380741+0000","last_undegraded":"2024-04-26T18:29:46.380741+0000","last_fullsized":"2024-04-26T18:29:46.380741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:41.107725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230683108,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"41'2821","reported_seq":4546,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.880248+0000","last_change":"2024-04-26T18:03:00.450087+0000","last_active":"2024-04-26T18:31:36.880248+0000","last_peered":"2024-04-26T18:31:36.880248+0000","last_clean":"2024-04-26T18:31:36.880248+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T18:31:36.880248+0000","last_undegraded":"2024-04-26T18:31:36.880248+0000","last_fullsized":"2024-04-26T18:31:36.880248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:07.265582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.226534869,"stat_sum":{"num_bytes":47000043,"num_objects":1217,"num_object_clones":566,"num_object_copies":4868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":566,"num_read":206,"num_read_kb":291402,"num_write":2298,"num_write_kb":59293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'1115","reported_seq":1187,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174878+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T18:30:48.174878+0000","last_peered":"2024-04-26T18:30:48.174878+0000","last_clean":"2024-04-26T18:30:48.174878+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T18:30:48.174878+0000","last_undegraded":"2024-04-26T18:30:48.174878+0000","last_fullsized":"2024-04-26T18:30:48.174878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":1207,"num_write_kb":83571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"41'585","reported_seq":2668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.361929+0000","last_change":"2024-04-26T18:03:00.426487+0000","last_active":"2024-04-26T18:29:46.361929+0000","last_peered":"2024-04-26T18:29:46.361929+0000","last_clean":"2024-04-26T18:29:46.361929+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T18:29:46.361929+0000","last_undegraded":"2024-04-26T18:29:46.361929+0000","last_fullsized":"2024-04-26T18:29:46.361929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:33.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19357582500000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":12,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"41'2977","reported_seq":4608,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.346136+0000","last_change":"2024-04-26T18:03:00.392141+0000","last_active":"2024-04-26T18:31:32.346136+0000","last_peered":"2024-04-26T18:31:32.346136+0000","last_clean":"2024-04-26T18:31:32.346136+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T18:31:32.346136+0000","last_undegraded":"2024-04-26T18:31:32.346136+0000","last_fullsized":"2024-04-26T18:31:32.346136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:05.822108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17635221100000001,"stat_sum":{"num_bytes":22365631,"num_objects":1261,"num_object_clones":594,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1261,"num_whiteouts":594,"num_read":140,"num_read_kb":92586,"num_write":2429,"num_write_kb":39864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"41'1019","reported_seq":1088,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.103488+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T18:30:48.103488+0000","last_peered":"2024-04-26T18:30:48.103488+0000","last_clean":"2024-04-26T18:30:48.103488+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T18:30:48.103488+0000","last_undegraded":"2024-04-26T18:30:48.103488+0000","last_fullsized":"2024-04-26T18:30:48.103488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":1097,"num_write_kb":133138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'617","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347530+0000","last_change":"2024-04-26T18:03:00.388273+0000","last_active":"2024-04-26T18:29:46.347530+0000","last_peered":"2024-04-26T18:29:46.347530+0000","last_clean":"2024-04-26T18:29:46.347530+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T18:29:46.347530+0000","last_undegraded":"2024-04-26T18:29:46.347530+0000","last_fullsized":"2024-04-26T18:29:46.347530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:56.202777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16172857600000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"41'2946","reported_seq":4647,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.787520+0000","last_change":"2024-04-26T18:03:00.421690+0000","last_active":"2024-04-26T18:31:36.787520+0000","last_peered":"2024-04-26T18:31:36.787520+0000","last_clean":"2024-04-26T18:31:36.787520+0000","last_became_active":"2024-04-26T17:58:46.846516+0000","last_became_peered":"2024-04-26T17:58:46.846516+0000","last_unstale":"2024-04-26T18:31:36.787520+0000","last_undegraded":"2024-04-26T18:31:36.787520+0000","last_fullsized":"2024-04-26T18:31:36.787520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:34.049400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18830187000000001,"stat_sum":{"num_bytes":52036256,"num_objects":1294,"num_object_clones":599,"num_object_copies":5176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":599,"num_read":207,"num_read_kb":311106,"num_write":2398,"num_write_kb":54529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"41'525","reported_seq":594,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.579571+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T18:30:13.579571+0000","last_peered":"2024-04-26T18:30:13.579571+0000","last_clean":"2024-04-26T18:30:13.579571+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T18:30:13.579571+0000","last_undegraded":"2024-04-26T18:30:13.579571+0000","last_fullsized":"2024-04-26T18:30:13.579571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":594,"num_write_kb":70938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"41'594","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.439128+0000","last_change":"2024-04-26T18:03:00.385887+0000","last_active":"2024-04-26T18:29:46.439128+0000","last_peered":"2024-04-26T18:29:46.439128+0000","last_clean":"2024-04-26T18:29:46.439128+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T18:29:46.439128+0000","last_undegraded":"2024-04-26T18:29:46.439128+0000","last_fullsized":"2024-04-26T18:29:46.439128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:36.980517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161485249,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"41'2787","reported_seq":4507,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.854706+0000","last_change":"2024-04-26T18:03:00.421543+0000","last_active":"2024-04-26T18:31:36.854706+0000","last_peered":"2024-04-26T18:31:36.854706+0000","last_clean":"2024-04-26T18:31:36.854706+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T18:31:36.854706+0000","last_undegraded":"2024-04-26T18:31:36.854706+0000","last_fullsized":"2024-04-26T18:31:36.854706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2787,"log_dups_size":0,"ondisk_log_size":2787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:00.311837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18642139199999999,"stat_sum":{"num_bytes":46440810,"num_objects":1192,"num_object_clones":545,"num_object_copies":4768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":545,"num_read":179,"num_read_kb":201194,"num_write":2302,"num_write_kb":49304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"41'629","reported_seq":2703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347806+0000","last_change":"2024-04-26T18:03:00.044745+0000","last_active":"2024-04-26T18:29:46.347806+0000","last_peered":"2024-04-26T18:29:46.347806+0000","last_clean":"2024-04-26T18:29:46.347806+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T18:29:46.347806+0000","last_undegraded":"2024-04-26T18:29:46.347806+0000","last_fullsized":"2024-04-26T18:29:46.347806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:46.688756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101605577,"stat_sum":{"num_bytes":0,"num_objects":66,"num_object_clones":20,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"41'2536","reported_seq":2607,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:08.693990+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T18:30:08.693990+0000","last_peered":"2024-04-26T18:30:08.693990+0000","last_clean":"2024-04-26T18:30:08.693990+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T18:30:08.693990+0000","last_undegraded":"2024-04-26T18:30:08.693990+0000","last_fullsized":"2024-04-26T18:30:08.693990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2536,"log_dups_size":0,"ondisk_log_size":2536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":2609,"num_write_kb":88139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"41'2917","reported_seq":4583,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.847250+0000","last_change":"2024-04-26T18:03:00.418993+0000","last_active":"2024-04-26T18:31:36.847250+0000","last_peered":"2024-04-26T18:31:36.847250+0000","last_clean":"2024-04-26T18:31:36.847250+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T18:31:36.847250+0000","last_undegraded":"2024-04-26T18:31:36.847250+0000","last_fullsized":"2024-04-26T18:31:36.847250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:49.886797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19133515200000001,"stat_sum":{"num_bytes":43266035,"num_objects":1273,"num_object_clones":588,"num_object_copies":5092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1273,"num_whiteouts":588,"num_read":168,"num_read_kb":222667,"num_write":2389,"num_write_kb":54953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"41'605","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.349645+0000","last_change":"2024-04-26T18:03:00.446780+0000","last_active":"2024-04-26T18:29:48.349645+0000","last_peered":"2024-04-26T18:29:48.349645+0000","last_clean":"2024-04-26T18:29:48.349645+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T18:29:48.349645+0000","last_undegraded":"2024-04-26T18:29:48.349645+0000","last_fullsized":"2024-04-26T18:29:48.349645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:07.280297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22887548799999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":9,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'1327","reported_seq":1398,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:47.818586+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T18:30:47.818586+0000","last_peered":"2024-04-26T18:30:47.818586+0000","last_clean":"2024-04-26T18:30:47.818586+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T18:30:47.818586+0000","last_undegraded":"2024-04-26T18:30:47.818586+0000","last_fullsized":"2024-04-26T18:30:47.818586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":1392,"num_write_kb":95976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"41'2855","reported_seq":4547,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.895356+0000","last_change":"2024-04-26T18:03:00.416771+0000","last_active":"2024-04-26T18:31:36.895356+0000","last_peered":"2024-04-26T18:31:36.895356+0000","last_clean":"2024-04-26T18:31:36.895356+0000","last_became_active":"2024-04-26T17:58:46.846635+0000","last_became_peered":"2024-04-26T17:58:46.846635+0000","last_unstale":"2024-04-26T18:31:36.895356+0000","last_undegraded":"2024-04-26T18:31:36.895356+0000","last_fullsized":"2024-04-26T18:31:36.895356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:06.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928092499999999,"stat_sum":{"num_bytes":21448645,"num_objects":1180,"num_object_clones":543,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":543,"num_read":142,"num_read_kb":62635,"num_write":2368,"num_write_kb":33318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"41'646","reported_seq":2725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175950+0000","last_change":"2024-04-26T18:03:00.446546+0000","last_active":"2024-04-26T18:30:16.175950+0000","last_peered":"2024-04-26T18:30:16.175950+0000","last_clean":"2024-04-26T18:30:16.175950+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T18:30:16.175950+0000","last_undegraded":"2024-04-26T18:30:16.175950+0000","last_fullsized":"2024-04-26T18:30:16.175950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:30.786683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22842327800000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":15,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"41'848","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.175344+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T18:30:48.175344+0000","last_peered":"2024-04-26T18:30:48.175344+0000","last_clean":"2024-04-26T18:30:48.175344+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T18:30:48.175344+0000","last_undegraded":"2024-04-26T18:30:48.175344+0000","last_fullsized":"2024-04-26T18:30:48.175344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":901,"num_write_kb":79506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"41'2890","reported_seq":4575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.886843+0000","last_change":"2024-04-26T18:03:00.013967+0000","last_active":"2024-04-26T18:31:36.886843+0000","last_peered":"2024-04-26T18:31:36.886843+0000","last_clean":"2024-04-26T18:31:36.886843+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T18:31:36.886843+0000","last_undegraded":"2024-04-26T18:31:36.886843+0000","last_fullsized":"2024-04-26T18:31:36.886843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:56.071843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077792920000000002,"stat_sum":{"num_bytes":29575215,"num_objects":1245,"num_object_clones":583,"num_object_copies":4980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":583,"num_read":184,"num_read_kb":122824,"num_write":2351,"num_write_kb":42495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"41'615","reported_seq":2700,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375930+0000","last_change":"2024-04-26T18:03:00.424812+0000","last_active":"2024-04-26T18:29:46.375930+0000","last_peered":"2024-04-26T18:29:46.375930+0000","last_clean":"2024-04-26T18:29:46.375930+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T18:29:46.375930+0000","last_undegraded":"2024-04-26T18:29:46.375930+0000","last_fullsized":"2024-04-26T18:29:46.375930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:21.113921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18061166100000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"41'468","reported_seq":539,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:45.748977+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T18:30:45.748977+0000","last_peered":"2024-04-26T18:30:45.748977+0000","last_clean":"2024-04-26T18:30:45.748977+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T18:30:45.748977+0000","last_undegraded":"2024-04-26T18:30:45.748977+0000","last_fullsized":"2024-04-26T18:30:45.748977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":511,"num_write_kb":66851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"41'2805","reported_seq":4481,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.894628+0000","last_change":"2024-04-26T18:03:00.413832+0000","last_active":"2024-04-26T18:31:36.894628+0000","last_peered":"2024-04-26T18:31:36.894628+0000","last_clean":"2024-04-26T18:31:36.894628+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T18:31:36.894628+0000","last_undegraded":"2024-04-26T18:31:36.894628+0000","last_fullsized":"2024-04-26T18:31:36.894628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2805,"log_dups_size":0,"ondisk_log_size":2805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:37.962626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18788326999999999,"stat_sum":{"num_bytes":37828835,"num_objects":1237,"num_object_clones":573,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":573,"num_read":163,"num_read_kb":252845,"num_write":2275,"num_write_kb":48379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"41'593","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:38.193600+0000","last_change":"2024-04-26T18:03:00.425151+0000","last_active":"2024-04-26T18:30:38.193600+0000","last_peered":"2024-04-26T18:30:38.193600+0000","last_clean":"2024-04-26T18:30:38.193600+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T18:30:38.193600+0000","last_undegraded":"2024-04-26T18:30:38.193600+0000","last_fullsized":"2024-04-26T18:30:38.193600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.966252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19854031599999999,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"41'813","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:33.145622+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T18:29:33.145622+0000","last_peered":"2024-04-26T18:29:33.145622+0000","last_clean":"2024-04-26T18:29:33.145622+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T18:29:33.145622+0000","last_undegraded":"2024-04-26T18:29:33.145622+0000","last_fullsized":"2024-04-26T18:29:33.145622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":915,"num_write_kb":75562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"41'2861","reported_seq":4549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.873322+0000","last_change":"2024-04-26T18:03:00.424600+0000","last_active":"2024-04-26T18:31:36.873322+0000","last_peered":"2024-04-26T18:31:36.873322+0000","last_clean":"2024-04-26T18:31:36.873322+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T18:31:36.873322+0000","last_undegraded":"2024-04-26T18:31:36.873322+0000","last_fullsized":"2024-04-26T18:31:36.873322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:18.947305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.181349811,"stat_sum":{"num_bytes":38568471,"num_objects":1183,"num_object_clones":549,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":549,"num_read":148,"num_read_kb":161250,"num_write":2358,"num_write_kb":47514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"41'590","reported_seq":2670,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.151126+0000","last_change":"2024-04-26T18:03:00.451850+0000","last_active":"2024-04-26T18:29:47.151126+0000","last_peered":"2024-04-26T18:29:47.151126+0000","last_clean":"2024-04-26T18:29:47.151126+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T18:29:47.151126+0000","last_undegraded":"2024-04-26T18:29:47.151126+0000","last_fullsized":"2024-04-26T18:29:47.151126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:02.283489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217975578,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"41'1483","reported_seq":1554,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:59.181804+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T18:30:59.181804+0000","last_peered":"2024-04-26T18:30:59.181804+0000","last_clean":"2024-04-26T18:30:59.181804+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T18:30:59.181804+0000","last_undegraded":"2024-04-26T18:30:59.181804+0000","last_fullsized":"2024-04-26T18:30:59.181804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1483,"log_dups_size":0,"ondisk_log_size":1483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":3198,"num_write_kb":72387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"41'2904","reported_seq":4597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.340152+0000","last_change":"2024-04-26T18:03:00.447628+0000","last_active":"2024-04-26T18:31:32.340152+0000","last_peered":"2024-04-26T18:31:32.340152+0000","last_clean":"2024-04-26T18:31:32.340152+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T18:31:32.340152+0000","last_undegraded":"2024-04-26T18:31:32.340152+0000","last_fullsized":"2024-04-26T18:31:32.340152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2904,"log_dups_size":0,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:52.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23002119400000001,"stat_sum":{"num_bytes":32774060,"num_objects":1224,"num_object_clones":563,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1224,"num_whiteouts":563,"num_read":167,"num_read_kb":173625,"num_write":2397,"num_write_kb":37665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"41'607","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.414938+0000","last_change":"2024-04-26T18:03:00.013128+0000","last_active":"2024-04-26T18:29:41.414938+0000","last_peered":"2024-04-26T18:29:41.414938+0000","last_clean":"2024-04-26T18:29:41.414938+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T18:29:41.414938+0000","last_undegraded":"2024-04-26T18:29:41.414938+0000","last_fullsized":"2024-04-26T18:29:41.414938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:28.496234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077215679999999995,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"41'788","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.548547+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T18:30:18.548547+0000","last_peered":"2024-04-26T18:30:18.548547+0000","last_clean":"2024-04-26T18:30:18.548547+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T18:30:18.548547+0000","last_undegraded":"2024-04-26T18:30:18.548547+0000","last_fullsized":"2024-04-26T18:30:18.548547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":856,"num_write_kb":87605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"41'2980","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.803974+0000","last_change":"2024-04-26T18:03:00.424270+0000","last_active":"2024-04-26T18:31:36.803974+0000","last_peered":"2024-04-26T18:31:36.803974+0000","last_clean":"2024-04-26T18:31:36.803974+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T18:31:36.803974+0000","last_undegraded":"2024-04-26T18:31:36.803974+0000","last_fullsized":"2024-04-26T18:31:36.803974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:36.634495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20617318100000001,"stat_sum":{"num_bytes":38568987,"num_objects":1282,"num_object_clones":600,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":600,"num_read":166,"num_read_kb":191696,"num_write":2429,"num_write_kb":47342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'616","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.407143+0000","last_change":"2024-04-26T18:03:00.387991+0000","last_active":"2024-04-26T18:29:46.407143+0000","last_peered":"2024-04-26T18:29:46.407143+0000","last_clean":"2024-04-26T18:29:46.407143+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T18:29:46.407143+0000","last_undegraded":"2024-04-26T18:29:46.407143+0000","last_fullsized":"2024-04-26T18:29:46.407143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:06.986658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161265819,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"41'746","reported_seq":818,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.190651+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T18:30:48.190651+0000","last_peered":"2024-04-26T18:30:48.190651+0000","last_clean":"2024-04-26T18:30:48.190651+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T18:30:48.190651+0000","last_undegraded":"2024-04-26T18:30:48.190651+0000","last_fullsized":"2024-04-26T18:30:48.190651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":797,"num_write_kb":111877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"41'2902","reported_seq":4611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.889065+0000","last_change":"2024-04-26T18:03:00.012758+0000","last_active":"2024-04-26T18:31:36.889065+0000","last_peered":"2024-04-26T18:31:36.889065+0000","last_clean":"2024-04-26T18:31:36.889065+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T18:31:36.889065+0000","last_undegraded":"2024-04-26T18:31:36.889065+0000","last_fullsized":"2024-04-26T18:31:36.889065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2902,"log_dups_size":0,"ondisk_log_size":2902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.245551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077512545000000002,"stat_sum":{"num_bytes":51130541,"num_objects":1258,"num_object_clones":577,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":577,"num_read":197,"num_read_kb":290939,"num_write":2373,"num_write_kb":60236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'612","reported_seq":2696,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.356164+0000","last_change":"2024-04-26T18:03:00.422866+0000","last_active":"2024-04-26T18:30:01.356164+0000","last_peered":"2024-04-26T18:30:01.356164+0000","last_clean":"2024-04-26T18:30:01.356164+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T18:30:01.356164+0000","last_undegraded":"2024-04-26T18:30:01.356164+0000","last_fullsized":"2024-04-26T18:30:01.356164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:27.152866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18566148499999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"41'538","reported_seq":610,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.192866+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T18:30:48.192866+0000","last_peered":"2024-04-26T18:30:48.192866+0000","last_clean":"2024-04-26T18:30:48.192866+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T18:30:48.192866+0000","last_undegraded":"2024-04-26T18:30:48.192866+0000","last_fullsized":"2024-04-26T18:30:48.192866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":583,"num_write_kb":83272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"41'2814","reported_seq":4454,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.883940+0000","last_change":"2024-04-26T18:03:00.013541+0000","last_active":"2024-04-26T18:31:36.883940+0000","last_peered":"2024-04-26T18:31:36.883940+0000","last_clean":"2024-04-26T18:31:36.883940+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T18:31:36.883940+0000","last_undegraded":"2024-04-26T18:31:36.883940+0000","last_fullsized":"2024-04-26T18:31:36.883940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:37.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077645753999999997,"stat_sum":{"num_bytes":21677192,"num_objects":1207,"num_object_clones":566,"num_object_copies":4828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":566,"num_read":118,"num_read_kb":106859,"num_write":2295,"num_write_kb":28218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"41'620","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.352068+0000","last_change":"2024-04-26T18:03:00.012108+0000","last_active":"2024-04-26T18:30:01.352068+0000","last_peered":"2024-04-26T18:30:01.352068+0000","last_clean":"2024-04-26T18:30:01.352068+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T18:30:01.352068+0000","last_undegraded":"2024-04-26T18:30:01.352068+0000","last_fullsized":"2024-04-26T18:30:01.352068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:45.171474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076659478000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'1618","reported_seq":2626,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.549967+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T18:30:18.549967+0000","last_peered":"2024-04-26T18:30:18.549967+0000","last_clean":"2024-04-26T18:30:18.549967+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T18:30:18.549967+0000","last_undegraded":"2024-04-26T18:30:18.549967+0000","last_fullsized":"2024-04-26T18:30:18.549967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1618,"log_dups_size":0,"ondisk_log_size":1618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":992,"num_read_kb":4725,"num_write":1685,"num_write_kb":100551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"41'2764","reported_seq":4482,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.876010+0000","last_change":"2024-04-26T18:03:00.014183+0000","last_active":"2024-04-26T18:31:36.876010+0000","last_peered":"2024-04-26T18:31:36.876010+0000","last_clean":"2024-04-26T18:31:36.876010+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T18:31:36.876010+0000","last_undegraded":"2024-04-26T18:31:36.876010+0000","last_fullsized":"2024-04-26T18:31:36.876010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2764,"log_dups_size":0,"ondisk_log_size":2764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:54.571531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077766350999999997,"stat_sum":{"num_bytes":40144243,"num_objects":1196,"num_object_clones":556,"num_object_copies":4784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":556,"num_read":186,"num_read_kb":267655,"num_write":2256,"num_write_kb":47769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"41'586","reported_seq":2669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390842+0000","last_change":"2024-04-26T18:03:00.423065+0000","last_active":"2024-04-26T18:29:46.390842+0000","last_peered":"2024-04-26T18:29:46.390842+0000","last_clean":"2024-04-26T18:29:46.390842+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T18:29:46.390842+0000","last_undegraded":"2024-04-26T18:29:46.390842+0000","last_fullsized":"2024-04-26T18:29:46.390842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:15.084787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20174721700000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'667","reported_seq":739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.152482+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T18:29:48.152482+0000","last_peered":"2024-04-26T18:29:48.152482+0000","last_clean":"2024-04-26T18:29:48.152482+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T18:29:48.152482+0000","last_undegraded":"2024-04-26T18:29:48.152482+0000","last_fullsized":"2024-04-26T18:29:48.152482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":715,"num_write_kb":79339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"41'2915","reported_seq":4593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.876907+0000","last_change":"2024-04-26T18:03:00.426626+0000","last_active":"2024-04-26T18:31:36.876907+0000","last_peered":"2024-04-26T18:31:36.876907+0000","last_clean":"2024-04-26T18:31:36.876907+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T18:31:36.876907+0000","last_undegraded":"2024-04-26T18:31:36.876907+0000","last_fullsized":"2024-04-26T18:31:36.876907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:11.102216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20190264199999999,"stat_sum":{"num_bytes":26615609,"num_objects":1212,"num_object_clones":560,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":560,"num_read":151,"num_read_kb":128735,"num_write":2402,"num_write_kb":29722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"41'621","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.171918+0000","last_change":"2024-04-26T18:03:00.450371+0000","last_active":"2024-04-26T18:30:16.171918+0000","last_peered":"2024-04-26T18:30:16.171918+0000","last_clean":"2024-04-26T18:30:16.171918+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T18:30:16.171918+0000","last_undegraded":"2024-04-26T18:30:16.171918+0000","last_fullsized":"2024-04-26T18:30:16.171918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:39.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22655562100000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'1595","reported_seq":1667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175583+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T18:30:16.175583+0000","last_peered":"2024-04-26T18:30:16.175583+0000","last_clean":"2024-04-26T18:30:16.175583+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T18:30:16.175583+0000","last_undegraded":"2024-04-26T18:30:16.175583+0000","last_fullsized":"2024-04-26T18:30:16.175583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1595,"log_dups_size":0,"ondisk_log_size":1595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":0,"num_write":1680,"num_write_kb":72101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:28:03.048194+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T18:28:03.048194+0000","last_peered":"2024-04-26T18:28:03.048194+0000","last_clean":"2024-04-26T18:28:03.048194+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T18:28:03.048194+0000","last_undegraded":"2024-04-26T18:28:03.048194+0000","last_fullsized":"2024-04-26T18:28:03.048194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"41'3034","reported_seq":4678,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.920048+0000","last_change":"2024-04-26T18:03:00.043842+0000","last_active":"2024-04-26T18:31:36.920048+0000","last_peered":"2024-04-26T18:31:36.920048+0000","last_clean":"2024-04-26T18:31:36.920048+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T18:31:36.920048+0000","last_undegraded":"2024-04-26T18:31:36.920048+0000","last_fullsized":"2024-04-26T18:31:36.920048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:43.054742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101669149,"stat_sum":{"num_bytes":43937728,"num_objects":1270,"num_object_clones":639,"num_object_copies":5080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1270,"num_whiteouts":551,"num_read":194,"num_read_kb":160197,"num_write":2447,"num_write_kb":52378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"41'602","reported_seq":2680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.344820+0000","last_change":"2024-04-26T18:03:00.046750+0000","last_active":"2024-04-26T18:29:46.344820+0000","last_peered":"2024-04-26T18:29:46.344820+0000","last_clean":"2024-04-26T18:29:46.344820+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T18:29:46.344820+0000","last_undegraded":"2024-04-26T18:29:46.344820+0000","last_fullsized":"2024-04-26T18:29:46.344820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:48.686392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10552916,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"41'542","reported_seq":613,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:15.802404+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T18:30:15.802404+0000","last_peered":"2024-04-26T18:30:15.802404+0000","last_clean":"2024-04-26T18:30:15.802404+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T18:30:15.802404+0000","last_undegraded":"2024-04-26T18:30:15.802404+0000","last_fullsized":"2024-04-26T18:30:15.802404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":567,"num_write_kb":79001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"41'2911","reported_seq":4622,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:28.781006+0000","last_change":"2024-04-26T18:03:00.044856+0000","last_active":"2024-04-26T18:31:28.781006+0000","last_peered":"2024-04-26T18:31:28.781006+0000","last_clean":"2024-04-26T18:31:28.781006+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T18:31:28.781006+0000","last_undegraded":"2024-04-26T18:31:28.781006+0000","last_fullsized":"2024-04-26T18:31:28.781006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.254209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102636063,"stat_sum":{"num_bytes":37322430,"num_objects":1233,"num_object_clones":576,"num_object_copies":4932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1233,"num_whiteouts":576,"num_read":199,"num_read_kb":211238,"num_write":2388,"num_write_kb":48792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"41'607","reported_seq":2693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375271+0000","last_change":"2024-04-26T18:03:00.390471+0000","last_active":"2024-04-26T18:29:46.375271+0000","last_peered":"2024-04-26T18:29:46.375271+0000","last_clean":"2024-04-26T18:29:46.375271+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T18:29:46.375271+0000","last_undegraded":"2024-04-26T18:29:46.375271+0000","last_fullsized":"2024-04-26T18:29:46.375271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:29.493089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16359686500000001,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"41'1297","reported_seq":1368,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.203238+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T18:30:48.203238+0000","last_peered":"2024-04-26T18:30:48.203238+0000","last_clean":"2024-04-26T18:30:48.203238+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T18:30:48.203238+0000","last_undegraded":"2024-04-26T18:30:48.203238+0000","last_fullsized":"2024-04-26T18:30:48.203238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1297,"log_dups_size":0,"ondisk_log_size":1297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29364754,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":1371,"num_write_kb":104375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"41'2892","reported_seq":4596,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.883073+0000","last_change":"2024-04-26T18:03:00.425610+0000","last_active":"2024-04-26T18:31:36.883073+0000","last_peered":"2024-04-26T18:31:36.883073+0000","last_clean":"2024-04-26T18:31:36.883073+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T18:31:36.883073+0000","last_undegraded":"2024-04-26T18:31:36.883073+0000","last_fullsized":"2024-04-26T18:31:36.883073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:33.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20706662200000001,"stat_sum":{"num_bytes":43474396,"num_objects":1246,"num_object_clones":573,"num_object_copies":4984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":573,"num_read":190,"num_read_kb":265762,"num_write":2374,"num_write_kb":47127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"41'593","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375676+0000","last_change":"2024-04-26T18:03:00.046998+0000","last_active":"2024-04-26T18:29:46.375676+0000","last_peered":"2024-04-26T18:29:46.375676+0000","last_clean":"2024-04-26T18:29:46.375676+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T18:29:46.375676+0000","last_undegraded":"2024-04-26T18:29:46.375676+0000","last_fullsized":"2024-04-26T18:29:46.375676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:51.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104614815,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"41'698","reported_seq":769,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174916+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T18:30:48.174916+0000","last_peered":"2024-04-26T18:30:48.174916+0000","last_clean":"2024-04-26T18:30:48.174916+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T18:30:48.174916+0000","last_undegraded":"2024-04-26T18:30:48.174916+0000","last_fullsized":"2024-04-26T18:30:48.174916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":758,"num_write_kb":95614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"41'2925","reported_seq":4669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:39.302134+0000","last_change":"2024-04-26T18:03:00.379880+0000","last_active":"2024-04-26T18:31:39.302134+0000","last_peered":"2024-04-26T18:31:39.302134+0000","last_clean":"2024-04-26T18:31:39.302134+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T18:31:39.302134+0000","last_undegraded":"2024-04-26T18:31:39.302134+0000","last_fullsized":"2024-04-26T18:31:39.302134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:12.400616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16179385399999999,"stat_sum":{"num_bytes":31406117,"num_objects":1218,"num_object_clones":563,"num_object_copies":4872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":563,"num_read":219,"num_read_kb":160548,"num_write":2420,"num_write_kb":43855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"41'599","reported_seq":2684,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390465+0000","last_change":"2024-04-26T18:03:00.046050+0000","last_active":"2024-04-26T18:29:46.390465+0000","last_peered":"2024-04-26T18:29:46.390465+0000","last_clean":"2024-04-26T18:29:46.390465+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T18:29:46.390465+0000","last_undegraded":"2024-04-26T18:29:46.390465+0000","last_fullsized":"2024-04-26T18:29:46.390465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:37.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103300084,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'716","reported_seq":786,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.376382+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T18:30:16.376382+0000","last_peered":"2024-04-26T18:30:16.376382+0000","last_clean":"2024-04-26T18:30:16.376382+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T18:30:16.376382+0000","last_undegraded":"2024-04-26T18:30:16.376382+0000","last_fullsized":"2024-04-26T18:30:16.376382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165846,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":771,"num_write_kb":75142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"41'2803","reported_seq":4571,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:39.299548+0000","last_change":"2024-04-26T18:03:00.424342+0000","last_active":"2024-04-26T18:31:39.299548+0000","last_peered":"2024-04-26T18:31:39.299548+0000","last_clean":"2024-04-26T18:31:39.299548+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T18:31:39.299548+0000","last_undegraded":"2024-04-26T18:31:39.299548+0000","last_fullsized":"2024-04-26T18:31:39.299548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:41.316721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18140468300000001,"stat_sum":{"num_bytes":44194819,"num_objects":1210,"num_object_clones":561,"num_object_copies":4840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":561,"num_read":242,"num_read_kb":262276,"num_write":2276,"num_write_kb":51233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"41'643","reported_seq":2722,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.432005+0000","last_change":"2024-04-26T18:03:00.047648+0000","last_active":"2024-04-26T18:29:46.432005+0000","last_peered":"2024-04-26T18:29:46.432005+0000","last_clean":"2024-04-26T18:29:46.432005+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T18:29:46.432005+0000","last_undegraded":"2024-04-26T18:29:46.432005+0000","last_fullsized":"2024-04-26T18:29:46.432005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.617916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101409261,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":14,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"41'843","reported_seq":913,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.172834+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T18:30:16.172834+0000","last_peered":"2024-04-26T18:30:16.172834+0000","last_clean":"2024-04-26T18:30:16.172834+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T18:30:16.172834+0000","last_undegraded":"2024-04-26T18:30:16.172834+0000","last_fullsized":"2024-04-26T18:30:16.172834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":83,"num_read_kb":0,"num_write":946,"num_write_kb":79922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"41'2759","reported_seq":4442,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.899193+0000","last_change":"2024-04-26T18:03:00.423934+0000","last_active":"2024-04-26T18:31:36.899193+0000","last_peered":"2024-04-26T18:31:36.899193+0000","last_clean":"2024-04-26T18:31:36.899193+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T18:31:36.899193+0000","last_undegraded":"2024-04-26T18:31:36.899193+0000","last_fullsized":"2024-04-26T18:31:36.899193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:22.663372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19926888800000001,"stat_sum":{"num_bytes":38301955,"num_objects":1186,"num_object_clones":557,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":557,"num_read":154,"num_read_kb":145957,"num_write":2246,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'591","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.067174+0000","last_change":"2024-04-26T18:03:00.040005+0000","last_active":"2024-04-26T18:30:48.067174+0000","last_peered":"2024-04-26T18:30:48.067174+0000","last_clean":"2024-04-26T18:30:48.067174+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T18:30:48.067174+0000","last_undegraded":"2024-04-26T18:30:48.067174+0000","last_fullsized":"2024-04-26T18:30:48.067174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:00.688873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099299311000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"41'590","reported_seq":660,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.577085+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T18:30:13.577085+0000","last_peered":"2024-04-26T18:30:13.577085+0000","last_clean":"2024-04-26T18:30:13.577085+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T18:30:13.577085+0000","last_undegraded":"2024-04-26T18:30:13.577085+0000","last_fullsized":"2024-04-26T18:30:13.577085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":625,"num_write_kb":74929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"41'3058","reported_seq":4719,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.884873+0000","last_change":"2024-04-26T18:03:00.451560+0000","last_active":"2024-04-26T18:31:36.884873+0000","last_peered":"2024-04-26T18:31:36.884873+0000","last_clean":"2024-04-26T18:31:36.884873+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T18:31:36.884873+0000","last_undegraded":"2024-04-26T18:31:36.884873+0000","last_fullsized":"2024-04-26T18:31:36.884873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:26.188503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21925704200000001,"stat_sum":{"num_bytes":62040101,"num_objects":1342,"num_object_clones":661,"num_object_copies":5368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1342,"num_whiteouts":573,"num_read":237,"num_read_kb":346938,"num_write":2466,"num_write_kb":72826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"41'619","reported_seq":2685,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.355077+0000","last_change":"2024-04-26T18:03:00.082382+0000","last_active":"2024-04-26T18:29:48.355077+0000","last_peered":"2024-04-26T18:29:48.355077+0000","last_clean":"2024-04-26T18:29:48.355077+0000","last_became_active":"2024-04-26T17:58:46.842960+0000","last_became_peered":"2024-04-26T17:58:46.842960+0000","last_unstale":"2024-04-26T18:29:48.355077+0000","last_undegraded":"2024-04-26T18:29:48.355077+0000","last_fullsized":"2024-04-26T18:29:48.355077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:11:24.844599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029754315999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"41'522","reported_seq":592,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.545859+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T18:30:13.545859+0000","last_peered":"2024-04-26T18:30:13.545859+0000","last_clean":"2024-04-26T18:30:13.545859+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T18:30:13.545859+0000","last_undegraded":"2024-04-26T18:30:13.545859+0000","last_fullsized":"2024-04-26T18:30:13.545859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":593,"num_write_kb":58770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"41'2848","reported_seq":4547,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.798779+0000","last_change":"2024-04-26T18:03:00.451927+0000","last_active":"2024-04-26T18:31:36.798779+0000","last_peered":"2024-04-26T18:31:36.798779+0000","last_clean":"2024-04-26T18:31:36.798779+0000","last_became_active":"2024-04-26T17:58:46.841624+0000","last_became_peered":"2024-04-26T17:58:46.841624+0000","last_unstale":"2024-04-26T18:31:36.798779+0000","last_undegraded":"2024-04-26T18:31:36.798779+0000","last_fullsized":"2024-04-26T18:31:36.798779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:11.632385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218331676,"stat_sum":{"num_bytes":37909871,"num_objects":1250,"num_object_clones":586,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":586,"num_read":191,"num_read_kb":253371,"num_write":2312,"num_write_kb":56158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"41'583","reported_seq":2663,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.357556+0000","last_change":"2024-04-26T18:03:00.428027+0000","last_active":"2024-04-26T18:29:41.357556+0000","last_peered":"2024-04-26T18:29:41.357556+0000","last_clean":"2024-04-26T18:29:41.357556+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T18:29:41.357556+0000","last_undegraded":"2024-04-26T18:29:41.357556+0000","last_fullsized":"2024-04-26T18:29:41.357556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:18.542428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.185065913,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"41'426","reported_seq":496,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:20.748118+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T18:30:20.748118+0000","last_peered":"2024-04-26T18:30:20.748118+0000","last_clean":"2024-04-26T18:30:20.748118+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T18:30:20.748118+0000","last_undegraded":"2024-04-26T18:30:20.748118+0000","last_fullsized":"2024-04-26T18:30:20.748118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":485,"num_write_kb":79130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"41'2856","reported_seq":4518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.860347+0000","last_change":"2024-04-26T18:03:00.386810+0000","last_active":"2024-04-26T18:31:36.860347+0000","last_peered":"2024-04-26T18:31:36.860347+0000","last_clean":"2024-04-26T18:31:36.860347+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T18:31:36.860347+0000","last_undegraded":"2024-04-26T18:31:36.860347+0000","last_fullsized":"2024-04-26T18:31:36.860347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:32.381881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16361857299999999,"stat_sum":{"num_bytes":26393816,"num_objects":1264,"num_object_clones":588,"num_object_copies":5056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1264,"num_whiteouts":588,"num_read":164,"num_read_kb":98786,"num_write":2329,"num_write_kb":28734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"41'612","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.420696+0000","last_change":"2024-04-26T18:03:00.046237+0000","last_active":"2024-04-26T18:29:46.420696+0000","last_peered":"2024-04-26T18:29:46.420696+0000","last_clean":"2024-04-26T18:29:46.420696+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T18:29:46.420696+0000","last_undegraded":"2024-04-26T18:29:46.420696+0000","last_fullsized":"2024-04-26T18:29:46.420696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:43.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10539311699999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"41'818","reported_seq":888,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:20.757985+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T18:31:20.757985+0000","last_peered":"2024-04-26T18:31:20.757985+0000","last_clean":"2024-04-26T18:31:20.757985+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T18:31:20.757985+0000","last_undegraded":"2024-04-26T18:31:20.757985+0000","last_fullsized":"2024-04-26T18:31:20.757985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777888,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":70,"num_read_kb":0,"num_write":938,"num_write_kb":112536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"41'2763","reported_seq":4471,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.863016+0000","last_change":"2024-04-26T18:03:00.011745+0000","last_active":"2024-04-26T18:31:36.863016+0000","last_peered":"2024-04-26T18:31:36.863016+0000","last_clean":"2024-04-26T18:31:36.863016+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T18:31:36.863016+0000","last_undegraded":"2024-04-26T18:31:36.863016+0000","last_fullsized":"2024-04-26T18:31:36.863016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.553669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076321086999999996,"stat_sum":{"num_bytes":36028739,"num_objects":1149,"num_object_clones":527,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":527,"num_read":149,"num_read_kb":73233,"num_write":2275,"num_write_kb":49180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'611","reported_seq":2692,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.396699+0000","last_change":"2024-04-26T18:03:00.416589+0000","last_active":"2024-04-26T18:29:41.396699+0000","last_peered":"2024-04-26T18:29:41.396699+0000","last_clean":"2024-04-26T18:29:41.396699+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T18:29:41.396699+0000","last_undegraded":"2024-04-26T18:29:41.396699+0000","last_fullsized":"2024-04-26T18:29:41.396699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:33.817050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187850924,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"41'1273","reported_seq":1342,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.159063+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T18:30:09.159063+0000","last_peered":"2024-04-26T18:30:09.159063+0000","last_clean":"2024-04-26T18:30:09.159063+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T18:30:09.159063+0000","last_undegraded":"2024-04-26T18:30:09.159063+0000","last_fullsized":"2024-04-26T18:30:09.159063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1332,"num_write_kb":75702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"41'2855","reported_seq":4517,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.859406+0000","last_change":"2024-04-26T18:03:00.422955+0000","last_active":"2024-04-26T18:31:36.859406+0000","last_peered":"2024-04-26T18:31:36.859406+0000","last_clean":"2024-04-26T18:31:36.859406+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T18:31:36.859406+0000","last_undegraded":"2024-04-26T18:31:36.859406+0000","last_fullsized":"2024-04-26T18:31:36.859406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:17.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18615647199999999,"stat_sum":{"num_bytes":26768950,"num_objects":1237,"num_object_clones":575,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":575,"num_read":151,"num_read_kb":65496,"num_write":2334,"num_write_kb":43840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"41'599","reported_seq":2677,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.372641+0000","last_change":"2024-04-26T18:03:00.427018+0000","last_active":"2024-04-26T18:29:41.372641+0000","last_peered":"2024-04-26T18:29:41.372641+0000","last_clean":"2024-04-26T18:29:41.372641+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T18:29:41.372641+0000","last_undegraded":"2024-04-26T18:29:41.372641+0000","last_fullsized":"2024-04-26T18:29:41.372641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:59.016233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19386972299999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"41'2203","reported_seq":2272,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169468+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T18:30:09.169468+0000","last_peered":"2024-04-26T18:30:09.169468+0000","last_clean":"2024-04-26T18:30:09.169468+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T18:30:09.169468+0000","last_undegraded":"2024-04-26T18:30:09.169468+0000","last_fullsized":"2024-04-26T18:30:09.169468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":2240,"num_write_kb":108871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"41'2818","reported_seq":4518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.850564+0000","last_change":"2024-04-26T18:03:00.448747+0000","last_active":"2024-04-26T18:31:36.850564+0000","last_peered":"2024-04-26T18:31:36.850564+0000","last_clean":"2024-04-26T18:31:36.850564+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T18:31:36.850564+0000","last_undegraded":"2024-04-26T18:31:36.850564+0000","last_fullsized":"2024-04-26T18:31:36.850564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2818,"log_dups_size":0,"ondisk_log_size":2818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:54.613985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23086587,"stat_sum":{"num_bytes":33941132,"num_objects":1186,"num_object_clones":549,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":549,"num_read":163,"num_read_kb":131768,"num_write":2312,"num_write_kb":45432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"41'585","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:32.405129+0000","last_change":"2024-04-26T18:03:00.387751+0000","last_active":"2024-04-26T18:29:32.405129+0000","last_peered":"2024-04-26T18:29:32.405129+0000","last_clean":"2024-04-26T18:29:32.405129+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T18:29:32.405129+0000","last_undegraded":"2024-04-26T18:29:32.405129+0000","last_fullsized":"2024-04-26T18:29:32.405129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:17.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16159970800000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"41'918","reported_seq":1135,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174589+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T18:30:48.174589+0000","last_peered":"2024-04-26T18:30:48.174589+0000","last_clean":"2024-04-26T18:30:48.174589+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T18:30:48.174589+0000","last_undegraded":"2024-04-26T18:30:48.174589+0000","last_fullsized":"2024-04-26T18:30:48.174589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17376085,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":220,"num_read_kb":683,"num_write":1019,"num_write_kb":76520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"41'2989","reported_seq":4686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.343459+0000","last_change":"2024-04-26T18:03:00.450154+0000","last_active":"2024-04-26T18:31:32.343459+0000","last_peered":"2024-04-26T18:31:32.343459+0000","last_clean":"2024-04-26T18:31:32.343459+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T18:31:32.343459+0000","last_undegraded":"2024-04-26T18:31:32.343459+0000","last_fullsized":"2024-04-26T18:31:32.343459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:45.503657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22647874100000001,"stat_sum":{"num_bytes":37857272,"num_objects":1229,"num_object_clones":574,"num_object_copies":4916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":574,"num_read":187,"num_read_kb":231681,"num_write":2457,"num_write_kb":51113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"41'2741","reported_seq":4461,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.893946+0000","last_change":"2024-04-26T18:03:00.424939+0000","last_active":"2024-04-26T18:31:36.893946+0000","last_peered":"2024-04-26T18:31:36.893946+0000","last_clean":"2024-04-26T18:31:36.893946+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T18:31:36.893946+0000","last_undegraded":"2024-04-26T18:31:36.893946+0000","last_fullsized":"2024-04-26T18:31:36.893946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:30.278112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20154621,"stat_sum":{"num_bytes":35946841,"num_objects":1130,"num_object_clones":524,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1130,"num_whiteouts":524,"num_read":155,"num_read_kb":163014,"num_write":2271,"num_write_kb":38909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"41'602","reported_seq":2679,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.410519+0000","last_change":"2024-04-26T18:03:00.011427+0000","last_active":"2024-04-26T18:29:46.410519+0000","last_peered":"2024-04-26T18:29:46.410519+0000","last_clean":"2024-04-26T18:29:46.410519+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T18:29:46.410519+0000","last_undegraded":"2024-04-26T18:29:46.410519+0000","last_fullsized":"2024-04-26T18:29:46.410519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:42.428994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076360936000000004,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"41'1493","reported_seq":1562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.171031+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T18:30:16.171031+0000","last_peered":"2024-04-26T18:30:16.171031+0000","last_clean":"2024-04-26T18:30:16.171031+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T18:30:16.171031+0000","last_undegraded":"2024-04-26T18:30:16.171031+0000","last_fullsized":"2024-04-26T18:30:16.171031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":1554,"num_write_kb":113147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"41'2755","reported_seq":4436,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.814569+0000","last_change":"2024-04-26T18:03:00.045338+0000","last_active":"2024-04-26T18:31:36.814569+0000","last_peered":"2024-04-26T18:31:36.814569+0000","last_clean":"2024-04-26T18:31:36.814569+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T18:31:36.814569+0000","last_undegraded":"2024-04-26T18:31:36.814569+0000","last_fullsized":"2024-04-26T18:31:36.814569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:47.473281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101684618,"stat_sum":{"num_bytes":29230084,"num_objects":1175,"num_object_clones":548,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":548,"num_read":140,"num_read_kb":149625,"num_write":2265,"num_write_kb":32436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"41'678","reported_seq":2748,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.346338+0000","last_change":"2024-04-26T18:03:00.010584+0000","last_active":"2024-04-26T18:29:48.346338+0000","last_peered":"2024-04-26T18:29:48.346338+0000","last_clean":"2024-04-26T18:29:48.346338+0000","last_became_active":"2024-04-26T17:58:47.348873+0000","last_became_peered":"2024-04-26T17:58:47.348873+0000","last_unstale":"2024-04-26T18:29:48.346338+0000","last_undegraded":"2024-04-26T18:29:48.346338+0000","last_fullsized":"2024-04-26T18:29:48.346338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:17.045379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075584111999999995,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"41'758","reported_seq":827,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169521+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T18:30:09.169521+0000","last_peered":"2024-04-26T18:30:09.169521+0000","last_clean":"2024-04-26T18:30:09.169521+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T18:30:09.169521+0000","last_undegraded":"2024-04-26T18:30:09.169521+0000","last_fullsized":"2024-04-26T18:30:09.169521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":840,"num_write_kb":71498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"41'948","reported_seq":1017,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.065770+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T18:30:33.065770+0000","last_peered":"2024-04-26T18:30:33.065770+0000","last_clean":"2024-04-26T18:30:33.065770+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T18:30:33.065770+0000","last_undegraded":"2024-04-26T18:30:33.065770+0000","last_fullsized":"2024-04-26T18:30:33.065770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":1019,"num_write_kb":79683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"41'588","reported_seq":2667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.349367+0000","last_change":"2024-04-26T18:03:00.424808+0000","last_active":"2024-04-26T18:29:48.349367+0000","last_peered":"2024-04-26T18:29:48.349367+0000","last_clean":"2024-04-26T18:29:48.349367+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T18:29:48.349367+0000","last_undegraded":"2024-04-26T18:29:48.349367+0000","last_fullsized":"2024-04-26T18:29:48.349367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:07.262537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20583575700000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"41'2937","reported_seq":4605,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.781361+0000","last_change":"2024-04-26T18:03:00.085072+0000","last_active":"2024-04-26T18:31:36.781361+0000","last_peered":"2024-04-26T18:31:36.781361+0000","last_clean":"2024-04-26T18:31:36.781361+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T18:31:36.781361+0000","last_undegraded":"2024-04-26T18:31:36.781361+0000","last_fullsized":"2024-04-26T18:31:36.781361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:19.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025934391000000001,"stat_sum":{"num_bytes":29962641,"num_objects":1274,"num_object_clones":596,"num_object_copies":5096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":596,"num_read":178,"num_read_kb":211369,"num_write":2395,"num_write_kb":42590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"41'542","reported_seq":611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.066572+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T18:30:33.066572+0000","last_peered":"2024-04-26T18:30:33.066572+0000","last_clean":"2024-04-26T18:30:33.066572+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T18:30:33.066572+0000","last_undegraded":"2024-04-26T18:30:33.066572+0000","last_fullsized":"2024-04-26T18:30:33.066572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":620,"num_write_kb":96015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"41'620","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.452032+0000","last_change":"2024-04-26T18:03:00.422447+0000","last_active":"2024-04-26T18:29:46.452032+0000","last_peered":"2024-04-26T18:29:46.452032+0000","last_clean":"2024-04-26T18:29:46.452032+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T18:29:46.452032+0000","last_undegraded":"2024-04-26T18:29:46.452032+0000","last_fullsized":"2024-04-26T18:29:46.452032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:19.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18696554200000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"41'2812","reported_seq":4494,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.336075+0000","last_change":"2024-04-26T18:03:00.452403+0000","last_active":"2024-04-26T18:31:32.336075+0000","last_peered":"2024-04-26T18:31:32.336075+0000","last_clean":"2024-04-26T18:31:32.336075+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T18:31:32.336075+0000","last_undegraded":"2024-04-26T18:31:32.336075+0000","last_fullsized":"2024-04-26T18:31:32.336075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:38.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215933711,"stat_sum":{"num_bytes":39516255,"num_objects":1208,"num_object_clones":558,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":558,"num_read":157,"num_read_kb":155459,"num_write":2289,"num_write_kb":56059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"41'619","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.343539+0000","last_change":"2024-04-26T18:03:00.038929+0000","last_active":"2024-04-26T18:29:48.343539+0000","last_peered":"2024-04-26T18:29:48.343539+0000","last_clean":"2024-04-26T18:29:48.343539+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T18:29:48.343539+0000","last_undegraded":"2024-04-26T18:29:48.343539+0000","last_fullsized":"2024-04-26T18:29:48.343539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:12.133508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098603622000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"41'650","reported_seq":2731,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.191322+0000","last_change":"2024-04-26T18:03:00.080058+0000","last_active":"2024-04-26T18:30:48.191322+0000","last_peered":"2024-04-26T18:30:48.191322+0000","last_clean":"2024-04-26T18:30:48.191322+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T18:30:48.191322+0000","last_undegraded":"2024-04-26T18:30:48.191322+0000","last_fullsized":"2024-04-26T18:30:48.191322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:21.430086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032925850999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"41'602","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:03.169842+0000","last_change":"2024-04-26T18:03:00.082718+0000","last_active":"2024-04-26T18:30:03.169842+0000","last_peered":"2024-04-26T18:30:03.169842+0000","last_clean":"2024-04-26T18:30:03.169842+0000","last_became_active":"2024-04-26T17:58:46.843441+0000","last_became_peered":"2024-04-26T17:58:46.843441+0000","last_unstale":"2024-04-26T18:30:03.169842+0000","last_undegraded":"2024-04-26T18:30:03.169842+0000","last_fullsized":"2024-04-26T18:30:03.169842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:59.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030186671000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"41'658","reported_seq":2736,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.338929+0000","last_change":"2024-04-26T18:03:00.420297+0000","last_active":"2024-04-26T18:29:41.338929+0000","last_peered":"2024-04-26T18:29:41.338929+0000","last_clean":"2024-04-26T18:29:41.338929+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T18:29:41.338929+0000","last_undegraded":"2024-04-26T18:29:41.338929+0000","last_fullsized":"2024-04-26T18:29:41.338929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:17.932988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.201538621,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"41'594","reported_seq":2676,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.352627+0000","last_change":"2024-04-26T18:03:00.452146+0000","last_active":"2024-04-26T18:30:01.352627+0000","last_peered":"2024-04-26T18:30:01.352627+0000","last_clean":"2024-04-26T18:30:01.352627+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T18:30:01.352627+0000","last_undegraded":"2024-04-26T18:30:01.352627+0000","last_fullsized":"2024-04-26T18:30:01.352627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:38.204578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217865696,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"41'614","reported_seq":2690,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:38.350023+0000","last_change":"2024-04-26T18:03:00.013263+0000","last_active":"2024-04-26T18:30:38.350023+0000","last_peered":"2024-04-26T18:30:38.350023+0000","last_clean":"2024-04-26T18:30:38.350023+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T18:30:38.350023+0000","last_undegraded":"2024-04-26T18:30:38.350023+0000","last_fullsized":"2024-04-26T18:30:38.350023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:40.421470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077286562000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":18,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"41'640","reported_seq":2724,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.359704+0000","last_change":"2024-04-26T18:03:00.044300+0000","last_active":"2024-04-26T18:29:46.359704+0000","last_peered":"2024-04-26T18:29:46.359704+0000","last_clean":"2024-04-26T18:29:46.359704+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T18:29:46.359704+0000","last_undegraded":"2024-04-26T18:29:46.359704+0000","last_fullsized":"2024-04-26T18:29:46.359704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:41.880840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101304621,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"41'588","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.150007+0000","last_change":"2024-04-26T18:03:00.451279+0000","last_active":"2024-04-26T18:29:47.150007+0000","last_peered":"2024-04-26T18:29:47.150007+0000","last_clean":"2024-04-26T18:29:47.150007+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T18:29:47.150007+0000","last_undegraded":"2024-04-26T18:29:47.150007+0000","last_fullsized":"2024-04-26T18:29:47.150007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:01.568762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21869934299999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"41'612","reported_seq":2692,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:43.067031+0000","last_change":"2024-04-26T18:03:00.382958+0000","last_active":"2024-04-26T18:30:43.067031+0000","last_peered":"2024-04-26T18:30:43.067031+0000","last_clean":"2024-04-26T18:30:43.067031+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T18:30:43.067031+0000","last_undegraded":"2024-04-26T18:30:43.067031+0000","last_fullsized":"2024-04-26T18:30:43.067031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:24.729192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16324759799999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"41'601","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:42.333632+0000","last_change":"2024-04-26T18:03:00.449823+0000","last_active":"2024-04-26T18:29:42.333632+0000","last_peered":"2024-04-26T18:29:42.333632+0000","last_clean":"2024-04-26T18:29:42.333632+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T18:29:42.333632+0000","last_undegraded":"2024-04-26T18:29:42.333632+0000","last_fullsized":"2024-04-26T18:29:42.333632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:31.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22595842999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":20,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"41'628","reported_seq":2712,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347096+0000","last_change":"2024-04-26T18:03:00.387942+0000","last_active":"2024-04-26T18:29:46.347096+0000","last_peered":"2024-04-26T18:29:46.347096+0000","last_clean":"2024-04-26T18:29:46.347096+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T18:29:46.347096+0000","last_undegraded":"2024-04-26T18:29:46.347096+0000","last_fullsized":"2024-04-26T18:29:46.347096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:12.544391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16093863,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"41'620","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.378968+0000","last_change":"2024-04-26T18:03:00.417549+0000","last_active":"2024-04-26T18:29:46.378968+0000","last_peered":"2024-04-26T18:29:46.378968+0000","last_clean":"2024-04-26T18:29:46.378968+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T18:29:46.378968+0000","last_undegraded":"2024-04-26T18:29:46.378968+0000","last_fullsized":"2024-04-26T18:29:46.378968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:03.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.199229399,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"41'627","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390505+0000","last_change":"2024-04-26T18:03:00.037623+0000","last_active":"2024-04-26T18:29:46.390505+0000","last_peered":"2024-04-26T18:29:46.390505+0000","last_clean":"2024-04-26T18:29:46.390505+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T18:29:46.390505+0000","last_undegraded":"2024-04-26T18:29:46.390505+0000","last_fullsized":"2024-04-26T18:29:46.390505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:23.801334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097146090000000004,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":18,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"41'645","reported_seq":2721,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175759+0000","last_change":"2024-04-26T18:03:00.047343+0000","last_active":"2024-04-26T18:30:16.175759+0000","last_peered":"2024-04-26T18:30:16.175759+0000","last_clean":"2024-04-26T18:30:16.175759+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T18:30:16.175759+0000","last_undegraded":"2024-04-26T18:30:16.175759+0000","last_fullsized":"2024-04-26T18:30:16.175759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.305800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104951684,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"41'585","reported_seq":2665,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.175924+0000","last_change":"2024-04-26T18:03:00.080377+0000","last_active":"2024-04-26T18:30:48.175924+0000","last_peered":"2024-04-26T18:30:48.175924+0000","last_clean":"2024-04-26T18:30:48.175924+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T18:30:48.175924+0000","last_undegraded":"2024-04-26T18:30:48.175924+0000","last_fullsized":"2024-04-26T18:30:48.175924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:16.651583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032670101999999999,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"41'637","reported_seq":2717,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.378343+0000","last_change":"2024-04-26T18:03:00.390632+0000","last_active":"2024-04-26T18:29:46.378343+0000","last_peered":"2024-04-26T18:29:46.378343+0000","last_clean":"2024-04-26T18:29:46.378343+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T18:29:46.378343+0000","last_undegraded":"2024-04-26T18:29:46.378343+0000","last_fullsized":"2024-04-26T18:29:46.378343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:04.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15919065099999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"41'612","reported_seq":2693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.067474+0000","last_change":"2024-04-26T18:03:00.381346+0000","last_active":"2024-04-26T18:30:48.067474+0000","last_peered":"2024-04-26T18:30:48.067474+0000","last_clean":"2024-04-26T18:30:48.067474+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T18:30:48.067474+0000","last_undegraded":"2024-04-26T18:30:48.067474+0000","last_fullsized":"2024-04-26T18:30:48.067474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:38.159280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16311753700000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"41'635","reported_seq":2713,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.203186+0000","last_change":"2024-04-26T18:03:00.012809+0000","last_active":"2024-04-26T18:30:48.203186+0000","last_peered":"2024-04-26T18:30:48.203186+0000","last_clean":"2024-04-26T18:30:48.203186+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T18:30:48.203186+0000","last_undegraded":"2024-04-26T18:30:48.203186+0000","last_fullsized":"2024-04-26T18:30:48.203186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:47.235898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077647145000000001,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"41'596","reported_seq":2681,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.375114+0000","last_change":"2024-04-26T18:03:00.427662+0000","last_active":"2024-04-26T18:29:41.375114+0000","last_peered":"2024-04-26T18:29:41.375114+0000","last_clean":"2024-04-26T18:29:41.375114+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T18:29:41.375114+0000","last_undegraded":"2024-04-26T18:29:41.375114+0000","last_fullsized":"2024-04-26T18:29:41.375114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:35.215492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18619005699999999,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"41'583","reported_seq":2663,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:35.399093+0000","last_change":"2024-04-26T18:03:00.444694+0000","last_active":"2024-04-26T18:29:35.399093+0000","last_peered":"2024-04-26T18:29:35.399093+0000","last_clean":"2024-04-26T18:29:35.399093+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T18:29:35.399093+0000","last_undegraded":"2024-04-26T18:29:35.399093+0000","last_fullsized":"2024-04-26T18:29:35.399093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:27.452738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22687219,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"41'600","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.355615+0000","last_change":"2024-04-26T18:03:00.415887+0000","last_active":"2024-04-26T18:29:48.355615+0000","last_peered":"2024-04-26T18:29:48.355615+0000","last_clean":"2024-04-26T18:29:48.355615+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T18:29:48.355615+0000","last_undegraded":"2024-04-26T18:29:48.355615+0000","last_fullsized":"2024-04-26T18:29:48.355615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:42.102564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18821249400000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"41'606","reported_seq":2687,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.350019+0000","last_change":"2024-04-26T18:03:00.042914+0000","last_active":"2024-04-26T18:30:01.350019+0000","last_peered":"2024-04-26T18:30:01.350019+0000","last_clean":"2024-04-26T18:30:01.350019+0000","last_became_active":"2024-04-26T17:58:46.846437+0000","last_became_peered":"2024-04-26T17:58:46.846437+0000","last_unstale":"2024-04-26T18:30:01.350019+0000","last_undegraded":"2024-04-26T18:30:01.350019+0000","last_fullsized":"2024-04-26T18:30:01.350019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:04.851963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100440928,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":16,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"41'591","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.373726+0000","last_change":"2024-04-26T18:03:00.043307+0000","last_active":"2024-04-26T18:29:41.373726+0000","last_peered":"2024-04-26T18:29:41.373726+0000","last_clean":"2024-04-26T18:29:41.373726+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T18:29:41.373726+0000","last_undegraded":"2024-04-26T18:29:41.373726+0000","last_fullsized":"2024-04-26T18:29:41.373726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:35.890122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100379555,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"41'637","reported_seq":2709,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.345489+0000","last_change":"2024-04-26T18:03:00.046913+0000","last_active":"2024-04-26T18:29:46.345489+0000","last_peered":"2024-04-26T18:29:46.345489+0000","last_clean":"2024-04-26T18:29:46.345489+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T18:29:46.345489+0000","last_undegraded":"2024-04-26T18:29:46.345489+0000","last_fullsized":"2024-04-26T18:29:46.345489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:46.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104580398,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":20,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"41'579","reported_seq":2658,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.337001+0000","last_change":"2024-04-26T18:03:00.449103+0000","last_active":"2024-04-26T18:29:47.337001+0000","last_peered":"2024-04-26T18:29:47.337001+0000","last_clean":"2024-04-26T18:29:47.337001+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T18:29:47.337001+0000","last_undegraded":"2024-04-26T18:29:47.337001+0000","last_fullsized":"2024-04-26T18:29:47.337001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:13.870912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230423819,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"41'606","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.348929+0000","last_change":"2024-04-26T18:03:00.047650+0000","last_active":"2024-04-26T18:29:46.348929+0000","last_peered":"2024-04-26T18:29:46.348929+0000","last_clean":"2024-04-26T18:29:46.348929+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T18:29:46.348929+0000","last_undegraded":"2024-04-26T18:29:46.348929+0000","last_fullsized":"2024-04-26T18:29:46.348929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:11.007748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101654339,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"41'571","reported_seq":2651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175691+0000","last_change":"2024-04-26T18:03:00.390090+0000","last_active":"2024-04-26T18:30:16.175691+0000","last_peered":"2024-04-26T18:30:16.175691+0000","last_clean":"2024-04-26T18:30:16.175691+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T18:30:16.175691+0000","last_undegraded":"2024-04-26T18:30:16.175691+0000","last_fullsized":"2024-04-26T18:30:16.175691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:52.940552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16310901,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"41'640","reported_seq":2726,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.350482+0000","last_change":"2024-04-26T18:03:00.045506+0000","last_active":"2024-04-26T18:30:01.350482+0000","last_peered":"2024-04-26T18:30:01.350482+0000","last_clean":"2024-04-26T18:30:01.350482+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T18:30:01.350482+0000","last_undegraded":"2024-04-26T18:30:01.350482+0000","last_fullsized":"2024-04-26T18:30:01.350482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.552957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10388457199999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"41'631","reported_seq":2709,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.346504+0000","last_change":"2024-04-26T18:03:00.390493+0000","last_active":"2024-04-26T18:29:46.346504+0000","last_peered":"2024-04-26T18:29:46.346504+0000","last_clean":"2024-04-26T18:29:46.346504+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T18:29:46.346504+0000","last_undegraded":"2024-04-26T18:29:46.346504+0000","last_fullsized":"2024-04-26T18:29:46.346504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:20.892370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16390716399999999,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":17,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"41'597","reported_seq":2682,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.351509+0000","last_change":"2024-04-26T18:03:00.414568+0000","last_active":"2024-04-26T18:30:01.351509+0000","last_peered":"2024-04-26T18:30:01.351509+0000","last_clean":"2024-04-26T18:30:01.351509+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T18:30:01.351509+0000","last_undegraded":"2024-04-26T18:30:01.351509+0000","last_fullsized":"2024-04-26T18:30:01.351509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:12.402497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19882805000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"41'589","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.188162+0000","last_change":"2024-04-26T18:03:00.013917+0000","last_active":"2024-04-26T18:30:48.188162+0000","last_peered":"2024-04-26T18:30:48.188162+0000","last_clean":"2024-04-26T18:30:48.188162+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T18:30:48.188162+0000","last_undegraded":"2024-04-26T18:30:48.188162+0000","last_fullsized":"2024-04-26T18:30:48.188162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:25.271335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077373158999999997,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"41'577","reported_seq":2665,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.192100+0000","last_change":"2024-04-26T18:03:00.046476+0000","last_active":"2024-04-26T18:30:48.192100+0000","last_peered":"2024-04-26T18:30:48.192100+0000","last_clean":"2024-04-26T18:30:48.192100+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T18:30:48.192100+0000","last_undegraded":"2024-04-26T18:30:48.192100+0000","last_fullsized":"2024-04-26T18:30:48.192100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:28.837314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104812107,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1183673720,"num_objects":39268,"num_object_clones":18317,"num_object_copies":157072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39268,"num_whiteouts":18141,"num_read":5592,"num_read_kb":5964736,"num_write":75176,"num_write_kb":1483989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2573631488,"data_stored":2574974976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91894,"ondisk_log_size":91894,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3085,"num_object_clones":812,"num_object_copies":6170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3085,"num_whiteouts":812,"num_read":0,"num_read_kb":0,"num_write":3093,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39039,"ondisk_log_size":39039,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797002251,"num_objects":1886,"num_object_clones":0,"num_object_copies":3772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1886,"num_whiteouts":0,"num_read":2824,"num_read_kb":5408,"num_write":35008,"num_write_kb":2756179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1594064896,"data_stored":1594004502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31195,"ondisk_log_size":31195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575259,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814068,"kb_used_data":570604,"kb_used_omap":1,"kb_used_meta":243454,"kb_avail":93557772,"statfs":{"total":96636764160,"available":95803158528,"internally_reserved":0,"allocated":584298496,"data_stored":584389236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249297355},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575259,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864928,"kb_used_data":545112,"kb_used_omap":1,"kb_used_meta":319806,"kb_avail":93506912,"statfs":{"total":96636764160,"available":95751077888,"internally_reserved":0,"allocated":558194688,"data_stored":558281943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":327481799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575259,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":747420,"kb_used_data":455444,"kb_used_omap":1,"kb_used_meta":291966,"kb_avail":93624420,"statfs":{"total":96636764160,"available":95871406080,"internally_reserved":0,"allocated":466374656,"data_stored":466129553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":298973637},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575259,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":742816,"kb_used_data":481304,"kb_used_omap":1,"kb_used_meta":261502,"kb_avail":93629024,"statfs":{"total":96636764160,"available":95876120576,"internally_reserved":0,"allocated":492855296,"data_stored":492773676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267778501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575259,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":908776,"kb_used_data":574944,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":93463064,"statfs":{"total":96636764160,"available":95706177536,"internally_reserved":0,"allocated":588742656,"data_stored":588833154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":341834184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575259,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530044,"kb_used_data":322676,"kb_used_omap":1,"kb_used_meta":207358,"kb_avail":93841796,"statfs":{"total":96636764160,"available":96093999104,"internally_reserved":0,"allocated":330420224,"data_stored":330182370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212335045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575259,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":986984,"kb_used_data":635168,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93384856,"statfs":{"total":96636764160,"available":95626092544,"internally_reserved":0,"allocated":650412032,"data_stored":650334542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575260,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705452,"kb_used_data":489700,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93666388,"statfs":{"total":96636764160,"available":95914381312,"internally_reserved":0,"allocated":501452800,"data_stored":501199532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":205012992,"data_stored":205001130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234885740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163586048,"data_stored":163578528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163594240,"data_stored":163582538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":206127104,"data_stored":206119855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":222908416,"data_stored":222897653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297279488,"data_stored":297275762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":295362560,"data_stored":295362560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415035392,"data_stored":415203328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229273600,"data_stored":229273600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":424673280,"data_stored":425009152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":328777728,"data_stored":328945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":259764224,"data_stored":259764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":334802944,"data_stored":335138816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":285941760,"data_stored":286277632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:31:52.217 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:31:52.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.349+0000 7f8b86371640 1 Processor -- start 2024-04-26T18:31:52.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.349+0000 7f8b86371640 1 -- start start 2024-04-26T18:31:52.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b86371640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8b80155da0 0x7f8b8015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b86371640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b800cd840 0x7f8b800c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b86371640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8015f2a0 con 0x7f8b80156180 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b86371640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8015cbc0 con 0x7f8b80155da0 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b86371640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800cc730 con 0x7f8b800cd840 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b8490e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b800cd840 0x7f8b800c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b7ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8b80155da0 0x7f8b8015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b7ffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8b80155da0 0x7f8b8015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:53904/0 (socket says 172.21.15.139:53904) 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b7ffff640 1 -- 172.21.15.139:0/3223794749 learned_addr learned my addr 172.21.15.139:0/3223794749 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.350+0000 7f8b7f7fe640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f8b80156180 0x7f8b800d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:54150/0 (socket says 172.21.15.139:54150) 2024-04-26T18:31:52.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.351+0000 7f8b7ffff640 1 -- 172.21.15.139:0/3223794749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b800cd840 msgr2=0x7f8b800c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.351+0000 7f8b7ffff640 1 --2- 172.21.15.139:0/3223794749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b800cd840 0x7f8b800c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.351+0000 7f8b7ffff640 1 -- 172.21.15.139:0/3223794749 >> v1:172.21.15.143:6789/0 conn(0x7f8b80156180 legacy=0x7f8b800d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.351+0000 7f8b7ffff640 1 -- 172.21.15.139:0/3223794749 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8015f580 con 0x7f8b80155da0 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.351+0000 7f8b7ffff640 1 --2- 172.21.15.139:0/3223794749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 0x7f8b8015c680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009870 tx=0x7f8b7002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0201e80f8e7e834 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.351+0000 7f8b7effd640 1 -- 172.21.15.139:0/3223794749 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70037070 con 0x7f8b80155da0 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b7effd640 1 -- 172.21.15.139:0/3223794749 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b70032440 con 0x7f8b80155da0 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b7effd640 1 -- 172.21.15.139:0/3223794749 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70032810 con 0x7f8b80155da0 2024-04-26T18:31:52.354 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 -- 172.21.15.139:0/3223794749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 msgr2=0x7f8b8015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 --2- 172.21.15.139:0/3223794749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 0x7f8b8015c680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009870 tx=0x7f8b7002a1c0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 -- 172.21.15.139:0/3223794749 shutdown_connections 2024-04-26T18:31:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 --2- 172.21.15.139:0/3223794749 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b800cd840 0x7f8b800c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 --2- 172.21.15.139:0/3223794749 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 0x7f8b8015c680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 -- 172.21.15.139:0/3223794749 >> 172.21.15.139:0/3223794749 conn(0x7f8b80068090 msgr2=0x7f8b800684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 -- 172.21.15.139:0/3223794749 shutdown_connections 2024-04-26T18:31:52.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.352+0000 7f8b86371640 1 -- 172.21.15.139:0/3223794749 wait complete. 2024-04-26T18:31:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.353+0000 7f8b86371640 1 Processor -- start 2024-04-26T18:31:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.353+0000 7f8b86371640 1 -- start start 2024-04-26T18:31:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b86371640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b800cd840 0x7f8b801e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b86371640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 0x7f8b800c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b86371640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b801f1d40 0x7f8b801f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.358 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b86371640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b800d19d0 con 0x7f8b800cd840 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b86371640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8015fb40 con 0x7f8b80155da0 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b86371640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800d1b50 con 0x7f8b801f1d40 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b800cd840 0x7f8b801e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b800cd840 0x7f8b801e79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51122/0 (socket says 172.21.15.139:51122) 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 -- 172.21.15.139:0/4121270493 learned_addr learned my addr 172.21.15.139:0/4121270493 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7f7fe640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 0x7f8b800c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b8490e640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b801f1d40 0x7f8b801f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.359 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 -- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b801f1d40 msgr2=0x7f8b801f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b801f1d40 0x7f8b801f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 -- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 msgr2=0x7f8b800c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 0x7f8b800c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.354+0000 7f8b7ffff640 1 -- 172.21.15.139:0/4121270493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b801f2710 con 0x7f8b800cd840 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.355+0000 7f8b7ffff640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b800cd840 0x7f8b801e79d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000c00 tx=0x7f8b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.355+0000 7f8b7cff9640 1 -- 172.21.15.139:0/4121270493 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70037040 con 0x7f8b800cd840 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.355+0000 7f8b7cff9640 1 -- 172.21.15.139:0/4121270493 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b70042070 con 0x7f8b800cd840 2024-04-26T18:31:52.360 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.355+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b801f5aa0 con 0x7f8b800cd840 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.355+0000 7f8b7cff9640 1 -- 172.21.15.139:0/4121270493 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70030880 con 0x7f8b800cd840 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.355+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b80159180 con 0x7f8b800cd840 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.356+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b80076d20 con 0x7f8b800cd840 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.356+0000 7f8b7cff9640 1 -- 172.21.15.139:0/4121270493 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b7002ad10 con 0x7f8b800cd840 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.356+0000 7f8b7cff9640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.357+0000 7f8b7cff9640 1 -- 172.21.15.139:0/4121270493 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8b700ac380 con 0x7f8b800cd840 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.357+0000 7f8b7f7fe640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.361 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.357+0000 7f8b7f7fe640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b801e7f10 tx=0x7f8b74000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.361+0000 7f8b7cff9640 1 -- 172.21.15.139:0/4121270493 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b70079d20 con 0x7f8b800cd840 2024-04-26T18:31:52.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.535+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b800d15d0 con 0x7f8b6c06c8f0 2024-04-26T18:31:52.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.542+0000 7f8b7cff9640 1 -- 172.21.15.139:0/4121270493 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+337848 (secure 0 0 0) 0x7f8b800d15d0 con 0x7f8b6c06c8f0 2024-04-26T18:31:52.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:52.547 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T18:31:52.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8b6c06c8f0 msgr2=0x7f8b6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b801e7f10 tx=0x7f8b74000ed0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b800cd840 msgr2=0x7f8b801e79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b800cd840 0x7f8b801e79d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000c00 tx=0x7f8b700046c0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 shutdown_connections 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8b801f1d40 0x7f8b801f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8b80155da0 0x7f8b800c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 --2- 172.21.15.139:0/4121270493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b800cd840 0x7f8b801e79d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 >> 172.21.15.139:0/4121270493 conn(0x7f8b80068090 msgr2=0x7f8b8015cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 shutdown_connections 2024-04-26T18:31:52.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.546+0000 7f8b86371640 1 -- 172.21.15.139:0/4121270493 wait complete. 2024-04-26T18:31:52.557 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":1053,"stamp":"2024-04-26T18:31:51.588383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1981266339,"num_objects":44241,"num_object_clones":19129,"num_object_copies":167018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44241,"num_whiteouts":18953,"num_read":8532,"num_read_kb":5970244,"num_write":113436,"num_write_kb":4242584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162245,"ondisk_log_size":162245,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6300488,"kb_used_data":4074952,"kb_used_omap":12,"kb_used_meta":2225459,"kb_avail":748674232,"statfs":{"total":773094113280,"available":766642413568,"internally_reserved":0,"allocated":4172750848,"data_stored":4172124006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2278870580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":222,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004567"},"pg_stats":[{"pgid":"2.1f","version":"41'522","reported_seq":594,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:40.758347+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T18:31:40.758347+0000","last_peered":"2024-04-26T18:31:40.758347+0000","last_clean":"2024-04-26T18:31:40.758347+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T18:31:40.758347+0000","last_undegraded":"2024-04-26T18:31:40.758347+0000","last_fullsized":"2024-04-26T18:31:40.758347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37228914,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":590,"num_write_kb":74511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"41'601","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.380741+0000","last_change":"2024-04-26T18:03:00.448985+0000","last_active":"2024-04-26T18:29:46.380741+0000","last_peered":"2024-04-26T18:29:46.380741+0000","last_clean":"2024-04-26T18:29:46.380741+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T18:29:46.380741+0000","last_undegraded":"2024-04-26T18:29:46.380741+0000","last_fullsized":"2024-04-26T18:29:46.380741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:41.107725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230683108,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"41'2821","reported_seq":4546,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.880248+0000","last_change":"2024-04-26T18:03:00.450087+0000","last_active":"2024-04-26T18:31:36.880248+0000","last_peered":"2024-04-26T18:31:36.880248+0000","last_clean":"2024-04-26T18:31:36.880248+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T18:31:36.880248+0000","last_undegraded":"2024-04-26T18:31:36.880248+0000","last_fullsized":"2024-04-26T18:31:36.880248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:07.265582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.226534869,"stat_sum":{"num_bytes":47000043,"num_objects":1217,"num_object_clones":566,"num_object_copies":4868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":566,"num_read":206,"num_read_kb":291402,"num_write":2298,"num_write_kb":59293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'1115","reported_seq":1187,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174878+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T18:30:48.174878+0000","last_peered":"2024-04-26T18:30:48.174878+0000","last_clean":"2024-04-26T18:30:48.174878+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T18:30:48.174878+0000","last_undegraded":"2024-04-26T18:30:48.174878+0000","last_fullsized":"2024-04-26T18:30:48.174878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":1207,"num_write_kb":83571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"41'585","reported_seq":2668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.361929+0000","last_change":"2024-04-26T18:03:00.426487+0000","last_active":"2024-04-26T18:29:46.361929+0000","last_peered":"2024-04-26T18:29:46.361929+0000","last_clean":"2024-04-26T18:29:46.361929+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T18:29:46.361929+0000","last_undegraded":"2024-04-26T18:29:46.361929+0000","last_fullsized":"2024-04-26T18:29:46.361929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:33.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19357582500000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":12,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"41'2977","reported_seq":4608,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.346136+0000","last_change":"2024-04-26T18:03:00.392141+0000","last_active":"2024-04-26T18:31:32.346136+0000","last_peered":"2024-04-26T18:31:32.346136+0000","last_clean":"2024-04-26T18:31:32.346136+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T18:31:32.346136+0000","last_undegraded":"2024-04-26T18:31:32.346136+0000","last_fullsized":"2024-04-26T18:31:32.346136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:05.822108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17635221100000001,"stat_sum":{"num_bytes":22365631,"num_objects":1261,"num_object_clones":594,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1261,"num_whiteouts":594,"num_read":140,"num_read_kb":92586,"num_write":2429,"num_write_kb":39864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"41'1019","reported_seq":1088,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.103488+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T18:30:48.103488+0000","last_peered":"2024-04-26T18:30:48.103488+0000","last_clean":"2024-04-26T18:30:48.103488+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T18:30:48.103488+0000","last_undegraded":"2024-04-26T18:30:48.103488+0000","last_fullsized":"2024-04-26T18:30:48.103488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":1097,"num_write_kb":133138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'617","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347530+0000","last_change":"2024-04-26T18:03:00.388273+0000","last_active":"2024-04-26T18:29:46.347530+0000","last_peered":"2024-04-26T18:29:46.347530+0000","last_clean":"2024-04-26T18:29:46.347530+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T18:29:46.347530+0000","last_undegraded":"2024-04-26T18:29:46.347530+0000","last_fullsized":"2024-04-26T18:29:46.347530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:56.202777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16172857600000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"41'2946","reported_seq":4647,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.787520+0000","last_change":"2024-04-26T18:03:00.421690+0000","last_active":"2024-04-26T18:31:36.787520+0000","last_peered":"2024-04-26T18:31:36.787520+0000","last_clean":"2024-04-26T18:31:36.787520+0000","last_became_active":"2024-04-26T17:58:46.846516+0000","last_became_peered":"2024-04-26T17:58:46.846516+0000","last_unstale":"2024-04-26T18:31:36.787520+0000","last_undegraded":"2024-04-26T18:31:36.787520+0000","last_fullsized":"2024-04-26T18:31:36.787520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:34.049400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18830187000000001,"stat_sum":{"num_bytes":52036256,"num_objects":1294,"num_object_clones":599,"num_object_copies":5176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":599,"num_read":207,"num_read_kb":311106,"num_write":2398,"num_write_kb":54529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"41'525","reported_seq":594,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.579571+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T18:30:13.579571+0000","last_peered":"2024-04-26T18:30:13.579571+0000","last_clean":"2024-04-26T18:30:13.579571+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T18:30:13.579571+0000","last_undegraded":"2024-04-26T18:30:13.579571+0000","last_fullsized":"2024-04-26T18:30:13.579571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":594,"num_write_kb":70938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"41'594","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.439128+0000","last_change":"2024-04-26T18:03:00.385887+0000","last_active":"2024-04-26T18:29:46.439128+0000","last_peered":"2024-04-26T18:29:46.439128+0000","last_clean":"2024-04-26T18:29:46.439128+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T18:29:46.439128+0000","last_undegraded":"2024-04-26T18:29:46.439128+0000","last_fullsized":"2024-04-26T18:29:46.439128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:36.980517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161485249,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"41'2787","reported_seq":4507,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.854706+0000","last_change":"2024-04-26T18:03:00.421543+0000","last_active":"2024-04-26T18:31:36.854706+0000","last_peered":"2024-04-26T18:31:36.854706+0000","last_clean":"2024-04-26T18:31:36.854706+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T18:31:36.854706+0000","last_undegraded":"2024-04-26T18:31:36.854706+0000","last_fullsized":"2024-04-26T18:31:36.854706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2787,"log_dups_size":0,"ondisk_log_size":2787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:00.311837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18642139199999999,"stat_sum":{"num_bytes":46440810,"num_objects":1192,"num_object_clones":545,"num_object_copies":4768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":545,"num_read":179,"num_read_kb":201194,"num_write":2302,"num_write_kb":49304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"41'629","reported_seq":2703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347806+0000","last_change":"2024-04-26T18:03:00.044745+0000","last_active":"2024-04-26T18:29:46.347806+0000","last_peered":"2024-04-26T18:29:46.347806+0000","last_clean":"2024-04-26T18:29:46.347806+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T18:29:46.347806+0000","last_undegraded":"2024-04-26T18:29:46.347806+0000","last_fullsized":"2024-04-26T18:29:46.347806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:46.688756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101605577,"stat_sum":{"num_bytes":0,"num_objects":66,"num_object_clones":20,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"41'2536","reported_seq":2607,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:08.693990+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T18:30:08.693990+0000","last_peered":"2024-04-26T18:30:08.693990+0000","last_clean":"2024-04-26T18:30:08.693990+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T18:30:08.693990+0000","last_undegraded":"2024-04-26T18:30:08.693990+0000","last_fullsized":"2024-04-26T18:30:08.693990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2536,"log_dups_size":0,"ondisk_log_size":2536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":2609,"num_write_kb":88139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"41'2917","reported_seq":4583,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.847250+0000","last_change":"2024-04-26T18:03:00.418993+0000","last_active":"2024-04-26T18:31:36.847250+0000","last_peered":"2024-04-26T18:31:36.847250+0000","last_clean":"2024-04-26T18:31:36.847250+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T18:31:36.847250+0000","last_undegraded":"2024-04-26T18:31:36.847250+0000","last_fullsized":"2024-04-26T18:31:36.847250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:49.886797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19133515200000001,"stat_sum":{"num_bytes":43266035,"num_objects":1273,"num_object_clones":588,"num_object_copies":5092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1273,"num_whiteouts":588,"num_read":168,"num_read_kb":222667,"num_write":2389,"num_write_kb":54953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"41'605","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.349645+0000","last_change":"2024-04-26T18:03:00.446780+0000","last_active":"2024-04-26T18:29:48.349645+0000","last_peered":"2024-04-26T18:29:48.349645+0000","last_clean":"2024-04-26T18:29:48.349645+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T18:29:48.349645+0000","last_undegraded":"2024-04-26T18:29:48.349645+0000","last_fullsized":"2024-04-26T18:29:48.349645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:07.280297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22887548799999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":9,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'1327","reported_seq":1398,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:47.818586+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T18:30:47.818586+0000","last_peered":"2024-04-26T18:30:47.818586+0000","last_clean":"2024-04-26T18:30:47.818586+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T18:30:47.818586+0000","last_undegraded":"2024-04-26T18:30:47.818586+0000","last_fullsized":"2024-04-26T18:30:47.818586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":1392,"num_write_kb":95976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"41'2855","reported_seq":4547,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.895356+0000","last_change":"2024-04-26T18:03:00.416771+0000","last_active":"2024-04-26T18:31:36.895356+0000","last_peered":"2024-04-26T18:31:36.895356+0000","last_clean":"2024-04-26T18:31:36.895356+0000","last_became_active":"2024-04-26T17:58:46.846635+0000","last_became_peered":"2024-04-26T17:58:46.846635+0000","last_unstale":"2024-04-26T18:31:36.895356+0000","last_undegraded":"2024-04-26T18:31:36.895356+0000","last_fullsized":"2024-04-26T18:31:36.895356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:06.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928092499999999,"stat_sum":{"num_bytes":21448645,"num_objects":1180,"num_object_clones":543,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":543,"num_read":142,"num_read_kb":62635,"num_write":2368,"num_write_kb":33318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"41'646","reported_seq":2725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175950+0000","last_change":"2024-04-26T18:03:00.446546+0000","last_active":"2024-04-26T18:30:16.175950+0000","last_peered":"2024-04-26T18:30:16.175950+0000","last_clean":"2024-04-26T18:30:16.175950+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T18:30:16.175950+0000","last_undegraded":"2024-04-26T18:30:16.175950+0000","last_fullsized":"2024-04-26T18:30:16.175950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:30.786683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22842327800000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":15,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"41'848","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.175344+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T18:30:48.175344+0000","last_peered":"2024-04-26T18:30:48.175344+0000","last_clean":"2024-04-26T18:30:48.175344+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T18:30:48.175344+0000","last_undegraded":"2024-04-26T18:30:48.175344+0000","last_fullsized":"2024-04-26T18:30:48.175344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":901,"num_write_kb":79506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"41'2890","reported_seq":4575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.886843+0000","last_change":"2024-04-26T18:03:00.013967+0000","last_active":"2024-04-26T18:31:36.886843+0000","last_peered":"2024-04-26T18:31:36.886843+0000","last_clean":"2024-04-26T18:31:36.886843+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T18:31:36.886843+0000","last_undegraded":"2024-04-26T18:31:36.886843+0000","last_fullsized":"2024-04-26T18:31:36.886843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:56.071843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077792920000000002,"stat_sum":{"num_bytes":29575215,"num_objects":1245,"num_object_clones":583,"num_object_copies":4980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":583,"num_read":184,"num_read_kb":122824,"num_write":2351,"num_write_kb":42495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"41'615","reported_seq":2700,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375930+0000","last_change":"2024-04-26T18:03:00.424812+0000","last_active":"2024-04-26T18:29:46.375930+0000","last_peered":"2024-04-26T18:29:46.375930+0000","last_clean":"2024-04-26T18:29:46.375930+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T18:29:46.375930+0000","last_undegraded":"2024-04-26T18:29:46.375930+0000","last_fullsized":"2024-04-26T18:29:46.375930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:21.113921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18061166100000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"41'468","reported_seq":539,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:45.748977+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T18:30:45.748977+0000","last_peered":"2024-04-26T18:30:45.748977+0000","last_clean":"2024-04-26T18:30:45.748977+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T18:30:45.748977+0000","last_undegraded":"2024-04-26T18:30:45.748977+0000","last_fullsized":"2024-04-26T18:30:45.748977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":511,"num_write_kb":66851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"41'2805","reported_seq":4481,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.894628+0000","last_change":"2024-04-26T18:03:00.413832+0000","last_active":"2024-04-26T18:31:36.894628+0000","last_peered":"2024-04-26T18:31:36.894628+0000","last_clean":"2024-04-26T18:31:36.894628+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T18:31:36.894628+0000","last_undegraded":"2024-04-26T18:31:36.894628+0000","last_fullsized":"2024-04-26T18:31:36.894628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2805,"log_dups_size":0,"ondisk_log_size":2805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:37.962626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18788326999999999,"stat_sum":{"num_bytes":37828835,"num_objects":1237,"num_object_clones":573,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":573,"num_read":163,"num_read_kb":252845,"num_write":2275,"num_write_kb":48379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"41'593","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:38.193600+0000","last_change":"2024-04-26T18:03:00.425151+0000","last_active":"2024-04-26T18:30:38.193600+0000","last_peered":"2024-04-26T18:30:38.193600+0000","last_clean":"2024-04-26T18:30:38.193600+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T18:30:38.193600+0000","last_undegraded":"2024-04-26T18:30:38.193600+0000","last_fullsized":"2024-04-26T18:30:38.193600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.966252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19854031599999999,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"41'813","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:33.145622+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T18:29:33.145622+0000","last_peered":"2024-04-26T18:29:33.145622+0000","last_clean":"2024-04-26T18:29:33.145622+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T18:29:33.145622+0000","last_undegraded":"2024-04-26T18:29:33.145622+0000","last_fullsized":"2024-04-26T18:29:33.145622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":915,"num_write_kb":75562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"41'2861","reported_seq":4549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.873322+0000","last_change":"2024-04-26T18:03:00.424600+0000","last_active":"2024-04-26T18:31:36.873322+0000","last_peered":"2024-04-26T18:31:36.873322+0000","last_clean":"2024-04-26T18:31:36.873322+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T18:31:36.873322+0000","last_undegraded":"2024-04-26T18:31:36.873322+0000","last_fullsized":"2024-04-26T18:31:36.873322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:18.947305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.181349811,"stat_sum":{"num_bytes":38568471,"num_objects":1183,"num_object_clones":549,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":549,"num_read":148,"num_read_kb":161250,"num_write":2358,"num_write_kb":47514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"41'590","reported_seq":2670,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.151126+0000","last_change":"2024-04-26T18:03:00.451850+0000","last_active":"2024-04-26T18:29:47.151126+0000","last_peered":"2024-04-26T18:29:47.151126+0000","last_clean":"2024-04-26T18:29:47.151126+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T18:29:47.151126+0000","last_undegraded":"2024-04-26T18:29:47.151126+0000","last_fullsized":"2024-04-26T18:29:47.151126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:02.283489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217975578,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"41'1483","reported_seq":1554,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:59.181804+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T18:30:59.181804+0000","last_peered":"2024-04-26T18:30:59.181804+0000","last_clean":"2024-04-26T18:30:59.181804+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T18:30:59.181804+0000","last_undegraded":"2024-04-26T18:30:59.181804+0000","last_fullsized":"2024-04-26T18:30:59.181804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1483,"log_dups_size":0,"ondisk_log_size":1483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":3198,"num_write_kb":72387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"41'2904","reported_seq":4597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.340152+0000","last_change":"2024-04-26T18:03:00.447628+0000","last_active":"2024-04-26T18:31:32.340152+0000","last_peered":"2024-04-26T18:31:32.340152+0000","last_clean":"2024-04-26T18:31:32.340152+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T18:31:32.340152+0000","last_undegraded":"2024-04-26T18:31:32.340152+0000","last_fullsized":"2024-04-26T18:31:32.340152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2904,"log_dups_size":0,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:52.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23002119400000001,"stat_sum":{"num_bytes":32774060,"num_objects":1224,"num_object_clones":563,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1224,"num_whiteouts":563,"num_read":167,"num_read_kb":173625,"num_write":2397,"num_write_kb":37665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"41'607","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.414938+0000","last_change":"2024-04-26T18:03:00.013128+0000","last_active":"2024-04-26T18:29:41.414938+0000","last_peered":"2024-04-26T18:29:41.414938+0000","last_clean":"2024-04-26T18:29:41.414938+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T18:29:41.414938+0000","last_undegraded":"2024-04-26T18:29:41.414938+0000","last_fullsized":"2024-04-26T18:29:41.414938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:28.496234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077215679999999995,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"41'788","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.548547+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T18:30:18.548547+0000","last_peered":"2024-04-26T18:30:18.548547+0000","last_clean":"2024-04-26T18:30:18.548547+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T18:30:18.548547+0000","last_undegraded":"2024-04-26T18:30:18.548547+0000","last_fullsized":"2024-04-26T18:30:18.548547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":856,"num_write_kb":87605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"41'2980","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.803974+0000","last_change":"2024-04-26T18:03:00.424270+0000","last_active":"2024-04-26T18:31:36.803974+0000","last_peered":"2024-04-26T18:31:36.803974+0000","last_clean":"2024-04-26T18:31:36.803974+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T18:31:36.803974+0000","last_undegraded":"2024-04-26T18:31:36.803974+0000","last_fullsized":"2024-04-26T18:31:36.803974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:36.634495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20617318100000001,"stat_sum":{"num_bytes":38568987,"num_objects":1282,"num_object_clones":600,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":600,"num_read":166,"num_read_kb":191696,"num_write":2429,"num_write_kb":47342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'616","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.407143+0000","last_change":"2024-04-26T18:03:00.387991+0000","last_active":"2024-04-26T18:29:46.407143+0000","last_peered":"2024-04-26T18:29:46.407143+0000","last_clean":"2024-04-26T18:29:46.407143+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T18:29:46.407143+0000","last_undegraded":"2024-04-26T18:29:46.407143+0000","last_fullsized":"2024-04-26T18:29:46.407143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:06.986658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161265819,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"41'746","reported_seq":818,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.190651+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T18:30:48.190651+0000","last_peered":"2024-04-26T18:30:48.190651+0000","last_clean":"2024-04-26T18:30:48.190651+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T18:30:48.190651+0000","last_undegraded":"2024-04-26T18:30:48.190651+0000","last_fullsized":"2024-04-26T18:30:48.190651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":797,"num_write_kb":111877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"41'2902","reported_seq":4611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.889065+0000","last_change":"2024-04-26T18:03:00.012758+0000","last_active":"2024-04-26T18:31:36.889065+0000","last_peered":"2024-04-26T18:31:36.889065+0000","last_clean":"2024-04-26T18:31:36.889065+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T18:31:36.889065+0000","last_undegraded":"2024-04-26T18:31:36.889065+0000","last_fullsized":"2024-04-26T18:31:36.889065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2902,"log_dups_size":0,"ondisk_log_size":2902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.245551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077512545000000002,"stat_sum":{"num_bytes":51130541,"num_objects":1258,"num_object_clones":577,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":577,"num_read":197,"num_read_kb":290939,"num_write":2373,"num_write_kb":60236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'612","reported_seq":2696,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.356164+0000","last_change":"2024-04-26T18:03:00.422866+0000","last_active":"2024-04-26T18:30:01.356164+0000","last_peered":"2024-04-26T18:30:01.356164+0000","last_clean":"2024-04-26T18:30:01.356164+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T18:30:01.356164+0000","last_undegraded":"2024-04-26T18:30:01.356164+0000","last_fullsized":"2024-04-26T18:30:01.356164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:27.152866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18566148499999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"41'538","reported_seq":610,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.192866+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T18:30:48.192866+0000","last_peered":"2024-04-26T18:30:48.192866+0000","last_clean":"2024-04-26T18:30:48.192866+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T18:30:48.192866+0000","last_undegraded":"2024-04-26T18:30:48.192866+0000","last_fullsized":"2024-04-26T18:30:48.192866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":583,"num_write_kb":83272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"41'2814","reported_seq":4454,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.883940+0000","last_change":"2024-04-26T18:03:00.013541+0000","last_active":"2024-04-26T18:31:36.883940+0000","last_peered":"2024-04-26T18:31:36.883940+0000","last_clean":"2024-04-26T18:31:36.883940+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T18:31:36.883940+0000","last_undegraded":"2024-04-26T18:31:36.883940+0000","last_fullsized":"2024-04-26T18:31:36.883940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:37.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077645753999999997,"stat_sum":{"num_bytes":21677192,"num_objects":1207,"num_object_clones":566,"num_object_copies":4828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":566,"num_read":118,"num_read_kb":106859,"num_write":2295,"num_write_kb":28218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"41'620","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.352068+0000","last_change":"2024-04-26T18:03:00.012108+0000","last_active":"2024-04-26T18:30:01.352068+0000","last_peered":"2024-04-26T18:30:01.352068+0000","last_clean":"2024-04-26T18:30:01.352068+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T18:30:01.352068+0000","last_undegraded":"2024-04-26T18:30:01.352068+0000","last_fullsized":"2024-04-26T18:30:01.352068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:45.171474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076659478000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'1618","reported_seq":2626,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.549967+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T18:30:18.549967+0000","last_peered":"2024-04-26T18:30:18.549967+0000","last_clean":"2024-04-26T18:30:18.549967+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T18:30:18.549967+0000","last_undegraded":"2024-04-26T18:30:18.549967+0000","last_fullsized":"2024-04-26T18:30:18.549967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1618,"log_dups_size":0,"ondisk_log_size":1618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":992,"num_read_kb":4725,"num_write":1685,"num_write_kb":100551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"41'2764","reported_seq":4482,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.876010+0000","last_change":"2024-04-26T18:03:00.014183+0000","last_active":"2024-04-26T18:31:36.876010+0000","last_peered":"2024-04-26T18:31:36.876010+0000","last_clean":"2024-04-26T18:31:36.876010+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T18:31:36.876010+0000","last_undegraded":"2024-04-26T18:31:36.876010+0000","last_fullsized":"2024-04-26T18:31:36.876010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2764,"log_dups_size":0,"ondisk_log_size":2764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:54.571531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077766350999999997,"stat_sum":{"num_bytes":40144243,"num_objects":1196,"num_object_clones":556,"num_object_copies":4784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":556,"num_read":186,"num_read_kb":267655,"num_write":2256,"num_write_kb":47769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"41'586","reported_seq":2669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390842+0000","last_change":"2024-04-26T18:03:00.423065+0000","last_active":"2024-04-26T18:29:46.390842+0000","last_peered":"2024-04-26T18:29:46.390842+0000","last_clean":"2024-04-26T18:29:46.390842+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T18:29:46.390842+0000","last_undegraded":"2024-04-26T18:29:46.390842+0000","last_fullsized":"2024-04-26T18:29:46.390842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:15.084787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20174721700000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'667","reported_seq":739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.152482+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T18:29:48.152482+0000","last_peered":"2024-04-26T18:29:48.152482+0000","last_clean":"2024-04-26T18:29:48.152482+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T18:29:48.152482+0000","last_undegraded":"2024-04-26T18:29:48.152482+0000","last_fullsized":"2024-04-26T18:29:48.152482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":715,"num_write_kb":79339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"41'2915","reported_seq":4593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.876907+0000","last_change":"2024-04-26T18:03:00.426626+0000","last_active":"2024-04-26T18:31:36.876907+0000","last_peered":"2024-04-26T18:31:36.876907+0000","last_clean":"2024-04-26T18:31:36.876907+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T18:31:36.876907+0000","last_undegraded":"2024-04-26T18:31:36.876907+0000","last_fullsized":"2024-04-26T18:31:36.876907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:11.102216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20190264199999999,"stat_sum":{"num_bytes":26615609,"num_objects":1212,"num_object_clones":560,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":560,"num_read":151,"num_read_kb":128735,"num_write":2402,"num_write_kb":29722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"41'621","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.171918+0000","last_change":"2024-04-26T18:03:00.450371+0000","last_active":"2024-04-26T18:30:16.171918+0000","last_peered":"2024-04-26T18:30:16.171918+0000","last_clean":"2024-04-26T18:30:16.171918+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T18:30:16.171918+0000","last_undegraded":"2024-04-26T18:30:16.171918+0000","last_fullsized":"2024-04-26T18:30:16.171918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:39.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22655562100000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'1595","reported_seq":1667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175583+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T18:30:16.175583+0000","last_peered":"2024-04-26T18:30:16.175583+0000","last_clean":"2024-04-26T18:30:16.175583+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T18:30:16.175583+0000","last_undegraded":"2024-04-26T18:30:16.175583+0000","last_fullsized":"2024-04-26T18:30:16.175583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1595,"log_dups_size":0,"ondisk_log_size":1595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":0,"num_write":1680,"num_write_kb":72101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:28:03.048194+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T18:28:03.048194+0000","last_peered":"2024-04-26T18:28:03.048194+0000","last_clean":"2024-04-26T18:28:03.048194+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T18:28:03.048194+0000","last_undegraded":"2024-04-26T18:28:03.048194+0000","last_fullsized":"2024-04-26T18:28:03.048194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"41'3034","reported_seq":4678,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.920048+0000","last_change":"2024-04-26T18:03:00.043842+0000","last_active":"2024-04-26T18:31:36.920048+0000","last_peered":"2024-04-26T18:31:36.920048+0000","last_clean":"2024-04-26T18:31:36.920048+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T18:31:36.920048+0000","last_undegraded":"2024-04-26T18:31:36.920048+0000","last_fullsized":"2024-04-26T18:31:36.920048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:43.054742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101669149,"stat_sum":{"num_bytes":43937728,"num_objects":1270,"num_object_clones":639,"num_object_copies":5080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1270,"num_whiteouts":551,"num_read":194,"num_read_kb":160197,"num_write":2447,"num_write_kb":52378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"41'602","reported_seq":2680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.344820+0000","last_change":"2024-04-26T18:03:00.046750+0000","last_active":"2024-04-26T18:29:46.344820+0000","last_peered":"2024-04-26T18:29:46.344820+0000","last_clean":"2024-04-26T18:29:46.344820+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T18:29:46.344820+0000","last_undegraded":"2024-04-26T18:29:46.344820+0000","last_fullsized":"2024-04-26T18:29:46.344820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:48.686392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10552916,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"41'542","reported_seq":613,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:15.802404+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T18:30:15.802404+0000","last_peered":"2024-04-26T18:30:15.802404+0000","last_clean":"2024-04-26T18:30:15.802404+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T18:30:15.802404+0000","last_undegraded":"2024-04-26T18:30:15.802404+0000","last_fullsized":"2024-04-26T18:30:15.802404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":567,"num_write_kb":79001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"41'2911","reported_seq":4622,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:28.781006+0000","last_change":"2024-04-26T18:03:00.044856+0000","last_active":"2024-04-26T18:31:28.781006+0000","last_peered":"2024-04-26T18:31:28.781006+0000","last_clean":"2024-04-26T18:31:28.781006+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T18:31:28.781006+0000","last_undegraded":"2024-04-26T18:31:28.781006+0000","last_fullsized":"2024-04-26T18:31:28.781006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.254209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102636063,"stat_sum":{"num_bytes":37322430,"num_objects":1233,"num_object_clones":576,"num_object_copies":4932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1233,"num_whiteouts":576,"num_read":199,"num_read_kb":211238,"num_write":2388,"num_write_kb":48792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"41'607","reported_seq":2693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375271+0000","last_change":"2024-04-26T18:03:00.390471+0000","last_active":"2024-04-26T18:29:46.375271+0000","last_peered":"2024-04-26T18:29:46.375271+0000","last_clean":"2024-04-26T18:29:46.375271+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T18:29:46.375271+0000","last_undegraded":"2024-04-26T18:29:46.375271+0000","last_fullsized":"2024-04-26T18:29:46.375271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:29.493089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16359686500000001,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"41'1297","reported_seq":1368,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.203238+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T18:30:48.203238+0000","last_peered":"2024-04-26T18:30:48.203238+0000","last_clean":"2024-04-26T18:30:48.203238+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T18:30:48.203238+0000","last_undegraded":"2024-04-26T18:30:48.203238+0000","last_fullsized":"2024-04-26T18:30:48.203238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1297,"log_dups_size":0,"ondisk_log_size":1297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29364754,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":1371,"num_write_kb":104375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"41'2892","reported_seq":4596,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.883073+0000","last_change":"2024-04-26T18:03:00.425610+0000","last_active":"2024-04-26T18:31:36.883073+0000","last_peered":"2024-04-26T18:31:36.883073+0000","last_clean":"2024-04-26T18:31:36.883073+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T18:31:36.883073+0000","last_undegraded":"2024-04-26T18:31:36.883073+0000","last_fullsized":"2024-04-26T18:31:36.883073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:33.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20706662200000001,"stat_sum":{"num_bytes":43474396,"num_objects":1246,"num_object_clones":573,"num_object_copies":4984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":573,"num_read":190,"num_read_kb":265762,"num_write":2374,"num_write_kb":47127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"41'593","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375676+0000","last_change":"2024-04-26T18:03:00.046998+0000","last_active":"2024-04-26T18:29:46.375676+0000","last_peered":"2024-04-26T18:29:46.375676+0000","last_clean":"2024-04-26T18:29:46.375676+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T18:29:46.375676+0000","last_undegraded":"2024-04-26T18:29:46.375676+0000","last_fullsized":"2024-04-26T18:29:46.375676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:51.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104614815,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"41'698","reported_seq":769,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174916+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T18:30:48.174916+0000","last_peered":"2024-04-26T18:30:48.174916+0000","last_clean":"2024-04-26T18:30:48.174916+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T18:30:48.174916+0000","last_undegraded":"2024-04-26T18:30:48.174916+0000","last_fullsized":"2024-04-26T18:30:48.174916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":758,"num_write_kb":95614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"41'2925","reported_seq":4669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:39.302134+0000","last_change":"2024-04-26T18:03:00.379880+0000","last_active":"2024-04-26T18:31:39.302134+0000","last_peered":"2024-04-26T18:31:39.302134+0000","last_clean":"2024-04-26T18:31:39.302134+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T18:31:39.302134+0000","last_undegraded":"2024-04-26T18:31:39.302134+0000","last_fullsized":"2024-04-26T18:31:39.302134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:12.400616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16179385399999999,"stat_sum":{"num_bytes":31406117,"num_objects":1218,"num_object_clones":563,"num_object_copies":4872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":563,"num_read":219,"num_read_kb":160548,"num_write":2420,"num_write_kb":43855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"41'599","reported_seq":2684,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390465+0000","last_change":"2024-04-26T18:03:00.046050+0000","last_active":"2024-04-26T18:29:46.390465+0000","last_peered":"2024-04-26T18:29:46.390465+0000","last_clean":"2024-04-26T18:29:46.390465+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T18:29:46.390465+0000","last_undegraded":"2024-04-26T18:29:46.390465+0000","last_fullsized":"2024-04-26T18:29:46.390465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:37.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103300084,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'716","reported_seq":786,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.376382+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T18:30:16.376382+0000","last_peered":"2024-04-26T18:30:16.376382+0000","last_clean":"2024-04-26T18:30:16.376382+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T18:30:16.376382+0000","last_undegraded":"2024-04-26T18:30:16.376382+0000","last_fullsized":"2024-04-26T18:30:16.376382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165846,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":771,"num_write_kb":75142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"41'2803","reported_seq":4571,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:39.299548+0000","last_change":"2024-04-26T18:03:00.424342+0000","last_active":"2024-04-26T18:31:39.299548+0000","last_peered":"2024-04-26T18:31:39.299548+0000","last_clean":"2024-04-26T18:31:39.299548+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T18:31:39.299548+0000","last_undegraded":"2024-04-26T18:31:39.299548+0000","last_fullsized":"2024-04-26T18:31:39.299548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:41.316721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18140468300000001,"stat_sum":{"num_bytes":44194819,"num_objects":1210,"num_object_clones":561,"num_object_copies":4840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":561,"num_read":242,"num_read_kb":262276,"num_write":2276,"num_write_kb":51233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"41'643","reported_seq":2722,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.432005+0000","last_change":"2024-04-26T18:03:00.047648+0000","last_active":"2024-04-26T18:29:46.432005+0000","last_peered":"2024-04-26T18:29:46.432005+0000","last_clean":"2024-04-26T18:29:46.432005+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T18:29:46.432005+0000","last_undegraded":"2024-04-26T18:29:46.432005+0000","last_fullsized":"2024-04-26T18:29:46.432005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.617916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101409261,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":14,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"41'843","reported_seq":913,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.172834+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T18:30:16.172834+0000","last_peered":"2024-04-26T18:30:16.172834+0000","last_clean":"2024-04-26T18:30:16.172834+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T18:30:16.172834+0000","last_undegraded":"2024-04-26T18:30:16.172834+0000","last_fullsized":"2024-04-26T18:30:16.172834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":83,"num_read_kb":0,"num_write":946,"num_write_kb":79922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"41'2759","reported_seq":4442,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.899193+0000","last_change":"2024-04-26T18:03:00.423934+0000","last_active":"2024-04-26T18:31:36.899193+0000","last_peered":"2024-04-26T18:31:36.899193+0000","last_clean":"2024-04-26T18:31:36.899193+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T18:31:36.899193+0000","last_undegraded":"2024-04-26T18:31:36.899193+0000","last_fullsized":"2024-04-26T18:31:36.899193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:22.663372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19926888800000001,"stat_sum":{"num_bytes":38301955,"num_objects":1186,"num_object_clones":557,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":557,"num_read":154,"num_read_kb":145957,"num_write":2246,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'591","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.067174+0000","last_change":"2024-04-26T18:03:00.040005+0000","last_active":"2024-04-26T18:30:48.067174+0000","last_peered":"2024-04-26T18:30:48.067174+0000","last_clean":"2024-04-26T18:30:48.067174+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T18:30:48.067174+0000","last_undegraded":"2024-04-26T18:30:48.067174+0000","last_fullsized":"2024-04-26T18:30:48.067174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:00.688873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099299311000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"41'590","reported_seq":660,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.577085+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T18:30:13.577085+0000","last_peered":"2024-04-26T18:30:13.577085+0000","last_clean":"2024-04-26T18:30:13.577085+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T18:30:13.577085+0000","last_undegraded":"2024-04-26T18:30:13.577085+0000","last_fullsized":"2024-04-26T18:30:13.577085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":625,"num_write_kb":74929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"41'3058","reported_seq":4719,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.884873+0000","last_change":"2024-04-26T18:03:00.451560+0000","last_active":"2024-04-26T18:31:36.884873+0000","last_peered":"2024-04-26T18:31:36.884873+0000","last_clean":"2024-04-26T18:31:36.884873+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T18:31:36.884873+0000","last_undegraded":"2024-04-26T18:31:36.884873+0000","last_fullsized":"2024-04-26T18:31:36.884873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:26.188503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21925704200000001,"stat_sum":{"num_bytes":62040101,"num_objects":1342,"num_object_clones":661,"num_object_copies":5368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1342,"num_whiteouts":573,"num_read":237,"num_read_kb":346938,"num_write":2466,"num_write_kb":72826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"41'619","reported_seq":2685,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.355077+0000","last_change":"2024-04-26T18:03:00.082382+0000","last_active":"2024-04-26T18:29:48.355077+0000","last_peered":"2024-04-26T18:29:48.355077+0000","last_clean":"2024-04-26T18:29:48.355077+0000","last_became_active":"2024-04-26T17:58:46.842960+0000","last_became_peered":"2024-04-26T17:58:46.842960+0000","last_unstale":"2024-04-26T18:29:48.355077+0000","last_undegraded":"2024-04-26T18:29:48.355077+0000","last_fullsized":"2024-04-26T18:29:48.355077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:11:24.844599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029754315999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"41'522","reported_seq":592,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.545859+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T18:30:13.545859+0000","last_peered":"2024-04-26T18:30:13.545859+0000","last_clean":"2024-04-26T18:30:13.545859+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T18:30:13.545859+0000","last_undegraded":"2024-04-26T18:30:13.545859+0000","last_fullsized":"2024-04-26T18:30:13.545859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":593,"num_write_kb":58770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"41'2848","reported_seq":4547,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.798779+0000","last_change":"2024-04-26T18:03:00.451927+0000","last_active":"2024-04-26T18:31:36.798779+0000","last_peered":"2024-04-26T18:31:36.798779+0000","last_clean":"2024-04-26T18:31:36.798779+0000","last_became_active":"2024-04-26T17:58:46.841624+0000","last_became_peered":"2024-04-26T17:58:46.841624+0000","last_unstale":"2024-04-26T18:31:36.798779+0000","last_undegraded":"2024-04-26T18:31:36.798779+0000","last_fullsized":"2024-04-26T18:31:36.798779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:11.632385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218331676,"stat_sum":{"num_bytes":37909871,"num_objects":1250,"num_object_clones":586,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":586,"num_read":191,"num_read_kb":253371,"num_write":2312,"num_write_kb":56158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"41'583","reported_seq":2663,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.357556+0000","last_change":"2024-04-26T18:03:00.428027+0000","last_active":"2024-04-26T18:29:41.357556+0000","last_peered":"2024-04-26T18:29:41.357556+0000","last_clean":"2024-04-26T18:29:41.357556+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T18:29:41.357556+0000","last_undegraded":"2024-04-26T18:29:41.357556+0000","last_fullsized":"2024-04-26T18:29:41.357556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:18.542428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.185065913,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"41'426","reported_seq":496,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:20.748118+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T18:30:20.748118+0000","last_peered":"2024-04-26T18:30:20.748118+0000","last_clean":"2024-04-26T18:30:20.748118+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T18:30:20.748118+0000","last_undegraded":"2024-04-26T18:30:20.748118+0000","last_fullsized":"2024-04-26T18:30:20.748118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":485,"num_write_kb":79130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"41'2856","reported_seq":4518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.860347+0000","last_change":"2024-04-26T18:03:00.386810+0000","last_active":"2024-04-26T18:31:36.860347+0000","last_peered":"2024-04-26T18:31:36.860347+0000","last_clean":"2024-04-26T18:31:36.860347+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T18:31:36.860347+0000","last_undegraded":"2024-04-26T18:31:36.860347+0000","last_fullsized":"2024-04-26T18:31:36.860347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:32.381881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16361857299999999,"stat_sum":{"num_bytes":26393816,"num_objects":1264,"num_object_clones":588,"num_object_copies":5056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1264,"num_whiteouts":588,"num_read":164,"num_read_kb":98786,"num_write":2329,"num_write_kb":28734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"41'612","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.420696+0000","last_change":"2024-04-26T18:03:00.046237+0000","last_active":"2024-04-26T18:29:46.420696+0000","last_peered":"2024-04-26T18:29:46.420696+0000","last_clean":"2024-04-26T18:29:46.420696+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T18:29:46.420696+0000","last_undegraded":"2024-04-26T18:29:46.420696+0000","last_fullsized":"2024-04-26T18:29:46.420696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:43.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10539311699999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"41'818","reported_seq":888,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:20.757985+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T18:31:20.757985+0000","last_peered":"2024-04-26T18:31:20.757985+0000","last_clean":"2024-04-26T18:31:20.757985+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T18:31:20.757985+0000","last_undegraded":"2024-04-26T18:31:20.757985+0000","last_fullsized":"2024-04-26T18:31:20.757985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777888,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":70,"num_read_kb":0,"num_write":938,"num_write_kb":112536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"41'2763","reported_seq":4471,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.863016+0000","last_change":"2024-04-26T18:03:00.011745+0000","last_active":"2024-04-26T18:31:36.863016+0000","last_peered":"2024-04-26T18:31:36.863016+0000","last_clean":"2024-04-26T18:31:36.863016+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T18:31:36.863016+0000","last_undegraded":"2024-04-26T18:31:36.863016+0000","last_fullsized":"2024-04-26T18:31:36.863016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.553669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076321086999999996,"stat_sum":{"num_bytes":36028739,"num_objects":1149,"num_object_clones":527,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":527,"num_read":149,"num_read_kb":73233,"num_write":2275,"num_write_kb":49180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'611","reported_seq":2692,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.396699+0000","last_change":"2024-04-26T18:03:00.416589+0000","last_active":"2024-04-26T18:29:41.396699+0000","last_peered":"2024-04-26T18:29:41.396699+0000","last_clean":"2024-04-26T18:29:41.396699+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T18:29:41.396699+0000","last_undegraded":"2024-04-26T18:29:41.396699+0000","last_fullsized":"2024-04-26T18:29:41.396699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:33.817050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187850924,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"41'1273","reported_seq":1342,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.159063+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T18:30:09.159063+0000","last_peered":"2024-04-26T18:30:09.159063+0000","last_clean":"2024-04-26T18:30:09.159063+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T18:30:09.159063+0000","last_undegraded":"2024-04-26T18:30:09.159063+0000","last_fullsized":"2024-04-26T18:30:09.159063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1332,"num_write_kb":75702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"41'2855","reported_seq":4517,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.859406+0000","last_change":"2024-04-26T18:03:00.422955+0000","last_active":"2024-04-26T18:31:36.859406+0000","last_peered":"2024-04-26T18:31:36.859406+0000","last_clean":"2024-04-26T18:31:36.859406+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T18:31:36.859406+0000","last_undegraded":"2024-04-26T18:31:36.859406+0000","last_fullsized":"2024-04-26T18:31:36.859406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:17.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18615647199999999,"stat_sum":{"num_bytes":26768950,"num_objects":1237,"num_object_clones":575,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":575,"num_read":151,"num_read_kb":65496,"num_write":2334,"num_write_kb":43840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"41'599","reported_seq":2677,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.372641+0000","last_change":"2024-04-26T18:03:00.427018+0000","last_active":"2024-04-26T18:29:41.372641+0000","last_peered":"2024-04-26T18:29:41.372641+0000","last_clean":"2024-04-26T18:29:41.372641+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T18:29:41.372641+0000","last_undegraded":"2024-04-26T18:29:41.372641+0000","last_fullsized":"2024-04-26T18:29:41.372641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:59.016233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19386972299999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"41'2203","reported_seq":2272,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169468+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T18:30:09.169468+0000","last_peered":"2024-04-26T18:30:09.169468+0000","last_clean":"2024-04-26T18:30:09.169468+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T18:30:09.169468+0000","last_undegraded":"2024-04-26T18:30:09.169468+0000","last_fullsized":"2024-04-26T18:30:09.169468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":2240,"num_write_kb":108871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"41'2818","reported_seq":4518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.850564+0000","last_change":"2024-04-26T18:03:00.448747+0000","last_active":"2024-04-26T18:31:36.850564+0000","last_peered":"2024-04-26T18:31:36.850564+0000","last_clean":"2024-04-26T18:31:36.850564+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T18:31:36.850564+0000","last_undegraded":"2024-04-26T18:31:36.850564+0000","last_fullsized":"2024-04-26T18:31:36.850564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2818,"log_dups_size":0,"ondisk_log_size":2818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:54.613985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23086587,"stat_sum":{"num_bytes":33941132,"num_objects":1186,"num_object_clones":549,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":549,"num_read":163,"num_read_kb":131768,"num_write":2312,"num_write_kb":45432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"41'585","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:32.405129+0000","last_change":"2024-04-26T18:03:00.387751+0000","last_active":"2024-04-26T18:29:32.405129+0000","last_peered":"2024-04-26T18:29:32.405129+0000","last_clean":"2024-04-26T18:29:32.405129+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T18:29:32.405129+0000","last_undegraded":"2024-04-26T18:29:32.405129+0000","last_fullsized":"2024-04-26T18:29:32.405129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:17.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16159970800000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"41'918","reported_seq":1135,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174589+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T18:30:48.174589+0000","last_peered":"2024-04-26T18:30:48.174589+0000","last_clean":"2024-04-26T18:30:48.174589+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T18:30:48.174589+0000","last_undegraded":"2024-04-26T18:30:48.174589+0000","last_fullsized":"2024-04-26T18:30:48.174589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17376085,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":220,"num_read_kb":683,"num_write":1019,"num_write_kb":76520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"41'2989","reported_seq":4686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.343459+0000","last_change":"2024-04-26T18:03:00.450154+0000","last_active":"2024-04-26T18:31:32.343459+0000","last_peered":"2024-04-26T18:31:32.343459+0000","last_clean":"2024-04-26T18:31:32.343459+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T18:31:32.343459+0000","last_undegraded":"2024-04-26T18:31:32.343459+0000","last_fullsized":"2024-04-26T18:31:32.343459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:45.503657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22647874100000001,"stat_sum":{"num_bytes":37857272,"num_objects":1229,"num_object_clones":574,"num_object_copies":4916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":574,"num_read":187,"num_read_kb":231681,"num_write":2457,"num_write_kb":51113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"41'2741","reported_seq":4461,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.893946+0000","last_change":"2024-04-26T18:03:00.424939+0000","last_active":"2024-04-26T18:31:36.893946+0000","last_peered":"2024-04-26T18:31:36.893946+0000","last_clean":"2024-04-26T18:31:36.893946+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T18:31:36.893946+0000","last_undegraded":"2024-04-26T18:31:36.893946+0000","last_fullsized":"2024-04-26T18:31:36.893946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:30.278112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20154621,"stat_sum":{"num_bytes":35946841,"num_objects":1130,"num_object_clones":524,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1130,"num_whiteouts":524,"num_read":155,"num_read_kb":163014,"num_write":2271,"num_write_kb":38909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"41'602","reported_seq":2679,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.410519+0000","last_change":"2024-04-26T18:03:00.011427+0000","last_active":"2024-04-26T18:29:46.410519+0000","last_peered":"2024-04-26T18:29:46.410519+0000","last_clean":"2024-04-26T18:29:46.410519+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T18:29:46.410519+0000","last_undegraded":"2024-04-26T18:29:46.410519+0000","last_fullsized":"2024-04-26T18:29:46.410519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:42.428994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076360936000000004,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"41'1493","reported_seq":1562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.171031+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T18:30:16.171031+0000","last_peered":"2024-04-26T18:30:16.171031+0000","last_clean":"2024-04-26T18:30:16.171031+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T18:30:16.171031+0000","last_undegraded":"2024-04-26T18:30:16.171031+0000","last_fullsized":"2024-04-26T18:30:16.171031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":1554,"num_write_kb":113147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"41'2755","reported_seq":4436,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.814569+0000","last_change":"2024-04-26T18:03:00.045338+0000","last_active":"2024-04-26T18:31:36.814569+0000","last_peered":"2024-04-26T18:31:36.814569+0000","last_clean":"2024-04-26T18:31:36.814569+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T18:31:36.814569+0000","last_undegraded":"2024-04-26T18:31:36.814569+0000","last_fullsized":"2024-04-26T18:31:36.814569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:47.473281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101684618,"stat_sum":{"num_bytes":29230084,"num_objects":1175,"num_object_clones":548,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":548,"num_read":140,"num_read_kb":149625,"num_write":2265,"num_write_kb":32436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"41'678","reported_seq":2748,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.346338+0000","last_change":"2024-04-26T18:03:00.010584+0000","last_active":"2024-04-26T18:29:48.346338+0000","last_peered":"2024-04-26T18:29:48.346338+0000","last_clean":"2024-04-26T18:29:48.346338+0000","last_became_active":"2024-04-26T17:58:47.348873+0000","last_became_peered":"2024-04-26T17:58:47.348873+0000","last_unstale":"2024-04-26T18:29:48.346338+0000","last_undegraded":"2024-04-26T18:29:48.346338+0000","last_fullsized":"2024-04-26T18:29:48.346338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:17.045379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075584111999999995,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"41'758","reported_seq":827,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169521+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T18:30:09.169521+0000","last_peered":"2024-04-26T18:30:09.169521+0000","last_clean":"2024-04-26T18:30:09.169521+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T18:30:09.169521+0000","last_undegraded":"2024-04-26T18:30:09.169521+0000","last_fullsized":"2024-04-26T18:30:09.169521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":840,"num_write_kb":71498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"41'948","reported_seq":1017,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.065770+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T18:30:33.065770+0000","last_peered":"2024-04-26T18:30:33.065770+0000","last_clean":"2024-04-26T18:30:33.065770+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T18:30:33.065770+0000","last_undegraded":"2024-04-26T18:30:33.065770+0000","last_fullsized":"2024-04-26T18:30:33.065770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":1019,"num_write_kb":79683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"41'588","reported_seq":2667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.349367+0000","last_change":"2024-04-26T18:03:00.424808+0000","last_active":"2024-04-26T18:29:48.349367+0000","last_peered":"2024-04-26T18:29:48.349367+0000","last_clean":"2024-04-26T18:29:48.349367+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T18:29:48.349367+0000","last_undegraded":"2024-04-26T18:29:48.349367+0000","last_fullsized":"2024-04-26T18:29:48.349367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:07.262537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20583575700000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"41'2937","reported_seq":4605,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.781361+0000","last_change":"2024-04-26T18:03:00.085072+0000","last_active":"2024-04-26T18:31:36.781361+0000","last_peered":"2024-04-26T18:31:36.781361+0000","last_clean":"2024-04-26T18:31:36.781361+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T18:31:36.781361+0000","last_undegraded":"2024-04-26T18:31:36.781361+0000","last_fullsized":"2024-04-26T18:31:36.781361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:19.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025934391000000001,"stat_sum":{"num_bytes":29962641,"num_objects":1274,"num_object_clones":596,"num_object_copies":5096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":596,"num_read":178,"num_read_kb":211369,"num_write":2395,"num_write_kb":42590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"41'542","reported_seq":611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.066572+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T18:30:33.066572+0000","last_peered":"2024-04-26T18:30:33.066572+0000","last_clean":"2024-04-26T18:30:33.066572+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T18:30:33.066572+0000","last_undegraded":"2024-04-26T18:30:33.066572+0000","last_fullsized":"2024-04-26T18:30:33.066572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":620,"num_write_kb":96015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"41'620","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.452032+0000","last_change":"2024-04-26T18:03:00.422447+0000","last_active":"2024-04-26T18:29:46.452032+0000","last_peered":"2024-04-26T18:29:46.452032+0000","last_clean":"2024-04-26T18:29:46.452032+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T18:29:46.452032+0000","last_undegraded":"2024-04-26T18:29:46.452032+0000","last_fullsized":"2024-04-26T18:29:46.452032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:19.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18696554200000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"41'2812","reported_seq":4494,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.336075+0000","last_change":"2024-04-26T18:03:00.452403+0000","last_active":"2024-04-26T18:31:32.336075+0000","last_peered":"2024-04-26T18:31:32.336075+0000","last_clean":"2024-04-26T18:31:32.336075+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T18:31:32.336075+0000","last_undegraded":"2024-04-26T18:31:32.336075+0000","last_fullsized":"2024-04-26T18:31:32.336075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:38.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215933711,"stat_sum":{"num_bytes":39516255,"num_objects":1208,"num_object_clones":558,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":558,"num_read":157,"num_read_kb":155459,"num_write":2289,"num_write_kb":56059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"41'619","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.343539+0000","last_change":"2024-04-26T18:03:00.038929+0000","last_active":"2024-04-26T18:29:48.343539+0000","last_peered":"2024-04-26T18:29:48.343539+0000","last_clean":"2024-04-26T18:29:48.343539+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T18:29:48.343539+0000","last_undegraded":"2024-04-26T18:29:48.343539+0000","last_fullsized":"2024-04-26T18:29:48.343539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:12.133508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098603622000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"41'650","reported_seq":2731,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.191322+0000","last_change":"2024-04-26T18:03:00.080058+0000","last_active":"2024-04-26T18:30:48.191322+0000","last_peered":"2024-04-26T18:30:48.191322+0000","last_clean":"2024-04-26T18:30:48.191322+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T18:30:48.191322+0000","last_undegraded":"2024-04-26T18:30:48.191322+0000","last_fullsized":"2024-04-26T18:30:48.191322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:21.430086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032925850999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"41'602","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:03.169842+0000","last_change":"2024-04-26T18:03:00.082718+0000","last_active":"2024-04-26T18:30:03.169842+0000","last_peered":"2024-04-26T18:30:03.169842+0000","last_clean":"2024-04-26T18:30:03.169842+0000","last_became_active":"2024-04-26T17:58:46.843441+0000","last_became_peered":"2024-04-26T17:58:46.843441+0000","last_unstale":"2024-04-26T18:30:03.169842+0000","last_undegraded":"2024-04-26T18:30:03.169842+0000","last_fullsized":"2024-04-26T18:30:03.169842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:59.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030186671000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"41'658","reported_seq":2736,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.338929+0000","last_change":"2024-04-26T18:03:00.420297+0000","last_active":"2024-04-26T18:29:41.338929+0000","last_peered":"2024-04-26T18:29:41.338929+0000","last_clean":"2024-04-26T18:29:41.338929+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T18:29:41.338929+0000","last_undegraded":"2024-04-26T18:29:41.338929+0000","last_fullsized":"2024-04-26T18:29:41.338929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:17.932988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.201538621,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"41'594","reported_seq":2676,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.352627+0000","last_change":"2024-04-26T18:03:00.452146+0000","last_active":"2024-04-26T18:30:01.352627+0000","last_peered":"2024-04-26T18:30:01.352627+0000","last_clean":"2024-04-26T18:30:01.352627+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T18:30:01.352627+0000","last_undegraded":"2024-04-26T18:30:01.352627+0000","last_fullsized":"2024-04-26T18:30:01.352627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:38.204578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217865696,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"41'614","reported_seq":2690,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:38.350023+0000","last_change":"2024-04-26T18:03:00.013263+0000","last_active":"2024-04-26T18:30:38.350023+0000","last_peered":"2024-04-26T18:30:38.350023+0000","last_clean":"2024-04-26T18:30:38.350023+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T18:30:38.350023+0000","last_undegraded":"2024-04-26T18:30:38.350023+0000","last_fullsized":"2024-04-26T18:30:38.350023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:40.421470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077286562000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":18,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"41'640","reported_seq":2724,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.359704+0000","last_change":"2024-04-26T18:03:00.044300+0000","last_active":"2024-04-26T18:29:46.359704+0000","last_peered":"2024-04-26T18:29:46.359704+0000","last_clean":"2024-04-26T18:29:46.359704+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T18:29:46.359704+0000","last_undegraded":"2024-04-26T18:29:46.359704+0000","last_fullsized":"2024-04-26T18:29:46.359704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:41.880840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101304621,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"41'588","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.150007+0000","last_change":"2024-04-26T18:03:00.451279+0000","last_active":"2024-04-26T18:29:47.150007+0000","last_peered":"2024-04-26T18:29:47.150007+0000","last_clean":"2024-04-26T18:29:47.150007+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T18:29:47.150007+0000","last_undegraded":"2024-04-26T18:29:47.150007+0000","last_fullsized":"2024-04-26T18:29:47.150007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:01.568762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21869934299999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"41'612","reported_seq":2692,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:43.067031+0000","last_change":"2024-04-26T18:03:00.382958+0000","last_active":"2024-04-26T18:30:43.067031+0000","last_peered":"2024-04-26T18:30:43.067031+0000","last_clean":"2024-04-26T18:30:43.067031+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T18:30:43.067031+0000","last_undegraded":"2024-04-26T18:30:43.067031+0000","last_fullsized":"2024-04-26T18:30:43.067031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:24.729192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16324759799999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"41'601","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:42.333632+0000","last_change":"2024-04-26T18:03:00.449823+0000","last_active":"2024-04-26T18:29:42.333632+0000","last_peered":"2024-04-26T18:29:42.333632+0000","last_clean":"2024-04-26T18:29:42.333632+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T18:29:42.333632+0000","last_undegraded":"2024-04-26T18:29:42.333632+0000","last_fullsized":"2024-04-26T18:29:42.333632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:31.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22595842999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":20,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"41'628","reported_seq":2712,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347096+0000","last_change":"2024-04-26T18:03:00.387942+0000","last_active":"2024-04-26T18:29:46.347096+0000","last_peered":"2024-04-26T18:29:46.347096+0000","last_clean":"2024-04-26T18:29:46.347096+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T18:29:46.347096+0000","last_undegraded":"2024-04-26T18:29:46.347096+0000","last_fullsized":"2024-04-26T18:29:46.347096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:12.544391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16093863,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"41'620","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.378968+0000","last_change":"2024-04-26T18:03:00.417549+0000","last_active":"2024-04-26T18:29:46.378968+0000","last_peered":"2024-04-26T18:29:46.378968+0000","last_clean":"2024-04-26T18:29:46.378968+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T18:29:46.378968+0000","last_undegraded":"2024-04-26T18:29:46.378968+0000","last_fullsized":"2024-04-26T18:29:46.378968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:03.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.199229399,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"41'627","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390505+0000","last_change":"2024-04-26T18:03:00.037623+0000","last_active":"2024-04-26T18:29:46.390505+0000","last_peered":"2024-04-26T18:29:46.390505+0000","last_clean":"2024-04-26T18:29:46.390505+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T18:29:46.390505+0000","last_undegraded":"2024-04-26T18:29:46.390505+0000","last_fullsized":"2024-04-26T18:29:46.390505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:23.801334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097146090000000004,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":18,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"41'645","reported_seq":2721,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175759+0000","last_change":"2024-04-26T18:03:00.047343+0000","last_active":"2024-04-26T18:30:16.175759+0000","last_peered":"2024-04-26T18:30:16.175759+0000","last_clean":"2024-04-26T18:30:16.175759+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T18:30:16.175759+0000","last_undegraded":"2024-04-26T18:30:16.175759+0000","last_fullsized":"2024-04-26T18:30:16.175759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.305800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104951684,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"41'585","reported_seq":2665,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.175924+0000","last_change":"2024-04-26T18:03:00.080377+0000","last_active":"2024-04-26T18:30:48.175924+0000","last_peered":"2024-04-26T18:30:48.175924+0000","last_clean":"2024-04-26T18:30:48.175924+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T18:30:48.175924+0000","last_undegraded":"2024-04-26T18:30:48.175924+0000","last_fullsized":"2024-04-26T18:30:48.175924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:16.651583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032670101999999999,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"41'637","reported_seq":2717,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.378343+0000","last_change":"2024-04-26T18:03:00.390632+0000","last_active":"2024-04-26T18:29:46.378343+0000","last_peered":"2024-04-26T18:29:46.378343+0000","last_clean":"2024-04-26T18:29:46.378343+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T18:29:46.378343+0000","last_undegraded":"2024-04-26T18:29:46.378343+0000","last_fullsized":"2024-04-26T18:29:46.378343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:04.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15919065099999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"41'612","reported_seq":2693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.067474+0000","last_change":"2024-04-26T18:03:00.381346+0000","last_active":"2024-04-26T18:30:48.067474+0000","last_peered":"2024-04-26T18:30:48.067474+0000","last_clean":"2024-04-26T18:30:48.067474+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T18:30:48.067474+0000","last_undegraded":"2024-04-26T18:30:48.067474+0000","last_fullsized":"2024-04-26T18:30:48.067474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:38.159280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16311753700000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"41'635","reported_seq":2713,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.203186+0000","last_change":"2024-04-26T18:03:00.012809+0000","last_active":"2024-04-26T18:30:48.203186+0000","last_peered":"2024-04-26T18:30:48.203186+0000","last_clean":"2024-04-26T18:30:48.203186+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T18:30:48.203186+0000","last_undegraded":"2024-04-26T18:30:48.203186+0000","last_fullsized":"2024-04-26T18:30:48.203186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:47.235898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077647145000000001,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"41'596","reported_seq":2681,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.375114+0000","last_change":"2024-04-26T18:03:00.427662+0000","last_active":"2024-04-26T18:29:41.375114+0000","last_peered":"2024-04-26T18:29:41.375114+0000","last_clean":"2024-04-26T18:29:41.375114+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T18:29:41.375114+0000","last_undegraded":"2024-04-26T18:29:41.375114+0000","last_fullsized":"2024-04-26T18:29:41.375114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:35.215492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18619005699999999,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"41'583","reported_seq":2663,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:35.399093+0000","last_change":"2024-04-26T18:03:00.444694+0000","last_active":"2024-04-26T18:29:35.399093+0000","last_peered":"2024-04-26T18:29:35.399093+0000","last_clean":"2024-04-26T18:29:35.399093+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T18:29:35.399093+0000","last_undegraded":"2024-04-26T18:29:35.399093+0000","last_fullsized":"2024-04-26T18:29:35.399093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:27.452738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22687219,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"41'600","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.355615+0000","last_change":"2024-04-26T18:03:00.415887+0000","last_active":"2024-04-26T18:29:48.355615+0000","last_peered":"2024-04-26T18:29:48.355615+0000","last_clean":"2024-04-26T18:29:48.355615+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T18:29:48.355615+0000","last_undegraded":"2024-04-26T18:29:48.355615+0000","last_fullsized":"2024-04-26T18:29:48.355615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:42.102564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18821249400000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"41'606","reported_seq":2687,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.350019+0000","last_change":"2024-04-26T18:03:00.042914+0000","last_active":"2024-04-26T18:30:01.350019+0000","last_peered":"2024-04-26T18:30:01.350019+0000","last_clean":"2024-04-26T18:30:01.350019+0000","last_became_active":"2024-04-26T17:58:46.846437+0000","last_became_peered":"2024-04-26T17:58:46.846437+0000","last_unstale":"2024-04-26T18:30:01.350019+0000","last_undegraded":"2024-04-26T18:30:01.350019+0000","last_fullsized":"2024-04-26T18:30:01.350019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:04.851963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100440928,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":16,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"41'591","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.373726+0000","last_change":"2024-04-26T18:03:00.043307+0000","last_active":"2024-04-26T18:29:41.373726+0000","last_peered":"2024-04-26T18:29:41.373726+0000","last_clean":"2024-04-26T18:29:41.373726+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T18:29:41.373726+0000","last_undegraded":"2024-04-26T18:29:41.373726+0000","last_fullsized":"2024-04-26T18:29:41.373726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:35.890122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100379555,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"41'637","reported_seq":2709,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.345489+0000","last_change":"2024-04-26T18:03:00.046913+0000","last_active":"2024-04-26T18:29:46.345489+0000","last_peered":"2024-04-26T18:29:46.345489+0000","last_clean":"2024-04-26T18:29:46.345489+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T18:29:46.345489+0000","last_undegraded":"2024-04-26T18:29:46.345489+0000","last_fullsized":"2024-04-26T18:29:46.345489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:46.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104580398,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":20,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"41'579","reported_seq":2658,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.337001+0000","last_change":"2024-04-26T18:03:00.449103+0000","last_active":"2024-04-26T18:29:47.337001+0000","last_peered":"2024-04-26T18:29:47.337001+0000","last_clean":"2024-04-26T18:29:47.337001+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T18:29:47.337001+0000","last_undegraded":"2024-04-26T18:29:47.337001+0000","last_fullsized":"2024-04-26T18:29:47.337001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:13.870912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230423819,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"41'606","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.348929+0000","last_change":"2024-04-26T18:03:00.047650+0000","last_active":"2024-04-26T18:29:46.348929+0000","last_peered":"2024-04-26T18:29:46.348929+0000","last_clean":"2024-04-26T18:29:46.348929+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T18:29:46.348929+0000","last_undegraded":"2024-04-26T18:29:46.348929+0000","last_fullsized":"2024-04-26T18:29:46.348929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:11.007748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101654339,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"41'571","reported_seq":2651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175691+0000","last_change":"2024-04-26T18:03:00.390090+0000","last_active":"2024-04-26T18:30:16.175691+0000","last_peered":"2024-04-26T18:30:16.175691+0000","last_clean":"2024-04-26T18:30:16.175691+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T18:30:16.175691+0000","last_undegraded":"2024-04-26T18:30:16.175691+0000","last_fullsized":"2024-04-26T18:30:16.175691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:52.940552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16310901,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"41'640","reported_seq":2726,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.350482+0000","last_change":"2024-04-26T18:03:00.045506+0000","last_active":"2024-04-26T18:30:01.350482+0000","last_peered":"2024-04-26T18:30:01.350482+0000","last_clean":"2024-04-26T18:30:01.350482+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T18:30:01.350482+0000","last_undegraded":"2024-04-26T18:30:01.350482+0000","last_fullsized":"2024-04-26T18:30:01.350482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.552957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10388457199999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"41'631","reported_seq":2709,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.346504+0000","last_change":"2024-04-26T18:03:00.390493+0000","last_active":"2024-04-26T18:29:46.346504+0000","last_peered":"2024-04-26T18:29:46.346504+0000","last_clean":"2024-04-26T18:29:46.346504+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T18:29:46.346504+0000","last_undegraded":"2024-04-26T18:29:46.346504+0000","last_fullsized":"2024-04-26T18:29:46.346504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:20.892370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16390716399999999,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":17,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"41'597","reported_seq":2682,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.351509+0000","last_change":"2024-04-26T18:03:00.414568+0000","last_active":"2024-04-26T18:30:01.351509+0000","last_peered":"2024-04-26T18:30:01.351509+0000","last_clean":"2024-04-26T18:30:01.351509+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T18:30:01.351509+0000","last_undegraded":"2024-04-26T18:30:01.351509+0000","last_fullsized":"2024-04-26T18:30:01.351509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:12.402497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19882805000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"41'589","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.188162+0000","last_change":"2024-04-26T18:03:00.013917+0000","last_active":"2024-04-26T18:30:48.188162+0000","last_peered":"2024-04-26T18:30:48.188162+0000","last_clean":"2024-04-26T18:30:48.188162+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T18:30:48.188162+0000","last_undegraded":"2024-04-26T18:30:48.188162+0000","last_fullsized":"2024-04-26T18:30:48.188162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:25.271335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077373158999999997,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"41'577","reported_seq":2665,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.192100+0000","last_change":"2024-04-26T18:03:00.046476+0000","last_active":"2024-04-26T18:30:48.192100+0000","last_peered":"2024-04-26T18:30:48.192100+0000","last_clean":"2024-04-26T18:30:48.192100+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T18:30:48.192100+0000","last_undegraded":"2024-04-26T18:30:48.192100+0000","last_fullsized":"2024-04-26T18:30:48.192100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:28.837314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104812107,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1183673720,"num_objects":39268,"num_object_clones":18317,"num_object_copies":157072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39268,"num_whiteouts":18141,"num_read":5592,"num_read_kb":5964736,"num_write":75176,"num_write_kb":1483989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2573631488,"data_stored":2574974976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91894,"ondisk_log_size":91894,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3085,"num_object_clones":812,"num_object_copies":6170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3085,"num_whiteouts":812,"num_read":0,"num_read_kb":0,"num_write":3093,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39039,"ondisk_log_size":39039,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797002251,"num_objects":1886,"num_object_clones":0,"num_object_copies":3772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1886,"num_whiteouts":0,"num_read":2824,"num_read_kb":5408,"num_write":35008,"num_write_kb":2756179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1594064896,"data_stored":1594004502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31195,"ondisk_log_size":31195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575259,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814068,"kb_used_data":570604,"kb_used_omap":1,"kb_used_meta":243454,"kb_avail":93557772,"statfs":{"total":96636764160,"available":95803158528,"internally_reserved":0,"allocated":584298496,"data_stored":584389236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249297355},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575259,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864928,"kb_used_data":545112,"kb_used_omap":1,"kb_used_meta":319806,"kb_avail":93506912,"statfs":{"total":96636764160,"available":95751077888,"internally_reserved":0,"allocated":558194688,"data_stored":558281943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":327481799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575259,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":747420,"kb_used_data":455444,"kb_used_omap":1,"kb_used_meta":291966,"kb_avail":93624420,"statfs":{"total":96636764160,"available":95871406080,"internally_reserved":0,"allocated":466374656,"data_stored":466129553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":298973637},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575259,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":742816,"kb_used_data":481304,"kb_used_omap":1,"kb_used_meta":261502,"kb_avail":93629024,"statfs":{"total":96636764160,"available":95876120576,"internally_reserved":0,"allocated":492855296,"data_stored":492773676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267778501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575259,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":908776,"kb_used_data":574944,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":93463064,"statfs":{"total":96636764160,"available":95706177536,"internally_reserved":0,"allocated":588742656,"data_stored":588833154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":341834184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575259,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530044,"kb_used_data":322676,"kb_used_omap":1,"kb_used_meta":207358,"kb_avail":93841796,"statfs":{"total":96636764160,"available":96093999104,"internally_reserved":0,"allocated":330420224,"data_stored":330182370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212335045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575259,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":986984,"kb_used_data":635168,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93384856,"statfs":{"total":96636764160,"available":95626092544,"internally_reserved":0,"allocated":650412032,"data_stored":650334542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575260,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705452,"kb_used_data":489700,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93666388,"statfs":{"total":96636764160,"available":95914381312,"internally_reserved":0,"allocated":501452800,"data_stored":501199532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":205012992,"data_stored":205001130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234885740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163586048,"data_stored":163578528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163594240,"data_stored":163582538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":206127104,"data_stored":206119855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":222908416,"data_stored":222897653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297279488,"data_stored":297275762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":295362560,"data_stored":295362560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415035392,"data_stored":415203328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229273600,"data_stored":229273600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":424673280,"data_stored":425009152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":328777728,"data_stored":328945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":259764224,"data_stored":259764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":334802944,"data_stored":335138816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":285941760,"data_stored":286277632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:31:52.562 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T18:31:52.563 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:31:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.694+0000 7fe66c738640 1 Processor -- start 2024-04-26T18:31:52.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.694+0000 7fe66c738640 1 -- start start 2024-04-26T18:31:52.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe66c738640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640b0c00 0x7fe66415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe66c738640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe6640afda0 0x7fe66415fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe66c738640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66415c2a0 con 0x7fe664072fd0 2024-04-26T18:31:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe66c738640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fe6640b0fe0 con 0x7fe6640afda0 2024-04-26T18:31:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe66c738640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe66415cb40 con 0x7fe6640b0c00 2024-04-26T18:31:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe669cd3640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe6640afda0 0x7fe66415fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe669cd3640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fe6640afda0 0x7fe66415fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51136/0 (socket says 172.21.15.139:51136) 2024-04-26T18:31:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe669cd3640 1 -- 172.21.15.139:0/1761194875 learned_addr learned my addr 172.21.15.139:0/1761194875 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:52.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.695+0000 7fe66a4d4640 1 --2- 172.21.15.139:0/1761194875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640b0c00 0x7fe66415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe669cd3640 1 -- 172.21.15.139:0/1761194875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640b0c00 msgr2=0x7fe66415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe669cd3640 1 --2- 172.21.15.139:0/1761194875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640b0c00 0x7fe66415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe669cd3640 1 -- 172.21.15.139:0/1761194875 >> v1:172.21.15.143:6789/0 conn(0x7fe664072fd0 legacy=0x7fe664068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe669cd3640 1 -- 172.21.15.139:0/1761194875 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66415c580 con 0x7fe6640afda0 2024-04-26T18:31:52.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe669cd3640 1 --2- 172.21.15.139:0/1761194875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640afda0 0x7fe66415fad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe654009870 tx=0x7fe65402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54967ff376fbf440 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe6694d2640 1 -- 172.21.15.139:0/1761194875 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654037070 con 0x7fe6640afda0 2024-04-26T18:31:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe6694d2640 1 -- 172.21.15.139:0/1761194875 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65402ae50 con 0x7fe6640afda0 2024-04-26T18:31:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.696+0000 7fe6694d2640 1 -- 172.21.15.139:0/1761194875 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654032860 con 0x7fe6640afda0 2024-04-26T18:31:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 -- 172.21.15.139:0/1761194875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640afda0 msgr2=0x7fe66415fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 --2- 172.21.15.139:0/1761194875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640afda0 0x7fe66415fad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe654009870 tx=0x7fe65402a300 comp rx=0 tx=0).stop 2024-04-26T18:31:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 -- 172.21.15.139:0/1761194875 shutdown_connections 2024-04-26T18:31:52.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 --2- 172.21.15.139:0/1761194875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640afda0 0x7fe66415fad0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 --2- 172.21.15.139:0/1761194875 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640b0c00 0x7fe66415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 -- 172.21.15.139:0/1761194875 >> 172.21.15.139:0/1761194875 conn(0x7fe6640ce110 msgr2=0x7fe6640ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 -- 172.21.15.139:0/1761194875 shutdown_connections 2024-04-26T18:31:52.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.697+0000 7fe66c738640 1 -- 172.21.15.139:0/1761194875 wait complete. 2024-04-26T18:31:52.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.698+0000 7fe66c738640 1 Processor -- start 2024-04-26T18:31:52.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.698+0000 7fe66c738640 1 -- start start 2024-04-26T18:31:52.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66c738640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe664072fd0 0x7fe6640b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66c738640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640afda0 0x7fe6641f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66c738640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640b0c00 0x7fe6641e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66c738640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe66415f2d0 con 0x7fe6640b0c00 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66c738640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fe66415f640 con 0x7fe664072fd0 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66c738640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fe664160010 con 0x7fe6640afda0 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640b0c00 0x7fe6641e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640b0c00 0x7fe6641e80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51152/0 (socket says 172.21.15.139:51152) 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 -- 172.21.15.139:0/3042045983 learned_addr learned my addr 172.21.15.139:0/3042045983 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:52.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66a4d4640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe664072fd0 0x7fe6640b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe669cd3640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640afda0 0x7fe6641f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 -- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640afda0 msgr2=0x7fe6641f1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640afda0 0x7fe6641f1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 -- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe664072fd0 msgr2=0x7fe6640b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe664072fd0 0x7fe6640b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 -- 172.21.15.139:0/3042045983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6640b3540 con 0x7fe6640b0c00 2024-04-26T18:31:52.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe66acd5640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640b0c00 0x7fe6641e80c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c7a0 tx=0x7fe66000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe65affd640 1 -- 172.21.15.139:0/3042045983 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660003b70 con 0x7fe6640b0c00 2024-04-26T18:31:52.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.699+0000 7fe65affd640 1 -- 172.21.15.139:0/3042045983 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe660003d30 con 0x7fe6640b0c00 2024-04-26T18:31:52.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.700+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6641f2450 con 0x7fe6640b0c00 2024-04-26T18:31:52.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.700+0000 7fe65affd640 1 -- 172.21.15.139:0/3042045983 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66000aa90 con 0x7fe6640b0c00 2024-04-26T18:31:52.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.700+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe664158f00 con 0x7fe6640b0c00 2024-04-26T18:31:52.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.700+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe664073b10 con 0x7fe6640b0c00 2024-04-26T18:31:52.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.701+0000 7fe65affd640 1 -- 172.21.15.139:0/3042045983 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe66000ac30 con 0x7fe6640b0c00 2024-04-26T18:31:52.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.701+0000 7fe65affd640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe64806c8f0 0x7fe64806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:52.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.701+0000 7fe65affd640 1 -- 172.21.15.139:0/3042045983 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fe66008be00 con 0x7fe6640b0c00 2024-04-26T18:31:52.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.701+0000 7fe66a4d4640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe64806c8f0 0x7fe64806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:52.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.702+0000 7fe66a4d4640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe64806c8f0 0x7fe64806edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009aa0 tx=0x7fe65c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:52.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.706+0000 7fe65affd640 1 -- 172.21.15.139:0/3042045983 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe664073b10 con 0x7fe6640b0c00 2024-04-26T18:31:52.882 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.882+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe664076d20 con 0x7fe64806c8f0 2024-04-26T18:31:52.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.889+0000 7fe65affd640 1 -- 172.21.15.139:0/3042045983 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+337848 (secure 0 0 0) 0x7fe664076d20 con 0x7fe64806c8f0 2024-04-26T18:31:52.893 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:52.895 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T18:31:52.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe64806c8f0 msgr2=0x7fe64806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe64806c8f0 0x7fe64806edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009aa0 tx=0x7fe65c009190 comp rx=0 tx=0).stop 2024-04-26T18:31:52.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640b0c00 msgr2=0x7fe6641e80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:52.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640b0c00 0x7fe6641e80c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c7a0 tx=0x7fe66000cc60 comp rx=0 tx=0).stop 2024-04-26T18:31:52.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 shutdown_connections 2024-04-26T18:31:52.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fe64806c8f0 0x7fe64806edb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6640b0c00 0x7fe6641e80c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fe6640afda0 0x7fe6641f1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 --2- 172.21.15.139:0/3042045983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe664072fd0 0x7fe6640b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:52.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 >> 172.21.15.139:0/3042045983 conn(0x7fe6640ce110 msgr2=0x7fe66406eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:52.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 shutdown_connections 2024-04-26T18:31:52.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:52.893+0000 7fe66c738640 1 -- 172.21.15.139:0/3042045983 wait complete. 2024-04-26T18:31:52.904 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":1053,"stamp":"2024-04-26T18:31:51.588383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1981266339,"num_objects":44241,"num_object_clones":19129,"num_object_copies":167018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44241,"num_whiteouts":18953,"num_read":8532,"num_read_kb":5970244,"num_write":113436,"num_write_kb":4242584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162245,"ondisk_log_size":162245,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6300488,"kb_used_data":4074952,"kb_used_omap":12,"kb_used_meta":2225459,"kb_avail":748674232,"statfs":{"total":773094113280,"available":766642413568,"internally_reserved":0,"allocated":4172750848,"data_stored":4172124006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2278870580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":222,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004567"},"pg_stats":[{"pgid":"2.1f","version":"41'522","reported_seq":594,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:40.758347+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T18:31:40.758347+0000","last_peered":"2024-04-26T18:31:40.758347+0000","last_clean":"2024-04-26T18:31:40.758347+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T18:31:40.758347+0000","last_undegraded":"2024-04-26T18:31:40.758347+0000","last_fullsized":"2024-04-26T18:31:40.758347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37228914,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":590,"num_write_kb":74511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"41'601","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.380741+0000","last_change":"2024-04-26T18:03:00.448985+0000","last_active":"2024-04-26T18:29:46.380741+0000","last_peered":"2024-04-26T18:29:46.380741+0000","last_clean":"2024-04-26T18:29:46.380741+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T18:29:46.380741+0000","last_undegraded":"2024-04-26T18:29:46.380741+0000","last_fullsized":"2024-04-26T18:29:46.380741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:41.107725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230683108,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"41'2821","reported_seq":4546,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.880248+0000","last_change":"2024-04-26T18:03:00.450087+0000","last_active":"2024-04-26T18:31:36.880248+0000","last_peered":"2024-04-26T18:31:36.880248+0000","last_clean":"2024-04-26T18:31:36.880248+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T18:31:36.880248+0000","last_undegraded":"2024-04-26T18:31:36.880248+0000","last_fullsized":"2024-04-26T18:31:36.880248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:07.265582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.226534869,"stat_sum":{"num_bytes":47000043,"num_objects":1217,"num_object_clones":566,"num_object_copies":4868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":566,"num_read":206,"num_read_kb":291402,"num_write":2298,"num_write_kb":59293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'1115","reported_seq":1187,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174878+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T18:30:48.174878+0000","last_peered":"2024-04-26T18:30:48.174878+0000","last_clean":"2024-04-26T18:30:48.174878+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T18:30:48.174878+0000","last_undegraded":"2024-04-26T18:30:48.174878+0000","last_fullsized":"2024-04-26T18:30:48.174878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":1207,"num_write_kb":83571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"41'585","reported_seq":2668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.361929+0000","last_change":"2024-04-26T18:03:00.426487+0000","last_active":"2024-04-26T18:29:46.361929+0000","last_peered":"2024-04-26T18:29:46.361929+0000","last_clean":"2024-04-26T18:29:46.361929+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T18:29:46.361929+0000","last_undegraded":"2024-04-26T18:29:46.361929+0000","last_fullsized":"2024-04-26T18:29:46.361929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:33.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19357582500000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":12,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"41'2977","reported_seq":4608,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.346136+0000","last_change":"2024-04-26T18:03:00.392141+0000","last_active":"2024-04-26T18:31:32.346136+0000","last_peered":"2024-04-26T18:31:32.346136+0000","last_clean":"2024-04-26T18:31:32.346136+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T18:31:32.346136+0000","last_undegraded":"2024-04-26T18:31:32.346136+0000","last_fullsized":"2024-04-26T18:31:32.346136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:05.822108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17635221100000001,"stat_sum":{"num_bytes":22365631,"num_objects":1261,"num_object_clones":594,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1261,"num_whiteouts":594,"num_read":140,"num_read_kb":92586,"num_write":2429,"num_write_kb":39864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"41'1019","reported_seq":1088,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.103488+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T18:30:48.103488+0000","last_peered":"2024-04-26T18:30:48.103488+0000","last_clean":"2024-04-26T18:30:48.103488+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T18:30:48.103488+0000","last_undegraded":"2024-04-26T18:30:48.103488+0000","last_fullsized":"2024-04-26T18:30:48.103488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":1097,"num_write_kb":133138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'617","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347530+0000","last_change":"2024-04-26T18:03:00.388273+0000","last_active":"2024-04-26T18:29:46.347530+0000","last_peered":"2024-04-26T18:29:46.347530+0000","last_clean":"2024-04-26T18:29:46.347530+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T18:29:46.347530+0000","last_undegraded":"2024-04-26T18:29:46.347530+0000","last_fullsized":"2024-04-26T18:29:46.347530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:56.202777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16172857600000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"41'2946","reported_seq":4647,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.787520+0000","last_change":"2024-04-26T18:03:00.421690+0000","last_active":"2024-04-26T18:31:36.787520+0000","last_peered":"2024-04-26T18:31:36.787520+0000","last_clean":"2024-04-26T18:31:36.787520+0000","last_became_active":"2024-04-26T17:58:46.846516+0000","last_became_peered":"2024-04-26T17:58:46.846516+0000","last_unstale":"2024-04-26T18:31:36.787520+0000","last_undegraded":"2024-04-26T18:31:36.787520+0000","last_fullsized":"2024-04-26T18:31:36.787520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:34.049400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18830187000000001,"stat_sum":{"num_bytes":52036256,"num_objects":1294,"num_object_clones":599,"num_object_copies":5176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":599,"num_read":207,"num_read_kb":311106,"num_write":2398,"num_write_kb":54529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"41'525","reported_seq":594,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.579571+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T18:30:13.579571+0000","last_peered":"2024-04-26T18:30:13.579571+0000","last_clean":"2024-04-26T18:30:13.579571+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T18:30:13.579571+0000","last_undegraded":"2024-04-26T18:30:13.579571+0000","last_fullsized":"2024-04-26T18:30:13.579571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":594,"num_write_kb":70938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"41'594","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.439128+0000","last_change":"2024-04-26T18:03:00.385887+0000","last_active":"2024-04-26T18:29:46.439128+0000","last_peered":"2024-04-26T18:29:46.439128+0000","last_clean":"2024-04-26T18:29:46.439128+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T18:29:46.439128+0000","last_undegraded":"2024-04-26T18:29:46.439128+0000","last_fullsized":"2024-04-26T18:29:46.439128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:36.980517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161485249,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"41'2787","reported_seq":4507,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.854706+0000","last_change":"2024-04-26T18:03:00.421543+0000","last_active":"2024-04-26T18:31:36.854706+0000","last_peered":"2024-04-26T18:31:36.854706+0000","last_clean":"2024-04-26T18:31:36.854706+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T18:31:36.854706+0000","last_undegraded":"2024-04-26T18:31:36.854706+0000","last_fullsized":"2024-04-26T18:31:36.854706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2787,"log_dups_size":0,"ondisk_log_size":2787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:00.311837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18642139199999999,"stat_sum":{"num_bytes":46440810,"num_objects":1192,"num_object_clones":545,"num_object_copies":4768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":545,"num_read":179,"num_read_kb":201194,"num_write":2302,"num_write_kb":49304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"41'629","reported_seq":2703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347806+0000","last_change":"2024-04-26T18:03:00.044745+0000","last_active":"2024-04-26T18:29:46.347806+0000","last_peered":"2024-04-26T18:29:46.347806+0000","last_clean":"2024-04-26T18:29:46.347806+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T18:29:46.347806+0000","last_undegraded":"2024-04-26T18:29:46.347806+0000","last_fullsized":"2024-04-26T18:29:46.347806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:46.688756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101605577,"stat_sum":{"num_bytes":0,"num_objects":66,"num_object_clones":20,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"41'2536","reported_seq":2607,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:08.693990+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T18:30:08.693990+0000","last_peered":"2024-04-26T18:30:08.693990+0000","last_clean":"2024-04-26T18:30:08.693990+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T18:30:08.693990+0000","last_undegraded":"2024-04-26T18:30:08.693990+0000","last_fullsized":"2024-04-26T18:30:08.693990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2536,"log_dups_size":0,"ondisk_log_size":2536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":2609,"num_write_kb":88139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"41'2917","reported_seq":4583,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.847250+0000","last_change":"2024-04-26T18:03:00.418993+0000","last_active":"2024-04-26T18:31:36.847250+0000","last_peered":"2024-04-26T18:31:36.847250+0000","last_clean":"2024-04-26T18:31:36.847250+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T18:31:36.847250+0000","last_undegraded":"2024-04-26T18:31:36.847250+0000","last_fullsized":"2024-04-26T18:31:36.847250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:49.886797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19133515200000001,"stat_sum":{"num_bytes":43266035,"num_objects":1273,"num_object_clones":588,"num_object_copies":5092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1273,"num_whiteouts":588,"num_read":168,"num_read_kb":222667,"num_write":2389,"num_write_kb":54953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"41'605","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.349645+0000","last_change":"2024-04-26T18:03:00.446780+0000","last_active":"2024-04-26T18:29:48.349645+0000","last_peered":"2024-04-26T18:29:48.349645+0000","last_clean":"2024-04-26T18:29:48.349645+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T18:29:48.349645+0000","last_undegraded":"2024-04-26T18:29:48.349645+0000","last_fullsized":"2024-04-26T18:29:48.349645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:07.280297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22887548799999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":9,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'1327","reported_seq":1398,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:47.818586+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T18:30:47.818586+0000","last_peered":"2024-04-26T18:30:47.818586+0000","last_clean":"2024-04-26T18:30:47.818586+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T18:30:47.818586+0000","last_undegraded":"2024-04-26T18:30:47.818586+0000","last_fullsized":"2024-04-26T18:30:47.818586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":1392,"num_write_kb":95976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"41'2855","reported_seq":4547,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.895356+0000","last_change":"2024-04-26T18:03:00.416771+0000","last_active":"2024-04-26T18:31:36.895356+0000","last_peered":"2024-04-26T18:31:36.895356+0000","last_clean":"2024-04-26T18:31:36.895356+0000","last_became_active":"2024-04-26T17:58:46.846635+0000","last_became_peered":"2024-04-26T17:58:46.846635+0000","last_unstale":"2024-04-26T18:31:36.895356+0000","last_undegraded":"2024-04-26T18:31:36.895356+0000","last_fullsized":"2024-04-26T18:31:36.895356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:06.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928092499999999,"stat_sum":{"num_bytes":21448645,"num_objects":1180,"num_object_clones":543,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":543,"num_read":142,"num_read_kb":62635,"num_write":2368,"num_write_kb":33318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"41'646","reported_seq":2725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175950+0000","last_change":"2024-04-26T18:03:00.446546+0000","last_active":"2024-04-26T18:30:16.175950+0000","last_peered":"2024-04-26T18:30:16.175950+0000","last_clean":"2024-04-26T18:30:16.175950+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T18:30:16.175950+0000","last_undegraded":"2024-04-26T18:30:16.175950+0000","last_fullsized":"2024-04-26T18:30:16.175950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:30.786683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22842327800000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":15,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"41'848","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.175344+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T18:30:48.175344+0000","last_peered":"2024-04-26T18:30:48.175344+0000","last_clean":"2024-04-26T18:30:48.175344+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T18:30:48.175344+0000","last_undegraded":"2024-04-26T18:30:48.175344+0000","last_fullsized":"2024-04-26T18:30:48.175344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":901,"num_write_kb":79506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"41'2890","reported_seq":4575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.886843+0000","last_change":"2024-04-26T18:03:00.013967+0000","last_active":"2024-04-26T18:31:36.886843+0000","last_peered":"2024-04-26T18:31:36.886843+0000","last_clean":"2024-04-26T18:31:36.886843+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T18:31:36.886843+0000","last_undegraded":"2024-04-26T18:31:36.886843+0000","last_fullsized":"2024-04-26T18:31:36.886843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:56.071843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077792920000000002,"stat_sum":{"num_bytes":29575215,"num_objects":1245,"num_object_clones":583,"num_object_copies":4980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":583,"num_read":184,"num_read_kb":122824,"num_write":2351,"num_write_kb":42495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"41'615","reported_seq":2700,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375930+0000","last_change":"2024-04-26T18:03:00.424812+0000","last_active":"2024-04-26T18:29:46.375930+0000","last_peered":"2024-04-26T18:29:46.375930+0000","last_clean":"2024-04-26T18:29:46.375930+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T18:29:46.375930+0000","last_undegraded":"2024-04-26T18:29:46.375930+0000","last_fullsized":"2024-04-26T18:29:46.375930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:21.113921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18061166100000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"41'468","reported_seq":539,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:45.748977+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T18:30:45.748977+0000","last_peered":"2024-04-26T18:30:45.748977+0000","last_clean":"2024-04-26T18:30:45.748977+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T18:30:45.748977+0000","last_undegraded":"2024-04-26T18:30:45.748977+0000","last_fullsized":"2024-04-26T18:30:45.748977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":511,"num_write_kb":66851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"41'2805","reported_seq":4481,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.894628+0000","last_change":"2024-04-26T18:03:00.413832+0000","last_active":"2024-04-26T18:31:36.894628+0000","last_peered":"2024-04-26T18:31:36.894628+0000","last_clean":"2024-04-26T18:31:36.894628+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T18:31:36.894628+0000","last_undegraded":"2024-04-26T18:31:36.894628+0000","last_fullsized":"2024-04-26T18:31:36.894628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2805,"log_dups_size":0,"ondisk_log_size":2805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:37.962626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18788326999999999,"stat_sum":{"num_bytes":37828835,"num_objects":1237,"num_object_clones":573,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":573,"num_read":163,"num_read_kb":252845,"num_write":2275,"num_write_kb":48379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"41'593","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:38.193600+0000","last_change":"2024-04-26T18:03:00.425151+0000","last_active":"2024-04-26T18:30:38.193600+0000","last_peered":"2024-04-26T18:30:38.193600+0000","last_clean":"2024-04-26T18:30:38.193600+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T18:30:38.193600+0000","last_undegraded":"2024-04-26T18:30:38.193600+0000","last_fullsized":"2024-04-26T18:30:38.193600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.966252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19854031599999999,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"41'813","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:33.145622+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T18:29:33.145622+0000","last_peered":"2024-04-26T18:29:33.145622+0000","last_clean":"2024-04-26T18:29:33.145622+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T18:29:33.145622+0000","last_undegraded":"2024-04-26T18:29:33.145622+0000","last_fullsized":"2024-04-26T18:29:33.145622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":915,"num_write_kb":75562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"41'2861","reported_seq":4549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.873322+0000","last_change":"2024-04-26T18:03:00.424600+0000","last_active":"2024-04-26T18:31:36.873322+0000","last_peered":"2024-04-26T18:31:36.873322+0000","last_clean":"2024-04-26T18:31:36.873322+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T18:31:36.873322+0000","last_undegraded":"2024-04-26T18:31:36.873322+0000","last_fullsized":"2024-04-26T18:31:36.873322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:18.947305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.181349811,"stat_sum":{"num_bytes":38568471,"num_objects":1183,"num_object_clones":549,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":549,"num_read":148,"num_read_kb":161250,"num_write":2358,"num_write_kb":47514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"41'590","reported_seq":2670,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.151126+0000","last_change":"2024-04-26T18:03:00.451850+0000","last_active":"2024-04-26T18:29:47.151126+0000","last_peered":"2024-04-26T18:29:47.151126+0000","last_clean":"2024-04-26T18:29:47.151126+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T18:29:47.151126+0000","last_undegraded":"2024-04-26T18:29:47.151126+0000","last_fullsized":"2024-04-26T18:29:47.151126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:02.283489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217975578,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"41'1483","reported_seq":1554,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:59.181804+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T18:30:59.181804+0000","last_peered":"2024-04-26T18:30:59.181804+0000","last_clean":"2024-04-26T18:30:59.181804+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T18:30:59.181804+0000","last_undegraded":"2024-04-26T18:30:59.181804+0000","last_fullsized":"2024-04-26T18:30:59.181804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1483,"log_dups_size":0,"ondisk_log_size":1483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":3198,"num_write_kb":72387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"41'2904","reported_seq":4597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.340152+0000","last_change":"2024-04-26T18:03:00.447628+0000","last_active":"2024-04-26T18:31:32.340152+0000","last_peered":"2024-04-26T18:31:32.340152+0000","last_clean":"2024-04-26T18:31:32.340152+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T18:31:32.340152+0000","last_undegraded":"2024-04-26T18:31:32.340152+0000","last_fullsized":"2024-04-26T18:31:32.340152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2904,"log_dups_size":0,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:52.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23002119400000001,"stat_sum":{"num_bytes":32774060,"num_objects":1224,"num_object_clones":563,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1224,"num_whiteouts":563,"num_read":167,"num_read_kb":173625,"num_write":2397,"num_write_kb":37665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"41'607","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.414938+0000","last_change":"2024-04-26T18:03:00.013128+0000","last_active":"2024-04-26T18:29:41.414938+0000","last_peered":"2024-04-26T18:29:41.414938+0000","last_clean":"2024-04-26T18:29:41.414938+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T18:29:41.414938+0000","last_undegraded":"2024-04-26T18:29:41.414938+0000","last_fullsized":"2024-04-26T18:29:41.414938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:28.496234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077215679999999995,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"41'788","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.548547+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T18:30:18.548547+0000","last_peered":"2024-04-26T18:30:18.548547+0000","last_clean":"2024-04-26T18:30:18.548547+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T18:30:18.548547+0000","last_undegraded":"2024-04-26T18:30:18.548547+0000","last_fullsized":"2024-04-26T18:30:18.548547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":856,"num_write_kb":87605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"41'2980","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.803974+0000","last_change":"2024-04-26T18:03:00.424270+0000","last_active":"2024-04-26T18:31:36.803974+0000","last_peered":"2024-04-26T18:31:36.803974+0000","last_clean":"2024-04-26T18:31:36.803974+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T18:31:36.803974+0000","last_undegraded":"2024-04-26T18:31:36.803974+0000","last_fullsized":"2024-04-26T18:31:36.803974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:36.634495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20617318100000001,"stat_sum":{"num_bytes":38568987,"num_objects":1282,"num_object_clones":600,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":600,"num_read":166,"num_read_kb":191696,"num_write":2429,"num_write_kb":47342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'616","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.407143+0000","last_change":"2024-04-26T18:03:00.387991+0000","last_active":"2024-04-26T18:29:46.407143+0000","last_peered":"2024-04-26T18:29:46.407143+0000","last_clean":"2024-04-26T18:29:46.407143+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T18:29:46.407143+0000","last_undegraded":"2024-04-26T18:29:46.407143+0000","last_fullsized":"2024-04-26T18:29:46.407143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:06.986658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161265819,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"41'746","reported_seq":818,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.190651+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T18:30:48.190651+0000","last_peered":"2024-04-26T18:30:48.190651+0000","last_clean":"2024-04-26T18:30:48.190651+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T18:30:48.190651+0000","last_undegraded":"2024-04-26T18:30:48.190651+0000","last_fullsized":"2024-04-26T18:30:48.190651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":797,"num_write_kb":111877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"41'2902","reported_seq":4611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.889065+0000","last_change":"2024-04-26T18:03:00.012758+0000","last_active":"2024-04-26T18:31:36.889065+0000","last_peered":"2024-04-26T18:31:36.889065+0000","last_clean":"2024-04-26T18:31:36.889065+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T18:31:36.889065+0000","last_undegraded":"2024-04-26T18:31:36.889065+0000","last_fullsized":"2024-04-26T18:31:36.889065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2902,"log_dups_size":0,"ondisk_log_size":2902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.245551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077512545000000002,"stat_sum":{"num_bytes":51130541,"num_objects":1258,"num_object_clones":577,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":577,"num_read":197,"num_read_kb":290939,"num_write":2373,"num_write_kb":60236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'612","reported_seq":2696,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.356164+0000","last_change":"2024-04-26T18:03:00.422866+0000","last_active":"2024-04-26T18:30:01.356164+0000","last_peered":"2024-04-26T18:30:01.356164+0000","last_clean":"2024-04-26T18:30:01.356164+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T18:30:01.356164+0000","last_undegraded":"2024-04-26T18:30:01.356164+0000","last_fullsized":"2024-04-26T18:30:01.356164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:27.152866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18566148499999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"41'538","reported_seq":610,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.192866+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T18:30:48.192866+0000","last_peered":"2024-04-26T18:30:48.192866+0000","last_clean":"2024-04-26T18:30:48.192866+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T18:30:48.192866+0000","last_undegraded":"2024-04-26T18:30:48.192866+0000","last_fullsized":"2024-04-26T18:30:48.192866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":583,"num_write_kb":83272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"41'2814","reported_seq":4454,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.883940+0000","last_change":"2024-04-26T18:03:00.013541+0000","last_active":"2024-04-26T18:31:36.883940+0000","last_peered":"2024-04-26T18:31:36.883940+0000","last_clean":"2024-04-26T18:31:36.883940+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T18:31:36.883940+0000","last_undegraded":"2024-04-26T18:31:36.883940+0000","last_fullsized":"2024-04-26T18:31:36.883940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:37.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077645753999999997,"stat_sum":{"num_bytes":21677192,"num_objects":1207,"num_object_clones":566,"num_object_copies":4828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":566,"num_read":118,"num_read_kb":106859,"num_write":2295,"num_write_kb":28218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"41'620","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.352068+0000","last_change":"2024-04-26T18:03:00.012108+0000","last_active":"2024-04-26T18:30:01.352068+0000","last_peered":"2024-04-26T18:30:01.352068+0000","last_clean":"2024-04-26T18:30:01.352068+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T18:30:01.352068+0000","last_undegraded":"2024-04-26T18:30:01.352068+0000","last_fullsized":"2024-04-26T18:30:01.352068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:45.171474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076659478000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'1618","reported_seq":2626,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.549967+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T18:30:18.549967+0000","last_peered":"2024-04-26T18:30:18.549967+0000","last_clean":"2024-04-26T18:30:18.549967+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T18:30:18.549967+0000","last_undegraded":"2024-04-26T18:30:18.549967+0000","last_fullsized":"2024-04-26T18:30:18.549967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1618,"log_dups_size":0,"ondisk_log_size":1618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":992,"num_read_kb":4725,"num_write":1685,"num_write_kb":100551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"41'2764","reported_seq":4482,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.876010+0000","last_change":"2024-04-26T18:03:00.014183+0000","last_active":"2024-04-26T18:31:36.876010+0000","last_peered":"2024-04-26T18:31:36.876010+0000","last_clean":"2024-04-26T18:31:36.876010+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T18:31:36.876010+0000","last_undegraded":"2024-04-26T18:31:36.876010+0000","last_fullsized":"2024-04-26T18:31:36.876010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2764,"log_dups_size":0,"ondisk_log_size":2764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:54.571531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077766350999999997,"stat_sum":{"num_bytes":40144243,"num_objects":1196,"num_object_clones":556,"num_object_copies":4784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":556,"num_read":186,"num_read_kb":267655,"num_write":2256,"num_write_kb":47769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"41'586","reported_seq":2669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390842+0000","last_change":"2024-04-26T18:03:00.423065+0000","last_active":"2024-04-26T18:29:46.390842+0000","last_peered":"2024-04-26T18:29:46.390842+0000","last_clean":"2024-04-26T18:29:46.390842+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T18:29:46.390842+0000","last_undegraded":"2024-04-26T18:29:46.390842+0000","last_fullsized":"2024-04-26T18:29:46.390842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:15.084787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20174721700000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'667","reported_seq":739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.152482+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T18:29:48.152482+0000","last_peered":"2024-04-26T18:29:48.152482+0000","last_clean":"2024-04-26T18:29:48.152482+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T18:29:48.152482+0000","last_undegraded":"2024-04-26T18:29:48.152482+0000","last_fullsized":"2024-04-26T18:29:48.152482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":715,"num_write_kb":79339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"41'2915","reported_seq":4593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.876907+0000","last_change":"2024-04-26T18:03:00.426626+0000","last_active":"2024-04-26T18:31:36.876907+0000","last_peered":"2024-04-26T18:31:36.876907+0000","last_clean":"2024-04-26T18:31:36.876907+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T18:31:36.876907+0000","last_undegraded":"2024-04-26T18:31:36.876907+0000","last_fullsized":"2024-04-26T18:31:36.876907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:11.102216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20190264199999999,"stat_sum":{"num_bytes":26615609,"num_objects":1212,"num_object_clones":560,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":560,"num_read":151,"num_read_kb":128735,"num_write":2402,"num_write_kb":29722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"41'621","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.171918+0000","last_change":"2024-04-26T18:03:00.450371+0000","last_active":"2024-04-26T18:30:16.171918+0000","last_peered":"2024-04-26T18:30:16.171918+0000","last_clean":"2024-04-26T18:30:16.171918+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T18:30:16.171918+0000","last_undegraded":"2024-04-26T18:30:16.171918+0000","last_fullsized":"2024-04-26T18:30:16.171918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:39.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22655562100000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'1595","reported_seq":1667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175583+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T18:30:16.175583+0000","last_peered":"2024-04-26T18:30:16.175583+0000","last_clean":"2024-04-26T18:30:16.175583+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T18:30:16.175583+0000","last_undegraded":"2024-04-26T18:30:16.175583+0000","last_fullsized":"2024-04-26T18:30:16.175583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1595,"log_dups_size":0,"ondisk_log_size":1595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":0,"num_write":1680,"num_write_kb":72101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:28:03.048194+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T18:28:03.048194+0000","last_peered":"2024-04-26T18:28:03.048194+0000","last_clean":"2024-04-26T18:28:03.048194+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T18:28:03.048194+0000","last_undegraded":"2024-04-26T18:28:03.048194+0000","last_fullsized":"2024-04-26T18:28:03.048194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"41'3034","reported_seq":4678,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.920048+0000","last_change":"2024-04-26T18:03:00.043842+0000","last_active":"2024-04-26T18:31:36.920048+0000","last_peered":"2024-04-26T18:31:36.920048+0000","last_clean":"2024-04-26T18:31:36.920048+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T18:31:36.920048+0000","last_undegraded":"2024-04-26T18:31:36.920048+0000","last_fullsized":"2024-04-26T18:31:36.920048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:43.054742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101669149,"stat_sum":{"num_bytes":43937728,"num_objects":1270,"num_object_clones":639,"num_object_copies":5080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1270,"num_whiteouts":551,"num_read":194,"num_read_kb":160197,"num_write":2447,"num_write_kb":52378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"41'602","reported_seq":2680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.344820+0000","last_change":"2024-04-26T18:03:00.046750+0000","last_active":"2024-04-26T18:29:46.344820+0000","last_peered":"2024-04-26T18:29:46.344820+0000","last_clean":"2024-04-26T18:29:46.344820+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T18:29:46.344820+0000","last_undegraded":"2024-04-26T18:29:46.344820+0000","last_fullsized":"2024-04-26T18:29:46.344820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:48.686392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10552916,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"41'542","reported_seq":613,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:15.802404+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T18:30:15.802404+0000","last_peered":"2024-04-26T18:30:15.802404+0000","last_clean":"2024-04-26T18:30:15.802404+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T18:30:15.802404+0000","last_undegraded":"2024-04-26T18:30:15.802404+0000","last_fullsized":"2024-04-26T18:30:15.802404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":567,"num_write_kb":79001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"41'2911","reported_seq":4622,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:28.781006+0000","last_change":"2024-04-26T18:03:00.044856+0000","last_active":"2024-04-26T18:31:28.781006+0000","last_peered":"2024-04-26T18:31:28.781006+0000","last_clean":"2024-04-26T18:31:28.781006+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T18:31:28.781006+0000","last_undegraded":"2024-04-26T18:31:28.781006+0000","last_fullsized":"2024-04-26T18:31:28.781006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.254209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102636063,"stat_sum":{"num_bytes":37322430,"num_objects":1233,"num_object_clones":576,"num_object_copies":4932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1233,"num_whiteouts":576,"num_read":199,"num_read_kb":211238,"num_write":2388,"num_write_kb":48792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"41'607","reported_seq":2693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375271+0000","last_change":"2024-04-26T18:03:00.390471+0000","last_active":"2024-04-26T18:29:46.375271+0000","last_peered":"2024-04-26T18:29:46.375271+0000","last_clean":"2024-04-26T18:29:46.375271+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T18:29:46.375271+0000","last_undegraded":"2024-04-26T18:29:46.375271+0000","last_fullsized":"2024-04-26T18:29:46.375271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:29.493089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16359686500000001,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"41'1297","reported_seq":1368,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.203238+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T18:30:48.203238+0000","last_peered":"2024-04-26T18:30:48.203238+0000","last_clean":"2024-04-26T18:30:48.203238+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T18:30:48.203238+0000","last_undegraded":"2024-04-26T18:30:48.203238+0000","last_fullsized":"2024-04-26T18:30:48.203238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1297,"log_dups_size":0,"ondisk_log_size":1297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29364754,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":1371,"num_write_kb":104375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"41'2892","reported_seq":4596,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.883073+0000","last_change":"2024-04-26T18:03:00.425610+0000","last_active":"2024-04-26T18:31:36.883073+0000","last_peered":"2024-04-26T18:31:36.883073+0000","last_clean":"2024-04-26T18:31:36.883073+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T18:31:36.883073+0000","last_undegraded":"2024-04-26T18:31:36.883073+0000","last_fullsized":"2024-04-26T18:31:36.883073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:33.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20706662200000001,"stat_sum":{"num_bytes":43474396,"num_objects":1246,"num_object_clones":573,"num_object_copies":4984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":573,"num_read":190,"num_read_kb":265762,"num_write":2374,"num_write_kb":47127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"41'593","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.375676+0000","last_change":"2024-04-26T18:03:00.046998+0000","last_active":"2024-04-26T18:29:46.375676+0000","last_peered":"2024-04-26T18:29:46.375676+0000","last_clean":"2024-04-26T18:29:46.375676+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T18:29:46.375676+0000","last_undegraded":"2024-04-26T18:29:46.375676+0000","last_fullsized":"2024-04-26T18:29:46.375676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:51.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104614815,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"41'698","reported_seq":769,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174916+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T18:30:48.174916+0000","last_peered":"2024-04-26T18:30:48.174916+0000","last_clean":"2024-04-26T18:30:48.174916+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T18:30:48.174916+0000","last_undegraded":"2024-04-26T18:30:48.174916+0000","last_fullsized":"2024-04-26T18:30:48.174916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":758,"num_write_kb":95614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"41'2925","reported_seq":4669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:39.302134+0000","last_change":"2024-04-26T18:03:00.379880+0000","last_active":"2024-04-26T18:31:39.302134+0000","last_peered":"2024-04-26T18:31:39.302134+0000","last_clean":"2024-04-26T18:31:39.302134+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T18:31:39.302134+0000","last_undegraded":"2024-04-26T18:31:39.302134+0000","last_fullsized":"2024-04-26T18:31:39.302134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:12.400616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16179385399999999,"stat_sum":{"num_bytes":31406117,"num_objects":1218,"num_object_clones":563,"num_object_copies":4872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":563,"num_read":219,"num_read_kb":160548,"num_write":2420,"num_write_kb":43855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"41'599","reported_seq":2684,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390465+0000","last_change":"2024-04-26T18:03:00.046050+0000","last_active":"2024-04-26T18:29:46.390465+0000","last_peered":"2024-04-26T18:29:46.390465+0000","last_clean":"2024-04-26T18:29:46.390465+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T18:29:46.390465+0000","last_undegraded":"2024-04-26T18:29:46.390465+0000","last_fullsized":"2024-04-26T18:29:46.390465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:37.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103300084,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'716","reported_seq":786,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.376382+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T18:30:16.376382+0000","last_peered":"2024-04-26T18:30:16.376382+0000","last_clean":"2024-04-26T18:30:16.376382+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T18:30:16.376382+0000","last_undegraded":"2024-04-26T18:30:16.376382+0000","last_fullsized":"2024-04-26T18:30:16.376382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165846,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":771,"num_write_kb":75142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"41'2803","reported_seq":4571,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:39.299548+0000","last_change":"2024-04-26T18:03:00.424342+0000","last_active":"2024-04-26T18:31:39.299548+0000","last_peered":"2024-04-26T18:31:39.299548+0000","last_clean":"2024-04-26T18:31:39.299548+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T18:31:39.299548+0000","last_undegraded":"2024-04-26T18:31:39.299548+0000","last_fullsized":"2024-04-26T18:31:39.299548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:41.316721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18140468300000001,"stat_sum":{"num_bytes":44194819,"num_objects":1210,"num_object_clones":561,"num_object_copies":4840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":561,"num_read":242,"num_read_kb":262276,"num_write":2276,"num_write_kb":51233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"41'643","reported_seq":2722,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.432005+0000","last_change":"2024-04-26T18:03:00.047648+0000","last_active":"2024-04-26T18:29:46.432005+0000","last_peered":"2024-04-26T18:29:46.432005+0000","last_clean":"2024-04-26T18:29:46.432005+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T18:29:46.432005+0000","last_undegraded":"2024-04-26T18:29:46.432005+0000","last_fullsized":"2024-04-26T18:29:46.432005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.617916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101409261,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":14,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"41'843","reported_seq":913,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.172834+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T18:30:16.172834+0000","last_peered":"2024-04-26T18:30:16.172834+0000","last_clean":"2024-04-26T18:30:16.172834+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T18:30:16.172834+0000","last_undegraded":"2024-04-26T18:30:16.172834+0000","last_fullsized":"2024-04-26T18:30:16.172834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":83,"num_read_kb":0,"num_write":946,"num_write_kb":79922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"41'2759","reported_seq":4442,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.899193+0000","last_change":"2024-04-26T18:03:00.423934+0000","last_active":"2024-04-26T18:31:36.899193+0000","last_peered":"2024-04-26T18:31:36.899193+0000","last_clean":"2024-04-26T18:31:36.899193+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T18:31:36.899193+0000","last_undegraded":"2024-04-26T18:31:36.899193+0000","last_fullsized":"2024-04-26T18:31:36.899193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:22.663372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19926888800000001,"stat_sum":{"num_bytes":38301955,"num_objects":1186,"num_object_clones":557,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":557,"num_read":154,"num_read_kb":145957,"num_write":2246,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'591","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.067174+0000","last_change":"2024-04-26T18:03:00.040005+0000","last_active":"2024-04-26T18:30:48.067174+0000","last_peered":"2024-04-26T18:30:48.067174+0000","last_clean":"2024-04-26T18:30:48.067174+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T18:30:48.067174+0000","last_undegraded":"2024-04-26T18:30:48.067174+0000","last_fullsized":"2024-04-26T18:30:48.067174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:00.688873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099299311000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"41'590","reported_seq":660,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.577085+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T18:30:13.577085+0000","last_peered":"2024-04-26T18:30:13.577085+0000","last_clean":"2024-04-26T18:30:13.577085+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T18:30:13.577085+0000","last_undegraded":"2024-04-26T18:30:13.577085+0000","last_fullsized":"2024-04-26T18:30:13.577085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":625,"num_write_kb":74929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"41'3058","reported_seq":4719,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.884873+0000","last_change":"2024-04-26T18:03:00.451560+0000","last_active":"2024-04-26T18:31:36.884873+0000","last_peered":"2024-04-26T18:31:36.884873+0000","last_clean":"2024-04-26T18:31:36.884873+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T18:31:36.884873+0000","last_undegraded":"2024-04-26T18:31:36.884873+0000","last_fullsized":"2024-04-26T18:31:36.884873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:26.188503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21925704200000001,"stat_sum":{"num_bytes":62040101,"num_objects":1342,"num_object_clones":661,"num_object_copies":5368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1342,"num_whiteouts":573,"num_read":237,"num_read_kb":346938,"num_write":2466,"num_write_kb":72826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"41'619","reported_seq":2685,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.355077+0000","last_change":"2024-04-26T18:03:00.082382+0000","last_active":"2024-04-26T18:29:48.355077+0000","last_peered":"2024-04-26T18:29:48.355077+0000","last_clean":"2024-04-26T18:29:48.355077+0000","last_became_active":"2024-04-26T17:58:46.842960+0000","last_became_peered":"2024-04-26T17:58:46.842960+0000","last_unstale":"2024-04-26T18:29:48.355077+0000","last_undegraded":"2024-04-26T18:29:48.355077+0000","last_fullsized":"2024-04-26T18:29:48.355077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:11:24.844599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029754315999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"41'522","reported_seq":592,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.545859+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T18:30:13.545859+0000","last_peered":"2024-04-26T18:30:13.545859+0000","last_clean":"2024-04-26T18:30:13.545859+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T18:30:13.545859+0000","last_undegraded":"2024-04-26T18:30:13.545859+0000","last_fullsized":"2024-04-26T18:30:13.545859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":593,"num_write_kb":58770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"41'2848","reported_seq":4547,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.798779+0000","last_change":"2024-04-26T18:03:00.451927+0000","last_active":"2024-04-26T18:31:36.798779+0000","last_peered":"2024-04-26T18:31:36.798779+0000","last_clean":"2024-04-26T18:31:36.798779+0000","last_became_active":"2024-04-26T17:58:46.841624+0000","last_became_peered":"2024-04-26T17:58:46.841624+0000","last_unstale":"2024-04-26T18:31:36.798779+0000","last_undegraded":"2024-04-26T18:31:36.798779+0000","last_fullsized":"2024-04-26T18:31:36.798779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:11.632385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218331676,"stat_sum":{"num_bytes":37909871,"num_objects":1250,"num_object_clones":586,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":586,"num_read":191,"num_read_kb":253371,"num_write":2312,"num_write_kb":56158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"41'583","reported_seq":2663,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.357556+0000","last_change":"2024-04-26T18:03:00.428027+0000","last_active":"2024-04-26T18:29:41.357556+0000","last_peered":"2024-04-26T18:29:41.357556+0000","last_clean":"2024-04-26T18:29:41.357556+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T18:29:41.357556+0000","last_undegraded":"2024-04-26T18:29:41.357556+0000","last_fullsized":"2024-04-26T18:29:41.357556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:18.542428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.185065913,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"41'426","reported_seq":496,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:20.748118+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T18:30:20.748118+0000","last_peered":"2024-04-26T18:30:20.748118+0000","last_clean":"2024-04-26T18:30:20.748118+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T18:30:20.748118+0000","last_undegraded":"2024-04-26T18:30:20.748118+0000","last_fullsized":"2024-04-26T18:30:20.748118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":485,"num_write_kb":79130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"41'2856","reported_seq":4518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.860347+0000","last_change":"2024-04-26T18:03:00.386810+0000","last_active":"2024-04-26T18:31:36.860347+0000","last_peered":"2024-04-26T18:31:36.860347+0000","last_clean":"2024-04-26T18:31:36.860347+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T18:31:36.860347+0000","last_undegraded":"2024-04-26T18:31:36.860347+0000","last_fullsized":"2024-04-26T18:31:36.860347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:32.381881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16361857299999999,"stat_sum":{"num_bytes":26393816,"num_objects":1264,"num_object_clones":588,"num_object_copies":5056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1264,"num_whiteouts":588,"num_read":164,"num_read_kb":98786,"num_write":2329,"num_write_kb":28734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"41'612","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.420696+0000","last_change":"2024-04-26T18:03:00.046237+0000","last_active":"2024-04-26T18:29:46.420696+0000","last_peered":"2024-04-26T18:29:46.420696+0000","last_clean":"2024-04-26T18:29:46.420696+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T18:29:46.420696+0000","last_undegraded":"2024-04-26T18:29:46.420696+0000","last_fullsized":"2024-04-26T18:29:46.420696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:43.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10539311699999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"41'818","reported_seq":888,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:20.757985+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T18:31:20.757985+0000","last_peered":"2024-04-26T18:31:20.757985+0000","last_clean":"2024-04-26T18:31:20.757985+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T18:31:20.757985+0000","last_undegraded":"2024-04-26T18:31:20.757985+0000","last_fullsized":"2024-04-26T18:31:20.757985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777888,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":70,"num_read_kb":0,"num_write":938,"num_write_kb":112536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"41'2763","reported_seq":4471,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.863016+0000","last_change":"2024-04-26T18:03:00.011745+0000","last_active":"2024-04-26T18:31:36.863016+0000","last_peered":"2024-04-26T18:31:36.863016+0000","last_clean":"2024-04-26T18:31:36.863016+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T18:31:36.863016+0000","last_undegraded":"2024-04-26T18:31:36.863016+0000","last_fullsized":"2024-04-26T18:31:36.863016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.553669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076321086999999996,"stat_sum":{"num_bytes":36028739,"num_objects":1149,"num_object_clones":527,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":527,"num_read":149,"num_read_kb":73233,"num_write":2275,"num_write_kb":49180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'611","reported_seq":2692,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.396699+0000","last_change":"2024-04-26T18:03:00.416589+0000","last_active":"2024-04-26T18:29:41.396699+0000","last_peered":"2024-04-26T18:29:41.396699+0000","last_clean":"2024-04-26T18:29:41.396699+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T18:29:41.396699+0000","last_undegraded":"2024-04-26T18:29:41.396699+0000","last_fullsized":"2024-04-26T18:29:41.396699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:33.817050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187850924,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"41'1273","reported_seq":1342,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.159063+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T18:30:09.159063+0000","last_peered":"2024-04-26T18:30:09.159063+0000","last_clean":"2024-04-26T18:30:09.159063+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T18:30:09.159063+0000","last_undegraded":"2024-04-26T18:30:09.159063+0000","last_fullsized":"2024-04-26T18:30:09.159063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1332,"num_write_kb":75702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"41'2855","reported_seq":4517,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.859406+0000","last_change":"2024-04-26T18:03:00.422955+0000","last_active":"2024-04-26T18:31:36.859406+0000","last_peered":"2024-04-26T18:31:36.859406+0000","last_clean":"2024-04-26T18:31:36.859406+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T18:31:36.859406+0000","last_undegraded":"2024-04-26T18:31:36.859406+0000","last_fullsized":"2024-04-26T18:31:36.859406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:17.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18615647199999999,"stat_sum":{"num_bytes":26768950,"num_objects":1237,"num_object_clones":575,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":575,"num_read":151,"num_read_kb":65496,"num_write":2334,"num_write_kb":43840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"41'599","reported_seq":2677,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.372641+0000","last_change":"2024-04-26T18:03:00.427018+0000","last_active":"2024-04-26T18:29:41.372641+0000","last_peered":"2024-04-26T18:29:41.372641+0000","last_clean":"2024-04-26T18:29:41.372641+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T18:29:41.372641+0000","last_undegraded":"2024-04-26T18:29:41.372641+0000","last_fullsized":"2024-04-26T18:29:41.372641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:59.016233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19386972299999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"41'2203","reported_seq":2272,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169468+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T18:30:09.169468+0000","last_peered":"2024-04-26T18:30:09.169468+0000","last_clean":"2024-04-26T18:30:09.169468+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T18:30:09.169468+0000","last_undegraded":"2024-04-26T18:30:09.169468+0000","last_fullsized":"2024-04-26T18:30:09.169468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":2240,"num_write_kb":108871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"41'2818","reported_seq":4518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.850564+0000","last_change":"2024-04-26T18:03:00.448747+0000","last_active":"2024-04-26T18:31:36.850564+0000","last_peered":"2024-04-26T18:31:36.850564+0000","last_clean":"2024-04-26T18:31:36.850564+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T18:31:36.850564+0000","last_undegraded":"2024-04-26T18:31:36.850564+0000","last_fullsized":"2024-04-26T18:31:36.850564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2818,"log_dups_size":0,"ondisk_log_size":2818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:54.613985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23086587,"stat_sum":{"num_bytes":33941132,"num_objects":1186,"num_object_clones":549,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":549,"num_read":163,"num_read_kb":131768,"num_write":2312,"num_write_kb":45432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"41'585","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:32.405129+0000","last_change":"2024-04-26T18:03:00.387751+0000","last_active":"2024-04-26T18:29:32.405129+0000","last_peered":"2024-04-26T18:29:32.405129+0000","last_clean":"2024-04-26T18:29:32.405129+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T18:29:32.405129+0000","last_undegraded":"2024-04-26T18:29:32.405129+0000","last_fullsized":"2024-04-26T18:29:32.405129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:17.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16159970800000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"41'918","reported_seq":1135,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174589+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T18:30:48.174589+0000","last_peered":"2024-04-26T18:30:48.174589+0000","last_clean":"2024-04-26T18:30:48.174589+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T18:30:48.174589+0000","last_undegraded":"2024-04-26T18:30:48.174589+0000","last_fullsized":"2024-04-26T18:30:48.174589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17376085,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":220,"num_read_kb":683,"num_write":1019,"num_write_kb":76520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"41'2989","reported_seq":4686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.343459+0000","last_change":"2024-04-26T18:03:00.450154+0000","last_active":"2024-04-26T18:31:32.343459+0000","last_peered":"2024-04-26T18:31:32.343459+0000","last_clean":"2024-04-26T18:31:32.343459+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T18:31:32.343459+0000","last_undegraded":"2024-04-26T18:31:32.343459+0000","last_fullsized":"2024-04-26T18:31:32.343459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:45.503657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22647874100000001,"stat_sum":{"num_bytes":37857272,"num_objects":1229,"num_object_clones":574,"num_object_copies":4916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":574,"num_read":187,"num_read_kb":231681,"num_write":2457,"num_write_kb":51113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"41'2741","reported_seq":4461,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.893946+0000","last_change":"2024-04-26T18:03:00.424939+0000","last_active":"2024-04-26T18:31:36.893946+0000","last_peered":"2024-04-26T18:31:36.893946+0000","last_clean":"2024-04-26T18:31:36.893946+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T18:31:36.893946+0000","last_undegraded":"2024-04-26T18:31:36.893946+0000","last_fullsized":"2024-04-26T18:31:36.893946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:30.278112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20154621,"stat_sum":{"num_bytes":35946841,"num_objects":1130,"num_object_clones":524,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1130,"num_whiteouts":524,"num_read":155,"num_read_kb":163014,"num_write":2271,"num_write_kb":38909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"41'602","reported_seq":2679,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.410519+0000","last_change":"2024-04-26T18:03:00.011427+0000","last_active":"2024-04-26T18:29:46.410519+0000","last_peered":"2024-04-26T18:29:46.410519+0000","last_clean":"2024-04-26T18:29:46.410519+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T18:29:46.410519+0000","last_undegraded":"2024-04-26T18:29:46.410519+0000","last_fullsized":"2024-04-26T18:29:46.410519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:42.428994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076360936000000004,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"41'1493","reported_seq":1562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.171031+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T18:30:16.171031+0000","last_peered":"2024-04-26T18:30:16.171031+0000","last_clean":"2024-04-26T18:30:16.171031+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T18:30:16.171031+0000","last_undegraded":"2024-04-26T18:30:16.171031+0000","last_fullsized":"2024-04-26T18:30:16.171031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":1554,"num_write_kb":113147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"41'2755","reported_seq":4436,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.814569+0000","last_change":"2024-04-26T18:03:00.045338+0000","last_active":"2024-04-26T18:31:36.814569+0000","last_peered":"2024-04-26T18:31:36.814569+0000","last_clean":"2024-04-26T18:31:36.814569+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T18:31:36.814569+0000","last_undegraded":"2024-04-26T18:31:36.814569+0000","last_fullsized":"2024-04-26T18:31:36.814569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:47.473281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101684618,"stat_sum":{"num_bytes":29230084,"num_objects":1175,"num_object_clones":548,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":548,"num_read":140,"num_read_kb":149625,"num_write":2265,"num_write_kb":32436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"41'678","reported_seq":2748,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.346338+0000","last_change":"2024-04-26T18:03:00.010584+0000","last_active":"2024-04-26T18:29:48.346338+0000","last_peered":"2024-04-26T18:29:48.346338+0000","last_clean":"2024-04-26T18:29:48.346338+0000","last_became_active":"2024-04-26T17:58:47.348873+0000","last_became_peered":"2024-04-26T17:58:47.348873+0000","last_unstale":"2024-04-26T18:29:48.346338+0000","last_undegraded":"2024-04-26T18:29:48.346338+0000","last_fullsized":"2024-04-26T18:29:48.346338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:17.045379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075584111999999995,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"41'758","reported_seq":827,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169521+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T18:30:09.169521+0000","last_peered":"2024-04-26T18:30:09.169521+0000","last_clean":"2024-04-26T18:30:09.169521+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T18:30:09.169521+0000","last_undegraded":"2024-04-26T18:30:09.169521+0000","last_fullsized":"2024-04-26T18:30:09.169521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":840,"num_write_kb":71498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"41'948","reported_seq":1017,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.065770+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T18:30:33.065770+0000","last_peered":"2024-04-26T18:30:33.065770+0000","last_clean":"2024-04-26T18:30:33.065770+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T18:30:33.065770+0000","last_undegraded":"2024-04-26T18:30:33.065770+0000","last_fullsized":"2024-04-26T18:30:33.065770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":1019,"num_write_kb":79683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"41'588","reported_seq":2667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.349367+0000","last_change":"2024-04-26T18:03:00.424808+0000","last_active":"2024-04-26T18:29:48.349367+0000","last_peered":"2024-04-26T18:29:48.349367+0000","last_clean":"2024-04-26T18:29:48.349367+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T18:29:48.349367+0000","last_undegraded":"2024-04-26T18:29:48.349367+0000","last_fullsized":"2024-04-26T18:29:48.349367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:07.262537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20583575700000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"41'2937","reported_seq":4605,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.781361+0000","last_change":"2024-04-26T18:03:00.085072+0000","last_active":"2024-04-26T18:31:36.781361+0000","last_peered":"2024-04-26T18:31:36.781361+0000","last_clean":"2024-04-26T18:31:36.781361+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T18:31:36.781361+0000","last_undegraded":"2024-04-26T18:31:36.781361+0000","last_fullsized":"2024-04-26T18:31:36.781361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:19.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025934391000000001,"stat_sum":{"num_bytes":29962641,"num_objects":1274,"num_object_clones":596,"num_object_copies":5096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":596,"num_read":178,"num_read_kb":211369,"num_write":2395,"num_write_kb":42590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"41'542","reported_seq":611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.066572+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T18:30:33.066572+0000","last_peered":"2024-04-26T18:30:33.066572+0000","last_clean":"2024-04-26T18:30:33.066572+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T18:30:33.066572+0000","last_undegraded":"2024-04-26T18:30:33.066572+0000","last_fullsized":"2024-04-26T18:30:33.066572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":620,"num_write_kb":96015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"41'620","reported_seq":2699,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.452032+0000","last_change":"2024-04-26T18:03:00.422447+0000","last_active":"2024-04-26T18:29:46.452032+0000","last_peered":"2024-04-26T18:29:46.452032+0000","last_clean":"2024-04-26T18:29:46.452032+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T18:29:46.452032+0000","last_undegraded":"2024-04-26T18:29:46.452032+0000","last_fullsized":"2024-04-26T18:29:46.452032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:19.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18696554200000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"41'2812","reported_seq":4494,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:32.336075+0000","last_change":"2024-04-26T18:03:00.452403+0000","last_active":"2024-04-26T18:31:32.336075+0000","last_peered":"2024-04-26T18:31:32.336075+0000","last_clean":"2024-04-26T18:31:32.336075+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T18:31:32.336075+0000","last_undegraded":"2024-04-26T18:31:32.336075+0000","last_fullsized":"2024-04-26T18:31:32.336075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:38.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215933711,"stat_sum":{"num_bytes":39516255,"num_objects":1208,"num_object_clones":558,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":558,"num_read":157,"num_read_kb":155459,"num_write":2289,"num_write_kb":56059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"41'619","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.343539+0000","last_change":"2024-04-26T18:03:00.038929+0000","last_active":"2024-04-26T18:29:48.343539+0000","last_peered":"2024-04-26T18:29:48.343539+0000","last_clean":"2024-04-26T18:29:48.343539+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T18:29:48.343539+0000","last_undegraded":"2024-04-26T18:29:48.343539+0000","last_fullsized":"2024-04-26T18:29:48.343539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:12.133508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098603622000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"41'650","reported_seq":2731,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.191322+0000","last_change":"2024-04-26T18:03:00.080058+0000","last_active":"2024-04-26T18:30:48.191322+0000","last_peered":"2024-04-26T18:30:48.191322+0000","last_clean":"2024-04-26T18:30:48.191322+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T18:30:48.191322+0000","last_undegraded":"2024-04-26T18:30:48.191322+0000","last_fullsized":"2024-04-26T18:30:48.191322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:21.430086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032925850999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"41'602","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:03.169842+0000","last_change":"2024-04-26T18:03:00.082718+0000","last_active":"2024-04-26T18:30:03.169842+0000","last_peered":"2024-04-26T18:30:03.169842+0000","last_clean":"2024-04-26T18:30:03.169842+0000","last_became_active":"2024-04-26T17:58:46.843441+0000","last_became_peered":"2024-04-26T17:58:46.843441+0000","last_unstale":"2024-04-26T18:30:03.169842+0000","last_undegraded":"2024-04-26T18:30:03.169842+0000","last_fullsized":"2024-04-26T18:30:03.169842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:59.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030186671000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"41'658","reported_seq":2736,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.338929+0000","last_change":"2024-04-26T18:03:00.420297+0000","last_active":"2024-04-26T18:29:41.338929+0000","last_peered":"2024-04-26T18:29:41.338929+0000","last_clean":"2024-04-26T18:29:41.338929+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T18:29:41.338929+0000","last_undegraded":"2024-04-26T18:29:41.338929+0000","last_fullsized":"2024-04-26T18:29:41.338929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:17.932988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.201538621,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"41'594","reported_seq":2676,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.352627+0000","last_change":"2024-04-26T18:03:00.452146+0000","last_active":"2024-04-26T18:30:01.352627+0000","last_peered":"2024-04-26T18:30:01.352627+0000","last_clean":"2024-04-26T18:30:01.352627+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T18:30:01.352627+0000","last_undegraded":"2024-04-26T18:30:01.352627+0000","last_fullsized":"2024-04-26T18:30:01.352627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:38.204578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217865696,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"41'614","reported_seq":2690,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:38.350023+0000","last_change":"2024-04-26T18:03:00.013263+0000","last_active":"2024-04-26T18:30:38.350023+0000","last_peered":"2024-04-26T18:30:38.350023+0000","last_clean":"2024-04-26T18:30:38.350023+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T18:30:38.350023+0000","last_undegraded":"2024-04-26T18:30:38.350023+0000","last_fullsized":"2024-04-26T18:30:38.350023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:40.421470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077286562000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":18,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"41'640","reported_seq":2724,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.359704+0000","last_change":"2024-04-26T18:03:00.044300+0000","last_active":"2024-04-26T18:29:46.359704+0000","last_peered":"2024-04-26T18:29:46.359704+0000","last_clean":"2024-04-26T18:29:46.359704+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T18:29:46.359704+0000","last_undegraded":"2024-04-26T18:29:46.359704+0000","last_fullsized":"2024-04-26T18:29:46.359704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:41.880840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101304621,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"41'588","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.150007+0000","last_change":"2024-04-26T18:03:00.451279+0000","last_active":"2024-04-26T18:29:47.150007+0000","last_peered":"2024-04-26T18:29:47.150007+0000","last_clean":"2024-04-26T18:29:47.150007+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T18:29:47.150007+0000","last_undegraded":"2024-04-26T18:29:47.150007+0000","last_fullsized":"2024-04-26T18:29:47.150007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:01.568762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21869934299999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"41'612","reported_seq":2692,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:43.067031+0000","last_change":"2024-04-26T18:03:00.382958+0000","last_active":"2024-04-26T18:30:43.067031+0000","last_peered":"2024-04-26T18:30:43.067031+0000","last_clean":"2024-04-26T18:30:43.067031+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T18:30:43.067031+0000","last_undegraded":"2024-04-26T18:30:43.067031+0000","last_fullsized":"2024-04-26T18:30:43.067031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:24.729192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16324759799999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"41'601","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:42.333632+0000","last_change":"2024-04-26T18:03:00.449823+0000","last_active":"2024-04-26T18:29:42.333632+0000","last_peered":"2024-04-26T18:29:42.333632+0000","last_clean":"2024-04-26T18:29:42.333632+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T18:29:42.333632+0000","last_undegraded":"2024-04-26T18:29:42.333632+0000","last_fullsized":"2024-04-26T18:29:42.333632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:31.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22595842999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":20,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"41'628","reported_seq":2712,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.347096+0000","last_change":"2024-04-26T18:03:00.387942+0000","last_active":"2024-04-26T18:29:46.347096+0000","last_peered":"2024-04-26T18:29:46.347096+0000","last_clean":"2024-04-26T18:29:46.347096+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T18:29:46.347096+0000","last_undegraded":"2024-04-26T18:29:46.347096+0000","last_fullsized":"2024-04-26T18:29:46.347096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:12.544391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16093863,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"41'620","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.378968+0000","last_change":"2024-04-26T18:03:00.417549+0000","last_active":"2024-04-26T18:29:46.378968+0000","last_peered":"2024-04-26T18:29:46.378968+0000","last_clean":"2024-04-26T18:29:46.378968+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T18:29:46.378968+0000","last_undegraded":"2024-04-26T18:29:46.378968+0000","last_fullsized":"2024-04-26T18:29:46.378968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:03.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.199229399,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"41'627","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.390505+0000","last_change":"2024-04-26T18:03:00.037623+0000","last_active":"2024-04-26T18:29:46.390505+0000","last_peered":"2024-04-26T18:29:46.390505+0000","last_clean":"2024-04-26T18:29:46.390505+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T18:29:46.390505+0000","last_undegraded":"2024-04-26T18:29:46.390505+0000","last_fullsized":"2024-04-26T18:29:46.390505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:23.801334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097146090000000004,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":18,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"41'645","reported_seq":2721,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175759+0000","last_change":"2024-04-26T18:03:00.047343+0000","last_active":"2024-04-26T18:30:16.175759+0000","last_peered":"2024-04-26T18:30:16.175759+0000","last_clean":"2024-04-26T18:30:16.175759+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T18:30:16.175759+0000","last_undegraded":"2024-04-26T18:30:16.175759+0000","last_fullsized":"2024-04-26T18:30:16.175759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.305800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104951684,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"41'585","reported_seq":2665,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.175924+0000","last_change":"2024-04-26T18:03:00.080377+0000","last_active":"2024-04-26T18:30:48.175924+0000","last_peered":"2024-04-26T18:30:48.175924+0000","last_clean":"2024-04-26T18:30:48.175924+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T18:30:48.175924+0000","last_undegraded":"2024-04-26T18:30:48.175924+0000","last_fullsized":"2024-04-26T18:30:48.175924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:16.651583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032670101999999999,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"41'637","reported_seq":2717,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.378343+0000","last_change":"2024-04-26T18:03:00.390632+0000","last_active":"2024-04-26T18:29:46.378343+0000","last_peered":"2024-04-26T18:29:46.378343+0000","last_clean":"2024-04-26T18:29:46.378343+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T18:29:46.378343+0000","last_undegraded":"2024-04-26T18:29:46.378343+0000","last_fullsized":"2024-04-26T18:29:46.378343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:04.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15919065099999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"41'612","reported_seq":2693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.067474+0000","last_change":"2024-04-26T18:03:00.381346+0000","last_active":"2024-04-26T18:30:48.067474+0000","last_peered":"2024-04-26T18:30:48.067474+0000","last_clean":"2024-04-26T18:30:48.067474+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T18:30:48.067474+0000","last_undegraded":"2024-04-26T18:30:48.067474+0000","last_fullsized":"2024-04-26T18:30:48.067474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:38.159280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16311753700000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"41'635","reported_seq":2713,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.203186+0000","last_change":"2024-04-26T18:03:00.012809+0000","last_active":"2024-04-26T18:30:48.203186+0000","last_peered":"2024-04-26T18:30:48.203186+0000","last_clean":"2024-04-26T18:30:48.203186+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T18:30:48.203186+0000","last_undegraded":"2024-04-26T18:30:48.203186+0000","last_fullsized":"2024-04-26T18:30:48.203186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:47.235898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077647145000000001,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"41'596","reported_seq":2681,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.375114+0000","last_change":"2024-04-26T18:03:00.427662+0000","last_active":"2024-04-26T18:29:41.375114+0000","last_peered":"2024-04-26T18:29:41.375114+0000","last_clean":"2024-04-26T18:29:41.375114+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T18:29:41.375114+0000","last_undegraded":"2024-04-26T18:29:41.375114+0000","last_fullsized":"2024-04-26T18:29:41.375114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:35.215492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18619005699999999,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"41'583","reported_seq":2663,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:35.399093+0000","last_change":"2024-04-26T18:03:00.444694+0000","last_active":"2024-04-26T18:29:35.399093+0000","last_peered":"2024-04-26T18:29:35.399093+0000","last_clean":"2024-04-26T18:29:35.399093+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T18:29:35.399093+0000","last_undegraded":"2024-04-26T18:29:35.399093+0000","last_fullsized":"2024-04-26T18:29:35.399093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:27.452738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22687219,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"41'600","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.355615+0000","last_change":"2024-04-26T18:03:00.415887+0000","last_active":"2024-04-26T18:29:48.355615+0000","last_peered":"2024-04-26T18:29:48.355615+0000","last_clean":"2024-04-26T18:29:48.355615+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T18:29:48.355615+0000","last_undegraded":"2024-04-26T18:29:48.355615+0000","last_fullsized":"2024-04-26T18:29:48.355615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:42.102564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18821249400000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"41'606","reported_seq":2687,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.350019+0000","last_change":"2024-04-26T18:03:00.042914+0000","last_active":"2024-04-26T18:30:01.350019+0000","last_peered":"2024-04-26T18:30:01.350019+0000","last_clean":"2024-04-26T18:30:01.350019+0000","last_became_active":"2024-04-26T17:58:46.846437+0000","last_became_peered":"2024-04-26T17:58:46.846437+0000","last_unstale":"2024-04-26T18:30:01.350019+0000","last_undegraded":"2024-04-26T18:30:01.350019+0000","last_fullsized":"2024-04-26T18:30:01.350019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:04.851963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100440928,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":16,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"41'591","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:41.373726+0000","last_change":"2024-04-26T18:03:00.043307+0000","last_active":"2024-04-26T18:29:41.373726+0000","last_peered":"2024-04-26T18:29:41.373726+0000","last_clean":"2024-04-26T18:29:41.373726+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T18:29:41.373726+0000","last_undegraded":"2024-04-26T18:29:41.373726+0000","last_fullsized":"2024-04-26T18:29:41.373726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:35.890122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100379555,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"41'637","reported_seq":2709,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.345489+0000","last_change":"2024-04-26T18:03:00.046913+0000","last_active":"2024-04-26T18:29:46.345489+0000","last_peered":"2024-04-26T18:29:46.345489+0000","last_clean":"2024-04-26T18:29:46.345489+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T18:29:46.345489+0000","last_undegraded":"2024-04-26T18:29:46.345489+0000","last_fullsized":"2024-04-26T18:29:46.345489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:46.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104580398,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":20,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"41'579","reported_seq":2658,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:47.337001+0000","last_change":"2024-04-26T18:03:00.449103+0000","last_active":"2024-04-26T18:29:47.337001+0000","last_peered":"2024-04-26T18:29:47.337001+0000","last_clean":"2024-04-26T18:29:47.337001+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T18:29:47.337001+0000","last_undegraded":"2024-04-26T18:29:47.337001+0000","last_fullsized":"2024-04-26T18:29:47.337001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:13.870912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230423819,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"41'606","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.348929+0000","last_change":"2024-04-26T18:03:00.047650+0000","last_active":"2024-04-26T18:29:46.348929+0000","last_peered":"2024-04-26T18:29:46.348929+0000","last_clean":"2024-04-26T18:29:46.348929+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T18:29:46.348929+0000","last_undegraded":"2024-04-26T18:29:46.348929+0000","last_fullsized":"2024-04-26T18:29:46.348929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:11.007748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101654339,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"41'571","reported_seq":2651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175691+0000","last_change":"2024-04-26T18:03:00.390090+0000","last_active":"2024-04-26T18:30:16.175691+0000","last_peered":"2024-04-26T18:30:16.175691+0000","last_clean":"2024-04-26T18:30:16.175691+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T18:30:16.175691+0000","last_undegraded":"2024-04-26T18:30:16.175691+0000","last_fullsized":"2024-04-26T18:30:16.175691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:52.940552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16310901,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"41'640","reported_seq":2726,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.350482+0000","last_change":"2024-04-26T18:03:00.045506+0000","last_active":"2024-04-26T18:30:01.350482+0000","last_peered":"2024-04-26T18:30:01.350482+0000","last_clean":"2024-04-26T18:30:01.350482+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T18:30:01.350482+0000","last_undegraded":"2024-04-26T18:30:01.350482+0000","last_fullsized":"2024-04-26T18:30:01.350482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.552957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10388457199999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"41'631","reported_seq":2709,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:46.346504+0000","last_change":"2024-04-26T18:03:00.390493+0000","last_active":"2024-04-26T18:29:46.346504+0000","last_peered":"2024-04-26T18:29:46.346504+0000","last_clean":"2024-04-26T18:29:46.346504+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T18:29:46.346504+0000","last_undegraded":"2024-04-26T18:29:46.346504+0000","last_fullsized":"2024-04-26T18:29:46.346504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:20.892370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16390716399999999,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":17,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"41'597","reported_seq":2682,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:01.351509+0000","last_change":"2024-04-26T18:03:00.414568+0000","last_active":"2024-04-26T18:30:01.351509+0000","last_peered":"2024-04-26T18:30:01.351509+0000","last_clean":"2024-04-26T18:30:01.351509+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T18:30:01.351509+0000","last_undegraded":"2024-04-26T18:30:01.351509+0000","last_fullsized":"2024-04-26T18:30:01.351509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:12.402497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19882805000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"41'589","reported_seq":2671,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.188162+0000","last_change":"2024-04-26T18:03:00.013917+0000","last_active":"2024-04-26T18:30:48.188162+0000","last_peered":"2024-04-26T18:30:48.188162+0000","last_clean":"2024-04-26T18:30:48.188162+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T18:30:48.188162+0000","last_undegraded":"2024-04-26T18:30:48.188162+0000","last_fullsized":"2024-04-26T18:30:48.188162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:25.271335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077373158999999997,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"41'577","reported_seq":2665,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.192100+0000","last_change":"2024-04-26T18:03:00.046476+0000","last_active":"2024-04-26T18:30:48.192100+0000","last_peered":"2024-04-26T18:30:48.192100+0000","last_clean":"2024-04-26T18:30:48.192100+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T18:30:48.192100+0000","last_undegraded":"2024-04-26T18:30:48.192100+0000","last_fullsized":"2024-04-26T18:30:48.192100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:28.837314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104812107,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1183673720,"num_objects":39268,"num_object_clones":18317,"num_object_copies":157072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39268,"num_whiteouts":18141,"num_read":5592,"num_read_kb":5964736,"num_write":75176,"num_write_kb":1483989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2573631488,"data_stored":2574974976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91894,"ondisk_log_size":91894,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3085,"num_object_clones":812,"num_object_copies":6170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3085,"num_whiteouts":812,"num_read":0,"num_read_kb":0,"num_write":3093,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39039,"ondisk_log_size":39039,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797002251,"num_objects":1886,"num_object_clones":0,"num_object_copies":3772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1886,"num_whiteouts":0,"num_read":2824,"num_read_kb":5408,"num_write":35008,"num_write_kb":2756179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1594064896,"data_stored":1594004502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31195,"ondisk_log_size":31195,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575259,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814068,"kb_used_data":570604,"kb_used_omap":1,"kb_used_meta":243454,"kb_avail":93557772,"statfs":{"total":96636764160,"available":95803158528,"internally_reserved":0,"allocated":584298496,"data_stored":584389236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249297355},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575259,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864928,"kb_used_data":545112,"kb_used_omap":1,"kb_used_meta":319806,"kb_avail":93506912,"statfs":{"total":96636764160,"available":95751077888,"internally_reserved":0,"allocated":558194688,"data_stored":558281943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":327481799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575259,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":747420,"kb_used_data":455444,"kb_used_omap":1,"kb_used_meta":291966,"kb_avail":93624420,"statfs":{"total":96636764160,"available":95871406080,"internally_reserved":0,"allocated":466374656,"data_stored":466129553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":298973637},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575259,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":742816,"kb_used_data":481304,"kb_used_omap":1,"kb_used_meta":261502,"kb_avail":93629024,"statfs":{"total":96636764160,"available":95876120576,"internally_reserved":0,"allocated":492855296,"data_stored":492773676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267778501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575259,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":908776,"kb_used_data":574944,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":93463064,"statfs":{"total":96636764160,"available":95706177536,"internally_reserved":0,"allocated":588742656,"data_stored":588833154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":341834184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575259,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530044,"kb_used_data":322676,"kb_used_omap":1,"kb_used_meta":207358,"kb_avail":93841796,"statfs":{"total":96636764160,"available":96093999104,"internally_reserved":0,"allocated":330420224,"data_stored":330182370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212335045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575259,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":986984,"kb_used_data":635168,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93384856,"statfs":{"total":96636764160,"available":95626092544,"internally_reserved":0,"allocated":650412032,"data_stored":650334542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575260,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705452,"kb_used_data":489700,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93666388,"statfs":{"total":96636764160,"available":95914381312,"internally_reserved":0,"allocated":501452800,"data_stored":501199532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":205012992,"data_stored":205001130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234885740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163586048,"data_stored":163578528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163594240,"data_stored":163582538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":206127104,"data_stored":206119855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":222908416,"data_stored":222897653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297279488,"data_stored":297275762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":295362560,"data_stored":295362560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415035392,"data_stored":415203328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229273600,"data_stored":229273600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":424673280,"data_stored":425009152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":328777728,"data_stored":328945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":259764224,"data_stored":259764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":334802944,"data_stored":335138816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":285941760,"data_stored":286277632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:31:52.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T18:31:53.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.043+0000 7fd2b6409640 1 Processor -- start 2024-04-26T18:31:53.043 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.043+0000 7fd2b6409640 1 -- start start 2024-04-26T18:31:53.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2b6409640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd2b00c89f0 0x7fd2b015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:53.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2b6409640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fd2b00c7c20 0x7fd2b00c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:53.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2b6409640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b00736a0 con 0x7fd2b0152cb0 2024-04-26T18:31:53.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2b6409640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b00c62e0 con 0x7fd2b00c89f0 2024-04-26T18:31:53.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2b6409640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b0073940 con 0x7fd2b00c7c20 2024-04-26T18:31:53.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2af7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd2b00c89f0 0x7fd2b015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:53.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2af7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fd2b00c89f0 0x7fd2b015bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51162/0 (socket says 172.21.15.139:51162) 2024-04-26T18:31:53.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2af7fe640 1 -- 172.21.15.139:0/1476751396 learned_addr learned my addr 172.21.15.139:0/1476751396 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:53.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2b49a6640 1 --2- 172.21.15.139:0/1476751396 >> v2:172.21.15.143:3300/0 conn(0x7fd2b00c7c20 0x7fd2b00c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:53.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2af7fe640 1 -- 172.21.15.139:0/1476751396 >> v2:172.21.15.143:3300/0 conn(0x7fd2b00c7c20 msgr2=0x7fd2b00c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:53.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2af7fe640 1 --2- 172.21.15.139:0/1476751396 >> v2:172.21.15.143:3300/0 conn(0x7fd2b00c7c20 0x7fd2b00c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.046 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2af7fe640 1 -- 172.21.15.139:0/1476751396 >> v1:172.21.15.143:6789/0 conn(0x7fd2b0152cb0 legacy=0x7fd2b00cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:53.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.044+0000 7fd2af7fe640 1 -- 172.21.15.139:0/1476751396 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b00c48c0 con 0x7fd2b00c89f0 2024-04-26T18:31:53.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.045+0000 7fd2af7fe640 1 --2- 172.21.15.139:0/1476751396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b00c89f0 0x7fd2b015bd50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0072060 tx=0x7fd2a402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568653d13fb9ce69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:53.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.045+0000 7fd2aeffd640 1 -- 172.21.15.139:0/1476751396 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4037070 con 0x7fd2b00c89f0 2024-04-26T18:31:53.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.045+0000 7fd2aeffd640 1 -- 172.21.15.139:0/1476751396 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a402ae50 con 0x7fd2b00c89f0 2024-04-26T18:31:53.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.045+0000 7fd2aeffd640 1 -- 172.21.15.139:0/1476751396 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4032860 con 0x7fd2b00c89f0 2024-04-26T18:31:53.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 -- 172.21.15.139:0/1476751396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b00c89f0 msgr2=0x7fd2b015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 --2- 172.21.15.139:0/1476751396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b00c89f0 0x7fd2b015bd50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0072060 tx=0x7fd2a402a300 comp rx=0 tx=0).stop 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 -- 172.21.15.139:0/1476751396 shutdown_connections 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 --2- 172.21.15.139:0/1476751396 >> v2:172.21.15.143:3300/0 conn(0x7fd2b00c7c20 0x7fd2b00c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 --2- 172.21.15.139:0/1476751396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b00c89f0 0x7fd2b015bd50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 -- 172.21.15.139:0/1476751396 >> 172.21.15.139:0/1476751396 conn(0x7fd2b0068270 msgr2=0x7fd2b0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 -- 172.21.15.139:0/1476751396 shutdown_connections 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.046+0000 7fd2b6409640 1 -- 172.21.15.139:0/1476751396 wait complete. 2024-04-26T18:31:53.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.047+0000 7fd2b6409640 1 Processor -- start 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.047+0000 7fd2b6409640 1 -- start start 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2b00c7c20 0x7fd2b01f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2b00c89f0 0x7fd2b014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b0152cb0 0x7fd2b0072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b00c4d20 con 0x7fd2b0152cb0 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b00c4ba0 con 0x7fd2b00c7c20 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b00cdb70 con 0x7fd2b00c89f0 2024-04-26T18:31:53.052 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b0152cb0 0x7fd2b0072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:53.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b0152cb0 0x7fd2b0072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51178/0 (socket says 172.21.15.139:51178) 2024-04-26T18:31:53.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 -- 172.21.15.139:0/91193486 learned_addr learned my addr 172.21.15.139:0/91193486 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:53.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2affff640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2b00c7c20 0x7fd2b01f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:53.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2af7fe640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2b00c89f0 0x7fd2b014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:53.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 -- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2b00c89f0 msgr2=0x7fd2b014b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:53.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2b00c89f0 0x7fd2b014b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.053 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 -- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2b00c7c20 msgr2=0x7fd2b01f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2b00c7c20 0x7fd2b01f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 -- 172.21.15.139:0/91193486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b014be60 con 0x7fd2b0152cb0 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b49a6640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b0152cb0 0x7fd2b0072b40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800efc0 tx=0x7fd2a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2acff9640 1 -- 172.21.15.139:0/91193486 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8018020 con 0x7fd2b0152cb0 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2acff9640 1 -- 172.21.15.139:0/91193486 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a8014480 con 0x7fd2b0152cb0 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2acff9640 1 -- 172.21.15.139:0/91193486 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8014870 con 0x7fd2b0152cb0 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b014c140 con 0x7fd2b0152cb0 2024-04-26T18:31:53.054 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.048+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b014f980 con 0x7fd2b0152cb0 2024-04-26T18:31:53.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.049+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b0076d20 con 0x7fd2b0152cb0 2024-04-26T18:31:53.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.050+0000 7fd2acff9640 1 -- 172.21.15.139:0/91193486 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd2a8005d10 con 0x7fd2b0152cb0 2024-04-26T18:31:53.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.050+0000 7fd2acff9640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd29c06c8f0 0x7fd29c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:53.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.050+0000 7fd2acff9640 1 -- 172.21.15.139:0/91193486 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fd2a808c8b0 con 0x7fd2b0152cb0 2024-04-26T18:31:53.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.050+0000 7fd2affff640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd29c06c8f0 0x7fd29c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:53.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.051+0000 7fd2affff640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd29c06c8f0 0x7fd29c06edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0001780 tx=0x7fd2a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:53.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.054+0000 7fd2acff9640 1 -- 172.21.15.139:0/91193486 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd2a8022070 con 0x7fd2b0152cb0 2024-04-26T18:31:53.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.230+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2b00c43a0 con 0x7fd2b0152cb0 2024-04-26T18:31:53.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.232+0000 7fd2acff9640 1 -- 172.21.15.139:0/91193486 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+19069 (secure 0 0 0) 0x7fd2a8010040 con 0x7fd2b0152cb0 2024-04-26T18:31:53.232 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:53.232 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":41,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T18:03:05.800428+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":464,"length":42}]},{"pool":4,"snaps":[{"begin":464,"length":42}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:31:53.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd29c06c8f0 msgr2=0x7fd29c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:53.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd29c06c8f0 0x7fd29c06edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0001780 tx=0x7fd2a0009040 comp rx=0 tx=0).stop 2024-04-26T18:31:53.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b0152cb0 msgr2=0x7fd2b0072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:53.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b0152cb0 0x7fd2b0072b40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd2a800efc0 tx=0x7fd2a800c490 comp rx=0 tx=0).stop 2024-04-26T18:31:53.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 shutdown_connections 2024-04-26T18:31:53.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fd29c06c8f0 0x7fd29c06edb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2b0152cb0 0x7fd2b0072b40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fd2b00c89f0 0x7fd2b014b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 --2- 172.21.15.139:0/91193486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2b00c7c20 0x7fd2b01f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:53.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 >> 172.21.15.139:0/91193486 conn(0x7fd2b0068270 msgr2=0x7fd2b00cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:53.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 shutdown_connections 2024-04-26T18:31:53.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:53.234+0000 7fd2b6409640 1 -- 172.21.15.139:0/91193486 wait complete. 2024-04-26T18:31:54.247 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T18:31:54.247 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:54.362 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.362+0000 7efd9e420640 1 Processor -- start 2024-04-26T18:31:54.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.362+0000 7efd9e420640 1 -- start start 2024-04-26T18:31:54.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9e420640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd98070de0 0x7efd9815c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9e420640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efd980714f0 0x7efd9815c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9e420640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980ca640 con 0x7efd98070a00 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9e420640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7efd980ca920 con 0x7efd980714f0 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9e420640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd980cac00 con 0x7efd98070de0 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9c9bd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efd980714f0 0x7efd9815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9c9bd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7efd980714f0 0x7efd9815c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51190/0 (socket says 172.21.15.139:51190) 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9c9bd640 1 -- 172.21.15.139:0/1772371382 learned_addr learned my addr 172.21.15.139:0/1772371382 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd977fe640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd98070de0 0x7efd9815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.365 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9c9bd640 1 -- 172.21.15.139:0/1772371382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd98070de0 msgr2=0x7efd9815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:54.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9c9bd640 1 --2- 172.21.15.139:0/1772371382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd98070de0 0x7efd9815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9c9bd640 1 -- 172.21.15.139:0/1772371382 >> v1:172.21.15.143:6789/0 conn(0x7efd98070a00 legacy=0x7efd9806c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd9c9bd640 1 -- 172.21.15.139:0/1772371382 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980caee0 con 0x7efd980714f0 2024-04-26T18:31:54.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.363+0000 7efd96ffd640 1 -- 172.21.15.139:0/1772371382 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633543298 0 0) 0x7efd980ca640 con 0x7efd98070a00 2024-04-26T18:31:54.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.364+0000 7efd9c9bd640 1 --2- 172.21.15.139:0/1772371382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd980714f0 0x7efd9815c690 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7efd90009e50 tx=0x7efd9002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0680ff6be6c914 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.366 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.364+0000 7efd96ffd640 1 -- 172.21.15.139:0/1772371382 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90036070 con 0x7efd980714f0 2024-04-26T18:31:54.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.364+0000 7efd96ffd640 1 -- 172.21.15.139:0/1772371382 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90031600 con 0x7efd980714f0 2024-04-26T18:31:54.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.364+0000 7efd96ffd640 1 -- 172.21.15.139:0/1772371382 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd900319d0 con 0x7efd980714f0 2024-04-26T18:31:54.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 -- 172.21.15.139:0/1772371382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd980714f0 msgr2=0x7efd9815c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 --2- 172.21.15.139:0/1772371382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd980714f0 0x7efd9815c690 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7efd90009e50 tx=0x7efd9002a680 comp rx=0 tx=0).stop 2024-04-26T18:31:54.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 -- 172.21.15.139:0/1772371382 shutdown_connections 2024-04-26T18:31:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 --2- 172.21.15.139:0/1772371382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd980714f0 0x7efd9815c690 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 --2- 172.21.15.139:0/1772371382 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd98070de0 0x7efd9815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 -- 172.21.15.139:0/1772371382 >> 172.21.15.139:0/1772371382 conn(0x7efd98068090 msgr2=0x7efd98068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 -- 172.21.15.139:0/1772371382 shutdown_connections 2024-04-26T18:31:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.365+0000 7efd9e420640 1 -- 172.21.15.139:0/1772371382 wait complete. 2024-04-26T18:31:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.366+0000 7efd9e420640 1 Processor -- start 2024-04-26T18:31:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.366+0000 7efd9e420640 1 -- start start 2024-04-26T18:31:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd9e420640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd98070a00 0x7efd981f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd9e420640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd98070de0 0x7efd980b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd9e420640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd980714f0 0x7efd980c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd9e420640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd98158f20 con 0x7efd98070de0 2024-04-26T18:31:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd9e420640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7efd98158da0 con 0x7efd98070a00 2024-04-26T18:31:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd9e420640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7efd981590a0 con 0x7efd980714f0 2024-04-26T18:31:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd98070de0 0x7efd980b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd98070de0 0x7efd980b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51200/0 (socket says 172.21.15.139:51200) 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 -- 172.21.15.139:0/1313689595 learned_addr learned my addr 172.21.15.139:0/1313689595 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd97fff640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd98070a00 0x7efd981f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd9c9bd640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd980714f0 0x7efd980c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 -- 172.21.15.139:0/1313689595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd980714f0 msgr2=0x7efd980c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7efd980714f0 0x7efd980c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 -- 172.21.15.139:0/1313689595 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd98070a00 msgr2=0x7efd981f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.374 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efd98070a00 0x7efd981f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 -- 172.21.15.139:0/1313689595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd981f55a0 con 0x7efd98070de0 2024-04-26T18:31:54.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.367+0000 7efd977fe640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd98070de0 0x7efd980b0dd0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00e9e0 tx=0x7efd8c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.368+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c017070 con 0x7efd98070de0 2024-04-26T18:31:54.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.368+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c00c9d0 con 0x7efd98070de0 2024-04-26T18:31:54.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.368+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd980b1d50 con 0x7efd98070de0 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.368+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00cdc0 con 0x7efd98070de0 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.368+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd980b1ff0 con 0x7efd98070de0 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.369+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd98076d20 con 0x7efd98070de0 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.369+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd8c01a070 con 0x7efd98070de0 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd94ff9640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd8406c8f0 0x7efd8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7efd8c08bea0 con 0x7efd98070de0 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd97fff640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd8406c8f0 0x7efd8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd94ff9640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7efd84076410 0x7efd840788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 --> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd84078f80 con 0x7efd84076410 2024-04-26T18:31:54.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7efd8c08e5a0 con 0x7efd98070de0 2024-04-26T18:31:54.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd9c9bd640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7efd84076410 0x7efd840788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd97fff640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd8406c8f0 0x7efd8406edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efd88000f60 tx=0x7efd88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.370+0000 7efd9c9bd640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7efd84076410 0x7efd840788b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.371+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== osd.0 v2:172.21.15.139:6800/1771669412 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd84078f80 con 0x7efd84076410 2024-04-26T18:31:54.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.384+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 --> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efd980cc940 con 0x7efd84076410 2024-04-26T18:31:54.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.384+0000 7efd94ff9640 1 -- 172.21.15.139:0/1313689595 <== osd.0 v2:172.21.15.139:6800/1771669412 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efd980cc940 con 0x7efd84076410 2024-04-26T18:31:54.384 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:54.385 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:54.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.384+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7efd84076410 msgr2=0x7efd840788b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.384+0000 7efd9e420640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6800/1771669412,v1:172.21.15.139:6801/1771669412] conn(0x7efd84076410 0x7efd840788b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd8406c8f0 msgr2=0x7efd8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.386 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7efd8406c8f0 0x7efd8406edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efd88000f60 tx=0x7efd88009040 comp rx=0 tx=0).stop 2024-04-26T18:31:54.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd98070de0 msgr2=0x7efd980b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 --2- 172.21.15.139:0/1313689595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd98070de0 0x7efd980b0dd0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00e9e0 tx=0x7efd8c00eea0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9c9bd640 1 -- 172.21.15.139:0/1313689595 reap_dead start 2024-04-26T18:31:54.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 shutdown_connections 2024-04-26T18:31:54.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 >> 172.21.15.139:0/1313689595 conn(0x7efd98068090 msgr2=0x7efd98159840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:54.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 shutdown_connections 2024-04-26T18:31:54.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.385+0000 7efd9e420640 1 -- 172.21.15.139:0/1313689595 wait complete. 2024-04-26T18:31:54.398 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T18:31:54.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.496+0000 7fb90c459640 1 Processor -- start 2024-04-26T18:31:54.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.497+0000 7fb90c459640 1 -- start start 2024-04-26T18:31:54.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.497+0000 7fb90c459640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb904152180 0x7fb9040c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb90c459640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb90406de20 con 0x7fb904158b30 2024-04-26T18:31:54.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb90c459640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb90406e100 con 0x7fb9040c8320 2024-04-26T18:31:54.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb90c459640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fb90406e3e0 con 0x7fb904152180 2024-04-26T18:31:54.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb90a1f5640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fb904152180 0x7fb9040c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb9099f4640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fb904158b30 0x7fb9040c9b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53318/0 (socket says 172.21.15.139:53318) 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb9099f4640 1 -- 172.21.15.139:0/2438150766 learned_addr learned my addr 172.21.15.139:0/2438150766 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb90a1f5640 1 -- 172.21.15.139:0/2438150766 >> v1:172.21.15.143:6789/0 conn(0x7fb9040c8320 legacy=0x7fb904072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb90a1f5640 1 -- 172.21.15.139:0/2438150766 >> v1:172.21.15.139:6789/0 conn(0x7fb904158b30 legacy=0x7fb9040c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb90a1f5640 1 -- 172.21.15.139:0/2438150766 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90406e6c0 con 0x7fb904152180 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.498+0000 7fb9091f3640 1 -- 172.21.15.139:0/2438150766 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433868091 0 0) 0x7fb90406de20 con 0x7fb904158b30 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb90a1f5640 1 --2- 172.21.15.139:0/2438150766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb904152180 0x7fb9040c7de0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80097a0 tx=0x7fb8f802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50253b70b82f18d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb9091f3640 1 -- 172.21.15.139:0/2438150766 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8037070 con 0x7fb904152180 2024-04-26T18:31:54.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb9091f3640 1 -- 172.21.15.139:0/2438150766 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f8032640 con 0x7fb904152180 2024-04-26T18:31:54.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb9091f3640 1 -- 172.21.15.139:0/2438150766 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8032a10 con 0x7fb904152180 2024-04-26T18:31:54.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb90c459640 1 -- 172.21.15.139:0/2438150766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb904152180 msgr2=0x7fb9040c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb90c459640 1 --2- 172.21.15.139:0/2438150766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb904152180 0x7fb9040c7de0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80097a0 tx=0x7fb8f802a2c0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb90c459640 1 -- 172.21.15.139:0/2438150766 shutdown_connections 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb90c459640 1 --2- 172.21.15.139:0/2438150766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb904152180 0x7fb9040c7de0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.499+0000 7fb90c459640 1 -- 172.21.15.139:0/2438150766 >> 172.21.15.139:0/2438150766 conn(0x7fb9040686c0 msgr2=0x7fb90406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.500+0000 7fb90c459640 1 -- 172.21.15.139:0/2438150766 shutdown_connections 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.500+0000 7fb90c459640 1 -- 172.21.15.139:0/2438150766 wait complete. 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 Processor -- start 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 -- start start 2024-04-26T18:31:54.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9040c8320 0x7fb9041eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb904152180 0x7fb904148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb904158b30 0x7fb9040ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb904152560 con 0x7fb9040c8320 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fb90406ec80 con 0x7fb904158b30 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90c459640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fb9040ca250 con 0x7fb904152180 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90a1f5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9040c8320 0x7fb9041eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90a1f5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9040c8320 0x7fb9041eff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51212/0 (socket says 172.21.15.139:51212) 2024-04-26T18:31:54.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.501+0000 7fb90a1f5640 1 -- 172.21.15.139:0/4119714420 learned_addr learned my addr 172.21.15.139:0/4119714420 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:54.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb9099f4640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb904152180 0x7fb904148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a9f6640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb904158b30 0x7fb9040ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a1f5640 1 -- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb904152180 msgr2=0x7fb904148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a1f5640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb904152180 0x7fb904148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a1f5640 1 -- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb904158b30 msgr2=0x7fb9040ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a1f5640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb904158b30 0x7fb9040ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a1f5640 1 -- 172.21.15.139:0/4119714420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90414c600 con 0x7fb9040c8320 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb9099f4640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb904152180 0x7fb904148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a9f6640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb904158b30 0x7fb9040ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90a1f5640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9040c8320 0x7fb9041eff90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000c00 tx=0x7fb8f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb8f6ffd640 1 -- 172.21.15.139:0/4119714420 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8041020 con 0x7fb9040c8320 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb8f6ffd640 1 -- 172.21.15.139:0/4119714420 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f8030970 con 0x7fb9040c8320 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90414c320 con 0x7fb9040c8320 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb8f6ffd640 1 -- 172.21.15.139:0/4119714420 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8037040 con 0x7fb9040c8320 2024-04-26T18:31:54.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.502+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9041f2e60 con 0x7fb9040c8320 2024-04-26T18:31:54.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.503+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb904076d20 con 0x7fb9040c8320 2024-04-26T18:31:54.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.503+0000 7fb8f6ffd640 1 -- 172.21.15.139:0/4119714420 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8f8044020 con 0x7fb9040c8320 2024-04-26T18:31:54.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.504+0000 7fb8f6ffd640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb8e806c8f0 0x7fb8e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.504+0000 7fb8f6ffd640 1 -- 172.21.15.139:0/4119714420 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fb8f80ac8f0 con 0x7fb9040c8320 2024-04-26T18:31:54.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.504+0000 7fb9099f4640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb8e806c8f0 0x7fb8e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.504+0000 7fb9099f4640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb8e806c8f0 0x7fb8e806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb900007fd0 tx=0x7fb900007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.508+0000 7fb8f6ffd640 1 -- 172.21.15.139:0/4119714420 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8f804b030 con 0x7fb9040c8320 2024-04-26T18:31:54.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.682+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb904070710 con 0x7fb8e806c8f0 2024-04-26T18:31:54.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.683+0000 7fb8f6ffd640 1 -- 172.21.15.139:0/4119714420 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb904070710 con 0x7fb8e806c8f0 2024-04-26T18:31:54.684 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T18:31:54.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb8e806c8f0 msgr2=0x7fb8e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb8e806c8f0 0x7fb8e806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb900007fd0 tx=0x7fb900007dc0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9040c8320 msgr2=0x7fb9041eff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9040c8320 0x7fb9041eff90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000c00 tx=0x7fb8f80046c0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 shutdown_connections 2024-04-26T18:31:54.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fb8e806c8f0 0x7fb8e806edb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb904158b30 0x7fb9040ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fb904152180 0x7fb904148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 --2- 172.21.15.139:0/4119714420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb9040c8320 0x7fb9041eff90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 >> 172.21.15.139:0/4119714420 conn(0x7fb9040686c0 msgr2=0x7fb90414cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:54.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 shutdown_connections 2024-04-26T18:31:54.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.685+0000 7fb90c459640 1 -- 172.21.15.139:0/4119714420 wait complete. 2024-04-26T18:31:54.696 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T18:31:54.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:54.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.805+0000 7f53a3a72640 1 Processor -- start 2024-04-26T18:31:54.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.805+0000 7f53a3a72640 1 -- start start 2024-04-26T18:31:54.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.806+0000 7f53a3a72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c0cb000 0x7f539c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.806+0000 7f53a3a72640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f539c0c9c50 con 0x7f539c15cf60 2024-04-26T18:31:54.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.806+0000 7f53a3a72640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f539c0ca1d0 con 0x7f539c070870 2024-04-26T18:31:54.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.806+0000 7f53a3a72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f539c0c9ef0 con 0x7f539c0cb000 2024-04-26T18:31:54.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.806+0000 7f53a200f640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f539c15cf60 0x7f539c1642f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53328/0 (socket says 172.21.15.139:53328) 2024-04-26T18:31:54.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.806+0000 7f53a200f640 1 -- 172.21.15.139:0/3453297423 learned_addr learned my addr 172.21.15.139:0/3453297423 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:54.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.806+0000 7f53a100d640 1 --2- 172.21.15.139:0/3453297423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c0cb000 0x7f539c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.807+0000 7f53a080c640 1 -- 172.21.15.139:0/3453297423 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3325350379 0 0) 0x7f539c0c9c50 con 0x7f539c15cf60 2024-04-26T18:31:54.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.807+0000 7f53a080c640 1 -- 172.21.15.139:0/3453297423 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5388003520 con 0x7f539c15cf60 2024-04-26T18:31:54.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.807+0000 7f53a080c640 1 -- 172.21.15.139:0/3453297423 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975382771 0 0) 0x7f539c0ca1d0 con 0x7f539c070870 2024-04-26T18:31:54.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.807+0000 7f53a080c640 1 -- 172.21.15.139:0/3453297423 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f539c0c9c50 con 0x7f539c070870 2024-04-26T18:31:54.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.807+0000 7f53a100d640 1 -- 172.21.15.139:0/3453297423 >> v1:172.21.15.143:6789/0 conn(0x7f539c070870 legacy=0x7f539c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.807+0000 7f53a100d640 1 -- 172.21.15.139:0/3453297423 >> v1:172.21.15.139:6789/0 conn(0x7f539c15cf60 legacy=0x7f539c1642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.807+0000 7f53a100d640 1 -- 172.21.15.139:0/3453297423 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c0cb550 con 0x7f539c0cb000 2024-04-26T18:31:54.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a100d640 1 --2- 172.21.15.139:0/3453297423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c0cb000 0x7f539c070c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f538c009800 tx=0x7f538c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1e857f73259526 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a080c640 1 -- 172.21.15.139:0/3453297423 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c037070 con 0x7f539c0cb000 2024-04-26T18:31:54.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a080c640 1 -- 172.21.15.139:0/3453297423 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c032440 con 0x7f539c0cb000 2024-04-26T18:31:54.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a080c640 1 -- 172.21.15.139:0/3453297423 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c0327f0 con 0x7f539c0cb000 2024-04-26T18:31:54.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a3a72640 1 -- 172.21.15.139:0/3453297423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c0cb000 msgr2=0x7f539c070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a3a72640 1 --2- 172.21.15.139:0/3453297423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c0cb000 0x7f539c070c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f538c009800 tx=0x7f538c02a230 comp rx=0 tx=0).stop 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a3a72640 1 -- 172.21.15.139:0/3453297423 shutdown_connections 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a3a72640 1 --2- 172.21.15.139:0/3453297423 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c0cb000 0x7f539c070c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a3a72640 1 -- 172.21.15.139:0/3453297423 >> 172.21.15.139:0/3453297423 conn(0x7f539c076730 msgr2=0x7f539c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a3a72640 1 -- 172.21.15.139:0/3453297423 shutdown_connections 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.808+0000 7f53a3a72640 1 -- 172.21.15.139:0/3453297423 wait complete. 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.809+0000 7f53a3a72640 1 Processor -- start 2024-04-26T18:31:54.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.809+0000 7f53a3a72640 1 -- start start 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a3a72640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c070870 0x7f539c0ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a3a72640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f539c0cb000 0x7f539c1f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a3a72640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c15cf60 0x7f539c1e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a3a72640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1540f0 con 0x7f539c15cf60 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a3a72640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f539c153f70 con 0x7f539c0cb000 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a3a72640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f539c071590 con 0x7f539c070870 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a200f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c15cf60 0x7f539c1e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.816 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a100d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f539c0cb000 0x7f539c1f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a200f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c15cf60 0x7f539c1e60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51222/0 (socket says 172.21.15.139:51222) 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a200f640 1 -- 172.21.15.139:0/1615198176 learned_addr learned my addr 172.21.15.139:0/1615198176 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.810+0000 7f53a180e640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c070870 0x7f539c0ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a100d640 1 -- 172.21.15.139:0/1615198176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c070870 msgr2=0x7f539c0ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a100d640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f539c070870 0x7f539c0ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a100d640 1 -- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c15cf60 msgr2=0x7f539c1e60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a100d640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c15cf60 0x7f539c1e60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a100d640 1 -- 172.21.15.139:0/1615198176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c0c7d20 con 0x7f539c0cb000 2024-04-26T18:31:54.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a200f640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c15cf60 0x7f539c1e60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:54.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a100d640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f539c0cb000 0x7f539c1f32c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f538c031000 tx=0x7f538c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c041020 con 0x7f539c0cb000 2024-04-26T18:31:54.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c03d620 con 0x7f539c0cb000 2024-04-26T18:31:54.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c037040 con 0x7f539c0cb000 2024-04-26T18:31:54.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539c14c200 con 0x7f539c0cb000 2024-04-26T18:31:54.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.811+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539c14ab80 con 0x7f539c0cb000 2024-04-26T18:31:54.818 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.812+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f539c069ae0 con 0x7f539c0cb000 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.812+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f538c044020 con 0x7f539c0cb000 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53927fc640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538006c8f0 0x7f538006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f538c0ac780 con 0x7f539c0cb000 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53a180e640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538006c8f0 0x7f538006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53927fc640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7f5380076380 0x7f5380078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 --> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f538c0067f0 con 0x7f5380076380 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f538c0acb30 con 0x7f539c0cb000 2024-04-26T18:31:54.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53a200f640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7f5380076380 0x7f5380078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53a180e640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538006c8f0 0x7f538006edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5398001ea0 tx=0x7f5398009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.813+0000 7f53a200f640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7f5380076380 0x7f5380078820 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.814+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== osd.1 v2:172.21.15.139:6824/1977806301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f538c0067f0 con 0x7f5380076380 2024-04-26T18:31:54.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.827+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 --> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f539c1f2b90 con 0x7f5380076380 2024-04-26T18:31:54.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.827+0000 7f53927fc640 1 -- 172.21.15.139:0/1615198176 <== osd.1 v2:172.21.15.139:6824/1977806301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f539c1f2b90 con 0x7f5380076380 2024-04-26T18:31:54.828 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:54.828 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:54.828 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:54.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.827+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7f5380076380 msgr2=0x7f5380078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6824/1977806301,v1:172.21.15.139:6825/1977806301] conn(0x7f5380076380 0x7f5380078820 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538006c8f0 msgr2=0x7f538006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f538006c8f0 0x7f538006edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5398001ea0 tx=0x7f5398009040 comp rx=0 tx=0).stop 2024-04-26T18:31:54.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f539c0cb000 msgr2=0x7f539c1f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 --2- 172.21.15.139:0/1615198176 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f539c0cb000 0x7f539c1f32c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f538c031000 tx=0x7f538c0046c0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a200f640 1 -- 172.21.15.139:0/1615198176 reap_dead start 2024-04-26T18:31:54.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 shutdown_connections 2024-04-26T18:31:54.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 >> 172.21.15.139:0/1615198176 conn(0x7f539c076730 msgr2=0x7f539c070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:54.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 shutdown_connections 2024-04-26T18:31:54.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.828+0000 7f53a3a72640 1 -- 172.21.15.139:0/1615198176 wait complete. 2024-04-26T18:31:54.839 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T18:31:54.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.935+0000 7f6ff07c6640 1 Processor -- start 2024-04-26T18:31:54.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.936+0000 7f6ff07c6640 1 -- start start 2024-04-26T18:31:54.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.936+0000 7f6ff07c6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6fe815f010 0x7f6fe80cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.936+0000 7f6ff07c6640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe80ccc60 con 0x7f6fe80cbac0 2024-04-26T18:31:54.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.936+0000 7f6ff07c6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe815f7a0 con 0x7f6fe8155cf0 2024-04-26T18:31:54.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.936+0000 7f6ff07c6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe806c310 con 0x7f6fe815f010 2024-04-26T18:31:54.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6feed63640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6fe80cbac0 0x7f6fe8071d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53342/0 (socket says 172.21.15.139:53342) 2024-04-26T18:31:54.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6feed63640 1 -- 172.21.15.139:0/3623697578 learned_addr learned my addr 172.21.15.139:0/3623697578 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:54.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6fedd61640 1 --2- 172.21.15.139:0/3623697578 >> v2:172.21.15.143:3300/0 conn(0x7f6fe815f010 0x7f6fe80cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6fed560640 1 -- 172.21.15.139:0/3623697578 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622171847 0 0) 0x7f6fe80ccc60 con 0x7f6fe80cbac0 2024-04-26T18:31:54.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6fed560640 1 -- 172.21.15.139:0/3623697578 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd4003520 con 0x7f6fe80cbac0 2024-04-26T18:31:54.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6fedd61640 1 -- 172.21.15.139:0/3623697578 >> v1:172.21.15.143:6789/0 conn(0x7f6fe8155cf0 legacy=0x7f6fe815c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6fedd61640 1 -- 172.21.15.139:0/3623697578 >> v1:172.21.15.139:6789/0 conn(0x7f6fe80cbac0 legacy=0x7f6fe8071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.937+0000 7f6fedd61640 1 -- 172.21.15.139:0/3623697578 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe815fa80 con 0x7f6fe815f010 2024-04-26T18:31:54.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6fedd61640 1 --2- 172.21.15.139:0/3623697578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe815f010 0x7f6fe80cb580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40097a0 tx=0x7f6fe402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b200da85e41dbbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6fed560640 1 -- 172.21.15.139:0/3623697578 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4037070 con 0x7f6fe815f010 2024-04-26T18:31:54.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6fed560640 1 -- 172.21.15.139:0/3623697578 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe4032640 con 0x7f6fe815f010 2024-04-26T18:31:54.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6fed560640 1 -- 172.21.15.139:0/3623697578 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40329f0 con 0x7f6fe815f010 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6ff07c6640 1 -- 172.21.15.139:0/3623697578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe815f010 msgr2=0x7f6fe80cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/3623697578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe815f010 0x7f6fe80cb580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40097a0 tx=0x7f6fe402a2c0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6ff07c6640 1 -- 172.21.15.139:0/3623697578 shutdown_connections 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/3623697578 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe815f010 0x7f6fe80cb580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6ff07c6640 1 -- 172.21.15.139:0/3623697578 >> 172.21.15.139:0/3623697578 conn(0x7f6fe806ffc0 msgr2=0x7f6fe80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6ff07c6640 1 -- 172.21.15.139:0/3623697578 shutdown_connections 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.938+0000 7f6ff07c6640 1 -- 172.21.15.139:0/3623697578 wait complete. 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 Processor -- start 2024-04-26T18:31:54.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 -- start start 2024-04-26T18:31:54.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe80cbac0 0x7f6fe80ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe8155cf0 0x7f6fe81f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fe815f010 0x7f6fe814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe80cb060 con 0x7f6fe8155cf0 2024-04-26T18:31:54.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe80cad80 con 0x7f6fe80cbac0 2024-04-26T18:31:54.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6ff07c6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe81560d0 con 0x7f6fe815f010 2024-04-26T18:31:54.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6fedd61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe8155cf0 0x7f6fe81f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6fedd61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe8155cf0 0x7f6fe81f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51232/0 (socket says 172.21.15.139:51232) 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6fedd61640 1 -- 172.21.15.139:0/1348559001 learned_addr learned my addr 172.21.15.139:0/1348559001 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6fee562640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe80cbac0 0x7f6fe80ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.940+0000 7f6feed63640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fe815f010 0x7f6fe814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fedd61640 1 -- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fe815f010 msgr2=0x7f6fe814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fedd61640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fe815f010 0x7f6fe814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fedd61640 1 -- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe80cbac0 msgr2=0x7f6fe80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:54.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fedd61640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe80cbac0 0x7f6fe80ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fedd61640 1 -- 172.21.15.139:0/1348559001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe815cff0 con 0x7f6fe8155cf0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fedd61640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe8155cf0 0x7f6fe81f4770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40097a0 tx=0x7f6fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fdaffd640 1 -- 172.21.15.139:0/1348559001 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4037050 con 0x7f6fe8155cf0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fdaffd640 1 -- 172.21.15.139:0/1348559001 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe4038040 con 0x7f6fe8155cf0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe80b0700 con 0x7f6fe8155cf0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6fdaffd640 1 -- 172.21.15.139:0/1348559001 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4004250 con 0x7f6fe8155cf0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.941+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe80b09a0 con 0x7f6fe8155cf0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.942+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe8076d20 con 0x7f6fe8155cf0 2024-04-26T18:31:54.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.942+0000 7f6fdaffd640 1 -- 172.21.15.139:0/1348559001 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fe4030900 con 0x7f6fe8155cf0 2024-04-26T18:31:54.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.943+0000 7f6fdaffd640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fcc06c8f0 0x7f6fcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:54.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.943+0000 7f6fee562640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fcc06c8f0 0x7f6fcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:54.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.943+0000 7f6fdaffd640 1 -- 172.21.15.139:0/1348559001 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f6fe40ac920 con 0x7f6fe8155cf0 2024-04-26T18:31:54.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.943+0000 7f6fee562640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fcc06c8f0 0x7f6fcc06edb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc001780 tx=0x7f6fdc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:54.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:54.947+0000 7f6fdaffd640 1 -- 172.21.15.139:0/1348559001 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6fe407a360 con 0x7f6fe8155cf0 2024-04-26T18:31:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.122+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6fe8153ac0 con 0x7f6fcc06c8f0 2024-04-26T18:31:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.122+0000 7f6fdaffd640 1 -- 172.21.15.139:0/1348559001 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6fe8153ac0 con 0x7f6fcc06c8f0 2024-04-26T18:31:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T18:31:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fcc06c8f0 msgr2=0x7f6fcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fcc06c8f0 0x7f6fcc06edb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc001780 tx=0x7f6fdc009040 comp rx=0 tx=0).stop 2024-04-26T18:31:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe8155cf0 msgr2=0x7f6fe81f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe8155cf0 0x7f6fe81f4770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40097a0 tx=0x7f6fe40046c0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 shutdown_connections 2024-04-26T18:31:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6fcc06c8f0 0x7f6fcc06edb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6fe815f010 0x7f6fe814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fe8155cf0 0x7f6fe81f4770 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 --2- 172.21.15.139:0/1348559001 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6fe80cbac0 0x7f6fe80ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 >> 172.21.15.139:0/1348559001 conn(0x7f6fe806ffc0 msgr2=0x7f6fe80703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 shutdown_connections 2024-04-26T18:31:55.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.125+0000 7f6ff07c6640 1 -- 172.21.15.139:0/1348559001 wait complete. 2024-04-26T18:31:55.136 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T18:31:55.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:55.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.237+0000 7fa864746640 1 Processor -- start 2024-04-26T18:31:55.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.237+0000 7fa864746640 1 -- start start 2024-04-26T18:31:55.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.238+0000 7fa864746640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa85c15f970 0x7fa85c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.238+0000 7fa864746640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85c15baf0 con 0x7fa85c0737e0 2024-04-26T18:31:55.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.238+0000 7fa864746640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85c15bdd0 con 0x7fa85c155ea0 2024-04-26T18:31:55.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.238+0000 7fa864746640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7fa85c15c950 con 0x7fa85c15f970 2024-04-26T18:31:55.239 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.238+0000 7fa861ce1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7fa85c15f970 0x7fa85c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.238+0000 7fa862ce3640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fa85c0737e0 0x7fa85c15d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53350/0 (socket says 172.21.15.139:53350) 2024-04-26T18:31:55.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.238+0000 7fa862ce3640 1 -- 172.21.15.139:0/3089853965 learned_addr learned my addr 172.21.15.139:0/3089853965 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:55.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa861ce1640 1 -- 172.21.15.139:0/3089853965 >> v1:172.21.15.143:6789/0 conn(0x7fa85c155ea0 legacy=0x7fa85c0c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa861ce1640 1 -- 172.21.15.139:0/3089853965 >> v1:172.21.15.139:6789/0 conn(0x7fa85c0737e0 legacy=0x7fa85c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa8614e0640 1 -- 172.21.15.139:0/3089853965 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525327524 0 0) 0x7fa85c15baf0 con 0x7fa85c0737e0 2024-04-26T18:31:55.240 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa861ce1640 1 -- 172.21.15.139:0/3089853965 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c15c0b0 con 0x7fa85c15f970 2024-04-26T18:31:55.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa861ce1640 1 --2- 172.21.15.139:0/3089853965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c15f970 0x7fa85c0732a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa8500097a0 tx=0x7fa85002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca69001e3d6f535 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa8614e0640 1 -- 172.21.15.139:0/3089853965 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850037070 con 0x7fa85c15f970 2024-04-26T18:31:55.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa8614e0640 1 -- 172.21.15.139:0/3089853965 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850032440 con 0x7fa85c15f970 2024-04-26T18:31:55.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.239+0000 7fa8614e0640 1 -- 172.21.15.139:0/3089853965 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850032810 con 0x7fa85c15f970 2024-04-26T18:31:55.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.240+0000 7fa864746640 1 -- 172.21.15.139:0/3089853965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c15f970 msgr2=0x7fa85c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.240+0000 7fa864746640 1 --2- 172.21.15.139:0/3089853965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c15f970 0x7fa85c0732a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fa8500097a0 tx=0x7fa85002a230 comp rx=0 tx=0).stop 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.240+0000 7fa864746640 1 -- 172.21.15.139:0/3089853965 shutdown_connections 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.240+0000 7fa864746640 1 --2- 172.21.15.139:0/3089853965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c15f970 0x7fa85c0732a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.240+0000 7fa864746640 1 -- 172.21.15.139:0/3089853965 >> 172.21.15.139:0/3089853965 conn(0x7fa85c070500 msgr2=0x7fa85c0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.240+0000 7fa864746640 1 -- 172.21.15.139:0/3089853965 shutdown_connections 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.240+0000 7fa864746640 1 -- 172.21.15.139:0/3089853965 wait complete. 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.241+0000 7fa864746640 1 Processor -- start 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.241+0000 7fa864746640 1 -- start start 2024-04-26T18:31:55.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa864746640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c0737e0 0x7fa85c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa864746640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa85c155ea0 0x7fa85c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa864746640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa85c15f970 0x7fa85c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa864746640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c15fde0 con 0x7fa85c0737e0 2024-04-26T18:31:55.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa864746640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c15c670 con 0x7fa85c15f970 2024-04-26T18:31:55.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa864746640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c15d930 con 0x7fa85c155ea0 2024-04-26T18:31:55.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c0737e0 0x7fa85c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c0737e0 0x7fa85c1510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51248/0 (socket says 172.21.15.139:51248) 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 -- 172.21.15.139:0/3585740991 learned_addr learned my addr 172.21.15.139:0/3585740991 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa862ce3640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa85c15f970 0x7fa85c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa861ce1640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa85c155ea0 0x7fa85c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 -- 172.21.15.139:0/3585740991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa85c155ea0 msgr2=0x7fa85c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa85c155ea0 0x7fa85c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 -- 172.21.15.139:0/3585740991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa85c15f970 msgr2=0x7fa85c15a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa85c15f970 0x7fa85c15a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 -- 172.21.15.139:0/3585740991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c1f5770 con 0x7fa85c0737e0 2024-04-26T18:31:55.247 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa861ce1640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fa85c155ea0 0x7fa85c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:31:55.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.242+0000 7fa8624e2640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c0737e0 0x7fa85c1510c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00c870 tx=0x7fa84c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.243+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c003b70 con 0x7fa85c0737e0 2024-04-26T18:31:55.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.243+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84c003d30 con 0x7fa85c0737e0 2024-04-26T18:31:55.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.243+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85c1f5a30 con 0x7fa85c0737e0 2024-04-26T18:31:55.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.243+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00aa90 con 0x7fa85c0737e0 2024-04-26T18:31:55.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.243+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85c1e8b00 con 0x7fa85c0737e0 2024-04-26T18:31:55.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.243+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa85c1e8d40 con 0x7fa85c0737e0 2024-04-26T18:31:55.249 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.244+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa84c00ac30 con 0x7fa85c0737e0 2024-04-26T18:31:55.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.244+0000 7fa85affd640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa84806c8f0 0x7fa84806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.244+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fa84c08be80 con 0x7fa85c0737e0 2024-04-26T18:31:55.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.244+0000 7fa861ce1640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa84806c8f0 0x7fa84806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.244+0000 7fa85affd640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fa848076400 0x7fa8480788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.245+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 --> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa84c00de50 con 0x7fa848076400 2024-04-26T18:31:55.250 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.245+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa84c08e580 con 0x7fa85c0737e0 2024-04-26T18:31:55.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.245+0000 7fa862ce3640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fa848076400 0x7fa8480788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.245+0000 7fa861ce1640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa84806c8f0 0x7fa84806edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa850034000 tx=0x7fa85002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.245+0000 7fa862ce3640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fa848076400 0x7fa8480788a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.251 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.246+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== osd.2 v2:172.21.15.139:6808/522876570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa84c00de50 con 0x7fa848076400 2024-04-26T18:31:55.258 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.258+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 --> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa85c076d20 con 0x7fa848076400 2024-04-26T18:31:55.259 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa85affd640 1 -- 172.21.15.139:0/3585740991 <== osd.2 v2:172.21.15.139:6808/522876570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa85c076d20 con 0x7fa848076400 2024-04-26T18:31:55.259 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:55.259 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:55.259 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:55.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fa848076400 msgr2=0x7fa8480788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6808/522876570,v1:172.21.15.139:6809/522876570] conn(0x7fa848076400 0x7fa8480788a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa84806c8f0 msgr2=0x7fa84806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fa84806c8f0 0x7fa84806edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa850034000 tx=0x7fa85002e000 comp rx=0 tx=0).stop 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c0737e0 msgr2=0x7fa85c1510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 --2- 172.21.15.139:0/3585740991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa85c0737e0 0x7fa85c1510c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00c870 tx=0x7fa84c00cd30 comp rx=0 tx=0).stop 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa862ce3640 1 -- 172.21.15.139:0/3585740991 reap_dead start 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 shutdown_connections 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 >> 172.21.15.139:0/3585740991 conn(0x7fa85c070500 msgr2=0x7fa85c0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 shutdown_connections 2024-04-26T18:31:55.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.259+0000 7fa864746640 1 -- 172.21.15.139:0/3585740991 wait complete. 2024-04-26T18:31:55.270 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T18:31:55.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.369+0000 7f9ba8847640 1 Processor -- start 2024-04-26T18:31:55.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.369+0000 7f9ba8847640 1 -- start start 2024-04-26T18:31:55.375 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.369+0000 7f9ba8847640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba4153c90 0x7f9ba40c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.369+0000 7f9ba8847640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9ba415a440 0x7f9ba40cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9ba8847640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba406fa50 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9ba8847640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f9ba40c48b0 con 0x7f9ba415a440 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9ba8847640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40cb7b0 con 0x7f9ba4153c90 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9b9bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9ba415a440 0x7f9ba40cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9b9bfff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f9ba415a440 0x7f9ba40cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51262/0 (socket says 172.21.15.139:51262) 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9b9bfff640 1 -- 172.21.15.139:0/3054740841 learned_addr learned my addr 172.21.15.139:0/3054740841 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:55.376 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9ba259c640 1 --2- 172.21.15.139:0/3054740841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba4153c90 0x7f9ba40c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9b9bfff640 1 -- 172.21.15.139:0/3054740841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba4153c90 msgr2=0x7f9ba40c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:55.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9b9bfff640 1 --2- 172.21.15.139:0/3054740841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba4153c90 0x7f9ba40c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9b9bfff640 1 -- 172.21.15.139:0/3054740841 >> v1:172.21.15.143:6789/0 conn(0x7f9ba40cb3a0 legacy=0x7f9ba40c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9b9bfff640 1 -- 172.21.15.139:0/3054740841 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba406fd30 con 0x7f9ba415a440 2024-04-26T18:31:55.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.370+0000 7f9ba1d9b640 1 -- 172.21.15.139:0/3054740841 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427631501 0 0) 0x7f9ba406fa50 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9b9bfff640 1 --2- 172.21.15.139:0/3054740841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba415a440 0x7f9ba40cae60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009870 tx=0x7f9b8c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67906b1ed6c71f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba1d9b640 1 -- 172.21.15.139:0/3054740841 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c037070 con 0x7f9ba415a440 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba1d9b640 1 -- 172.21.15.139:0/3054740841 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c032440 con 0x7f9ba415a440 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba1d9b640 1 -- 172.21.15.139:0/3054740841 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c032810 con 0x7f9ba415a440 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 -- 172.21.15.139:0/3054740841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba415a440 msgr2=0x7f9ba40cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 --2- 172.21.15.139:0/3054740841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba415a440 0x7f9ba40cae60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009870 tx=0x7f9b8c02a1c0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 -- 172.21.15.139:0/3054740841 shutdown_connections 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 --2- 172.21.15.139:0/3054740841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba415a440 0x7f9ba40cae60 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 --2- 172.21.15.139:0/3054740841 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba4153c90 0x7f9ba40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 -- 172.21.15.139:0/3054740841 >> 172.21.15.139:0/3054740841 conn(0x7f9ba4071d70 msgr2=0x7f9ba4072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 -- 172.21.15.139:0/3054740841 shutdown_connections 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.371+0000 7f9ba8847640 1 -- 172.21.15.139:0/3054740841 wait complete. 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 Processor -- start 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 -- start start 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba40cb3a0 0x7f9ba4152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ba4153c90 0x7f9ba4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba415a440 0x7f9ba41f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40705d0 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba40702f0 con 0x7f9ba4153c90 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba8847640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba40ccca0 con 0x7f9ba415a440 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba40cb3a0 0x7f9ba4152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba259c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba40cb3a0 0x7f9ba4152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51278/0 (socket says 172.21.15.139:51278) 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba259c640 1 -- 172.21.15.139:0/208079393 learned_addr learned my addr 172.21.15.139:0/208079393 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9b9bfff640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ba4153c90 0x7f9ba4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.373+0000 7f9ba2d9d640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba415a440 0x7f9ba41f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba259c640 1 -- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba415a440 msgr2=0x7f9ba41f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba259c640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba415a440 0x7f9ba41f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba259c640 1 -- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ba4153c90 msgr2=0x7f9ba4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba259c640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ba4153c90 0x7f9ba4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba259c640 1 -- 172.21.15.139:0/208079393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba41528f0 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba259c640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba40cb3a0 0x7f9ba4152040 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400e8a0 tx=0x7f9b9400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9b9affd640 1 -- 172.21.15.139:0/208079393 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94017070 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9b9affd640 1 -- 172.21.15.139:0/208079393 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9400c940 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba41567a0 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9b9affd640 1 -- 172.21.15.139:0/208079393 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400cd30 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.374+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba4156d60 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.375+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba4076d20 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.375+0000 7f9b9affd640 1 -- 172.21.15.139:0/208079393 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b9401a070 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.376+0000 7f9b9affd640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9b8406c8f0 0x7f9b8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.376+0000 7f9b9bfff640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9b8406c8f0 0x7f9b8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.376+0000 7f9b9affd640 1 -- 172.21.15.139:0/208079393 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f9b9408c110 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.376+0000 7f9b9bfff640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9b8406c8f0 0x7f9b8406edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c034000 tx=0x7f9b8c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.380+0000 7f9b9affd640 1 -- 172.21.15.139:0/208079393 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b94059ab0 con 0x7f9ba40cb3a0 2024-04-26T18:31:55.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.558+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9ba40ca3a0 con 0x7f9b8406c8f0 2024-04-26T18:31:55.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.558+0000 7f9b9affd640 1 -- 172.21.15.139:0/208079393 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9ba40ca3a0 con 0x7f9b8406c8f0 2024-04-26T18:31:55.559 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T18:31:55.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9b8406c8f0 msgr2=0x7f9b8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9b8406c8f0 0x7f9b8406edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c034000 tx=0x7f9b8c02e000 comp rx=0 tx=0).stop 2024-04-26T18:31:55.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba40cb3a0 msgr2=0x7f9ba4152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba40cb3a0 0x7f9ba4152040 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400e8a0 tx=0x7f9b9400ed60 comp rx=0 tx=0).stop 2024-04-26T18:31:55.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 shutdown_connections 2024-04-26T18:31:55.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f9b8406c8f0 0x7f9b8406edb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f9ba415a440 0x7f9ba41f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9ba4153c90 0x7f9ba4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 --2- 172.21.15.139:0/208079393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba40cb3a0 0x7f9ba4152040 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 >> 172.21.15.139:0/208079393 conn(0x7f9ba4071d70 msgr2=0x7f9ba41e5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 shutdown_connections 2024-04-26T18:31:55.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.560+0000 7f9ba8847640 1 -- 172.21.15.139:0/208079393 wait complete. 2024-04-26T18:31:55.572 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T18:31:55.572 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:55.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.681+0000 7f2d3e740640 1 Processor -- start 2024-04-26T18:31:55.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.681+0000 7f2d3e740640 1 -- start start 2024-04-26T18:31:55.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.682+0000 7f2d3e740640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d38155f30 0x7f2d3815c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.682+0000 7f2d3e740640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2d380cc210 0x7f2d380d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.682+0000 7f2d3e740640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2d380cd830 0x7f2d380d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.682+0000 7f2d3e740640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3815fe70 con 0x7f2d380cd830 2024-04-26T18:31:55.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.682+0000 7f2d3e740640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3815f2d0 con 0x7f2d380cc210 2024-04-26T18:31:55.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.682+0000 7f2d3e740640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3815cc00 con 0x7f2d38155f30 2024-04-26T18:31:55.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d377fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2d380cc210 0x7f2d380d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d38155f30 0x7f2d3815c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d3ccdd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2d380cd830 0x7f2d380d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d38155f30 0x7f2d3815c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:53498/0 (socket says 172.21.15.139:53498) 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d377fe640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2d380cc210 0x7f2d380d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:54008/0 (socket says 172.21.15.139:54008) 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 -- 172.21.15.139:0/2438003353 learned_addr learned my addr 172.21.15.139:0/2438003353 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 -- 172.21.15.139:0/2438003353 >> v2:172.21.15.143:3300/0 conn(0x7f2d380cc210 msgr2=0x7f2d380d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 --2- 172.21.15.139:0/2438003353 >> v2:172.21.15.143:3300/0 conn(0x7f2d380cc210 0x7f2d380d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 -- 172.21.15.139:0/2438003353 >> v2:172.21.15.139:3300/0 conn(0x7f2d380cd830 msgr2=0x7f2d380d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 --2- 172.21.15.139:0/2438003353 >> v2:172.21.15.139:3300/0 conn(0x7f2d380cd830 0x7f2d380d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d37fff640 1 -- 172.21.15.139:0/2438003353 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3815f540 con 0x7f2d38155f30 2024-04-26T18:31:55.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.683+0000 7f2d3ccdd640 1 --2- 172.21.15.139:0/2438003353 >> v2:172.21.15.139:3300/0 conn(0x7f2d380cd830 0x7f2d380d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:55.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.684+0000 7f2d37fff640 1 --2- 172.21.15.139:0/2438003353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d38155f30 0x7f2d3815c6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d380739f0 tx=0x7f2d2802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc39e7834a3d884 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.684+0000 7f2d36ffd640 1 -- 172.21.15.139:0/2438003353 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28037070 con 0x7f2d38155f30 2024-04-26T18:31:55.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.684+0000 7f2d36ffd640 1 -- 172.21.15.139:0/2438003353 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d28032440 con 0x7f2d38155f30 2024-04-26T18:31:55.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.684+0000 7f2d36ffd640 1 -- 172.21.15.139:0/2438003353 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28032810 con 0x7f2d38155f30 2024-04-26T18:31:55.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 -- 172.21.15.139:0/2438003353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d38155f30 msgr2=0x7f2d3815c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 --2- 172.21.15.139:0/2438003353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d38155f30 0x7f2d3815c6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d380739f0 tx=0x7f2d2802a1e0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 -- 172.21.15.139:0/2438003353 shutdown_connections 2024-04-26T18:31:55.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 --2- 172.21.15.139:0/2438003353 >> v2:172.21.15.139:3300/0 conn(0x7f2d380cd830 0x7f2d380d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 --2- 172.21.15.139:0/2438003353 >> v2:172.21.15.143:3300/0 conn(0x7f2d380cc210 0x7f2d380d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 --2- 172.21.15.139:0/2438003353 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d38155f30 0x7f2d3815c6c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 -- 172.21.15.139:0/2438003353 >> 172.21.15.139:0/2438003353 conn(0x7f2d38068090 msgr2=0x7f2d380684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 -- 172.21.15.139:0/2438003353 shutdown_connections 2024-04-26T18:31:55.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.685+0000 7f2d3e740640 1 -- 172.21.15.139:0/2438003353 wait complete. 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.686+0000 7f2d3e740640 1 Processor -- start 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.686+0000 7f2d3e740640 1 -- start start 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3e740640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380cc210 0x7f2d38151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3e740640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d380cd830 0x7f2d38152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3e740640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d38155f30 0x7f2d38153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3e740640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38156310 con 0x7f2d38155f30 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3e740640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3815fb00 con 0x7f2d380cc210 2024-04-26T18:31:55.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3e740640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2d380cc730 con 0x7f2d380cd830 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3ccdd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d38155f30 0x7f2d38153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380cc210 0x7f2d38151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3ccdd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d38155f30 0x7f2d38153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51298/0 (socket says 172.21.15.139:51298) 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3ccdd640 1 -- 172.21.15.139:0/1598753873 learned_addr learned my addr 172.21.15.139:0/1598753873 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d377fe640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d380cd830 0x7f2d38152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3ccdd640 1 -- 172.21.15.139:0/1598753873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d380cd830 msgr2=0x7f2d38152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3ccdd640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2d380cd830 0x7f2d38152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.687+0000 7f2d3ccdd640 1 -- 172.21.15.139:0/1598753873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380cc210 msgr2=0x7f2d38151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d3ccdd640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380cc210 0x7f2d38151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d3ccdd640 1 -- 172.21.15.139:0/1598753873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3815abe0 con 0x7f2d38155f30 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d37fff640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2d380cc210 0x7f2d38151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d3ccdd640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d38155f30 0x7f2d38153050 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009f00 tx=0x7f2d3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30018030 con 0x7f2d38155f30 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3000ce50 con 0x7f2d38155f30 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30003bb0 con 0x7f2d38155f30 2024-04-26T18:31:55.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3815aec0 con 0x7f2d38155f30 2024-04-26T18:31:55.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.688+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d38152310 con 0x7f2d38155f30 2024-04-26T18:31:55.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.689+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d38076d20 con 0x7f2d38155f30 2024-04-26T18:31:55.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.690+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d3001b070 con 0x7f2d38155f30 2024-04-26T18:31:55.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.690+0000 7f2d34ff9640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d2406c920 0x7f2d2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.690+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2d3008c850 con 0x7f2d38155f30 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.690+0000 7f2d37fff640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d2406c920 0x7f2d2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.691+0000 7f2d34ff9640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7f2d24076430 0x7f2d240788d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.691+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 --> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d30009a50 con 0x7f2d24076430 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.691+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2d300912a0 con 0x7f2d38155f30 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.691+0000 7f2d377fe640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7f2d24076430 0x7f2d240788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.691+0000 7f2d37fff640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d2406c920 0x7f2d2406ede0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d28034000 tx=0x7f2d2802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.691+0000 7f2d377fe640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7f2d24076430 0x7f2d240788d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.692+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== osd.3 v2:172.21.15.139:6816/797802605 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d30009a50 con 0x7f2d24076430 2024-04-26T18:31:55.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 --> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2d380cd370 con 0x7f2d24076430 2024-04-26T18:31:55.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d34ff9640 1 -- 172.21.15.139:0/1598753873 <== osd.3 v2:172.21.15.139:6816/797802605 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2d380cd370 con 0x7f2d24076430 2024-04-26T18:31:55.708 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:55.709 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:55.709 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:55.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7f2d24076430 msgr2=0x7f2d240788d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6816/797802605,v1:172.21.15.139:6817/797802605] conn(0x7f2d24076430 0x7f2d240788d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d2406c920 msgr2=0x7f2d2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2d2406c920 0x7f2d2406ede0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d28034000 tx=0x7f2d2802e000 comp rx=0 tx=0).stop 2024-04-26T18:31:55.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d38155f30 msgr2=0x7f2d38153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 --2- 172.21.15.139:0/1598753873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2d38155f30 0x7f2d38153050 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009f00 tx=0x7f2d3000c490 comp rx=0 tx=0).stop 2024-04-26T18:31:55.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3ccdd640 1 -- 172.21.15.139:0/1598753873 reap_dead start 2024-04-26T18:31:55.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 shutdown_connections 2024-04-26T18:31:55.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.708+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 >> 172.21.15.139:0/1598753873 conn(0x7f2d38068090 msgr2=0x7f2d3815d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.709+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 shutdown_connections 2024-04-26T18:31:55.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.709+0000 7f2d3e740640 1 -- 172.21.15.139:0/1598753873 wait complete. 2024-04-26T18:31:55.722 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T18:31:55.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.827+0000 7f5201b24640 1 Processor -- start 2024-04-26T18:31:55.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.828+0000 7f5201b24640 1 -- start start 2024-04-26T18:31:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.828+0000 7f5201b24640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f51fc0c8fd0 0x7f51fc153750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.828+0000 7f5201b24640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc0cb5d0 con 0x7f51fc0c7980 2024-04-26T18:31:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.828+0000 7f5201b24640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc0c8a60 con 0x7f51fc0c75a0 2024-04-26T18:31:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.828+0000 7f5201b24640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f51fc072910 con 0x7f51fc0c8fd0 2024-04-26T18:31:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.828+0000 7f51faffd640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f51fc0c7980 0x7f51fc1598f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53356/0 (socket says 172.21.15.139:53356) 2024-04-26T18:31:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.828+0000 7f51faffd640 1 -- 172.21.15.139:0/4270125828 learned_addr learned my addr 172.21.15.139:0/4270125828 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fbfff640 1 --2- 172.21.15.139:0/4270125828 >> v2:172.21.15.143:3300/0 conn(0x7f51fc0c8fd0 0x7f51fc153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677779317 0 0) 0x7f51fc0cb5d0 con 0x7f51fc0c7980 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e4003520 con 0x7f51fc0c7980 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432311909 0 0) 0x7f51fc0c8a60 con 0x7f51fc0c75a0 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51fc0cb5d0 con 0x7f51fc0c75a0 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fbfff640 1 -- 172.21.15.139:0/4270125828 >> v1:172.21.15.143:6789/0 conn(0x7f51fc0c75a0 legacy=0x7f51fc15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2558769224 0 0) 0x7f51e4003520 con 0x7f51fc0c7980 2024-04-26T18:31:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fbfff640 1 -- 172.21.15.139:0/4270125828 >> v1:172.21.15.139:6789/0 conn(0x7f51fc0c7980 legacy=0x7f51fc1598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.829+0000 7f51fbfff640 1 -- 172.21.15.139:0/4270125828 --> v2:172.21.15.143:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc072b60 con 0x7f51fc0c8fd0 2024-04-26T18:31:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f51fbfff640 1 --2- 172.21.15.139:0/4270125828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 0x7f51fc153750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009d90 tx=0x7f51f402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9410b9f1dbfef960 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0001670 con 0x7f51fc0c8fd0 2024-04-26T18:31:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f4007540 con 0x7f51fc0c8fd0 2024-04-26T18:31:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f51fa7fc640 1 -- 172.21.15.139:0/4270125828 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40078f0 con 0x7f51fc0c8fd0 2024-04-26T18:31:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f5201b24640 1 -- 172.21.15.139:0/4270125828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 msgr2=0x7f51fc153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f5201b24640 1 --2- 172.21.15.139:0/4270125828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 0x7f51fc153750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009d90 tx=0x7f51f402a710 comp rx=0 tx=0).stop 2024-04-26T18:31:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f5201b24640 1 -- 172.21.15.139:0/4270125828 shutdown_connections 2024-04-26T18:31:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f5201b24640 1 --2- 172.21.15.139:0/4270125828 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 0x7f51fc153750 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f5201b24640 1 -- 172.21.15.139:0/4270125828 >> 172.21.15.139:0/4270125828 conn(0x7f51fc06e500 msgr2=0x7f51fc06e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f5201b24640 1 -- 172.21.15.139:0/4270125828 shutdown_connections 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.830+0000 7f5201b24640 1 -- 172.21.15.139:0/4270125828 wait complete. 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 Processor -- start 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 -- start start 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51fc0c75a0 0x7f51fc15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51fc0c7980 0x7f51fc14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 0x7f51fc14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc15a000 con 0x7f51fc0c7980 2024-04-26T18:31:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0cb140 con 0x7f51fc0c8fd0 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.832+0000 7f5201b24640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc0c8620 con 0x7f51fc0c75a0 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51fc0c7980 0x7f51fc14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51fc0c7980 0x7f51fc14c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51300/0 (socket says 172.21.15.139:51300) 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 -- 172.21.15.139:0/4272607448 learned_addr learned my addr 172.21.15.139:0/4272607448 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51fb7fe640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51fc0c75a0 0x7f51fc15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51fbfff640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 0x7f51fc14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 -- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51fc0c75a0 msgr2=0x7f51fc15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51fc0c75a0 0x7f51fc15c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 -- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 msgr2=0x7f51fc14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 0x7f51fc14b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 -- 172.21.15.139:0/4272607448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc156f40 con 0x7f51fc0c7980 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51faffd640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51fc0c7980 0x7f51fc14c050 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f51f000c750 tx=0x7f51f000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51e3fff640 1 -- 172.21.15.139:0/4272607448 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0017070 con 0x7f51fc0c7980 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51e3fff640 1 -- 172.21.15.139:0/4272607448 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f0005ad0 con 0x7f51fc0c7980 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f51e3fff640 1 -- 172.21.15.139:0/4272607448 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0007070 con 0x7f51fc0c7980 2024-04-26T18:31:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc157220 con 0x7f51fc0c7980 2024-04-26T18:31:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.833+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51fc1efc60 con 0x7f51fc0c7980 2024-04-26T18:31:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.834+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51fc076d20 con 0x7f51fc0c7980 2024-04-26T18:31:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.835+0000 7f51e3fff640 1 -- 172.21.15.139:0/4272607448 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51f001a070 con 0x7f51fc0c7980 2024-04-26T18:31:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.835+0000 7f51e3fff640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f51e806c8f0 0x7f51e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.835+0000 7f51fb7fe640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f51e806c8f0 0x7f51e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.835+0000 7f51e3fff640 1 -- 172.21.15.139:0/4272607448 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f51f008b3d0 con 0x7f51fc0c7980 2024-04-26T18:31:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.836+0000 7f51fb7fe640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f51e806c8f0 0x7f51e806edb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0011e0 tx=0x7f51ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:55.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:55.840+0000 7f51e3fff640 1 -- 172.21.15.139:0/4272607448 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51f0058d70 con 0x7f51fc0c7980 2024-04-26T18:31:56.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.033+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f51fc15acc0 con 0x7f51e806c8f0 2024-04-26T18:31:56.034 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.034+0000 7f51e3fff640 1 -- 172.21.15.139:0/4272607448 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f51fc15acc0 con 0x7f51e806c8f0 2024-04-26T18:31:56.034 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T18:31:56.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f51e806c8f0 msgr2=0x7f51e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f51e806c8f0 0x7f51e806edb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0011e0 tx=0x7f51ec009040 comp rx=0 tx=0).stop 2024-04-26T18:31:56.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51fc0c7980 msgr2=0x7f51fc14c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51fc0c7980 0x7f51fc14c050 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f51f000c750 tx=0x7f51f000cc10 comp rx=0 tx=0).stop 2024-04-26T18:31:56.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 shutdown_connections 2024-04-26T18:31:56.037 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f51e806c8f0 0x7f51e806edb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51fc0c8fd0 0x7f51fc14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51fc0c7980 0x7f51fc14c050 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 --2- 172.21.15.139:0/4272607448 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f51fc0c75a0 0x7f51fc15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 >> 172.21.15.139:0/4272607448 conn(0x7f51fc06e500 msgr2=0x7f51fc15b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 shutdown_connections 2024-04-26T18:31:56.038 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.036+0000 7f5201b24640 1 -- 172.21.15.139:0/4272607448 wait complete. 2024-04-26T18:31:56.048 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T18:31:56.048 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:56.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.149+0000 7f0d628e1640 1 Processor -- start 2024-04-26T18:31:56.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.149+0000 7f0d628e1640 1 -- start start 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d628e1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c152b00 0x7f0d5c159330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d628e1640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0d5c073990 0x7f0d5c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d628e1640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f0d5c0c8be0 0x7f0d5c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d628e1640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c159870 con 0x7f0d5c073990 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d628e1640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c158870 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d628e1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0c4830 con 0x7f0d5c152b00 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0d5c073990 0x7f0d5c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.152 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f0d5c073990 0x7f0d5c0c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51304/0 (socket says 172.21.15.139:51304) 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/802669243 learned_addr learned my addr 172.21.15.139:0/802669243 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d60e7e640 1 --2- 172.21.15.139:0/802669243 >> v2:172.21.15.143:3300/0 conn(0x7f0d5c0c8be0 0x7f0d5c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5bfff640 1 --2- 172.21.15.139:0/802669243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c152b00 0x7f0d5c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/802669243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c152b00 msgr2=0x7f0d5c159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 --2- 172.21.15.139:0/802669243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c152b00 0x7f0d5c159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/802669243 >> v2:172.21.15.143:3300/0 conn(0x7f0d5c0c8be0 msgr2=0x7f0d5c0c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 --2- 172.21.15.139:0/802669243 >> v2:172.21.15.143:3300/0 conn(0x7f0d5c0c8be0 0x7f0d5c0c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.150+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/802669243 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0c4b10 con 0x7f0d5c073990 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.151+0000 7f0d5b7fe640 1 --2- 172.21.15.139:0/802669243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c073990 0x7f0d5c0c8000 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c06fbb0 tx=0x7f0d5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a94cd36d43cefb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.151+0000 7f0d5affd640 1 -- 172.21.15.139:0/802669243 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50037070 con 0x7f0d5c073990 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.151+0000 7f0d5affd640 1 -- 172.21.15.139:0/802669243 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d50032440 con 0x7f0d5c073990 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.151+0000 7f0d5affd640 1 -- 172.21.15.139:0/802669243 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50032810 con 0x7f0d5c073990 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.151+0000 7f0d628e1640 1 -- 172.21.15.139:0/802669243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c073990 msgr2=0x7f0d5c0c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.151+0000 7f0d628e1640 1 --2- 172.21.15.139:0/802669243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c073990 0x7f0d5c0c8000 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c06fbb0 tx=0x7f0d5002a270 comp rx=0 tx=0).stop 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.152+0000 7f0d628e1640 1 -- 172.21.15.139:0/802669243 shutdown_connections 2024-04-26T18:31:56.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.152+0000 7f0d628e1640 1 --2- 172.21.15.139:0/802669243 >> v2:172.21.15.143:3300/0 conn(0x7f0d5c0c8be0 0x7f0d5c0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.152+0000 7f0d628e1640 1 --2- 172.21.15.139:0/802669243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c073990 0x7f0d5c0c8000 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.152+0000 7f0d628e1640 1 --2- 172.21.15.139:0/802669243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c152b00 0x7f0d5c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.152+0000 7f0d628e1640 1 -- 172.21.15.139:0/802669243 >> 172.21.15.139:0/802669243 conn(0x7f0d5c06fc00 msgr2=0x7f0d5c070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.152+0000 7f0d628e1640 1 -- 172.21.15.139:0/802669243 shutdown_connections 2024-04-26T18:31:56.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.152+0000 7f0d628e1640 1 -- 172.21.15.139:0/802669243 wait complete. 2024-04-26T18:31:56.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.153+0000 7f0d628e1640 1 Processor -- start 2024-04-26T18:31:56.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.153+0000 7f0d628e1640 1 -- start start 2024-04-26T18:31:56.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c073990 0x7f0d5c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c0c8be0 0x7f0d5c145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d5c152b00 0x7f0d5c1f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c152ee0 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c158e10 con 0x7f0d5c152b00 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0c7b20 con 0x7f0d5c073990 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c0c8be0 0x7f0d5c145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c0c8be0 0x7f0d5c145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51310/0 (socket says 172.21.15.139:51310) 2024-04-26T18:31:56.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5bfff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c073990 0x7f0d5c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/2518161930 learned_addr learned my addr 172.21.15.139:0/2518161930 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d60e7e640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d5c152b00 0x7f0d5c1f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c073990 msgr2=0x7f0d5c0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f0d5c073990 0x7f0d5c0cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d5c152b00 msgr2=0x7f0d5c1f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0d5c152b00 0x7f0d5c1f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 -- 172.21.15.139:0/2518161930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c148230 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d5b7fe640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c0c8be0 0x7f0d5c145800 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0d5002a2b0 tx=0x7f0d500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50041020 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5003d620 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d50037040 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c0cb640 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.154+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c1487b0 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.155+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d5c076d20 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.156+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d50044020 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.156+0000 7f0d58ff9640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d4806c8f0 0x7f0d4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.156+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f0d500acca0 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.156+0000 7f0d5bfff640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d4806c8f0 0x7f0d4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.156+0000 7f0d58ff9640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7f0d48076400 0x7f0d480788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.156+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 --> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d50032440 con 0x7f0d48076400 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.156+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f0d500ad130 con 0x7f0d5c0c8be0 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.157+0000 7f0d60e7e640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7f0d48076400 0x7f0d480788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.157+0000 7f0d5bfff640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d4806c8f0 0x7f0d4806edb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009b40 tx=0x7f0d4c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.157+0000 7f0d60e7e640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7f0d48076400 0x7f0d480788a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.158+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== osd.4 v2:172.21.15.143:6800/1263839422 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d50032440 con 0x7f0d48076400 2024-04-26T18:31:56.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 --> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0d5c0c69f0 con 0x7f0d48076400 2024-04-26T18:31:56.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d58ff9640 1 -- 172.21.15.139:0/2518161930 <== osd.4 v2:172.21.15.143:6800/1263839422 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0d5c0c69f0 con 0x7f0d48076400 2024-04-26T18:31:56.171 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:56.171 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:56.172 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:56.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7f0d48076400 msgr2=0x7f0d480788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.143:6800/1263839422,v1:172.21.15.143:6801/1263839422] conn(0x7f0d48076400 0x7f0d480788a0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d4806c8f0 msgr2=0x7f0d4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f0d4806c8f0 0x7f0d4806edb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009b40 tx=0x7f0d4c009190 comp rx=0 tx=0).stop 2024-04-26T18:31:56.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c0c8be0 msgr2=0x7f0d5c145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 --2- 172.21.15.139:0/2518161930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d5c0c8be0 0x7f0d5c145800 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0d5002a2b0 tx=0x7f0d500046c0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d60e7e640 1 -- 172.21.15.139:0/2518161930 reap_dead start 2024-04-26T18:31:56.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 shutdown_connections 2024-04-26T18:31:56.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 >> 172.21.15.139:0/2518161930 conn(0x7f0d5c06fc00 msgr2=0x7f0d5c06deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 shutdown_connections 2024-04-26T18:31:56.174 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.171+0000 7f0d628e1640 1 -- 172.21.15.139:0/2518161930 wait complete. 2024-04-26T18:31:56.182 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T18:31:56.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.279+0000 7f2151474640 1 Processor -- start 2024-04-26T18:31:56.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.279+0000 7f2151474640 1 -- start start 2024-04-26T18:31:56.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f2151474640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f2151474640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f214c0d12e0 0x7f214c0d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f2151474640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f214c0cc490 con 0x7f214c155da0 2024-04-26T18:31:56.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f2151474640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f214c0cd8b0 con 0x7f214c0d12e0 2024-04-26T18:31:56.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f2151474640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f214c0cc770 con 0x7f214c0c63b0 2024-04-26T18:31:56.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f214b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f214c0d12e0 0x7f214c0d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f214b7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f214c0d12e0 0x7f214c0d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51314/0 (socket says 172.21.15.139:51314) 2024-04-26T18:31:56.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f214b7fe640 1 -- 172.21.15.139:0/2396487954 learned_addr learned my addr 172.21.15.139:0/2396487954 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f2143fff640 1 --2- 172.21.15.139:0/2396487954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f214b7fe640 1 -- 172.21.15.139:0/2396487954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 msgr2=0x7f214c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f214b7fe640 1 --2- 172.21.15.139:0/2396487954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c0ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f214b7fe640 1 -- 172.21.15.139:0/2396487954 >> v1:172.21.15.143:6789/0 conn(0x7f214c155da0 legacy=0x7f214c15fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.280+0000 7f214b7fe640 1 -- 172.21.15.139:0/2396487954 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c0cdb00 con 0x7f214c0d12e0 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f214b7fe640 1 --2- 172.21.15.139:0/2396487954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c0d1750 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2144009e50 tx=0x7f214402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b9bc1c1af675f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f214a7fc640 1 -- 172.21.15.139:0/2396487954 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144036070 con 0x7f214c0d12e0 2024-04-26T18:31:56.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f214a7fc640 1 -- 172.21.15.139:0/2396487954 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2144031600 con 0x7f214c0d12e0 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f214a7fc640 1 -- 172.21.15.139:0/2396487954 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440319d0 con 0x7f214c0d12e0 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f2151474640 1 -- 172.21.15.139:0/2396487954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 msgr2=0x7f214c0d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f2151474640 1 --2- 172.21.15.139:0/2396487954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c0d1750 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2144009e50 tx=0x7f214402a710 comp rx=0 tx=0).stop 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f2151474640 1 -- 172.21.15.139:0/2396487954 shutdown_connections 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f2151474640 1 --2- 172.21.15.139:0/2396487954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c0d1750 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f2151474640 1 --2- 172.21.15.139:0/2396487954 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c0ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.281+0000 7f2151474640 1 -- 172.21.15.139:0/2396487954 >> 172.21.15.139:0/2396487954 conn(0x7f214c068090 msgr2=0x7f214c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.284 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.282+0000 7f2151474640 1 -- 172.21.15.139:0/2396487954 shutdown_connections 2024-04-26T18:31:56.285 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.282+0000 7f2151474640 1 -- 172.21.15.139:0/2396487954 wait complete. 2024-04-26T18:31:56.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 Processor -- start 2024-04-26T18:31:56.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 -- start start 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c1431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f214c155da0 0x7f214c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f214c156180 con 0x7f214c0d12e0 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f214c0ce0c0 con 0x7f214c155da0 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2151474640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f214c0ccb70 con 0x7f214c0c63b0 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2143fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2143fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51324/0 (socket says 172.21.15.139:51324) 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f2143fff640 1 -- 172.21.15.139:0/659336380 learned_addr learned my addr 172.21.15.139:0/659336380 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f214affd640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c1431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.283+0000 7f214b7fe640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f214c155da0 0x7f214c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2143fff640 1 -- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 msgr2=0x7f214c1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2143fff640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c1431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2143fff640 1 -- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f214c155da0 msgr2=0x7f214c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2143fff640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f214c155da0 0x7f214c153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.289 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2143fff640 1 -- 172.21.15.139:0/659336380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c1476a0 con 0x7f214c0d12e0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2143fff640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c153930 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f213400e9b0 tx=0x7f213400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f21437fe640 1 -- 172.21.15.139:0/659336380 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134017070 con 0x7f214c0d12e0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f21437fe640 1 -- 172.21.15.139:0/659336380 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213400c9a0 con 0x7f214c0d12e0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f21437fe640 1 -- 172.21.15.139:0/659336380 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213400cd90 con 0x7f214c0d12e0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c147980 con 0x7f214c0d12e0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.284+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c154450 con 0x7f214c0d12e0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.285+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c076d20 con 0x7f214c0d12e0 2024-04-26T18:31:56.290 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.285+0000 7f21437fe640 1 -- 172.21.15.139:0/659336380 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f213401a070 con 0x7f214c0d12e0 2024-04-26T18:31:56.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.286+0000 7f21437fe640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f212c06c8f0 0x7f212c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.286+0000 7f21437fe640 1 -- 172.21.15.139:0/659336380 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f213408be50 con 0x7f214c0d12e0 2024-04-26T18:31:56.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.286+0000 7f214affd640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f212c06c8f0 0x7f212c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.286+0000 7f214affd640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f212c06c8f0 0x7f212c06edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f213c0016e0 tx=0x7f213c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.291 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.290+0000 7f21437fe640 1 -- 172.21.15.139:0/659336380 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2134059880 con 0x7f214c0d12e0 2024-04-26T18:31:56.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.466+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f214c147450 con 0x7f212c06c8f0 2024-04-26T18:31:56.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.467+0000 7f21437fe640 1 -- 172.21.15.139:0/659336380 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f214c147450 con 0x7f212c06c8f0 2024-04-26T18:31:56.467 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T18:31:56.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f212c06c8f0 msgr2=0x7f212c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f212c06c8f0 0x7f212c06edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f213c0016e0 tx=0x7f213c009040 comp rx=0 tx=0).stop 2024-04-26T18:31:56.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 msgr2=0x7f214c153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c153930 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f213400e9b0 tx=0x7f213400ee70 comp rx=0 tx=0).stop 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 shutdown_connections 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f212c06c8f0 0x7f212c06edb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f214c155da0 0x7f214c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f214c0d12e0 0x7f214c153930 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 --2- 172.21.15.139:0/659336380 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f214c0c63b0 0x7f214c1431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 >> 172.21.15.139:0/659336380 conn(0x7f214c068090 msgr2=0x7f214c14be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 shutdown_connections 2024-04-26T18:31:56.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.469+0000 7f2151474640 1 -- 172.21.15.139:0/659336380 wait complete. 2024-04-26T18:31:56.480 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T18:31:56.480 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:56.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.590+0000 7f8d6a514640 1 Processor -- start 2024-04-26T18:31:56.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.590+0000 7f8d6a514640 1 -- start start 2024-04-26T18:31:56.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d6a514640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8d64155cc0 0x7f8d640cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d6a514640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f8d6406c310 0x7f8d6406c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d6a514640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d640cb0d0 0x7f8d6406cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d6a514640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6415bb30 con 0x7f8d64155cc0 2024-04-26T18:31:56.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d6a514640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6415f020 con 0x7f8d6406c310 2024-04-26T18:31:56.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d6a514640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6415f2e0 con 0x7f8d640cb0d0 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8d64155cc0 0x7f8d640cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f8d64155cc0 0x7f8d640cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51328/0 (socket says 172.21.15.139:51328) 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 -- 172.21.15.139:0/167257461 learned_addr learned my addr 172.21.15.139:0/167257461 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d637fe640 1 --2- 172.21.15.139:0/167257461 >> v2:172.21.15.143:3300/0 conn(0x7f8d6406c310 0x7f8d6406c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d68ab1640 1 --2- 172.21.15.139:0/167257461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d640cb0d0 0x7f8d6406cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 -- 172.21.15.139:0/167257461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d640cb0d0 msgr2=0x7f8d6406cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 --2- 172.21.15.139:0/167257461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d640cb0d0 0x7f8d6406cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 -- 172.21.15.139:0/167257461 >> v2:172.21.15.143:3300/0 conn(0x7f8d6406c310 msgr2=0x7f8d6406c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 --2- 172.21.15.139:0/167257461 >> v2:172.21.15.143:3300/0 conn(0x7f8d6406c310 0x7f8d6406c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.591+0000 7f8d63fff640 1 -- 172.21.15.139:0/167257461 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6415f5c0 con 0x7f8d64155cc0 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.592+0000 7f8d63fff640 1 --2- 172.21.15.139:0/167257461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d64155cc0 0x7f8d640cab90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8d640cbb70 tx=0x7f8d5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d1413282dd6df8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.592+0000 7f8d62ffd640 1 -- 172.21.15.139:0/167257461 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54037070 con 0x7f8d64155cc0 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.592+0000 7f8d62ffd640 1 -- 172.21.15.139:0/167257461 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d54032440 con 0x7f8d64155cc0 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.592+0000 7f8d62ffd640 1 -- 172.21.15.139:0/167257461 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54032810 con 0x7f8d64155cc0 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 -- 172.21.15.139:0/167257461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d64155cc0 msgr2=0x7f8d640cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 --2- 172.21.15.139:0/167257461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d64155cc0 0x7f8d640cab90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8d640cbb70 tx=0x7f8d5402a1e0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 -- 172.21.15.139:0/167257461 shutdown_connections 2024-04-26T18:31:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 --2- 172.21.15.139:0/167257461 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d640cb0d0 0x7f8d6406cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 --2- 172.21.15.139:0/167257461 >> v2:172.21.15.143:3300/0 conn(0x7f8d6406c310 0x7f8d6406c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 --2- 172.21.15.139:0/167257461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d64155cc0 0x7f8d640cab90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 -- 172.21.15.139:0/167257461 >> 172.21.15.139:0/167257461 conn(0x7f8d64073110 msgr2=0x7f8d640734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 -- 172.21.15.139:0/167257461 shutdown_connections 2024-04-26T18:31:56.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.593+0000 7f8d6a514640 1 -- 172.21.15.139:0/167257461 wait complete. 2024-04-26T18:31:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.594+0000 7f8d6a514640 1 Processor -- start 2024-04-26T18:31:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.594+0000 7f8d6a514640 1 -- start start 2024-04-26T18:31:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d6a514640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6406c310 0x7f8d640c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d6a514640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d640cb0d0 0x7f8d640c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d6a514640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d64155cc0 0x7f8d641475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d6a514640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6415fe60 con 0x7f8d6406c310 2024-04-26T18:31:56.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d6a514640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6415fb80 con 0x7f8d640cb0d0 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d6a514640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f8d641560a0 con 0x7f8d64155cc0 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6406c310 0x7f8d640c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6406c310 0x7f8d640c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51338/0 (socket says 172.21.15.139:51338) 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 -- 172.21.15.139:0/375372139 learned_addr learned my addr 172.21.15.139:0/375372139 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d637fe640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d640cb0d0 0x7f8d640c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d68ab1640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d64155cc0 0x7f8d641475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 -- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d64155cc0 msgr2=0x7f8d641475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f8d64155cc0 0x7f8d641475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 -- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d640cb0d0 msgr2=0x7f8d640c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d640cb0d0 0x7f8d640c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 -- 172.21.15.139:0/375372139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d641f1900 con 0x7f8d6406c310 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d63fff640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6406c310 0x7f8d640c6980 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8d5402a220 tx=0x7f8d540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.595+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54041020 con 0x7f8d6406c310 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.596+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5403d620 con 0x7f8d6406c310 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.596+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d641f1be0 con 0x7f8d6406c310 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.596+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54037040 con 0x7f8d6406c310 2024-04-26T18:31:56.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.596+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d641f21a0 con 0x7f8d6406c310 2024-04-26T18:31:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.596+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d6415b870 con 0x7f8d6406c310 2024-04-26T18:31:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.597+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d54044020 con 0x7f8d6406c310 2024-04-26T18:31:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.597+0000 7f8d60ff9640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8d5006c8f0 0x7f8d5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.597+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f8d540ac550 con 0x7f8d6406c310 2024-04-26T18:31:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.597+0000 7f8d637fe640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8d5006c8f0 0x7f8d5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.597+0000 7f8d60ff9640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f8d50076400 0x7f8d500788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.598+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 --> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d5402be50 con 0x7f8d50076400 2024-04-26T18:31:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.598+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8d540b3050 con 0x7f8d6406c310 2024-04-26T18:31:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.598+0000 7f8d68ab1640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f8d50076400 0x7f8d500788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.598+0000 7f8d637fe640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8d5006c8f0 0x7f8d5006edb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8d6414ac00 tx=0x7f8d58009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.598+0000 7f8d68ab1640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f8d50076400 0x7f8d500788a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.599+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== osd.5 v2:172.21.15.143:6808/3412241994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d5402be50 con 0x7f8d50076400 2024-04-26T18:31:56.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.612+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 --> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8d641f2510 con 0x7f8d50076400 2024-04-26T18:31:56.612 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.612+0000 7f8d60ff9640 1 -- 172.21.15.139:0/375372139 <== osd.5 v2:172.21.15.143:6808/3412241994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8d641f2510 con 0x7f8d50076400 2024-04-26T18:31:56.612 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:56.613 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:56.613 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:56.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.612+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f8d50076400 msgr2=0x7f8d500788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.143:6808/3412241994,v1:172.21.15.143:6809/3412241994] conn(0x7f8d50076400 0x7f8d500788a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8d5006c8f0 msgr2=0x7f8d5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f8d5006c8f0 0x7f8d5006edb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8d6414ac00 tx=0x7f8d58009190 comp rx=0 tx=0).stop 2024-04-26T18:31:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6406c310 msgr2=0x7f8d640c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 --2- 172.21.15.139:0/375372139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d6406c310 0x7f8d640c6980 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8d5402a220 tx=0x7f8d540046c0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d68ab1640 1 -- 172.21.15.139:0/375372139 reap_dead start 2024-04-26T18:31:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 shutdown_connections 2024-04-26T18:31:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 >> 172.21.15.139:0/375372139 conn(0x7f8d64073110 msgr2=0x7f8d640c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 shutdown_connections 2024-04-26T18:31:56.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.613+0000 7f8d6a514640 1 -- 172.21.15.139:0/375372139 wait complete. 2024-04-26T18:31:56.623 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T18:31:56.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.737+0000 7f6515303640 1 Processor -- start 2024-04-26T18:31:56.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.737+0000 7f6515303640 1 -- start start 2024-04-26T18:31:56.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f6515303640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6510070630 0x7f65100c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f6515303640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6510070a80 con 0x7f65100c4ac0 2024-04-26T18:31:56.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f6515303640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65100ca660 con 0x7f6510156000 2024-04-26T18:31:56.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f6515303640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f65100ca920 con 0x7f6510070630 2024-04-26T18:31:56.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6510070630 0x7f65100c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650f7fe640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6510070630 0x7f65100c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51348/0 (socket says 172.21.15.139:51348) 2024-04-26T18:31:56.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650e7fc640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f65100c4ac0 0x7f651015c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:53360/0 (socket says 172.21.15.139:53360) 2024-04-26T18:31:56.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650f7fe640 1 -- 172.21.15.139:0/1624034979 learned_addr learned my addr 172.21.15.139:0/1624034979 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650f7fe640 1 -- 172.21.15.139:0/1624034979 >> v1:172.21.15.143:6789/0 conn(0x7f6510156000 legacy=0x7f651015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650f7fe640 1 -- 172.21.15.139:0/1624034979 >> v1:172.21.15.139:6789/0 conn(0x7f65100c4ac0 legacy=0x7f651015c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650dffb640 1 -- 172.21.15.139:0/1624034979 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115277220 0 0) 0x7f65100ca660 con 0x7f6510156000 2024-04-26T18:31:56.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.738+0000 7f650f7fe640 1 -- 172.21.15.139:0/1624034979 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651006ceb0 con 0x7f6510070630 2024-04-26T18:31:56.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.739+0000 7f650f7fe640 1 --2- 172.21.15.139:0/1624034979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f65100c9d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6508009e50 tx=0x7f650802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e66943847bba12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f650dffb640 1 -- 172.21.15.139:0/1624034979 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508036070 con 0x7f6510070630 2024-04-26T18:31:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f650dffb640 1 -- 172.21.15.139:0/1624034979 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6508031600 con 0x7f6510070630 2024-04-26T18:31:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f650dffb640 1 -- 172.21.15.139:0/1624034979 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65080319d0 con 0x7f6510070630 2024-04-26T18:31:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f6515303640 1 -- 172.21.15.139:0/1624034979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 msgr2=0x7f65100c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f6515303640 1 --2- 172.21.15.139:0/1624034979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f65100c9d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6508009e50 tx=0x7f650802a730 comp rx=0 tx=0).stop 2024-04-26T18:31:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f6515303640 1 -- 172.21.15.139:0/1624034979 shutdown_connections 2024-04-26T18:31:56.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f6515303640 1 --2- 172.21.15.139:0/1624034979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f65100c9d50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f6515303640 1 -- 172.21.15.139:0/1624034979 >> 172.21.15.139:0/1624034979 conn(0x7f6510071d70 msgr2=0x7f6510072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f6515303640 1 -- 172.21.15.139:0/1624034979 shutdown_connections 2024-04-26T18:31:56.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.740+0000 7f6515303640 1 -- 172.21.15.139:0/1624034979 wait complete. 2024-04-26T18:31:56.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 Processor -- start 2024-04-26T18:31:56.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 -- start start 2024-04-26T18:31:56.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f6510153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65100c4ac0 0x7f6510151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6510156000 0x7f65101f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f651006c4d0 con 0x7f6510070630 2024-04-26T18:31:56.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f651015c980 con 0x7f65100c4ac0 2024-04-26T18:31:56.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.742+0000 7f6515303640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f651006c650 con 0x7f6510156000 2024-04-26T18:31:56.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f6510153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f6510153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51364/0 (socket says 172.21.15.139:51364) 2024-04-26T18:31:56.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 -- 172.21.15.139:0/2163043893 learned_addr learned my addr 172.21.15.139:0/2163043893 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:56.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650f7fe640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6510156000 0x7f65101f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650e7fc640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65100c4ac0 0x7f6510151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 -- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6510156000 msgr2=0x7f65101f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6510156000 0x7f65101f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 -- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65100c4ac0 msgr2=0x7f6510151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65100c4ac0 0x7f6510151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 -- 172.21.15.139:0/2163043893 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6510156620 con 0x7f6510070630 2024-04-26T18:31:56.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f650effd640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f6510153ba0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f650000c3f0 tx=0x7f650000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f64f77fe640 1 -- 172.21.15.139:0/2163043893 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500017070 con 0x7f6510070630 2024-04-26T18:31:56.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f64f77fe640 1 -- 172.21.15.139:0/2163043893 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65000035f0 con 0x7f6510070630 2024-04-26T18:31:56.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f64f77fe640 1 -- 172.21.15.139:0/2163043893 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65000039e0 con 0x7f6510070630 2024-04-26T18:31:56.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.743+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65101568e0 con 0x7f6510070630 2024-04-26T18:31:56.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.744+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6510151bb0 con 0x7f6510070630 2024-04-26T18:31:56.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.745+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651006e3f0 con 0x7f6510070630 2024-04-26T18:31:56.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.745+0000 7f64f77fe640 1 -- 172.21.15.139:0/2163043893 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f650001a070 con 0x7f6510070630 2024-04-26T18:31:56.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.745+0000 7f64f77fe640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f64fc06c8f0 0x7f64fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:56.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.746+0000 7f64f77fe640 1 -- 172.21.15.139:0/2163043893 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f650008b2d0 con 0x7f6510070630 2024-04-26T18:31:56.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.746+0000 7f650e7fc640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f64fc06c8f0 0x7f64fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:56.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.746+0000 7f650e7fc640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f64fc06c8f0 0x7f64fc06edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f651015c5a0 tx=0x7f6504000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:56.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.750+0000 7f64f77fe640 1 -- 172.21.15.139:0/2163043893 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f651006e3f0 con 0x7f6510070630 2024-04-26T18:31:56.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.933+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6510076d20 con 0x7f64fc06c8f0 2024-04-26T18:31:56.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.934+0000 7f64f77fe640 1 -- 172.21.15.139:0/2163043893 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6510076d20 con 0x7f64fc06c8f0 2024-04-26T18:31:56.934 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T18:31:56.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f64fc06c8f0 msgr2=0x7f64fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f64fc06c8f0 0x7f64fc06edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f651015c5a0 tx=0x7f6504000ed0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 msgr2=0x7f6510153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:56.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f6510153ba0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f650000c3f0 tx=0x7f650000c8b0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 shutdown_connections 2024-04-26T18:31:56.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f64fc06c8f0 0x7f64fc06edb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6510156000 0x7f65101f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f65100c4ac0 0x7f6510151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 --2- 172.21.15.139:0/2163043893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6510070630 0x7f6510153ba0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:56.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 >> 172.21.15.139:0/2163043893 conn(0x7f6510071d70 msgr2=0x7f6510151060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:56.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 shutdown_connections 2024-04-26T18:31:56.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:56.936+0000 7f6515303640 1 -- 172.21.15.139:0/2163043893 wait complete. 2024-04-26T18:31:56.950 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T18:31:56.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:57.055 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.055+0000 7f7b29b9e640 1 Processor -- start 2024-04-26T18:31:57.056 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.055+0000 7f7b29b9e640 1 -- start start 2024-04-26T18:31:57.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b29b9e640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7b24153b20 0x7f7b2415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b29b9e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240c4f00 0x7f7b240703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b29b9e640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b240c7690 con 0x7f7b240708e0 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b29b9e640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f7b240c9860 con 0x7f7b24153b20 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b29b9e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7b24076100 con 0x7f7b240c4f00 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b28b9c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7b24153b20 0x7f7b2415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b28b9c640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f7b24153b20 0x7f7b2415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51370/0 (socket says 172.21.15.139:51370) 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b28b9c640 1 -- 172.21.15.139:0/3770931870 learned_addr learned my addr 172.21.15.139:0/3770931870 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b23fff640 1 --2- 172.21.15.139:0/3770931870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240c4f00 0x7f7b240703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b28b9c640 1 -- 172.21.15.139:0/3770931870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240c4f00 msgr2=0x7f7b240703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:57.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b28b9c640 1 --2- 172.21.15.139:0/3770931870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240c4f00 0x7f7b240703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b28b9c640 1 -- 172.21.15.139:0/3770931870 >> v1:172.21.15.143:6789/0 conn(0x7f7b240708e0 legacy=0x7f7b240c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.056+0000 7f7b28b9c640 1 -- 172.21.15.139:0/3770931870 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240c7970 con 0x7f7b24153b20 2024-04-26T18:31:57.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.057+0000 7f7b28b9c640 1 --2- 172.21.15.139:0/3770931870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b24153b20 0x7f7b2415d7b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009870 tx=0x7f7b1802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4b057dcf82758b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.057+0000 7f7b237fe640 1 -- 172.21.15.139:0/3770931870 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18037070 con 0x7f7b24153b20 2024-04-26T18:31:57.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.057+0000 7f7b237fe640 1 -- 172.21.15.139:0/3770931870 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b18032440 con 0x7f7b24153b20 2024-04-26T18:31:57.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.057+0000 7f7b237fe640 1 -- 172.21.15.139:0/3770931870 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18032810 con 0x7f7b24153b20 2024-04-26T18:31:57.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 -- 172.21.15.139:0/3770931870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b24153b20 msgr2=0x7f7b2415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 --2- 172.21.15.139:0/3770931870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b24153b20 0x7f7b2415d7b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009870 tx=0x7f7b1802a1c0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 -- 172.21.15.139:0/3770931870 shutdown_connections 2024-04-26T18:31:57.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 --2- 172.21.15.139:0/3770931870 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240c4f00 0x7f7b240703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 --2- 172.21.15.139:0/3770931870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b24153b20 0x7f7b2415d7b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 -- 172.21.15.139:0/3770931870 >> 172.21.15.139:0/3770931870 conn(0x7f7b240cd740 msgr2=0x7f7b240cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:57.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 -- 172.21.15.139:0/3770931870 shutdown_connections 2024-04-26T18:31:57.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.058+0000 7f7b29b9e640 1 -- 172.21.15.139:0/3770931870 wait complete. 2024-04-26T18:31:57.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.059+0000 7f7b29b9e640 1 Processor -- start 2024-04-26T18:31:57.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.059+0000 7f7b29b9e640 1 -- start start 2024-04-26T18:31:57.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b29b9e640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240708e0 0x7f7b240730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b29b9e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b240c4f00 0x7f7b241490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b29b9e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b24153b20 0x7f7b2414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b29b9e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24076630 con 0x7f7b240c4f00 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b29b9e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24070d90 con 0x7f7b24153b20 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b29b9e640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2406fe80 con 0x7f7b240708e0 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b240c4f00 0x7f7b241490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b240c4f00 0x7f7b241490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51382/0 (socket says 172.21.15.139:51382) 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 -- 172.21.15.139:0/730258668 learned_addr learned my addr 172.21.15.139:0/730258668 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b28b9c640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240708e0 0x7f7b240730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b2939d640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b24153b20 0x7f7b2414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 -- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240708e0 msgr2=0x7f7b240730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7b240708e0 0x7f7b240730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 -- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b24153b20 msgr2=0x7f7b2414bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7b24153b20 0x7f7b2414bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.060+0000 7f7b23fff640 1 -- 172.21.15.139:0/730258668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2414c8c0 con 0x7f7b240c4f00 2024-04-26T18:31:57.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.061+0000 7f7b23fff640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b240c4f00 0x7f7b241490a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e840 tx=0x7f7b1000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.061+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10017070 con 0x7f7b240c4f00 2024-04-26T18:31:57.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.061+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1000c8e0 con 0x7f7b240c4f00 2024-04-26T18:31:57.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.061+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b241f4ff0 con 0x7f7b240c4f00 2024-04-26T18:31:57.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.061+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000ccb0 con 0x7f7b240c4f00 2024-04-26T18:31:57.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.061+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b241f55b0 con 0x7f7b240c4f00 2024-04-26T18:31:57.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.062+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b240506c0 con 0x7f7b240c4f00 2024-04-26T18:31:57.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.062+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b1001a070 con 0x7f7b240c4f00 2024-04-26T18:31:57.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b217fa640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7b0806c8f0 0x7f7b0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7b1008bd10 con 0x7f7b240c4f00 2024-04-26T18:31:57.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b28b9c640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7b0806c8f0 0x7f7b0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b217fa640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7f7b08076410 0x7f7b080788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 --> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b1000e020 con 0x7f7b08076410 2024-04-26T18:31:57.068 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7b1008e370 con 0x7f7b240c4f00 2024-04-26T18:31:57.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b2939d640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7f7b08076410 0x7f7b080788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.063+0000 7f7b28b9c640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7b0806c8f0 0x7f7b0806edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b18034000 tx=0x7f7b1802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.064+0000 7f7b2939d640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7f7b08076410 0x7f7b080788b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.069 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.064+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== osd.6 v2:172.21.15.143:6816/3661563662 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b1000e020 con 0x7f7b08076410 2024-04-26T18:31:57.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.078+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 --> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7b241f5e50 con 0x7f7b08076410 2024-04-26T18:31:57.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b217fa640 1 -- 172.21.15.139:0/730258668 <== osd.6 v2:172.21.15.143:6816/3661563662 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7b241f5e50 con 0x7f7b08076410 2024-04-26T18:31:57.079 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:57.079 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:57.079 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:57.080 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7f7b08076410 msgr2=0x7f7b080788b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.143:6816/3661563662,v1:172.21.15.143:6817/3661563662] conn(0x7f7b08076410 0x7f7b080788b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7b0806c8f0 msgr2=0x7f7b0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7b0806c8f0 0x7f7b0806edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b18034000 tx=0x7f7b1802e000 comp rx=0 tx=0).stop 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b240c4f00 msgr2=0x7f7b241490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 --2- 172.21.15.139:0/730258668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b240c4f00 0x7f7b241490a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e840 tx=0x7f7b1000ed00 comp rx=0 tx=0).stop 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b2939d640 1 -- 172.21.15.139:0/730258668 reap_dead start 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 shutdown_connections 2024-04-26T18:31:57.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 >> 172.21.15.139:0/730258668 conn(0x7f7b240cd740 msgr2=0x7f7b24149d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:57.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 shutdown_connections 2024-04-26T18:31:57.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.079+0000 7f7b29b9e640 1 -- 172.21.15.139:0/730258668 wait complete. 2024-04-26T18:31:57.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T18:31:57.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.188+0000 7f52cd978640 1 Processor -- start 2024-04-26T18:31:57.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.188+0000 7f52cd978640 1 -- start start 2024-04-26T18:31:57.190 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52cd978640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f52c8155da0 0x7f52c815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52cd978640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80c63b0 0x7f52c80ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52cd978640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f52c80d12e0 0x7f52c80d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52cd978640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f52c80cd8b0 con 0x7f52c8155da0 2024-04-26T18:31:57.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52cd978640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f52c815ffd0 con 0x7f52c80d12e0 2024-04-26T18:31:57.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52cd978640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52c80cc490 con 0x7f52c80c63b0 2024-04-26T18:31:57.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f52c8155da0 0x7f52c815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.191 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f52c8155da0 0x7f52c815fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51396/0 (socket says 172.21.15.139:51396) 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 -- 172.21.15.139:0/2938687184 learned_addr learned my addr 172.21.15.139:0/2938687184 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c67fc640 1 --2- 172.21.15.139:0/2938687184 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80c63b0 0x7f52c80ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c77fe640 1 --2- 172.21.15.139:0/2938687184 >> v2:172.21.15.143:3300/0 conn(0x7f52c80d12e0 0x7f52c80d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 -- 172.21.15.139:0/2938687184 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80c63b0 msgr2=0x7f52c80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 --2- 172.21.15.139:0/2938687184 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80c63b0 0x7f52c80ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 -- 172.21.15.139:0/2938687184 >> v2:172.21.15.143:3300/0 conn(0x7f52c80d12e0 msgr2=0x7f52c80d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 --2- 172.21.15.139:0/2938687184 >> v2:172.21.15.143:3300/0 conn(0x7f52c80d12e0 0x7f52c80d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c6ffd640 1 -- 172.21.15.139:0/2938687184 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c80cc770 con 0x7f52c8155da0 2024-04-26T18:31:57.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.189+0000 7f52c77fe640 1 --2- 172.21.15.139:0/2938687184 >> v2:172.21.15.143:3300/0 conn(0x7f52c80d12e0 0x7f52c80d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:31:57.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.190+0000 7f52c6ffd640 1 --2- 172.21.15.139:0/2938687184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815fa90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f52c80cb950 tx=0x7f52b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226a222a4263f95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.190+0000 7f52c5ffb640 1 -- 172.21.15.139:0/2938687184 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8036070 con 0x7f52c8155da0 2024-04-26T18:31:57.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.190+0000 7f52c5ffb640 1 -- 172.21.15.139:0/2938687184 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b8031600 con 0x7f52c8155da0 2024-04-26T18:31:57.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.190+0000 7f52c5ffb640 1 -- 172.21.15.139:0/2938687184 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b80319d0 con 0x7f52c8155da0 2024-04-26T18:31:57.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 -- 172.21.15.139:0/2938687184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 msgr2=0x7f52c815fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 --2- 172.21.15.139:0/2938687184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815fa90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f52c80cb950 tx=0x7f52b802a6a0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 -- 172.21.15.139:0/2938687184 shutdown_connections 2024-04-26T18:31:57.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 --2- 172.21.15.139:0/2938687184 >> v2:172.21.15.143:3300/0 conn(0x7f52c80d12e0 0x7f52c80d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 --2- 172.21.15.139:0/2938687184 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80c63b0 0x7f52c80ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 --2- 172.21.15.139:0/2938687184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815fa90 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 -- 172.21.15.139:0/2938687184 >> 172.21.15.139:0/2938687184 conn(0x7f52c8068090 msgr2=0x7f52c80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 -- 172.21.15.139:0/2938687184 shutdown_connections 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.191+0000 7f52cd978640 1 -- 172.21.15.139:0/2938687184 wait complete. 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.192+0000 7f52cd978640 1 Processor -- start 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.192+0000 7f52cd978640 1 -- start start 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80c63b0 0x7f52c80b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80d12e0 0x7f52c80b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.198 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f52c80ce0c0 con 0x7f52c8155da0 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f52c80cdde0 con 0x7f52c80c63b0 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f52c8156180 con 0x7f52c80d12e0 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51410/0 (socket says 172.21.15.139:51410) 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 -- 172.21.15.139:0/4119432813 learned_addr learned my addr 172.21.15.139:0/4119432813 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c6ffd640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80c63b0 0x7f52c80b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c67fc640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80d12e0 0x7f52c80b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 -- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80d12e0 msgr2=0x7f52c80b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80d12e0 0x7f52c80b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 -- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80c63b0 msgr2=0x7f52c80b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80c63b0 0x7f52c80b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 -- 172.21.15.139:0/4119432813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c81e60b0 con 0x7f52c8155da0 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52c77fe640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815eb60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f52c000e7e0 tx=0x7f52c000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52affff640 1 -- 172.21.15.139:0/4119432813 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c000f040 con 0x7f52c8155da0 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52affff640 1 -- 172.21.15.139:0/4119432813 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c0004030 con 0x7f52c8155da0 2024-04-26T18:31:57.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c81e6390 con 0x7f52c8155da0 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52affff640 1 -- 172.21.15.139:0/4119432813 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c00043e0 con 0x7f52c8155da0 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.193+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c81e6950 con 0x7f52c8155da0 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.194+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c8076d20 con 0x7f52c8155da0 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.195+0000 7f52affff640 1 -- 172.21.15.139:0/4119432813 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52c000c6d0 con 0x7f52c8155da0 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.195+0000 7f52affff640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f52b406c8f0 0x7f52b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.195+0000 7f52affff640 1 -- 172.21.15.139:0/4119432813 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f52c008bf90 con 0x7f52c8155da0 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.195+0000 7f52c6ffd640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f52b406c8f0 0x7f52b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.196+0000 7f52c6ffd640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f52b406c8f0 0x7f52b406edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f52b8033000 tx=0x7f52b8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.200+0000 7f52affff640 1 -- 172.21.15.139:0/4119432813 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52c0017020 con 0x7f52c8155da0 2024-04-26T18:31:57.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.377+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f52c80cce80 con 0x7f52b406c8f0 2024-04-26T18:31:57.378 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.378+0000 7f52affff640 1 -- 172.21.15.139:0/4119432813 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f52c80cce80 con 0x7f52b406c8f0 2024-04-26T18:31:57.378 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T18:31:57.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f52b406c8f0 msgr2=0x7f52b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f52b406c8f0 0x7f52b406edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f52b8033000 tx=0x7f52b8009000 comp rx=0 tx=0).stop 2024-04-26T18:31:57.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 msgr2=0x7f52c815eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815eb60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f52c000e7e0 tx=0x7f52c000eca0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 shutdown_connections 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f52b406c8f0 0x7f52b406edb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52c8155da0 0x7f52c815eb60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f52c80d12e0 0x7f52c80b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 --2- 172.21.15.139:0/4119432813 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f52c80c63b0 0x7f52c80b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 >> 172.21.15.139:0/4119432813 conn(0x7f52c8068090 msgr2=0x7f52c8153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:57.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 shutdown_connections 2024-04-26T18:31:57.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.380+0000 7f52cd978640 1 -- 172.21.15.139:0/4119432813 wait complete. 2024-04-26T18:31:57.391 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T18:31:57.392 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:31:57.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.493+0000 7f24ecc59640 1 Processor -- start 2024-04-26T18:31:57.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.493+0000 7f24ecc59640 1 -- start start 2024-04-26T18:31:57.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24ecc59640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e806cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24ecc59640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24e806c310 0x7f24e806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24ecc59640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e80c9ed0 con 0x7f24e815c650 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24ecc59640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f24e8070d70 con 0x7f24e806c310 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24ecc59640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f24e8070160 con 0x7f24e8155e00 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e806cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24dffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24e806c310 0x7f24e806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24dffff640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f24e806c310 0x7f24e806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:54122/0 (socket says 172.21.15.139:54122) 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e659c640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e806cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:53638/0 (socket says 172.21.15.139:53638) 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e6d9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f24e815c650 0x7f24e80cae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:54282/0 (socket says 172.21.15.139:54282) 2024-04-26T18:31:57.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24dffff640 1 -- 172.21.15.139:0/3250245202 learned_addr learned my addr 172.21.15.139:0/3250245202 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e659c640 1 -- 172.21.15.139:0/3250245202 >> v2:172.21.15.143:3300/0 conn(0x7f24e806c310 msgr2=0x7f24e806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e659c640 1 --2- 172.21.15.139:0/3250245202 >> v2:172.21.15.143:3300/0 conn(0x7f24e806c310 0x7f24e806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e659c640 1 -- 172.21.15.139:0/3250245202 >> v1:172.21.15.143:6789/0 conn(0x7f24e815c650 legacy=0x7f24e80cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e659c640 1 -- 172.21.15.139:0/3250245202 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e8070440 con 0x7f24e8155e00 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24e5d9b640 1 -- 172.21.15.139:0/3250245202 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558078739 0 0) 0x7f24e80c9ed0 con 0x7f24e815c650 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.494+0000 7f24dffff640 1 --2- 172.21.15.139:0/3250245202 >> v2:172.21.15.143:3300/0 conn(0x7f24e806c310 0x7f24e806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.495+0000 7f24e659c640 1 --2- 172.21.15.139:0/3250245202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e806cb20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24e80ca0a0 tx=0x7f24d802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92cced9e4cd72d71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.495+0000 7f24e5d9b640 1 -- 172.21.15.139:0/3250245202 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8037070 con 0x7f24e8155e00 2024-04-26T18:31:57.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.495+0000 7f24e5d9b640 1 -- 172.21.15.139:0/3250245202 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d8032440 con 0x7f24e8155e00 2024-04-26T18:31:57.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.495+0000 7f24e5d9b640 1 -- 172.21.15.139:0/3250245202 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8032810 con 0x7f24e8155e00 2024-04-26T18:31:57.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 -- 172.21.15.139:0/3250245202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 msgr2=0x7f24e806cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 --2- 172.21.15.139:0/3250245202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e806cb20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24e80ca0a0 tx=0x7f24d802a210 comp rx=0 tx=0).stop 2024-04-26T18:31:57.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 -- 172.21.15.139:0/3250245202 shutdown_connections 2024-04-26T18:31:57.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 --2- 172.21.15.139:0/3250245202 >> v2:172.21.15.143:3300/0 conn(0x7f24e806c310 0x7f24e806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 --2- 172.21.15.139:0/3250245202 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e806cb20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 -- 172.21.15.139:0/3250245202 >> 172.21.15.139:0/3250245202 conn(0x7f24e8071e30 msgr2=0x7f24e8072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:57.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 -- 172.21.15.139:0/3250245202 shutdown_connections 2024-04-26T18:31:57.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.496+0000 7f24ecc59640 1 -- 172.21.15.139:0/3250245202 wait complete. 2024-04-26T18:31:57.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.497+0000 7f24ecc59640 1 Processor -- start 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.497+0000 7f24ecc59640 1 -- start start 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24ecc59640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24e806c310 0x7f24e81f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24ecc59640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24ecc59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24e815c650 0x7f24e80ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24ecc59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f24e81561e0 con 0x7f24e815c650 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24ecc59640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f24e8070a00 con 0x7f24e806c310 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24ecc59640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f24e8156360 con 0x7f24e8155e00 2024-04-26T18:31:57.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24e815c650 0x7f24e80ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24e806c310 0x7f24e81f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24dffff640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24e815c650 0x7f24e80ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51422/0 (socket says 172.21.15.139:51422) 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e659c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24e806c310 0x7f24e81f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.139:54128/0 (socket says 172.21.15.139:54128) 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 -- 172.21.15.139:0/1676827397 learned_addr learned my addr 172.21.15.139:0/1676827397 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 -- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 msgr2=0x7f24e814e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e814e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 -- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24e806c310 msgr2=0x7f24e81f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24e806c310 0x7f24e81f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 -- 172.21.15.139:0/1676827397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e814cde0 con 0x7f24e815c650 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24dffff640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f24e8155e00 0x7f24e814e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24e6d9d640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24e815c650 0x7f24e80ce280 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c7a0 tx=0x7f24e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.498+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0018070 con 0x7f24e815c650 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.499+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e000a5e0 con 0x7f24e815c650 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.499+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e81f1bd0 con 0x7f24e815c650 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.499+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e000aa50 con 0x7f24e815c650 2024-04-26T18:31:57.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.499+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e81f2190 con 0x7f24e815c650 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.499+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24e8076d20 con 0x7f24e815c650 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.500+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24e001b070 con 0x7f24e815c650 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24deffd640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f24c806c920 0x7f24c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f24e008ba80 con 0x7f24e815c650 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24e659c640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f24c806c920 0x7f24c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24deffd640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f24c8076430 0x7f24c80788d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 --> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24e001be50 con 0x7f24c8076430 2024-04-26T18:31:57.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f24e008bf10 con 0x7f24e815c650 2024-04-26T18:31:57.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24dffff640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f24c8076430 0x7f24c80788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24e659c640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f24c806c920 0x7f24c806ede0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24d8034000 tx=0x7f24d802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.501+0000 7f24dffff640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f24c8076430 0x7f24c80788d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.819+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== osd.7 v2:172.21.15.143:6824/735298849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24e001be50 con 0x7f24c8076430 2024-04-26T18:31:57.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.832+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 --> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f24e80ccc30 con 0x7f24c8076430 2024-04-26T18:31:57.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.832+0000 7f24deffd640 1 -- 172.21.15.139:0/1676827397 <== osd.7 v2:172.21.15.143:6824/735298849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f24e80ccc30 con 0x7f24c8076430 2024-04-26T18:31:57.833 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-26T18:31:57.833 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:31:57.833 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-26T18:31:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f24c8076430 msgr2=0x7f24c80788d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.143:6824/735298849,v1:172.21.15.143:6825/735298849] conn(0x7f24c8076430 0x7f24c80788d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f24c806c920 msgr2=0x7f24c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f24c806c920 0x7f24c806ede0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24d8034000 tx=0x7f24d802e000 comp rx=0 tx=0).stop 2024-04-26T18:31:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24e815c650 msgr2=0x7f24e80ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 --2- 172.21.15.139:0/1676827397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24e815c650 0x7f24e80ce280 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c7a0 tx=0x7f24e000cc60 comp rx=0 tx=0).stop 2024-04-26T18:31:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24e6d9d640 1 -- 172.21.15.139:0/1676827397 reap_dead start 2024-04-26T18:31:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 shutdown_connections 2024-04-26T18:31:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 >> 172.21.15.139:0/1676827397 conn(0x7f24e8071e30 msgr2=0x7f24e8155000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 shutdown_connections 2024-04-26T18:31:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.833+0000 7f24ecc59640 1 -- 172.21.15.139:0/1676827397 wait complete. 2024-04-26T18:31:57.844 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T18:31:57.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.945+0000 7f4e0cd6a640 1 Processor -- start 2024-04-26T18:31:57.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.945+0000 7f4e0cd6a640 1 -- start start 2024-04-26T18:31:57.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e0cd6a640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f4e080ce310 0x7f4e080c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e0cd6a640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4e080ce6f0 0x7f4e0815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e0cd6a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080c5630 0x7f4e0815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e0cd6a640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f4e080c8d60 con 0x7f4e080ce6f0 2024-04-26T18:31:57.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e0cd6a640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f4e080c7c90 con 0x7f4e080ce310 2024-04-26T18:31:57.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e0cd6a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4e080c9d40 con 0x7f4e080c5630 2024-04-26T18:31:57.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4e080ce6f0 0x7f4e0815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f4e080ce6f0 0x7f4e0815c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51428/0 (socket says 172.21.15.139:51428) 2024-04-26T18:31:57.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 -- 172.21.15.139:0/484405664 learned_addr learned my addr 172.21.15.139:0/484405664 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e0659c640 1 --2- 172.21.15.139:0/484405664 >> v2:172.21.15.143:3300/0 conn(0x7f4e080ce310 0x7f4e080c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e06d9d640 1 --2- 172.21.15.139:0/484405664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080c5630 0x7f4e0815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 -- 172.21.15.139:0/484405664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080c5630 msgr2=0x7f4e0815c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:57.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 --2- 172.21.15.139:0/484405664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080c5630 0x7f4e0815c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 -- 172.21.15.139:0/484405664 >> v2:172.21.15.143:3300/0 conn(0x7f4e080ce310 msgr2=0x7f4e080c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:57.952 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 --2- 172.21.15.139:0/484405664 >> v2:172.21.15.143:3300/0 conn(0x7f4e080ce310 0x7f4e080c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.946+0000 7f4e05d9b640 1 -- 172.21.15.139:0/484405664 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e080c9fe0 con 0x7f4e080ce6f0 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.947+0000 7f4e05d9b640 1 --2- 172.21.15.139:0/484405664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080ce6f0 0x7f4e0815c160 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4e08071a30 tx=0x7f4dfc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ac946b5dd95644 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.947+0000 7f4e0559a640 1 -- 172.21.15.139:0/484405664 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc037070 con 0x7f4e080ce6f0 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.947+0000 7f4e0559a640 1 -- 172.21.15.139:0/484405664 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dfc032440 con 0x7f4e080ce6f0 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.947+0000 7f4e0559a640 1 -- 172.21.15.139:0/484405664 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc032810 con 0x7f4e080ce6f0 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/484405664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080ce6f0 msgr2=0x7f4e0815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/484405664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080ce6f0 0x7f4e0815c160 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4e08071a30 tx=0x7f4dfc02a2a0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/484405664 shutdown_connections 2024-04-26T18:31:57.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/484405664 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080c5630 0x7f4e0815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/484405664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080ce6f0 0x7f4e0815c160 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/484405664 >> v2:172.21.15.143:3300/0 conn(0x7f4e080ce310 0x7f4e080c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/484405664 >> 172.21.15.139:0/484405664 conn(0x7f4e08073710 msgr2=0x7f4e08070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:57.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/484405664 shutdown_connections 2024-04-26T18:31:57.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.948+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/484405664 wait complete. 2024-04-26T18:31:57.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 Processor -- start 2024-04-26T18:31:57.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 -- start start 2024-04-26T18:31:57.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080c5630 0x7f4e081f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e080ce310 0x7f4e081f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080ce6f0 0x7f4e081466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4e080ca880 con 0x7f4e080c5630 2024-04-26T18:31:57.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f4e080ca5a0 con 0x7f4e080ce310 2024-04-26T18:31:57.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0cd6a640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f4e080c7700 con 0x7f4e080ce6f0 2024-04-26T18:31:57.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080c5630 0x7f4e081f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0659c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080c5630 0x7f4e081f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51430/0 (socket says 172.21.15.139:51430) 2024-04-26T18:31:57.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e0659c640 1 -- 172.21.15.139:0/1043116940 learned_addr learned my addr 172.21.15.139:0/1043116940 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:57.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e05d9b640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e080ce310 0x7f4e081f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.950+0000 7f4e06d9d640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080ce6f0 0x7f4e081466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0659c640 1 -- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080ce6f0 msgr2=0x7f4e081466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0659c640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080ce6f0 0x7f4e081466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0659c640 1 -- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e080ce310 msgr2=0x7f4e081f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0659c640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e080ce310 0x7f4e081f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0659c640 1 -- 172.21.15.139:0/1043116940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e081e3b00 con 0x7f4e080c5630 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e06d9d640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080ce6f0 0x7f4e081466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e05d9b640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e080ce310 0x7f4e081f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:31:57.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0659c640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080c5630 0x7f4e081f1060 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e9e0 tx=0x7f4df800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4df6ffd640 1 -- 172.21.15.139:0/1043116940 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8017070 con 0x7f4e080c5630 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4df6ffd640 1 -- 172.21.15.139:0/1043116940 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df800c9d0 con 0x7f4e080c5630 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4df6ffd640 1 -- 172.21.15.139:0/1043116940 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df800cdc0 con 0x7f4e080c5630 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e081e3d70 con 0x7f4e080c5630 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.951+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e081f0860 con 0x7f4e080c5630 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.953+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e081e4290 con 0x7f4e080c5630 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.953+0000 7f4df6ffd640 1 -- 172.21.15.139:0/1043116940 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4df801a070 con 0x7f4e080c5630 2024-04-26T18:31:57.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.954+0000 7f4df6ffd640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4de806c8f0 0x7f4de806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:57.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.954+0000 7f4df6ffd640 1 -- 172.21.15.139:0/1043116940 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f4df808c280 con 0x7f4e080c5630 2024-04-26T18:31:57.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.954+0000 7f4e05d9b640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4de806c8f0 0x7f4de806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:57.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.955+0000 7f4e05d9b640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4de806c8f0 0x7f4de806edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc034000 tx=0x7f4dfc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:57.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:57.961+0000 7f4df6ffd640 1 -- 172.21.15.139:0/1043116940 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e081e4290 con 0x7f4e080c5630 2024-04-26T18:31:58.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.159+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f4e08076d20 con 0x7f4de806c8f0 2024-04-26T18:31:58.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.159+0000 7f4df6ffd640 1 -- 172.21.15.139:0/1043116940 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4e08076d20 con 0x7f4de806c8f0 2024-04-26T18:31:58.160 INFO:teuthology.orchestra.run.smithi139.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T18:31:58.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4de806c8f0 msgr2=0x7f4de806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4de806c8f0 0x7f4de806edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc034000 tx=0x7f4dfc02e000 comp rx=0 tx=0).stop 2024-04-26T18:31:58.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080c5630 msgr2=0x7f4e081f1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080c5630 0x7f4e081f1060 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4df800e9e0 tx=0x7f4df800eea0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.162 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 shutdown_connections 2024-04-26T18:31:58.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f4de806c8f0 0x7f4de806edb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f4e080ce6f0 0x7f4e081466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e080ce310 0x7f4e081f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 --2- 172.21.15.139:0/1043116940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e080c5630 0x7f4e081f1060 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.161+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 >> 172.21.15.139:0/1043116940 conn(0x7f4e08073710 msgr2=0x7f4e08152310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:58.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.162+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 shutdown_connections 2024-04-26T18:31:58.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.162+0000 7f4e0cd6a640 1 -- 172.21.15.139:0/1043116940 wait complete. 2024-04-26T18:31:58.173 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:31:58.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.269+0000 7f2ef6fc6640 1 Processor -- start 2024-04-26T18:31:58.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.269+0000 7f2ef6fc6640 1 -- start start 2024-04-26T18:31:58.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2ef6fc6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2ef00ca8d0 0x7f2ef00cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:58.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2ef6fc6640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f2ef0070d20 0x7f2ef01534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:58.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2ef6fc6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef015a8b0 con 0x7f2ef00ca4f0 2024-04-26T18:31:58.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2ef6fc6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef0070180 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2ef6fc6640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef0159d30 con 0x7f2ef0070d20 2024-04-26T18:31:58.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2eeffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2ef00ca8d0 0x7f2ef00cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2eeffff640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2ef00ca8d0 0x7f2ef00cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51446/0 (socket says 172.21.15.139:51446) 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2eeffff640 1 -- 172.21.15.139:0/1260601442 learned_addr learned my addr 172.21.15.139:0/1260601442 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2ef5563640 1 --2- 172.21.15.139:0/1260601442 >> v2:172.21.15.143:3300/0 conn(0x7f2ef0070d20 0x7f2ef01534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2eeffff640 1 -- 172.21.15.139:0/1260601442 >> v2:172.21.15.143:3300/0 conn(0x7f2ef0070d20 msgr2=0x7f2ef01534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2eeffff640 1 --2- 172.21.15.139:0/1260601442 >> v2:172.21.15.143:3300/0 conn(0x7f2ef0070d20 0x7f2ef01534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2eeffff640 1 -- 172.21.15.139:0/1260601442 >> v1:172.21.15.143:6789/0 conn(0x7f2ef00ca4f0 legacy=0x7f2ef0070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.270+0000 7f2eeffff640 1 -- 172.21.15.139:0/1260601442 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef015a010 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.273 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2eeffff640 1 --2- 172.21.15.139:0/1260601442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef00cc970 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00b28f0 tx=0x7f2edc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c813fec4125037 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2eef7fe640 1 -- 172.21.15.139:0/1260601442 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc037070 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2eef7fe640 1 -- 172.21.15.139:0/1260601442 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2edc032440 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2eef7fe640 1 -- 172.21.15.139:0/1260601442 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc032810 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/1260601442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 msgr2=0x7f2ef00cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/1260601442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef00cc970 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00b28f0 tx=0x7f2edc02a270 comp rx=0 tx=0).stop 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/1260601442 shutdown_connections 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/1260601442 >> v2:172.21.15.143:3300/0 conn(0x7f2ef0070d20 0x7f2ef01534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/1260601442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef00cc970 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/1260601442 >> 172.21.15.139:0/1260601442 conn(0x7f2ef0071ec0 msgr2=0x7f2ef00722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:58.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/1260601442 shutdown_connections 2024-04-26T18:31:58.275 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.271+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/1260601442 wait complete. 2024-04-26T18:31:58.277 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.272+0000 7f2ef6fc6640 1 Processor -- start 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef6fc6640 1 -- start start 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef6fc6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ef0070d20 0x7f2ef0149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef6fc6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ef00ca4f0 0x7f2ef006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef6fc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef01e4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef6fc6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef00cbbc0 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef6fc6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef015a5d0 con 0x7f2ef0070d20 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef6fc6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef0159910 con 0x7f2ef00ca4f0 2024-04-26T18:31:58.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef5563640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef01e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef4d62640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ef0070d20 0x7f2ef0149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef5563640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef01e4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51452/0 (socket says 172.21.15.139:51452) 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.273+0000 7f2ef5563640 1 -- 172.21.15.139:0/972157778 learned_addr learned my addr 172.21.15.139:0/972157778 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2eeffff640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ef00ca4f0 0x7f2ef006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef5563640 1 -- 172.21.15.139:0/972157778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ef00ca4f0 msgr2=0x7f2ef006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef5563640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ef00ca4f0 0x7f2ef006daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef5563640 1 -- 172.21.15.139:0/972157778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ef0070d20 msgr2=0x7f2ef0149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.279 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef5563640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ef0070d20 0x7f2ef0149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef5563640 1 -- 172.21.15.139:0/972157778 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef00ce570 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef5563640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef01e4170 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009dd0 tx=0x7f2ee800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2eed7fa640 1 -- 172.21.15.139:0/972157778 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8018020 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2eed7fa640 1 -- 172.21.15.139:0/972157778 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee8014480 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef01f1700 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2eed7fa640 1 -- 172.21.15.139:0/972157778 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8014870 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.274+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef01f1ca0 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.275+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef0076d20 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.276+0000 7f2eed7fa640 1 -- 172.21.15.139:0/972157778 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ee8005d10 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.276+0000 7f2eed7fa640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ed406c8f0 0x7f2ed406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:31:58.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.276+0000 7f2eed7fa640 1 -- 172.21.15.139:0/972157778 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2ee808c8b0 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.276+0000 7f2ef4d62640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ed406c8f0 0x7f2ed406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:31:58.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.276+0000 7f2ef4d62640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ed406c8f0 0x7f2ed406edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4001780 tx=0x7f2ee4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:31:58.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.280+0000 7f2eed7fa640 1 -- 172.21.15.139:0/972157778 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ee8022070 con 0x7f2ef00ca8d0 2024-04-26T18:31:58.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.456+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ef00c5500 con 0x7f2ed406c8f0 2024-04-26T18:31:58.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.464+0000 7f2eed7fa640 1 -- 172.21.15.139:0/972157778 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+337992 (secure 0 0 0) 0x7f2ef00c5500 con 0x7f2ed406c8f0 2024-04-26T18:31:58.467 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:31:58.469 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T18:31:58.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ed406c8f0 msgr2=0x7f2ed406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ed406c8f0 0x7f2ed406edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4001780 tx=0x7f2ee4009040 comp rx=0 tx=0).stop 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 msgr2=0x7f2ef01e4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef01e4170 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009dd0 tx=0x7f2ee800c490 comp rx=0 tx=0).stop 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 shutdown_connections 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2ed406c8f0 0x7f2ed406edb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef00ca8d0 0x7f2ef01e4170 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2ef00ca4f0 0x7f2ef006daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 --2- 172.21.15.139:0/972157778 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2ef0070d20 0x7f2ef0149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:31:58.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 >> 172.21.15.139:0/972157778 conn(0x7f2ef0071ec0 msgr2=0x7f2ef0157880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:31:58.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 shutdown_connections 2024-04-26T18:31:58.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:31:58.467+0000 7f2ef6fc6640 1 -- 172.21.15.139:0/972157778 wait complete. 2024-04-26T18:31:58.479 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":1056,"stamp":"2024-04-26T18:31:57.589675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1981270772,"num_objects":44241,"num_object_clones":19129,"num_object_copies":167018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44241,"num_whiteouts":18953,"num_read":8653,"num_read_kb":6016516,"num_write":113441,"num_write_kb":4242591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162749,"ondisk_log_size":162749,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6300504,"kb_used_data":4074968,"kb_used_omap":12,"kb_used_meta":2225459,"kb_avail":748674216,"statfs":{"total":773094113280,"available":766642397184,"internally_reserved":0,"allocated":4172767232,"data_stored":4172132872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2278870580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,12,1,38],"upper_bound":64},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5527,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":46272,"num_write":6,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003788"},"pg_stats":[{"pgid":"2.1f","version":"41'525","reported_seq":597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.580477+0000","last_change":"2024-04-26T17:58:03.719034+0000","last_active":"2024-04-26T18:31:51.580477+0000","last_peered":"2024-04-26T18:31:51.580477+0000","last_clean":"2024-04-26T18:31:51.580477+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T18:31:51.580477+0000","last_undegraded":"2024-04-26T18:31:51.580477+0000","last_fullsized":"2024-04-26T18:31:51.580477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:00.741409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37233347,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":593,"num_write_kb":74518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"41'606","reported_seq":2691,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.632293+0000","last_change":"2024-04-26T18:03:00.448985+0000","last_active":"2024-04-26T18:31:51.632293+0000","last_peered":"2024-04-26T18:31:51.632293+0000","last_clean":"2024-04-26T18:31:51.632293+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T18:31:51.632293+0000","last_undegraded":"2024-04-26T18:31:51.632293+0000","last_fullsized":"2024-04-26T18:31:51.632293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:41.107725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230683108,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"41'2821","reported_seq":4553,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.922122+0000","last_change":"2024-04-26T18:03:00.450087+0000","last_active":"2024-04-26T18:31:49.922122+0000","last_peered":"2024-04-26T18:31:49.922122+0000","last_clean":"2024-04-26T18:31:49.922122+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T18:31:49.922122+0000","last_undegraded":"2024-04-26T18:31:49.922122+0000","last_fullsized":"2024-04-26T18:31:49.922122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:07.265582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.226534869,"stat_sum":{"num_bytes":47000043,"num_objects":1217,"num_object_clones":566,"num_object_copies":4868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":566,"num_read":213,"num_read_kb":295654,"num_write":2298,"num_write_kb":59293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'1115","reported_seq":1187,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174878+0000","last_change":"2024-04-26T17:58:03.716270+0000","last_active":"2024-04-26T18:30:48.174878+0000","last_peered":"2024-04-26T18:30:48.174878+0000","last_clean":"2024-04-26T18:30:48.174878+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T18:30:48.174878+0000","last_undegraded":"2024-04-26T18:30:48.174878+0000","last_fullsized":"2024-04-26T18:30:48.174878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:38.839807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":1207,"num_write_kb":83571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"41'591","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.649551+0000","last_change":"2024-04-26T18:03:00.426487+0000","last_active":"2024-04-26T18:31:51.649551+0000","last_peered":"2024-04-26T18:31:51.649551+0000","last_clean":"2024-04-26T18:31:51.649551+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T18:31:51.649551+0000","last_undegraded":"2024-04-26T18:31:51.649551+0000","last_fullsized":"2024-04-26T18:31:51.649551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:33.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19357582500000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":12,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"41'2977","reported_seq":4612,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.906195+0000","last_change":"2024-04-26T18:03:00.392141+0000","last_active":"2024-04-26T18:31:49.906195+0000","last_peered":"2024-04-26T18:31:49.906195+0000","last_clean":"2024-04-26T18:31:49.906195+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T18:31:49.906195+0000","last_undegraded":"2024-04-26T18:31:49.906195+0000","last_fullsized":"2024-04-26T18:31:49.906195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:05.822108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17635221100000001,"stat_sum":{"num_bytes":22365631,"num_objects":1261,"num_object_clones":594,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1261,"num_whiteouts":594,"num_read":144,"num_read_kb":92763,"num_write":2429,"num_write_kb":39864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"41'1019","reported_seq":1088,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.103488+0000","last_change":"2024-04-26T17:58:03.722989+0000","last_active":"2024-04-26T18:30:48.103488+0000","last_peered":"2024-04-26T18:30:48.103488+0000","last_clean":"2024-04-26T18:30:48.103488+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T18:30:48.103488+0000","last_undegraded":"2024-04-26T18:30:48.103488+0000","last_fullsized":"2024-04-26T18:30:48.103488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:28.225148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":1097,"num_write_kb":133138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'626","reported_seq":2708,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.655184+0000","last_change":"2024-04-26T18:03:00.388273+0000","last_active":"2024-04-26T18:31:51.655184+0000","last_peered":"2024-04-26T18:31:51.655184+0000","last_clean":"2024-04-26T18:31:51.655184+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T18:31:51.655184+0000","last_undegraded":"2024-04-26T18:31:51.655184+0000","last_fullsized":"2024-04-26T18:31:51.655184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:56.202777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16172857600000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"41'2946","reported_seq":4651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.918146+0000","last_change":"2024-04-26T18:03:00.421690+0000","last_active":"2024-04-26T18:31:49.918146+0000","last_peered":"2024-04-26T18:31:49.918146+0000","last_clean":"2024-04-26T18:31:49.918146+0000","last_became_active":"2024-04-26T17:58:46.846516+0000","last_became_peered":"2024-04-26T17:58:46.846516+0000","last_unstale":"2024-04-26T18:31:49.918146+0000","last_undegraded":"2024-04-26T18:31:49.918146+0000","last_fullsized":"2024-04-26T18:31:49.918146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:34.049400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18830187000000001,"stat_sum":{"num_bytes":52036256,"num_objects":1294,"num_object_clones":599,"num_object_copies":5176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":599,"num_read":211,"num_read_kb":315253,"num_write":2398,"num_write_kb":54529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"41'525","reported_seq":594,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.579571+0000","last_change":"2024-04-26T17:58:03.719198+0000","last_active":"2024-04-26T18:30:13.579571+0000","last_peered":"2024-04-26T18:30:13.579571+0000","last_clean":"2024-04-26T18:30:13.579571+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T18:30:13.579571+0000","last_undegraded":"2024-04-26T18:30:13.579571+0000","last_fullsized":"2024-04-26T18:30:13.579571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:59.073184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":594,"num_write_kb":70938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"41'609","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.656748+0000","last_change":"2024-04-26T18:03:00.385887+0000","last_active":"2024-04-26T18:31:51.656748+0000","last_peered":"2024-04-26T18:31:51.656748+0000","last_clean":"2024-04-26T18:31:51.656748+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T18:31:51.656748+0000","last_undegraded":"2024-04-26T18:31:51.656748+0000","last_fullsized":"2024-04-26T18:31:51.656748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:36.980517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161485249,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"41'2787","reported_seq":4509,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.878566+0000","last_change":"2024-04-26T18:03:00.421543+0000","last_active":"2024-04-26T18:31:49.878566+0000","last_peered":"2024-04-26T18:31:49.878566+0000","last_clean":"2024-04-26T18:31:49.878566+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T18:31:49.878566+0000","last_undegraded":"2024-04-26T18:31:49.878566+0000","last_fullsized":"2024-04-26T18:31:49.878566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2787,"log_dups_size":0,"ondisk_log_size":2787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:00.311837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18642139199999999,"stat_sum":{"num_bytes":46440810,"num_objects":1192,"num_object_clones":545,"num_object_copies":4768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":545,"num_read":181,"num_read_kb":201245,"num_write":2302,"num_write_kb":49304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"41'634","reported_seq":2708,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.629361+0000","last_change":"2024-04-26T18:03:00.044745+0000","last_active":"2024-04-26T18:31:51.629361+0000","last_peered":"2024-04-26T18:31:51.629361+0000","last_clean":"2024-04-26T18:31:51.629361+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T18:31:51.629361+0000","last_undegraded":"2024-04-26T18:31:51.629361+0000","last_fullsized":"2024-04-26T18:31:51.629361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:46.688756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101605577,"stat_sum":{"num_bytes":0,"num_objects":66,"num_object_clones":20,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"41'2536","reported_seq":2607,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:08.693990+0000","last_change":"2024-04-26T17:58:03.719807+0000","last_active":"2024-04-26T18:30:08.693990+0000","last_peered":"2024-04-26T18:30:08.693990+0000","last_clean":"2024-04-26T18:30:08.693990+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T18:30:08.693990+0000","last_undegraded":"2024-04-26T18:30:08.693990+0000","last_fullsized":"2024-04-26T18:30:08.693990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2536,"log_dups_size":0,"ondisk_log_size":2536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:47.867691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":2609,"num_write_kb":88139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"41'2917","reported_seq":4589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.942322+0000","last_change":"2024-04-26T18:03:00.418993+0000","last_active":"2024-04-26T18:31:49.942322+0000","last_peered":"2024-04-26T18:31:49.942322+0000","last_clean":"2024-04-26T18:31:49.942322+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T18:31:49.942322+0000","last_undegraded":"2024-04-26T18:31:49.942322+0000","last_fullsized":"2024-04-26T18:31:49.942322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:49.886797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19133515200000001,"stat_sum":{"num_bytes":43266035,"num_objects":1273,"num_object_clones":588,"num_object_copies":5092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1273,"num_whiteouts":588,"num_read":173,"num_read_kb":222814,"num_write":2389,"num_write_kb":54953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"41'613","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.625336+0000","last_change":"2024-04-26T18:03:00.446780+0000","last_active":"2024-04-26T18:31:51.625336+0000","last_peered":"2024-04-26T18:31:51.625336+0000","last_clean":"2024-04-26T18:31:51.625336+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T18:31:51.625336+0000","last_undegraded":"2024-04-26T18:31:51.625336+0000","last_fullsized":"2024-04-26T18:31:51.625336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:07.280297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22887548799999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":9,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'1327","reported_seq":1398,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:47.818586+0000","last_change":"2024-04-26T17:58:03.713126+0000","last_active":"2024-04-26T18:30:47.818586+0000","last_peered":"2024-04-26T18:30:47.818586+0000","last_clean":"2024-04-26T18:30:47.818586+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T18:30:47.818586+0000","last_undegraded":"2024-04-26T18:30:47.818586+0000","last_fullsized":"2024-04-26T18:30:47.818586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.323344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":1392,"num_write_kb":95976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"41'2855","reported_seq":4551,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.891487+0000","last_change":"2024-04-26T18:03:00.416771+0000","last_active":"2024-04-26T18:31:49.891487+0000","last_peered":"2024-04-26T18:31:49.891487+0000","last_clean":"2024-04-26T18:31:49.891487+0000","last_became_active":"2024-04-26T17:58:46.846635+0000","last_became_peered":"2024-04-26T17:58:46.846635+0000","last_unstale":"2024-04-26T18:31:49.891487+0000","last_undegraded":"2024-04-26T18:31:49.891487+0000","last_fullsized":"2024-04-26T18:31:49.891487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:18:06.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18928092499999999,"stat_sum":{"num_bytes":21448645,"num_objects":1180,"num_object_clones":543,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":543,"num_read":145,"num_read_kb":62792,"num_write":2368,"num_write_kb":33318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"41'655","reported_seq":2734,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.619383+0000","last_change":"2024-04-26T18:03:00.446546+0000","last_active":"2024-04-26T18:31:51.619383+0000","last_peered":"2024-04-26T18:31:51.619383+0000","last_clean":"2024-04-26T18:31:51.619383+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T18:31:51.619383+0000","last_undegraded":"2024-04-26T18:31:51.619383+0000","last_fullsized":"2024-04-26T18:31:51.619383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:59:30.786683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22842327800000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":15,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"41'848","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.175344+0000","last_change":"2024-04-26T17:58:03.718890+0000","last_active":"2024-04-26T18:30:48.175344+0000","last_peered":"2024-04-26T18:30:48.175344+0000","last_clean":"2024-04-26T18:30:48.175344+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T18:30:48.175344+0000","last_undegraded":"2024-04-26T18:30:48.175344+0000","last_fullsized":"2024-04-26T18:30:48.175344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.859513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":901,"num_write_kb":79506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"41'2890","reported_seq":4576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.900055+0000","last_change":"2024-04-26T18:03:00.013967+0000","last_active":"2024-04-26T18:31:36.900055+0000","last_peered":"2024-04-26T18:31:36.900055+0000","last_clean":"2024-04-26T18:31:36.900055+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T18:31:36.900055+0000","last_undegraded":"2024-04-26T18:31:36.900055+0000","last_fullsized":"2024-04-26T18:31:36.900055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:21:56.071843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077792920000000002,"stat_sum":{"num_bytes":29575215,"num_objects":1245,"num_object_clones":583,"num_object_copies":4980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":583,"num_read":185,"num_read_kb":122841,"num_write":2351,"num_write_kb":42495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"41'617","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.599640+0000","last_change":"2024-04-26T18:03:00.424812+0000","last_active":"2024-04-26T18:31:51.599640+0000","last_peered":"2024-04-26T18:31:51.599640+0000","last_clean":"2024-04-26T18:31:51.599640+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T18:31:51.599640+0000","last_undegraded":"2024-04-26T18:31:51.599640+0000","last_fullsized":"2024-04-26T18:31:51.599640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:21.113921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18061166100000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"41'468","reported_seq":539,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:45.748977+0000","last_change":"2024-04-26T17:58:03.720286+0000","last_active":"2024-04-26T18:30:45.748977+0000","last_peered":"2024-04-26T18:30:45.748977+0000","last_clean":"2024-04-26T18:30:45.748977+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T18:30:45.748977+0000","last_undegraded":"2024-04-26T18:30:45.748977+0000","last_fullsized":"2024-04-26T18:30:45.748977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:07.769472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":511,"num_write_kb":66851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"41'2805","reported_seq":4486,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.143849+0000","last_change":"2024-04-26T18:03:00.413832+0000","last_active":"2024-04-26T18:31:49.143849+0000","last_peered":"2024-04-26T18:31:49.143849+0000","last_clean":"2024-04-26T18:31:49.143849+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T18:31:49.143849+0000","last_undegraded":"2024-04-26T18:31:49.143849+0000","last_fullsized":"2024-04-26T18:31:49.143849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2805,"log_dups_size":0,"ondisk_log_size":2805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:37.962626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18788326999999999,"stat_sum":{"num_bytes":37828835,"num_objects":1237,"num_object_clones":573,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":573,"num_read":167,"num_read_kb":252976,"num_write":2275,"num_write_kb":48379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"41'600","reported_seq":2682,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.623060+0000","last_change":"2024-04-26T18:03:00.425151+0000","last_active":"2024-04-26T18:31:51.623060+0000","last_peered":"2024-04-26T18:31:51.623060+0000","last_clean":"2024-04-26T18:31:51.623060+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T18:31:51.623060+0000","last_undegraded":"2024-04-26T18:31:51.623060+0000","last_fullsized":"2024-04-26T18:31:51.623060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:28.966252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19854031599999999,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"41'813","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:33.145622+0000","last_change":"2024-04-26T17:58:03.723879+0000","last_active":"2024-04-26T18:29:33.145622+0000","last_peered":"2024-04-26T18:29:33.145622+0000","last_clean":"2024-04-26T18:29:33.145622+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T18:29:33.145622+0000","last_undegraded":"2024-04-26T18:29:33.145622+0000","last_fullsized":"2024-04-26T18:29:33.145622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:18.897855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":915,"num_write_kb":75562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"41'2861","reported_seq":4554,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.931552+0000","last_change":"2024-04-26T18:03:00.424600+0000","last_active":"2024-04-26T18:31:49.931552+0000","last_peered":"2024-04-26T18:31:49.931552+0000","last_clean":"2024-04-26T18:31:49.931552+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T18:31:49.931552+0000","last_undegraded":"2024-04-26T18:31:49.931552+0000","last_fullsized":"2024-04-26T18:31:49.931552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:18.947305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.181349811,"stat_sum":{"num_bytes":38568471,"num_objects":1183,"num_object_clones":549,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":549,"num_read":153,"num_read_kb":161622,"num_write":2358,"num_write_kb":47514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"41'595","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.618049+0000","last_change":"2024-04-26T18:03:00.451850+0000","last_active":"2024-04-26T18:31:51.618049+0000","last_peered":"2024-04-26T18:31:51.618049+0000","last_clean":"2024-04-26T18:31:51.618049+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T18:31:51.618049+0000","last_undegraded":"2024-04-26T18:31:51.618049+0000","last_fullsized":"2024-04-26T18:31:51.618049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:02.283489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217975578,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"41'1484","reported_seq":1555,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:05.183866+0000","last_change":"2024-04-26T17:58:03.723352+0000","last_active":"2024-04-26T18:31:05.183866+0000","last_peered":"2024-04-26T18:31:05.183866+0000","last_clean":"2024-04-26T18:31:05.183866+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T18:31:05.183866+0000","last_undegraded":"2024-04-26T18:31:05.183866+0000","last_fullsized":"2024-04-26T18:31:05.183866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.278084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":3200,"num_write_kb":72387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"41'2904","reported_seq":4604,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.925275+0000","last_change":"2024-04-26T18:03:00.447628+0000","last_active":"2024-04-26T18:31:49.925275+0000","last_peered":"2024-04-26T18:31:49.925275+0000","last_clean":"2024-04-26T18:31:49.925275+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T18:31:49.925275+0000","last_undegraded":"2024-04-26T18:31:49.925275+0000","last_fullsized":"2024-04-26T18:31:49.925275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2904,"log_dups_size":0,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:52.167836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23002119400000001,"stat_sum":{"num_bytes":32774060,"num_objects":1224,"num_object_clones":563,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1224,"num_whiteouts":563,"num_read":174,"num_read_kb":173649,"num_write":2397,"num_write_kb":37665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"41'616","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.619958+0000","last_change":"2024-04-26T18:03:00.013128+0000","last_active":"2024-04-26T18:31:51.619958+0000","last_peered":"2024-04-26T18:31:51.619958+0000","last_clean":"2024-04-26T18:31:51.619958+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T18:31:51.619958+0000","last_undegraded":"2024-04-26T18:31:51.619958+0000","last_fullsized":"2024-04-26T18:31:51.619958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:28.496234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077215679999999995,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"41'788","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.548547+0000","last_change":"2024-04-26T17:58:03.719276+0000","last_active":"2024-04-26T18:30:18.548547+0000","last_peered":"2024-04-26T18:30:18.548547+0000","last_clean":"2024-04-26T18:30:18.548547+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T18:30:18.548547+0000","last_undegraded":"2024-04-26T18:30:18.548547+0000","last_fullsized":"2024-04-26T18:30:18.548547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:05.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":856,"num_write_kb":87605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"41'2980","reported_seq":4642,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.979398+0000","last_change":"2024-04-26T18:03:00.424270+0000","last_active":"2024-04-26T18:31:49.979398+0000","last_peered":"2024-04-26T18:31:49.979398+0000","last_clean":"2024-04-26T18:31:49.979398+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T18:31:49.979398+0000","last_undegraded":"2024-04-26T18:31:49.979398+0000","last_fullsized":"2024-04-26T18:31:49.979398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:36.634495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20617318100000001,"stat_sum":{"num_bytes":38568987,"num_objects":1282,"num_object_clones":600,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":600,"num_read":173,"num_read_kb":195813,"num_write":2429,"num_write_kb":47342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'621","reported_seq":2707,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.652649+0000","last_change":"2024-04-26T18:03:00.387991+0000","last_active":"2024-04-26T18:31:51.652649+0000","last_peered":"2024-04-26T18:31:51.652649+0000","last_clean":"2024-04-26T18:31:51.652649+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T18:31:51.652649+0000","last_undegraded":"2024-04-26T18:31:51.652649+0000","last_fullsized":"2024-04-26T18:31:51.652649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:06.986658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.161265819,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"41'746","reported_seq":818,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.190651+0000","last_change":"2024-04-26T17:58:03.716215+0000","last_active":"2024-04-26T18:30:48.190651+0000","last_peered":"2024-04-26T18:30:48.190651+0000","last_clean":"2024-04-26T18:30:48.190651+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T18:30:48.190651+0000","last_undegraded":"2024-04-26T18:30:48.190651+0000","last_fullsized":"2024-04-26T18:30:48.190651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:03.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":797,"num_write_kb":111877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"41'2902","reported_seq":4613,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.107000+0000","last_change":"2024-04-26T18:03:00.012758+0000","last_active":"2024-04-26T18:31:49.107000+0000","last_peered":"2024-04-26T18:31:49.107000+0000","last_clean":"2024-04-26T18:31:49.107000+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T18:31:49.107000+0000","last_undegraded":"2024-04-26T18:31:49.107000+0000","last_fullsized":"2024-04-26T18:31:49.107000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2902,"log_dups_size":0,"ondisk_log_size":2902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:29.245551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077512545000000002,"stat_sum":{"num_bytes":51130541,"num_objects":1258,"num_object_clones":577,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":577,"num_read":199,"num_read_kb":291004,"num_write":2373,"num_write_kb":60236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'619","reported_seq":2703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.631645+0000","last_change":"2024-04-26T18:03:00.422866+0000","last_active":"2024-04-26T18:31:51.631645+0000","last_peered":"2024-04-26T18:31:51.631645+0000","last_clean":"2024-04-26T18:31:51.631645+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T18:31:51.631645+0000","last_undegraded":"2024-04-26T18:31:51.631645+0000","last_fullsized":"2024-04-26T18:31:51.631645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:27.152866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18566148499999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"41'538","reported_seq":610,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.192866+0000","last_change":"2024-04-26T17:58:03.711548+0000","last_active":"2024-04-26T18:30:48.192866+0000","last_peered":"2024-04-26T18:30:48.192866+0000","last_clean":"2024-04-26T18:30:48.192866+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T18:30:48.192866+0000","last_undegraded":"2024-04-26T18:30:48.192866+0000","last_fullsized":"2024-04-26T18:30:48.192866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:58.844662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":583,"num_write_kb":83272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"41'2814","reported_seq":4456,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.924329+0000","last_change":"2024-04-26T18:03:00.013541+0000","last_active":"2024-04-26T18:31:49.924329+0000","last_peered":"2024-04-26T18:31:49.924329+0000","last_clean":"2024-04-26T18:31:49.924329+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T18:31:49.924329+0000","last_undegraded":"2024-04-26T18:31:49.924329+0000","last_fullsized":"2024-04-26T18:31:49.924329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:37.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077645753999999997,"stat_sum":{"num_bytes":21677192,"num_objects":1207,"num_object_clones":566,"num_object_copies":4828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":566,"num_read":120,"num_read_kb":106865,"num_write":2295,"num_write_kb":28218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"41'628","reported_seq":2707,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.620038+0000","last_change":"2024-04-26T18:03:00.012108+0000","last_active":"2024-04-26T18:31:51.620038+0000","last_peered":"2024-04-26T18:31:51.620038+0000","last_clean":"2024-04-26T18:31:51.620038+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T18:31:51.620038+0000","last_undegraded":"2024-04-26T18:31:51.620038+0000","last_fullsized":"2024-04-26T18:31:51.620038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:45.171474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076659478000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'1618","reported_seq":2626,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.549967+0000","last_change":"2024-04-26T17:58:03.714397+0000","last_active":"2024-04-26T18:30:18.549967+0000","last_peered":"2024-04-26T18:30:18.549967+0000","last_clean":"2024-04-26T18:30:18.549967+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T18:30:18.549967+0000","last_undegraded":"2024-04-26T18:30:18.549967+0000","last_fullsized":"2024-04-26T18:30:18.549967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1618,"log_dups_size":0,"ondisk_log_size":1618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:45.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":992,"num_read_kb":4725,"num_write":1685,"num_write_kb":100551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"41'2764","reported_seq":4485,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.945886+0000","last_change":"2024-04-26T18:03:00.014183+0000","last_active":"2024-04-26T18:31:49.945886+0000","last_peered":"2024-04-26T18:31:49.945886+0000","last_clean":"2024-04-26T18:31:49.945886+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T18:31:49.945886+0000","last_undegraded":"2024-04-26T18:31:49.945886+0000","last_fullsized":"2024-04-26T18:31:49.945886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2764,"log_dups_size":0,"ondisk_log_size":2764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:54.571531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077766350999999997,"stat_sum":{"num_bytes":40144243,"num_objects":1196,"num_object_clones":556,"num_object_copies":4784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":556,"num_read":189,"num_read_kb":267710,"num_write":2256,"num_write_kb":47769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"41'591","reported_seq":2674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.617462+0000","last_change":"2024-04-26T18:03:00.423065+0000","last_active":"2024-04-26T18:31:51.617462+0000","last_peered":"2024-04-26T18:31:51.617462+0000","last_clean":"2024-04-26T18:31:51.617462+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T18:31:51.617462+0000","last_undegraded":"2024-04-26T18:31:51.617462+0000","last_fullsized":"2024-04-26T18:31:51.617462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:15.084787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20174721700000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'667","reported_seq":739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:29:48.152482+0000","last_change":"2024-04-26T17:58:03.720173+0000","last_active":"2024-04-26T18:29:48.152482+0000","last_peered":"2024-04-26T18:29:48.152482+0000","last_clean":"2024-04-26T18:29:48.152482+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T18:29:48.152482+0000","last_undegraded":"2024-04-26T18:29:48.152482+0000","last_fullsized":"2024-04-26T18:29:48.152482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:07.865610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":715,"num_write_kb":79339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"41'2915","reported_seq":4596,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.917258+0000","last_change":"2024-04-26T18:03:00.426626+0000","last_active":"2024-04-26T18:31:49.917258+0000","last_peered":"2024-04-26T18:31:49.917258+0000","last_clean":"2024-04-26T18:31:49.917258+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T18:31:49.917258+0000","last_undegraded":"2024-04-26T18:31:49.917258+0000","last_fullsized":"2024-04-26T18:31:49.917258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:11.102216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20190264199999999,"stat_sum":{"num_bytes":26615609,"num_objects":1212,"num_object_clones":560,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":560,"num_read":154,"num_read_kb":128765,"num_write":2402,"num_write_kb":29722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"41'629","reported_seq":2710,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.654798+0000","last_change":"2024-04-26T18:03:00.450371+0000","last_active":"2024-04-26T18:31:51.654798+0000","last_peered":"2024-04-26T18:31:51.654798+0000","last_clean":"2024-04-26T18:31:51.654798+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T18:31:51.654798+0000","last_undegraded":"2024-04-26T18:31:51.654798+0000","last_fullsized":"2024-04-26T18:31:51.654798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:39.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22655562100000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'1595","reported_seq":1667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.175583+0000","last_change":"2024-04-26T17:58:03.714775+0000","last_active":"2024-04-26T18:30:16.175583+0000","last_peered":"2024-04-26T18:30:16.175583+0000","last_clean":"2024-04-26T18:30:16.175583+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T18:30:16.175583+0000","last_undegraded":"2024-04-26T18:30:16.175583+0000","last_fullsized":"2024-04-26T18:30:16.175583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1595,"log_dups_size":0,"ondisk_log_size":1595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:07.510616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":0,"num_write":1680,"num_write_kb":72101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:28:03.048194+0000","last_change":"2024-04-26T17:57:54.436915+0000","last_active":"2024-04-26T18:28:03.048194+0000","last_peered":"2024-04-26T18:28:03.048194+0000","last_clean":"2024-04-26T18:28:03.048194+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T18:28:03.048194+0000","last_undegraded":"2024-04-26T18:28:03.048194+0000","last_fullsized":"2024-04-26T18:28:03.048194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:57:53.189662+0000","last_clean_scrub_stamp":"2024-04-26T17:57:53.189662+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:53.758034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"41'3034","reported_seq":4679,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:38.071662+0000","last_change":"2024-04-26T18:03:00.043842+0000","last_active":"2024-04-26T18:31:38.071662+0000","last_peered":"2024-04-26T18:31:38.071662+0000","last_clean":"2024-04-26T18:31:38.071662+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T18:31:38.071662+0000","last_undegraded":"2024-04-26T18:31:38.071662+0000","last_fullsized":"2024-04-26T18:31:38.071662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:43.054742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101669149,"stat_sum":{"num_bytes":43937728,"num_objects":1270,"num_object_clones":639,"num_object_copies":5080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1270,"num_whiteouts":551,"num_read":195,"num_read_kb":160663,"num_write":2447,"num_write_kb":52378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"41'609","reported_seq":2688,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.648624+0000","last_change":"2024-04-26T18:03:00.046750+0000","last_active":"2024-04-26T18:31:51.648624+0000","last_peered":"2024-04-26T18:31:51.648624+0000","last_clean":"2024-04-26T18:31:51.648624+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T18:31:51.648624+0000","last_undegraded":"2024-04-26T18:31:51.648624+0000","last_fullsized":"2024-04-26T18:31:51.648624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:48.686392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10552916,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"41'542","reported_seq":613,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:15.802404+0000","last_change":"2024-04-26T17:58:03.714435+0000","last_active":"2024-04-26T18:30:15.802404+0000","last_peered":"2024-04-26T18:30:15.802404+0000","last_clean":"2024-04-26T18:30:15.802404+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T18:30:15.802404+0000","last_undegraded":"2024-04-26T18:30:15.802404+0000","last_fullsized":"2024-04-26T18:30:15.802404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:59.638785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":567,"num_write_kb":79001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"41'2911","reported_seq":4625,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.903996+0000","last_change":"2024-04-26T18:03:00.044856+0000","last_active":"2024-04-26T18:31:49.903996+0000","last_peered":"2024-04-26T18:31:49.903996+0000","last_clean":"2024-04-26T18:31:49.903996+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T18:31:49.903996+0000","last_undegraded":"2024-04-26T18:31:49.903996+0000","last_fullsized":"2024-04-26T18:31:49.903996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:57.254209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102636063,"stat_sum":{"num_bytes":37322430,"num_objects":1233,"num_object_clones":576,"num_object_copies":4932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1233,"num_whiteouts":576,"num_read":202,"num_read_kb":211285,"num_write":2388,"num_write_kb":48792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"41'613","reported_seq":2700,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.657106+0000","last_change":"2024-04-26T18:03:00.390471+0000","last_active":"2024-04-26T18:31:51.657106+0000","last_peered":"2024-04-26T18:31:51.657106+0000","last_clean":"2024-04-26T18:31:51.657106+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T18:31:51.657106+0000","last_undegraded":"2024-04-26T18:31:51.657106+0000","last_fullsized":"2024-04-26T18:31:51.657106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:29.493089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16359686500000001,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"41'1297","reported_seq":1368,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.203238+0000","last_change":"2024-04-26T17:58:03.715548+0000","last_active":"2024-04-26T18:30:48.203238+0000","last_peered":"2024-04-26T18:30:48.203238+0000","last_clean":"2024-04-26T18:30:48.203238+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T18:30:48.203238+0000","last_undegraded":"2024-04-26T18:30:48.203238+0000","last_fullsized":"2024-04-26T18:30:48.203238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1297,"log_dups_size":0,"ondisk_log_size":1297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:16.432613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29364754,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":1371,"num_write_kb":104375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"41'2892","reported_seq":4602,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.981567+0000","last_change":"2024-04-26T18:03:00.425610+0000","last_active":"2024-04-26T18:31:49.981567+0000","last_peered":"2024-04-26T18:31:49.981567+0000","last_clean":"2024-04-26T18:31:49.981567+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T18:31:49.981567+0000","last_undegraded":"2024-04-26T18:31:49.981567+0000","last_fullsized":"2024-04-26T18:31:49.981567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:35:33.606482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20706662200000001,"stat_sum":{"num_bytes":43474396,"num_objects":1246,"num_object_clones":573,"num_object_copies":4984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":573,"num_read":195,"num_read_kb":270204,"num_write":2374,"num_write_kb":47127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"41'602","reported_seq":2683,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.652887+0000","last_change":"2024-04-26T18:03:00.046998+0000","last_active":"2024-04-26T18:31:51.652887+0000","last_peered":"2024-04-26T18:31:51.652887+0000","last_clean":"2024-04-26T18:31:51.652887+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T18:31:51.652887+0000","last_undegraded":"2024-04-26T18:31:51.652887+0000","last_fullsized":"2024-04-26T18:31:51.652887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:51.010015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104614815,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"41'698","reported_seq":769,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.174916+0000","last_change":"2024-04-26T17:58:03.715094+0000","last_active":"2024-04-26T18:30:48.174916+0000","last_peered":"2024-04-26T18:30:48.174916+0000","last_clean":"2024-04-26T18:30:48.174916+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T18:30:48.174916+0000","last_undegraded":"2024-04-26T18:30:48.174916+0000","last_fullsized":"2024-04-26T18:30:48.174916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:57.640651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":758,"num_write_kb":95614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"41'2925","reported_seq":4674,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.927130+0000","last_change":"2024-04-26T18:03:00.379880+0000","last_active":"2024-04-26T18:31:49.927130+0000","last_peered":"2024-04-26T18:31:49.927130+0000","last_clean":"2024-04-26T18:31:49.927130+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T18:31:49.927130+0000","last_undegraded":"2024-04-26T18:31:49.927130+0000","last_fullsized":"2024-04-26T18:31:49.927130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:12.400616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16179385399999999,"stat_sum":{"num_bytes":31406117,"num_objects":1218,"num_object_clones":563,"num_object_copies":4872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":563,"num_read":224,"num_read_kb":160685,"num_write":2420,"num_write_kb":43855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"41'604","reported_seq":2690,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.654280+0000","last_change":"2024-04-26T18:03:00.046050+0000","last_active":"2024-04-26T18:31:51.654280+0000","last_peered":"2024-04-26T18:31:51.654280+0000","last_clean":"2024-04-26T18:31:51.654280+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T18:31:51.654280+0000","last_undegraded":"2024-04-26T18:31:51.654280+0000","last_fullsized":"2024-04-26T18:31:51.654280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:37.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103300084,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'716","reported_seq":787,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.549837+0000","last_change":"2024-04-26T17:58:03.716248+0000","last_active":"2024-04-26T18:30:18.549837+0000","last_peered":"2024-04-26T18:30:18.549837+0000","last_clean":"2024-04-26T18:30:18.549837+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T18:30:18.549837+0000","last_undegraded":"2024-04-26T18:30:18.549837+0000","last_fullsized":"2024-04-26T18:30:18.549837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:02.479802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165846,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":771,"num_write_kb":75142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"41'2803","reported_seq":4577,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.968240+0000","last_change":"2024-04-26T18:03:00.424342+0000","last_active":"2024-04-26T18:31:49.968240+0000","last_peered":"2024-04-26T18:31:49.968240+0000","last_clean":"2024-04-26T18:31:49.968240+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T18:31:49.968240+0000","last_undegraded":"2024-04-26T18:31:49.968240+0000","last_fullsized":"2024-04-26T18:31:49.968240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:41.316721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18140468300000001,"stat_sum":{"num_bytes":44194819,"num_objects":1210,"num_object_clones":561,"num_object_copies":4840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":561,"num_read":248,"num_read_kb":269492,"num_write":2276,"num_write_kb":51233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"41'649","reported_seq":2728,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.647535+0000","last_change":"2024-04-26T18:03:00.047648+0000","last_active":"2024-04-26T18:31:51.647535+0000","last_peered":"2024-04-26T18:31:51.647535+0000","last_clean":"2024-04-26T18:31:51.647535+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T18:31:51.647535+0000","last_undegraded":"2024-04-26T18:31:51.647535+0000","last_fullsized":"2024-04-26T18:31:51.647535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:39.617916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101409261,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":14,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"41'843","reported_seq":913,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:16.172834+0000","last_change":"2024-04-26T17:58:03.711563+0000","last_active":"2024-04-26T18:30:16.172834+0000","last_peered":"2024-04-26T18:30:16.172834+0000","last_clean":"2024-04-26T18:30:16.172834+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T18:30:16.172834+0000","last_undegraded":"2024-04-26T18:30:16.172834+0000","last_fullsized":"2024-04-26T18:30:16.172834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:35.366904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":83,"num_read_kb":0,"num_write":946,"num_write_kb":79922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"41'2759","reported_seq":4445,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.893293+0000","last_change":"2024-04-26T18:03:00.423934+0000","last_active":"2024-04-26T18:31:49.893293+0000","last_peered":"2024-04-26T18:31:49.893293+0000","last_clean":"2024-04-26T18:31:49.893293+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T18:31:49.893293+0000","last_undegraded":"2024-04-26T18:31:49.893293+0000","last_fullsized":"2024-04-26T18:31:49.893293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:22.663372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19926888800000001,"stat_sum":{"num_bytes":38301955,"num_objects":1186,"num_object_clones":557,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":557,"num_read":157,"num_read_kb":146023,"num_write":2246,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'597","reported_seq":2679,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.613180+0000","last_change":"2024-04-26T18:03:00.040005+0000","last_active":"2024-04-26T18:31:51.613180+0000","last_peered":"2024-04-26T18:31:51.613180+0000","last_clean":"2024-04-26T18:31:51.613180+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T18:31:51.613180+0000","last_undegraded":"2024-04-26T18:31:51.613180+0000","last_fullsized":"2024-04-26T18:31:51.613180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:00.688873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099299311000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"41'590","reported_seq":660,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.577085+0000","last_change":"2024-04-26T17:58:03.722968+0000","last_active":"2024-04-26T18:30:13.577085+0000","last_peered":"2024-04-26T18:30:13.577085+0000","last_clean":"2024-04-26T18:30:13.577085+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T18:30:13.577085+0000","last_undegraded":"2024-04-26T18:30:13.577085+0000","last_fullsized":"2024-04-26T18:30:13.577085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:15.707054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":625,"num_write_kb":74929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"41'3058","reported_seq":4723,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:50.009417+0000","last_change":"2024-04-26T18:03:00.451560+0000","last_active":"2024-04-26T18:31:50.009417+0000","last_peered":"2024-04-26T18:31:50.009417+0000","last_clean":"2024-04-26T18:31:50.009417+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T18:31:50.009417+0000","last_undegraded":"2024-04-26T18:31:50.009417+0000","last_fullsized":"2024-04-26T18:31:50.009417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:26.188503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21925704200000001,"stat_sum":{"num_bytes":62040101,"num_objects":1342,"num_object_clones":661,"num_object_copies":5368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1342,"num_whiteouts":573,"num_read":241,"num_read_kb":351124,"num_write":2466,"num_write_kb":72826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"41'634","reported_seq":2700,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.631490+0000","last_change":"2024-04-26T18:03:00.082382+0000","last_active":"2024-04-26T18:31:51.631490+0000","last_peered":"2024-04-26T18:31:51.631490+0000","last_clean":"2024-04-26T18:31:51.631490+0000","last_became_active":"2024-04-26T17:58:46.842960+0000","last_became_peered":"2024-04-26T17:58:46.842960+0000","last_unstale":"2024-04-26T18:31:51.631490+0000","last_undegraded":"2024-04-26T18:31:51.631490+0000","last_fullsized":"2024-04-26T18:31:51.631490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:11:24.844599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029754315999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"41'522","reported_seq":592,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.545859+0000","last_change":"2024-04-26T17:58:03.713386+0000","last_active":"2024-04-26T18:30:13.545859+0000","last_peered":"2024-04-26T18:30:13.545859+0000","last_clean":"2024-04-26T18:30:13.545859+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T18:30:13.545859+0000","last_undegraded":"2024-04-26T18:30:13.545859+0000","last_fullsized":"2024-04-26T18:30:13.545859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:38.829489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":593,"num_write_kb":58770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"41'2848","reported_seq":4551,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:50.010447+0000","last_change":"2024-04-26T18:03:00.451927+0000","last_active":"2024-04-26T18:31:50.010447+0000","last_peered":"2024-04-26T18:31:50.010447+0000","last_clean":"2024-04-26T18:31:50.010447+0000","last_became_active":"2024-04-26T17:58:46.841624+0000","last_became_peered":"2024-04-26T17:58:46.841624+0000","last_unstale":"2024-04-26T18:31:50.010447+0000","last_undegraded":"2024-04-26T18:31:50.010447+0000","last_fullsized":"2024-04-26T18:31:50.010447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:11.632385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218331676,"stat_sum":{"num_bytes":37909871,"num_objects":1250,"num_object_clones":586,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":586,"num_read":195,"num_read_kb":261621,"num_write":2312,"num_write_kb":56158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"41'592","reported_seq":2672,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.626485+0000","last_change":"2024-04-26T18:03:00.428027+0000","last_active":"2024-04-26T18:31:51.626485+0000","last_peered":"2024-04-26T18:31:51.626485+0000","last_clean":"2024-04-26T18:31:51.626485+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T18:31:51.626485+0000","last_undegraded":"2024-04-26T18:31:51.626485+0000","last_fullsized":"2024-04-26T18:31:51.626485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:18.542428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.185065913,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"41'426","reported_seq":496,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:20.748118+0000","last_change":"2024-04-26T17:58:03.715753+0000","last_active":"2024-04-26T18:30:20.748118+0000","last_peered":"2024-04-26T18:30:20.748118+0000","last_clean":"2024-04-26T18:30:20.748118+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T18:30:20.748118+0000","last_undegraded":"2024-04-26T18:30:20.748118+0000","last_fullsized":"2024-04-26T18:30:20.748118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:36.347951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":485,"num_write_kb":79130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"41'2856","reported_seq":4524,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.932679+0000","last_change":"2024-04-26T18:03:00.386810+0000","last_active":"2024-04-26T18:31:49.932679+0000","last_peered":"2024-04-26T18:31:49.932679+0000","last_clean":"2024-04-26T18:31:49.932679+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T18:31:49.932679+0000","last_undegraded":"2024-04-26T18:31:49.932679+0000","last_fullsized":"2024-04-26T18:31:49.932679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:32.381881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16361857299999999,"stat_sum":{"num_bytes":26393816,"num_objects":1264,"num_object_clones":588,"num_object_copies":5056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1264,"num_whiteouts":588,"num_read":170,"num_read_kb":98987,"num_write":2329,"num_write_kb":28734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"41'618","reported_seq":2692,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.642502+0000","last_change":"2024-04-26T18:03:00.046237+0000","last_active":"2024-04-26T18:31:51.642502+0000","last_peered":"2024-04-26T18:31:51.642502+0000","last_clean":"2024-04-26T18:31:51.642502+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T18:31:51.642502+0000","last_undegraded":"2024-04-26T18:31:51.642502+0000","last_fullsized":"2024-04-26T18:31:51.642502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:43.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10539311699999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"41'818","reported_seq":888,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:20.757985+0000","last_change":"2024-04-26T17:58:03.724344+0000","last_active":"2024-04-26T18:31:20.757985+0000","last_peered":"2024-04-26T18:31:20.757985+0000","last_clean":"2024-04-26T18:31:20.757985+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T18:31:20.757985+0000","last_undegraded":"2024-04-26T18:31:20.757985+0000","last_fullsized":"2024-04-26T18:31:20.757985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:44:47.313929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777888,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":70,"num_read_kb":0,"num_write":938,"num_write_kb":112536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"41'2763","reported_seq":4475,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.921171+0000","last_change":"2024-04-26T18:03:00.011745+0000","last_active":"2024-04-26T18:31:49.921171+0000","last_peered":"2024-04-26T18:31:49.921171+0000","last_clean":"2024-04-26T18:31:49.921171+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T18:31:49.921171+0000","last_undegraded":"2024-04-26T18:31:49.921171+0000","last_fullsized":"2024-04-26T18:31:49.921171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:17.553669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076321086999999996,"stat_sum":{"num_bytes":36028739,"num_objects":1149,"num_object_clones":527,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":527,"num_read":153,"num_read_kb":73270,"num_write":2275,"num_write_kb":49180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'622","reported_seq":2703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.644767+0000","last_change":"2024-04-26T18:03:00.416589+0000","last_active":"2024-04-26T18:31:51.644767+0000","last_peered":"2024-04-26T18:31:51.644767+0000","last_clean":"2024-04-26T18:31:51.644767+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T18:31:51.644767+0000","last_undegraded":"2024-04-26T18:31:51.644767+0000","last_fullsized":"2024-04-26T18:31:51.644767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:33.817050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187850924,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"41'1273","reported_seq":1343,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169226+0000","last_change":"2024-04-26T17:58:03.718377+0000","last_active":"2024-04-26T18:30:09.169226+0000","last_peered":"2024-04-26T18:30:09.169226+0000","last_clean":"2024-04-26T18:30:09.169226+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T18:30:09.169226+0000","last_undegraded":"2024-04-26T18:30:09.169226+0000","last_fullsized":"2024-04-26T18:30:09.169226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:24:58.048536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1332,"num_write_kb":75702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"41'2855","reported_seq":4518,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:36.875035+0000","last_change":"2024-04-26T18:03:00.422955+0000","last_active":"2024-04-26T18:31:36.875035+0000","last_peered":"2024-04-26T18:31:36.875035+0000","last_clean":"2024-04-26T18:31:36.875035+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T18:31:36.875035+0000","last_undegraded":"2024-04-26T18:31:36.875035+0000","last_fullsized":"2024-04-26T18:31:36.875035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:17.130490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18615647199999999,"stat_sum":{"num_bytes":26768950,"num_objects":1237,"num_object_clones":575,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":575,"num_read":152,"num_read_kb":65566,"num_write":2334,"num_write_kb":43840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"41'608","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.649076+0000","last_change":"2024-04-26T18:03:00.427018+0000","last_active":"2024-04-26T18:31:51.649076+0000","last_peered":"2024-04-26T18:31:51.649076+0000","last_clean":"2024-04-26T18:31:51.649076+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T18:31:51.649076+0000","last_undegraded":"2024-04-26T18:31:51.649076+0000","last_fullsized":"2024-04-26T18:31:51.649076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:59.016233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19386972299999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"41'2203","reported_seq":2273,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:13.543216+0000","last_change":"2024-04-26T17:58:03.723340+0000","last_active":"2024-04-26T18:30:13.543216+0000","last_peered":"2024-04-26T18:30:13.543216+0000","last_clean":"2024-04-26T18:30:13.543216+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T18:30:13.543216+0000","last_undegraded":"2024-04-26T18:30:13.543216+0000","last_fullsized":"2024-04-26T18:30:13.543216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:48.565926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":2240,"num_write_kb":108871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"41'2818","reported_seq":4522,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.928231+0000","last_change":"2024-04-26T18:03:00.448747+0000","last_active":"2024-04-26T18:31:49.928231+0000","last_peered":"2024-04-26T18:31:49.928231+0000","last_clean":"2024-04-26T18:31:49.928231+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T18:31:49.928231+0000","last_undegraded":"2024-04-26T18:31:49.928231+0000","last_fullsized":"2024-04-26T18:31:49.928231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2818,"log_dups_size":0,"ondisk_log_size":2818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:54.613985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23086587,"stat_sum":{"num_bytes":33941132,"num_objects":1186,"num_object_clones":549,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":549,"num_read":167,"num_read_kb":131833,"num_write":2312,"num_write_kb":45432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"41'595","reported_seq":2681,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.657381+0000","last_change":"2024-04-26T18:03:00.387751+0000","last_active":"2024-04-26T18:31:51.657381+0000","last_peered":"2024-04-26T18:31:51.657381+0000","last_clean":"2024-04-26T18:31:51.657381+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T18:31:51.657381+0000","last_undegraded":"2024-04-26T18:31:51.657381+0000","last_fullsized":"2024-04-26T18:31:51.657381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:17.806485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16159970800000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"41'918","reported_seq":1136,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:48.188915+0000","last_change":"2024-04-26T17:58:03.723866+0000","last_active":"2024-04-26T18:30:48.188915+0000","last_peered":"2024-04-26T18:30:48.188915+0000","last_clean":"2024-04-26T18:30:48.188915+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T18:30:48.188915+0000","last_undegraded":"2024-04-26T18:30:48.188915+0000","last_fullsized":"2024-04-26T18:30:48.188915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:36.954401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17376085,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":220,"num_read_kb":683,"num_write":1019,"num_write_kb":76520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"41'2989","reported_seq":4689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.954232+0000","last_change":"2024-04-26T18:03:00.450154+0000","last_active":"2024-04-26T18:31:49.954232+0000","last_peered":"2024-04-26T18:31:49.954232+0000","last_clean":"2024-04-26T18:31:49.954232+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T18:31:49.954232+0000","last_undegraded":"2024-04-26T18:31:49.954232+0000","last_fullsized":"2024-04-26T18:31:49.954232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:57:45.503657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22647874100000001,"stat_sum":{"num_bytes":37857272,"num_objects":1229,"num_object_clones":574,"num_object_copies":4916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":574,"num_read":190,"num_read_kb":232293,"num_write":2457,"num_write_kb":51113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"41'2741","reported_seq":4466,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.930844+0000","last_change":"2024-04-26T18:03:00.424939+0000","last_active":"2024-04-26T18:31:49.930844+0000","last_peered":"2024-04-26T18:31:49.930844+0000","last_clean":"2024-04-26T18:31:49.930844+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T18:31:49.930844+0000","last_undegraded":"2024-04-26T18:31:49.930844+0000","last_fullsized":"2024-04-26T18:31:49.930844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:36:30.278112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20154621,"stat_sum":{"num_bytes":35946841,"num_objects":1130,"num_object_clones":524,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1130,"num_whiteouts":524,"num_read":160,"num_read_kb":163026,"num_write":2271,"num_write_kb":38909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"41'612","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.618427+0000","last_change":"2024-04-26T18:03:00.011427+0000","last_active":"2024-04-26T18:31:51.618427+0000","last_peered":"2024-04-26T18:31:51.618427+0000","last_clean":"2024-04-26T18:31:51.618427+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T18:31:51.618427+0000","last_undegraded":"2024-04-26T18:31:51.618427+0000","last_fullsized":"2024-04-26T18:31:51.618427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:42.428994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.076360936000000004,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"41'1493","reported_seq":1563,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:18.580879+0000","last_change":"2024-04-26T17:58:03.711192+0000","last_active":"2024-04-26T18:30:18.580879+0000","last_peered":"2024-04-26T18:30:18.580879+0000","last_clean":"2024-04-26T18:30:18.580879+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T18:30:18.580879+0000","last_undegraded":"2024-04-26T18:30:18.580879+0000","last_fullsized":"2024-04-26T18:30:18.580879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.268382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":1554,"num_write_kb":113147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"41'2755","reported_seq":4438,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.988567+0000","last_change":"2024-04-26T18:03:00.045338+0000","last_active":"2024-04-26T18:31:49.988567+0000","last_peered":"2024-04-26T18:31:49.988567+0000","last_clean":"2024-04-26T18:31:49.988567+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T18:31:49.988567+0000","last_undegraded":"2024-04-26T18:31:49.988567+0000","last_fullsized":"2024-04-26T18:31:49.988567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:47.473281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101684618,"stat_sum":{"num_bytes":29230084,"num_objects":1175,"num_object_clones":548,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":548,"num_read":142,"num_read_kb":156265,"num_write":2265,"num_write_kb":32436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"41'686","reported_seq":2756,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.622359+0000","last_change":"2024-04-26T18:03:00.010584+0000","last_active":"2024-04-26T18:31:51.622359+0000","last_peered":"2024-04-26T18:31:51.622359+0000","last_clean":"2024-04-26T18:31:51.622359+0000","last_became_active":"2024-04-26T17:58:47.348873+0000","last_became_peered":"2024-04-26T17:58:47.348873+0000","last_unstale":"2024-04-26T18:31:51.622359+0000","last_undegraded":"2024-04-26T18:31:51.622359+0000","last_fullsized":"2024-04-26T18:31:51.622359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:17.045379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075584111999999995,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"41'758","reported_seq":827,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:09.169521+0000","last_change":"2024-04-26T17:58:03.722892+0000","last_active":"2024-04-26T18:30:09.169521+0000","last_peered":"2024-04-26T18:30:09.169521+0000","last_clean":"2024-04-26T18:30:09.169521+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T18:30:09.169521+0000","last_undegraded":"2024-04-26T18:30:09.169521+0000","last_fullsized":"2024-04-26T18:30:09.169521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:42.602399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":840,"num_write_kb":71498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"41'948","reported_seq":1017,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.065770+0000","last_change":"2024-04-26T17:58:03.722912+0000","last_active":"2024-04-26T18:30:33.065770+0000","last_peered":"2024-04-26T18:30:33.065770+0000","last_clean":"2024-04-26T18:30:33.065770+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T18:30:33.065770+0000","last_undegraded":"2024-04-26T18:30:33.065770+0000","last_fullsized":"2024-04-26T18:30:33.065770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:58.876573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":1019,"num_write_kb":79683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"41'596","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.634562+0000","last_change":"2024-04-26T18:03:00.424808+0000","last_active":"2024-04-26T18:31:51.634562+0000","last_peered":"2024-04-26T18:31:51.634562+0000","last_clean":"2024-04-26T18:31:51.634562+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T18:31:51.634562+0000","last_undegraded":"2024-04-26T18:31:51.634562+0000","last_fullsized":"2024-04-26T18:31:51.634562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:07.262537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20583575700000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"41'2937","reported_seq":4609,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.911258+0000","last_change":"2024-04-26T18:03:00.085072+0000","last_active":"2024-04-26T18:31:49.911258+0000","last_peered":"2024-04-26T18:31:49.911258+0000","last_clean":"2024-04-26T18:31:49.911258+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T18:31:49.911258+0000","last_undegraded":"2024-04-26T18:31:49.911258+0000","last_fullsized":"2024-04-26T18:31:49.911258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:19.275660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025934391000000001,"stat_sum":{"num_bytes":29962641,"num_objects":1274,"num_object_clones":596,"num_object_copies":5096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":596,"num_read":182,"num_read_kb":211414,"num_write":2395,"num_write_kb":42590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"41'542","reported_seq":611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:30:33.066572+0000","last_change":"2024-04-26T17:58:03.720671+0000","last_active":"2024-04-26T18:30:33.066572+0000","last_peered":"2024-04-26T18:30:33.066572+0000","last_clean":"2024-04-26T18:30:33.066572+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T18:30:33.066572+0000","last_undegraded":"2024-04-26T18:30:33.066572+0000","last_fullsized":"2024-04-26T18:30:33.066572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.684914+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.684914+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:12.216093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":620,"num_write_kb":96015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"41'627","reported_seq":2706,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.636182+0000","last_change":"2024-04-26T18:03:00.422447+0000","last_active":"2024-04-26T18:31:51.636182+0000","last_peered":"2024-04-26T18:31:51.636182+0000","last_clean":"2024-04-26T18:31:51.636182+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T18:31:51.636182+0000","last_undegraded":"2024-04-26T18:31:51.636182+0000","last_fullsized":"2024-04-26T18:31:51.636182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:19.803315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18696554200000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"41'2812","reported_seq":4496,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.143037+0000","last_change":"2024-04-26T18:03:00.452403+0000","last_active":"2024-04-26T18:31:49.143037+0000","last_peered":"2024-04-26T18:31:49.143037+0000","last_clean":"2024-04-26T18:31:49.143037+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T18:31:49.143037+0000","last_undegraded":"2024-04-26T18:31:49.143037+0000","last_fullsized":"2024-04-26T18:31:49.143037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:38.426593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.215933711,"stat_sum":{"num_bytes":39516255,"num_objects":1208,"num_object_clones":558,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":558,"num_read":159,"num_read_kb":155491,"num_write":2289,"num_write_kb":56059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"41'628","reported_seq":2711,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.623071+0000","last_change":"2024-04-26T18:03:00.038929+0000","last_active":"2024-04-26T18:31:51.623071+0000","last_peered":"2024-04-26T18:31:51.623071+0000","last_clean":"2024-04-26T18:31:51.623071+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T18:31:51.623071+0000","last_undegraded":"2024-04-26T18:31:51.623071+0000","last_fullsized":"2024-04-26T18:31:51.623071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:12.133508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.098603622000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"41'662","reported_seq":2743,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.626333+0000","last_change":"2024-04-26T18:03:00.080058+0000","last_active":"2024-04-26T18:31:51.626333+0000","last_peered":"2024-04-26T18:31:51.626333+0000","last_clean":"2024-04-26T18:31:51.626333+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T18:31:51.626333+0000","last_undegraded":"2024-04-26T18:31:51.626333+0000","last_fullsized":"2024-04-26T18:31:51.626333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:21.430086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032925850999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"41'610","reported_seq":2681,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.619619+0000","last_change":"2024-04-26T18:03:00.082718+0000","last_active":"2024-04-26T18:31:51.619619+0000","last_peered":"2024-04-26T18:31:51.619619+0000","last_clean":"2024-04-26T18:31:51.619619+0000","last_became_active":"2024-04-26T17:58:46.843441+0000","last_became_peered":"2024-04-26T17:58:46.843441+0000","last_unstale":"2024-04-26T18:31:51.619619+0000","last_undegraded":"2024-04-26T18:31:51.619619+0000","last_fullsized":"2024-04-26T18:31:51.619619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:59.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030186671000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"41'665","reported_seq":2743,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.622382+0000","last_change":"2024-04-26T18:03:00.420297+0000","last_active":"2024-04-26T18:31:51.622382+0000","last_peered":"2024-04-26T18:31:51.622382+0000","last_clean":"2024-04-26T18:31:51.622382+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T18:31:51.622382+0000","last_undegraded":"2024-04-26T18:31:51.622382+0000","last_fullsized":"2024-04-26T18:31:51.622382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:17.932988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.201538621,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"41'598","reported_seq":2680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.629805+0000","last_change":"2024-04-26T18:03:00.452146+0000","last_active":"2024-04-26T18:31:51.629805+0000","last_peered":"2024-04-26T18:31:51.629805+0000","last_clean":"2024-04-26T18:31:51.629805+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T18:31:51.629805+0000","last_undegraded":"2024-04-26T18:31:51.629805+0000","last_fullsized":"2024-04-26T18:31:51.629805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:38.204578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.217865696,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"41'620","reported_seq":2696,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.617735+0000","last_change":"2024-04-26T18:03:00.013263+0000","last_active":"2024-04-26T18:31:51.617735+0000","last_peered":"2024-04-26T18:31:51.617735+0000","last_clean":"2024-04-26T18:31:51.617735+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T18:31:51.617735+0000","last_undegraded":"2024-04-26T18:31:51.617735+0000","last_fullsized":"2024-04-26T18:31:51.617735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:40.421470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077286562000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":18,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"41'655","reported_seq":2739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.635789+0000","last_change":"2024-04-26T18:03:00.044300+0000","last_active":"2024-04-26T18:31:51.635789+0000","last_peered":"2024-04-26T18:31:51.635789+0000","last_clean":"2024-04-26T18:31:51.635789+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T18:31:51.635789+0000","last_undegraded":"2024-04-26T18:31:51.635789+0000","last_fullsized":"2024-04-26T18:31:51.635789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:41.880840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101304621,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"41'590","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.629667+0000","last_change":"2024-04-26T18:03:00.451279+0000","last_active":"2024-04-26T18:31:51.629667+0000","last_peered":"2024-04-26T18:31:51.629667+0000","last_clean":"2024-04-26T18:31:51.629667+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T18:31:51.629667+0000","last_undegraded":"2024-04-26T18:31:51.629667+0000","last_fullsized":"2024-04-26T18:31:51.629667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:01.568762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21869934299999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"41'618","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.652504+0000","last_change":"2024-04-26T18:03:00.382958+0000","last_active":"2024-04-26T18:31:51.652504+0000","last_peered":"2024-04-26T18:31:51.652504+0000","last_clean":"2024-04-26T18:31:51.652504+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T18:31:51.652504+0000","last_undegraded":"2024-04-26T18:31:51.652504+0000","last_fullsized":"2024-04-26T18:31:51.652504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:24.729192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16324759799999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"41'609","reported_seq":2683,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.629739+0000","last_change":"2024-04-26T18:03:00.449823+0000","last_active":"2024-04-26T18:31:51.629739+0000","last_peered":"2024-04-26T18:31:51.629739+0000","last_clean":"2024-04-26T18:31:51.629739+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T18:31:51.629739+0000","last_undegraded":"2024-04-26T18:31:51.629739+0000","last_fullsized":"2024-04-26T18:31:51.629739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:31.626201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22595842999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":20,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"41'638","reported_seq":2723,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.657277+0000","last_change":"2024-04-26T18:03:00.387942+0000","last_active":"2024-04-26T18:31:51.657277+0000","last_peered":"2024-04-26T18:31:51.657277+0000","last_clean":"2024-04-26T18:31:51.657277+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T18:31:51.657277+0000","last_undegraded":"2024-04-26T18:31:51.657277+0000","last_fullsized":"2024-04-26T18:31:51.657277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:12.544391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16093863,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"41'631","reported_seq":2710,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.627877+0000","last_change":"2024-04-26T18:03:00.417549+0000","last_active":"2024-04-26T18:31:51.627877+0000","last_peered":"2024-04-26T18:31:51.627877+0000","last_clean":"2024-04-26T18:31:51.627877+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T18:31:51.627877+0000","last_undegraded":"2024-04-26T18:31:51.627877+0000","last_fullsized":"2024-04-26T18:31:51.627877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:03.208612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.199229399,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"41'635","reported_seq":2711,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.630125+0000","last_change":"2024-04-26T18:03:00.037623+0000","last_active":"2024-04-26T18:31:51.630125+0000","last_peered":"2024-04-26T18:31:51.630125+0000","last_clean":"2024-04-26T18:31:51.630125+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T18:31:51.630125+0000","last_undegraded":"2024-04-26T18:31:51.630125+0000","last_fullsized":"2024-04-26T18:31:51.630125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:23.801334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.097146090000000004,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":18,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"41'652","reported_seq":2728,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.641305+0000","last_change":"2024-04-26T18:03:00.047343+0000","last_active":"2024-04-26T18:31:51.641305+0000","last_peered":"2024-04-26T18:31:51.641305+0000","last_clean":"2024-04-26T18:31:51.641305+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T18:31:51.641305+0000","last_undegraded":"2024-04-26T18:31:51.641305+0000","last_fullsized":"2024-04-26T18:31:51.641305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:51.305800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104951684,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"41'595","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.630780+0000","last_change":"2024-04-26T18:03:00.080377+0000","last_active":"2024-04-26T18:31:51.630780+0000","last_peered":"2024-04-26T18:31:51.630780+0000","last_clean":"2024-04-26T18:31:51.630780+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T18:31:51.630780+0000","last_undegraded":"2024-04-26T18:31:51.630780+0000","last_fullsized":"2024-04-26T18:31:51.630780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:16.651583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032670101999999999,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"41'645","reported_seq":2725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.656663+0000","last_change":"2024-04-26T18:03:00.390632+0000","last_active":"2024-04-26T18:31:51.656663+0000","last_peered":"2024-04-26T18:31:51.656663+0000","last_clean":"2024-04-26T18:31:51.656663+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T18:31:51.656663+0000","last_undegraded":"2024-04-26T18:31:51.656663+0000","last_fullsized":"2024-04-26T18:31:51.656663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:04.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15919065099999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"41'621","reported_seq":2702,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.658170+0000","last_change":"2024-04-26T18:03:00.381346+0000","last_active":"2024-04-26T18:31:51.658170+0000","last_peered":"2024-04-26T18:31:51.658170+0000","last_clean":"2024-04-26T18:31:51.658170+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T18:31:51.658170+0000","last_undegraded":"2024-04-26T18:31:51.658170+0000","last_fullsized":"2024-04-26T18:31:51.658170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:38.159280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16311753700000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"41'642","reported_seq":2720,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.613894+0000","last_change":"2024-04-26T18:03:00.012809+0000","last_active":"2024-04-26T18:31:51.613894+0000","last_peered":"2024-04-26T18:31:51.613894+0000","last_clean":"2024-04-26T18:31:51.613894+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T18:31:51.613894+0000","last_undegraded":"2024-04-26T18:31:51.613894+0000","last_fullsized":"2024-04-26T18:31:51.613894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:07:47.235898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077647145000000001,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"41'604","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.623333+0000","last_change":"2024-04-26T18:03:00.427662+0000","last_active":"2024-04-26T18:31:51.623333+0000","last_peered":"2024-04-26T18:31:51.623333+0000","last_clean":"2024-04-26T18:31:51.623333+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T18:31:51.623333+0000","last_undegraded":"2024-04-26T18:31:51.623333+0000","last_fullsized":"2024-04-26T18:31:51.623333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:35.215492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18619005699999999,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"41'593","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.630815+0000","last_change":"2024-04-26T18:03:00.444694+0000","last_active":"2024-04-26T18:31:51.630815+0000","last_peered":"2024-04-26T18:31:51.630815+0000","last_clean":"2024-04-26T18:31:51.630815+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T18:31:51.630815+0000","last_undegraded":"2024-04-26T18:31:51.630815+0000","last_fullsized":"2024-04-26T18:31:51.630815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:27.452738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22687219,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"41'607","reported_seq":2682,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.630960+0000","last_change":"2024-04-26T18:03:00.415887+0000","last_active":"2024-04-26T18:31:51.630960+0000","last_peered":"2024-04-26T18:31:51.630960+0000","last_clean":"2024-04-26T18:31:51.630960+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T18:31:51.630960+0000","last_undegraded":"2024-04-26T18:31:51.630960+0000","last_fullsized":"2024-04-26T18:31:51.630960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:42.102564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18821249400000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"41'612","reported_seq":2693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.615469+0000","last_change":"2024-04-26T18:03:00.042914+0000","last_active":"2024-04-26T18:31:51.615469+0000","last_peered":"2024-04-26T18:31:51.615469+0000","last_clean":"2024-04-26T18:31:51.615469+0000","last_became_active":"2024-04-26T17:58:46.846437+0000","last_became_peered":"2024-04-26T17:58:46.846437+0000","last_unstale":"2024-04-26T18:31:51.615469+0000","last_undegraded":"2024-04-26T18:31:51.615469+0000","last_fullsized":"2024-04-26T18:31:51.615469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:04.851963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100440928,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":16,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"41'606","reported_seq":2686,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.655166+0000","last_change":"2024-04-26T18:03:00.043307+0000","last_active":"2024-04-26T18:31:51.655166+0000","last_peered":"2024-04-26T18:31:51.655166+0000","last_clean":"2024-04-26T18:31:51.655166+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T18:31:51.655166+0000","last_undegraded":"2024-04-26T18:31:51.655166+0000","last_fullsized":"2024-04-26T18:31:51.655166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:35.890122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100379555,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"41'648","reported_seq":2720,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.649896+0000","last_change":"2024-04-26T18:03:00.046913+0000","last_active":"2024-04-26T18:31:51.649896+0000","last_peered":"2024-04-26T18:31:51.649896+0000","last_clean":"2024-04-26T18:31:51.649896+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T18:31:51.649896+0000","last_undegraded":"2024-04-26T18:31:51.649896+0000","last_fullsized":"2024-04-26T18:31:51.649896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:46.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104580398,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":20,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"41'588","reported_seq":2667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.654975+0000","last_change":"2024-04-26T18:03:00.449103+0000","last_active":"2024-04-26T18:31:51.654975+0000","last_peered":"2024-04-26T18:31:51.654975+0000","last_clean":"2024-04-26T18:31:51.654975+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T18:31:51.654975+0000","last_undegraded":"2024-04-26T18:31:51.654975+0000","last_fullsized":"2024-04-26T18:31:51.654975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:13.870912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.230423819,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"41'611","reported_seq":2694,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.619765+0000","last_change":"2024-04-26T18:03:00.047650+0000","last_active":"2024-04-26T18:31:51.619765+0000","last_peered":"2024-04-26T18:31:51.619765+0000","last_clean":"2024-04-26T18:31:51.619765+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T18:31:51.619765+0000","last_undegraded":"2024-04-26T18:31:51.619765+0000","last_fullsized":"2024-04-26T18:31:51.619765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:11.007748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101654339,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"41'577","reported_seq":2657,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.657878+0000","last_change":"2024-04-26T18:03:00.390090+0000","last_active":"2024-04-26T18:31:51.657878+0000","last_peered":"2024-04-26T18:31:51.657878+0000","last_clean":"2024-04-26T18:31:51.657878+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T18:31:51.657878+0000","last_undegraded":"2024-04-26T18:31:51.657878+0000","last_fullsized":"2024-04-26T18:31:51.657878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:52.940552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16310901,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"41'644","reported_seq":2730,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.637588+0000","last_change":"2024-04-26T18:03:00.045506+0000","last_active":"2024-04-26T18:31:51.637588+0000","last_peered":"2024-04-26T18:31:51.637588+0000","last_clean":"2024-04-26T18:31:51.637588+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T18:31:51.637588+0000","last_undegraded":"2024-04-26T18:31:51.637588+0000","last_fullsized":"2024-04-26T18:31:51.637588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.552957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10388457199999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"41'639","reported_seq":2717,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.657213+0000","last_change":"2024-04-26T18:03:00.390493+0000","last_active":"2024-04-26T18:31:51.657213+0000","last_peered":"2024-04-26T18:31:51.657213+0000","last_clean":"2024-04-26T18:31:51.657213+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T18:31:51.657213+0000","last_undegraded":"2024-04-26T18:31:51.657213+0000","last_fullsized":"2024-04-26T18:31:51.657213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:20.892370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16390716399999999,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":17,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"41'604","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.623515+0000","last_change":"2024-04-26T18:03:00.414568+0000","last_active":"2024-04-26T18:31:51.623515+0000","last_peered":"2024-04-26T18:31:51.623515+0000","last_clean":"2024-04-26T18:31:51.623515+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T18:31:51.623515+0000","last_undegraded":"2024-04-26T18:31:51.623515+0000","last_fullsized":"2024-04-26T18:31:51.623515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:12.402497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19882805000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"41'593","reported_seq":2675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.618165+0000","last_change":"2024-04-26T18:03:00.013917+0000","last_active":"2024-04-26T18:31:51.618165+0000","last_peered":"2024-04-26T18:31:51.618165+0000","last_clean":"2024-04-26T18:31:51.618165+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T18:31:51.618165+0000","last_undegraded":"2024-04-26T18:31:51.618165+0000","last_fullsized":"2024-04-26T18:31:51.618165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:25.271335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.077373158999999997,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"41'585","reported_seq":2673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:51.643011+0000","last_change":"2024-04-26T18:03:00.046476+0000","last_active":"2024-04-26T18:31:51.643011+0000","last_peered":"2024-04-26T18:31:51.643011+0000","last_clean":"2024-04-26T18:31:51.643011+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T18:31:51.643011+0000","last_undegraded":"2024-04-26T18:31:51.643011+0000","last_fullsized":"2024-04-26T18:31:51.643011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:28.837314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104812107,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1183673720,"num_objects":39268,"num_object_clones":18317,"num_object_copies":157072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39268,"num_whiteouts":18141,"num_read":5713,"num_read_kb":6011008,"num_write":75176,"num_write_kb":1483989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2573631488,"data_stored":2574974976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91894,"ondisk_log_size":91894,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3085,"num_object_clones":812,"num_object_copies":6170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3085,"num_whiteouts":812,"num_read":0,"num_read_kb":0,"num_write":3093,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39539,"ondisk_log_size":39539,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797006684,"num_objects":1886,"num_object_clones":0,"num_object_copies":3772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1886,"num_whiteouts":0,"num_read":2824,"num_read_kb":5408,"num_write":35013,"num_write_kb":2756186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1594081280,"data_stored":1594013368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31199,"ondisk_log_size":31199,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575260,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814076,"kb_used_data":570612,"kb_used_omap":1,"kb_used_meta":243454,"kb_avail":93557764,"statfs":{"total":96636764160,"available":95803150336,"internally_reserved":0,"allocated":584306688,"data_stored":584393669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":249297355},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864928,"kb_used_data":545112,"kb_used_omap":1,"kb_used_meta":319806,"kb_avail":93506912,"statfs":{"total":96636764160,"available":95751077888,"internally_reserved":0,"allocated":558194688,"data_stored":558281943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":327481799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575260,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":747420,"kb_used_data":455444,"kb_used_omap":1,"kb_used_meta":291966,"kb_avail":93624420,"statfs":{"total":96636764160,"available":95871406080,"internally_reserved":0,"allocated":466374656,"data_stored":466129553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":298973637},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575260,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":742816,"kb_used_data":481304,"kb_used_omap":1,"kb_used_meta":261502,"kb_avail":93629024,"statfs":{"total":96636764160,"available":95876120576,"internally_reserved":0,"allocated":492855296,"data_stored":492773676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267778501},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575260,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":908776,"kb_used_data":574944,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":93463064,"statfs":{"total":96636764160,"available":95706177536,"internally_reserved":0,"allocated":588742656,"data_stored":588833154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":341834184},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575260,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530044,"kb_used_data":322676,"kb_used_omap":1,"kb_used_meta":207358,"kb_avail":93841796,"statfs":{"total":96636764160,"available":96093999104,"internally_reserved":0,"allocated":330420224,"data_stored":330182370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212335045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,12,1,38],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575260,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":986984,"kb_used_data":635168,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93384856,"statfs":{"total":96636764160,"available":95626092544,"internally_reserved":0,"allocated":650412032,"data_stored":650334542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575261,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705460,"kb_used_data":489708,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93666380,"statfs":{"total":96636764160,"available":95914373120,"internally_reserved":0,"allocated":501460992,"data_stored":501203965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":205021184,"data_stored":205005563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234885740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163586048,"data_stored":163578528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163594240,"data_stored":163582538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":206127104,"data_stored":206119855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":222908416,"data_stored":222897653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297287680,"data_stored":297280195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":295362560,"data_stored":295362560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415035392,"data_stored":415203328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229273600,"data_stored":229273600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":424673280,"data_stored":425009152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":328777728,"data_stored":328945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":259764224,"data_stored":259764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":334802944,"data_stored":335138816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":285941760,"data_stored":286277632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:31:58.488 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.489 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.489 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.489 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.489 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.489 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.490 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.490 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.490 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.490 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.490 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.490 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.491 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.491 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.491 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.491 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.491 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.491 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.492 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.492 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.492 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.492 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.492 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.492 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.493 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.493 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.493 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.493 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.493 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.493 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.493 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.494 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.494 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.494 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.494 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.494 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.495 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.495 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.495 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.495 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.495 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.495 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.496 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.496 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.496 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.497 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.497 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.497 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T17:57:53.189662+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=57, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.498 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.498 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.498 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.499 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.499 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.499 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.500 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.500 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.500 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.501 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.501 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.501 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.502 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.502 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.502 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.503 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.503 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.503 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.504 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.504 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.505 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.505 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.505 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.505 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.506 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.506 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.506 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.507 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.507 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.507 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.508 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.508 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.508 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.509 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.509 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.509 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.509 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.510 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.510 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.510 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.511 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.511 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.511 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.512 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.512 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.512 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.513 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-26T17:58:02.684914+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.513 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.513 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.513 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.514 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.514 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.515 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.515 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.515 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.516 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.516 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.516 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.516 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.517 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.517 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.517 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.517 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.518 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.518 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.518 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.519 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.519 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.519 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.519 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.520 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.520 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.520 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.521 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.521 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.521 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.522 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.522 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.522 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.523 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.523 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:31:58.523 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T18:32:18.524 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:32:18.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.634+0000 7f2c1fbc6640 1 Processor -- start 2024-04-26T18:32:18.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.634+0000 7f2c1fbc6640 1 -- start start 2024-04-26T18:32:18.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1fbc6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1815a1e0 0x7f2c180cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:18.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1fbc6640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c18073100 0x7f2c180cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:18.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1fbc6640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c18073680 con 0x7f2c180c7c20 2024-04-26T18:32:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1fbc6640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f2c18073c00 con 0x7f2c18073100 2024-04-26T18:32:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1fbc6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1806f0d0 con 0x7f2c1815a1e0 2024-04-26T18:32:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1e163640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c18073100 0x7f2c180cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1e163640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f2c18073100 0x7f2c180cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34004/0 (socket says 172.21.15.139:34004) 2024-04-26T18:32:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1e163640 1 -- 172.21.15.139:0/2593683190 learned_addr learned my addr 172.21.15.139:0/2593683190 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1d962640 1 --2- 172.21.15.139:0/2593683190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1815a1e0 0x7f2c180cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:18.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1e163640 1 -- 172.21.15.139:0/2593683190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1815a1e0 msgr2=0x7f2c180cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1e163640 1 --2- 172.21.15.139:0/2593683190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1815a1e0 0x7f2c180cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1e163640 1 -- 172.21.15.139:0/2593683190 >> v1:172.21.15.143:6789/0 conn(0x7f2c180c7c20 legacy=0x7f2c18160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1e163640 1 -- 172.21.15.139:0/2593683190 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c18073920 con 0x7f2c18073100 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.635+0000 7f2c1c960640 1 -- 172.21.15.139:0/2593683190 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682683908 0 0) 0x7f2c18073680 con 0x7f2c180c7c20 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.636+0000 7f2c1e163640 1 --2- 172.21.15.139:0/2593683190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c180cd9a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009e50 tx=0x7f2c1002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d9965c4ad92e6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.636+0000 7f2c1c960640 1 -- 172.21.15.139:0/2593683190 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10036070 con 0x7f2c18073100 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.636+0000 7f2c1c960640 1 -- 172.21.15.139:0/2593683190 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c10031600 con 0x7f2c18073100 2024-04-26T18:32:18.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.636+0000 7f2c1c960640 1 -- 172.21.15.139:0/2593683190 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c100319d0 con 0x7f2c18073100 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2593683190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 msgr2=0x7f2c180cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2593683190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c180cd9a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009e50 tx=0x7f2c1002a710 comp rx=0 tx=0).stop 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2593683190 shutdown_connections 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2593683190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c180cd9a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2593683190 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c1815a1e0 0x7f2c180cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2593683190 >> 172.21.15.139:0/2593683190 conn(0x7f2c18068270 msgr2=0x7f2c18068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2593683190 shutdown_connections 2024-04-26T18:32:18.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.637+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2593683190 wait complete. 2024-04-26T18:32:18.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.638+0000 7f2c1fbc6640 1 Processor -- start 2024-04-26T18:32:18.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.638+0000 7f2c1fbc6640 1 -- start start 2024-04-26T18:32:18.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c181f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c180c7c20 0x7f2c181f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1815a1e0 0x7f2c18153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1815a5c0 con 0x7f2c18073100 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f2c180721b0 con 0x7f2c1815a1e0 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f2c18160a90 con 0x7f2c180c7c20 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c181f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c181f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:34010/0 (socket says 172.21.15.139:34010) 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 -- 172.21.15.139:0/2400267715 learned_addr learned my addr 172.21.15.139:0/2400267715 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:18.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d161640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c180c7c20 0x7f2c181f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1e163640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1815a1e0 0x7f2c18153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 -- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c180c7c20 msgr2=0x7f2c181f9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c180c7c20 0x7f2c181f9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 -- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1815a1e0 msgr2=0x7f2c18153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1815a1e0 0x7f2c18153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 -- 172.21.15.139:0/2400267715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c181fa030 con 0x7f2c18073100 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1d962640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c181f6660 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00e8a0 tx=0x7f2c0c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:18.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c0a7fc640 1 -- 172.21.15.139:0/2400267715 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c017070 con 0x7f2c18073100 2024-04-26T18:32:18.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c0a7fc640 1 -- 172.21.15.139:0/2400267715 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c00c940 con 0x7f2c18073100 2024-04-26T18:32:18.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c180c5d00 con 0x7f2c18073100 2024-04-26T18:32:18.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c0a7fc640 1 -- 172.21.15.139:0/2400267715 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00cd30 con 0x7f2c18073100 2024-04-26T18:32:18.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.639+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c180c62c0 con 0x7f2c18073100 2024-04-26T18:32:18.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.640+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1806ea30 con 0x7f2c18073100 2024-04-26T18:32:18.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.641+0000 7f2c0a7fc640 1 -- 172.21.15.139:0/2400267715 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c0c01a070 con 0x7f2c18073100 2024-04-26T18:32:18.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.641+0000 7f2c0a7fc640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2bfc06c920 0x7f2bfc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:18.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.641+0000 7f2c1d161640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2bfc06c920 0x7f2bfc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:18.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.641+0000 7f2c0a7fc640 1 -- 172.21.15.139:0/2400267715 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f2c0c08bdc0 con 0x7f2c18073100 2024-04-26T18:32:18.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.642+0000 7f2c1d161640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2bfc06c920 0x7f2bfc06ede0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2c180c7290 tx=0x7f2c14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:18.648 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.646+0000 7f2c0a7fc640 1 -- 172.21.15.139:0/2400267715 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c1806ea30 con 0x7f2c18073100 2024-04-26T18:32:18.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.817+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c180c6500 con 0x7f2bfc06c920 2024-04-26T18:32:18.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.825+0000 7f2c0a7fc640 1 -- 172.21.15.139:0/2400267715 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339066 (secure 0 0 0) 0x7f2c180c6500 con 0x7f2bfc06c920 2024-04-26T18:32:18.828 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:32:18.830 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T18:32:18.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2bfc06c920 msgr2=0x7f2bfc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:18.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2bfc06c920 0x7f2bfc06ede0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2c180c7290 tx=0x7f2c14009040 comp rx=0 tx=0).stop 2024-04-26T18:32:18.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 msgr2=0x7f2c181f6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:18.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c181f6660 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00e8a0 tx=0x7f2c0c00ed60 comp rx=0 tx=0).stop 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 shutdown_connections 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f2bfc06c920 0x7f2bfc06ede0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2c1815a1e0 0x7f2c18153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f2c180c7c20 0x7f2c181f9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 --2- 172.21.15.139:0/2400267715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c18073100 0x7f2c181f6660 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 >> 172.21.15.139:0/2400267715 conn(0x7f2c18068270 msgr2=0x7f2c18154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 shutdown_connections 2024-04-26T18:32:18.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:18.829+0000 7f2c1fbc6640 1 -- 172.21.15.139:0/2400267715 wait complete. 2024-04-26T18:32:18.839 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":1066,"stamp":"2024-04-26T18:32:17.594819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1981270772,"num_objects":44241,"num_object_clones":19129,"num_object_copies":167018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44241,"num_whiteouts":18953,"num_read":8653,"num_read_kb":6016516,"num_write":113441,"num_write_kb":4242591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24527923,"num_omap_keys":38818,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167603,"ondisk_log_size":167603,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6322712,"kb_used_data":4074968,"kb_used_omap":12,"kb_used_meta":2247667,"kb_avail":748652008,"statfs":{"total":773094113280,"available":766619656192,"internally_reserved":0,"allocated":4172767232,"data_stored":4172132872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2301611572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805238,"num_omap_keys":4515,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"41'584","reported_seq":667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.796753+0000","last_change":"2024-04-26T18:31:56.796819+0000","last_active":"2024-04-26T18:31:56.796753+0000","last_peered":"2024-04-26T18:31:56.796753+0000","last_clean":"2024-04-26T18:31:56.796753+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T18:31:56.796753+0000","last_undegraded":"2024-04-26T18:31:56.796753+0000","last_fullsized":"2024-04-26T18:31:56.796753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'584","last_scrub_stamp":"2024-04-26T18:31:56.796674+0000","last_deep_scrub":"41'584","last_deep_scrub_stamp":"2024-04-26T18:31:56.796674+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.796674+0000","objects_scrubbed":60,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:28.842664+0000","scrub_duration":101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37233347,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":593,"num_write_kb":74518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":625450,"num_omap_keys":1097,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"41'654","reported_seq":2750,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.579100+0000","last_change":"2024-04-26T18:31:57.579100+0000","last_active":"2024-04-26T18:31:57.579100+0000","last_peered":"2024-04-26T18:31:57.579100+0000","last_clean":"2024-04-26T18:31:57.579100+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T18:31:57.579100+0000","last_undegraded":"2024-04-26T18:31:57.579100+0000","last_fullsized":"2024-04-26T18:31:57.579100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'654","last_scrub_stamp":"2024-04-26T18:31:57.578980+0000","last_deep_scrub":"41'654","last_deep_scrub_stamp":"2024-04-26T18:31:57.578980+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.578980+0000","objects_scrubbed":48,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:13.947523+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0.230683108,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"41'2821","reported_seq":4612,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.281942+0000","last_change":"2024-04-26T18:32:10.282021+0000","last_active":"2024-04-26T18:32:10.281942+0000","last_peered":"2024-04-26T18:32:10.281942+0000","last_clean":"2024-04-26T18:32:10.281942+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T18:32:10.281942+0000","last_undegraded":"2024-04-26T18:32:10.281942+0000","last_fullsized":"2024-04-26T18:32:10.281942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2821","last_scrub_stamp":"2024-04-26T18:32:10.281550+0000","last_deep_scrub":"41'2821","last_deep_scrub_stamp":"2024-04-26T18:32:10.281550+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.281550+0000","objects_scrubbed":1217,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:32.863399+0000","scrub_duration":546,"objects_trimmed":0,"snaptrim_duration":0.226534869,"stat_sum":{"num_bytes":47000043,"num_objects":1217,"num_object_clones":566,"num_object_copies":4868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":566,"num_read":213,"num_read_kb":295654,"num_write":2298,"num_write_kb":59293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'1181","reported_seq":1265,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.673264+0000","last_change":"2024-04-26T18:32:00.673264+0000","last_active":"2024-04-26T18:32:00.673264+0000","last_peered":"2024-04-26T18:32:00.673264+0000","last_clean":"2024-04-26T18:32:00.673264+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T18:32:00.673264+0000","last_undegraded":"2024-04-26T18:32:00.673264+0000","last_fullsized":"2024-04-26T18:32:00.673264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1181","last_scrub_stamp":"2024-04-26T18:32:00.673155+0000","last_deep_scrub":"41'1181","last_deep_scrub_stamp":"2024-04-26T18:32:00.673155+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.673155+0000","objects_scrubbed":66,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:14.043348+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":1207,"num_write_kb":83571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741342,"num_omap_keys":1239,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"41'635","reported_seq":2728,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.801335+0000","last_change":"2024-04-26T18:32:05.801380+0000","last_active":"2024-04-26T18:32:05.801335+0000","last_peered":"2024-04-26T18:32:05.801335+0000","last_clean":"2024-04-26T18:32:05.801335+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T18:32:05.801335+0000","last_undegraded":"2024-04-26T18:32:05.801335+0000","last_fullsized":"2024-04-26T18:32:05.801335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'635","last_scrub_stamp":"2024-04-26T18:32:05.801240+0000","last_deep_scrub":"41'635","last_deep_scrub_stamp":"2024-04-26T18:32:05.801240+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.801240+0000","objects_scrubbed":44,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:52.982610+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.19357582500000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":12,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"41'2977","reported_seq":4673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.320358+0000","last_change":"2024-04-26T18:32:07.320429+0000","last_active":"2024-04-26T18:32:07.320358+0000","last_peered":"2024-04-26T18:32:07.320358+0000","last_clean":"2024-04-26T18:32:07.320358+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T18:32:07.320358+0000","last_undegraded":"2024-04-26T18:32:07.320358+0000","last_fullsized":"2024-04-26T18:32:07.320358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2977","last_scrub_stamp":"2024-04-26T18:32:07.320264+0000","last_deep_scrub":"41'2977","last_deep_scrub_stamp":"2024-04-26T18:32:07.320264+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.320264+0000","objects_scrubbed":1261,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:18.016502+0000","scrub_duration":448,"objects_trimmed":0,"snaptrim_duration":0.17635221100000001,"stat_sum":{"num_bytes":22365631,"num_objects":1261,"num_object_clones":594,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1261,"num_whiteouts":594,"num_read":144,"num_read_kb":92763,"num_write":2429,"num_write_kb":39864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"41'1089","reported_seq":1169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.713575+0000","last_change":"2024-04-26T18:32:05.713654+0000","last_active":"2024-04-26T18:32:05.713575+0000","last_peered":"2024-04-26T18:32:05.713575+0000","last_clean":"2024-04-26T18:32:05.713575+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T18:32:05.713575+0000","last_undegraded":"2024-04-26T18:32:05.713575+0000","last_fullsized":"2024-04-26T18:32:05.713575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1089","last_scrub_stamp":"2024-04-26T18:32:05.713461+0000","last_deep_scrub":"41'1089","last_deep_scrub_stamp":"2024-04-26T18:32:05.713461+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.713461+0000","objects_scrubbed":70,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:27.191884+0000","scrub_duration":129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":1097,"num_write_kb":133138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946158,"num_omap_keys":1433,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'670","reported_seq":2762,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.817854+0000","last_change":"2024-04-26T18:32:06.817921+0000","last_active":"2024-04-26T18:32:06.817854+0000","last_peered":"2024-04-26T18:32:06.817854+0000","last_clean":"2024-04-26T18:32:06.817854+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T18:32:06.817854+0000","last_undegraded":"2024-04-26T18:32:06.817854+0000","last_fullsized":"2024-04-26T18:32:06.817854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:06.817747+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:06.817747+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.817747+0000","objects_scrubbed":44,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:13.360869+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0.16172857600000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"41'2946","reported_seq":4712,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.452156+0000","last_change":"2024-04-26T18:32:10.452241+0000","last_active":"2024-04-26T18:32:10.452156+0000","last_peered":"2024-04-26T18:32:10.452156+0000","last_clean":"2024-04-26T18:32:10.452156+0000","last_became_active":"2024-04-26T17:58:46.846516+0000","last_became_peered":"2024-04-26T17:58:46.846516+0000","last_unstale":"2024-04-26T18:32:10.452156+0000","last_undegraded":"2024-04-26T18:32:10.452156+0000","last_fullsized":"2024-04-26T18:32:10.452156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2946","last_scrub_stamp":"2024-04-26T18:32:10.452029+0000","last_deep_scrub":"41'2946","last_deep_scrub_stamp":"2024-04-26T18:32:10.452029+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.452029+0000","objects_scrubbed":1294,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:00.355165+0000","scrub_duration":588,"objects_trimmed":0,"snaptrim_duration":0.18830187000000001,"stat_sum":{"num_bytes":52036256,"num_objects":1294,"num_object_clones":599,"num_object_copies":5176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":599,"num_read":211,"num_read_kb":315253,"num_write":2398,"num_write_kb":54529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"41'589","reported_seq":669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.712715+0000","last_change":"2024-04-26T18:32:00.712754+0000","last_active":"2024-04-26T18:32:00.712715+0000","last_peered":"2024-04-26T18:32:00.712715+0000","last_clean":"2024-04-26T18:32:00.712715+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T18:32:00.712715+0000","last_undegraded":"2024-04-26T18:32:00.712715+0000","last_fullsized":"2024-04-26T18:32:00.712715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'589","last_scrub_stamp":"2024-04-26T18:32:00.712651+0000","last_deep_scrub":"41'589","last_deep_scrub_stamp":"2024-04-26T18:32:00.712651+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.712651+0000","objects_scrubbed":64,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:32.175673+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":594,"num_write_kb":70938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":905659,"num_omap_keys":1552,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"41'656","reported_seq":2743,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.919006+0000","last_change":"2024-04-26T18:31:58.919083+0000","last_active":"2024-04-26T18:31:58.919006+0000","last_peered":"2024-04-26T18:31:58.919006+0000","last_clean":"2024-04-26T18:31:58.919006+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T18:31:58.919006+0000","last_undegraded":"2024-04-26T18:31:58.919006+0000","last_fullsized":"2024-04-26T18:31:58.919006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'656","last_scrub_stamp":"2024-04-26T18:31:58.918900+0000","last_deep_scrub":"41'656","last_deep_scrub_stamp":"2024-04-26T18:31:58.918900+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.918900+0000","objects_scrubbed":47,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:11.806962+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0.161485249,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"41'2787","reported_seq":4566,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.273204+0000","last_change":"2024-04-26T18:32:05.273244+0000","last_active":"2024-04-26T18:32:05.273204+0000","last_peered":"2024-04-26T18:32:05.273204+0000","last_clean":"2024-04-26T18:32:05.273204+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T18:32:05.273204+0000","last_undegraded":"2024-04-26T18:32:05.273204+0000","last_fullsized":"2024-04-26T18:32:05.273204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2787","last_scrub_stamp":"2024-04-26T18:32:05.273123+0000","last_deep_scrub":"41'2787","last_deep_scrub_stamp":"2024-04-26T18:32:05.273123+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.273123+0000","objects_scrubbed":1192,"log_size":2787,"log_dups_size":0,"ondisk_log_size":2787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:08.317634+0000","scrub_duration":447,"objects_trimmed":0,"snaptrim_duration":0.18642139199999999,"stat_sum":{"num_bytes":46440810,"num_objects":1192,"num_object_clones":545,"num_object_copies":4768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":545,"num_read":181,"num_read_kb":201245,"num_write":2302,"num_write_kb":49304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"41'700","reported_seq":2785,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.923048+0000","last_change":"2024-04-26T18:32:03.923118+0000","last_active":"2024-04-26T18:32:03.923048+0000","last_peered":"2024-04-26T18:32:03.923048+0000","last_clean":"2024-04-26T18:32:03.923048+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T18:32:03.923048+0000","last_undegraded":"2024-04-26T18:32:03.923048+0000","last_fullsized":"2024-04-26T18:32:03.923048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'700","last_scrub_stamp":"2024-04-26T18:32:03.922947+0000","last_deep_scrub":"41'700","last_deep_scrub_stamp":"2024-04-26T18:32:03.922947+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.922947+0000","objects_scrubbed":66,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:34.045147+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0.101605577,"stat_sum":{"num_bytes":0,"num_objects":66,"num_object_clones":20,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"41'2586","reported_seq":2668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.759132+0000","last_change":"2024-04-26T18:32:02.759176+0000","last_active":"2024-04-26T18:32:02.759132+0000","last_peered":"2024-04-26T18:32:02.759132+0000","last_clean":"2024-04-26T18:32:02.759132+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T18:32:02.759132+0000","last_undegraded":"2024-04-26T18:32:02.759132+0000","last_fullsized":"2024-04-26T18:32:02.759132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2586","last_scrub_stamp":"2024-04-26T18:32:02.759035+0000","last_deep_scrub":"41'2586","last_deep_scrub_stamp":"2024-04-26T18:32:02.759035+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.759035+0000","objects_scrubbed":50,"log_size":2586,"log_dups_size":0,"ondisk_log_size":2586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:33.776082+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":2609,"num_write_kb":88139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731120,"num_omap_keys":1205,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"41'2917","reported_seq":4650,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.398451+0000","last_change":"2024-04-26T18:32:08.398511+0000","last_active":"2024-04-26T18:32:08.398451+0000","last_peered":"2024-04-26T18:32:08.398451+0000","last_clean":"2024-04-26T18:32:08.398451+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T18:32:08.398451+0000","last_undegraded":"2024-04-26T18:32:08.398451+0000","last_fullsized":"2024-04-26T18:32:08.398451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2917","last_scrub_stamp":"2024-04-26T18:32:08.398358+0000","last_deep_scrub":"41'2917","last_deep_scrub_stamp":"2024-04-26T18:32:08.398358+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.398358+0000","objects_scrubbed":1273,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:18.785042+0000","scrub_duration":506,"objects_trimmed":0,"snaptrim_duration":0.19133515200000001,"stat_sum":{"num_bytes":43266035,"num_objects":1273,"num_object_clones":588,"num_object_copies":5092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1273,"num_whiteouts":588,"num_read":173,"num_read_kb":222814,"num_write":2389,"num_write_kb":54953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"41'663","reported_seq":2759,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.631651+0000","last_change":"2024-04-26T18:31:59.631693+0000","last_active":"2024-04-26T18:31:59.631651+0000","last_peered":"2024-04-26T18:31:59.631651+0000","last_clean":"2024-04-26T18:31:59.631651+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T18:31:59.631651+0000","last_undegraded":"2024-04-26T18:31:59.631651+0000","last_fullsized":"2024-04-26T18:31:59.631651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'663","last_scrub_stamp":"2024-04-26T18:31:59.631553+0000","last_deep_scrub":"41'663","last_deep_scrub_stamp":"2024-04-26T18:31:59.631553+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.631553+0000","objects_scrubbed":50,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:22.786623+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0.22887548799999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":9,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'1388","reported_seq":1470,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.044298+0000","last_change":"2024-04-26T18:31:58.044331+0000","last_active":"2024-04-26T18:31:58.044298+0000","last_peered":"2024-04-26T18:31:58.044298+0000","last_clean":"2024-04-26T18:31:58.044298+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T18:31:58.044298+0000","last_undegraded":"2024-04-26T18:31:58.044298+0000","last_fullsized":"2024-04-26T18:31:58.044298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1388","last_scrub_stamp":"2024-04-26T18:31:58.044235+0000","last_deep_scrub":"41'1388","last_deep_scrub_stamp":"2024-04-26T18:31:58.044235+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.044235+0000","objects_scrubbed":61,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:36.044743+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":1392,"num_write_kb":95976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":773289,"num_omap_keys":1315,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"41'2855","reported_seq":4608,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.382931+0000","last_change":"2024-04-26T18:32:11.382976+0000","last_active":"2024-04-26T18:32:11.382931+0000","last_peered":"2024-04-26T18:32:11.382931+0000","last_clean":"2024-04-26T18:32:11.382931+0000","last_became_active":"2024-04-26T17:58:46.846635+0000","last_became_peered":"2024-04-26T17:58:46.846635+0000","last_unstale":"2024-04-26T18:32:11.382931+0000","last_undegraded":"2024-04-26T18:32:11.382931+0000","last_fullsized":"2024-04-26T18:32:11.382931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2855","last_scrub_stamp":"2024-04-26T18:32:11.382757+0000","last_deep_scrub":"41'2855","last_deep_scrub_stamp":"2024-04-26T18:32:11.382757+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.382757+0000","objects_scrubbed":1180,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.694014+0000","scrub_duration":499,"objects_trimmed":0,"snaptrim_duration":0.18928092499999999,"stat_sum":{"num_bytes":21448645,"num_objects":1180,"num_object_clones":543,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":543,"num_read":145,"num_read_kb":62792,"num_write":2368,"num_write_kb":33318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"41'711","reported_seq":2801,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.715520+0000","last_change":"2024-04-26T18:32:07.715551+0000","last_active":"2024-04-26T18:32:07.715520+0000","last_peered":"2024-04-26T18:32:07.715520+0000","last_clean":"2024-04-26T18:32:07.715520+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T18:32:07.715520+0000","last_undegraded":"2024-04-26T18:32:07.715520+0000","last_fullsized":"2024-04-26T18:32:07.715520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'711","last_scrub_stamp":"2024-04-26T18:32:07.715450+0000","last_deep_scrub":"41'711","last_deep_scrub_stamp":"2024-04-26T18:32:07.715450+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.715450+0000","objects_scrubbed":56,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:18.023367+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0.22842327800000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":15,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"41'900","reported_seq":982,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.114386+0000","last_change":"2024-04-26T18:32:02.114433+0000","last_active":"2024-04-26T18:32:02.114386+0000","last_peered":"2024-04-26T18:32:02.114386+0000","last_clean":"2024-04-26T18:32:02.114386+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T18:32:02.114386+0000","last_undegraded":"2024-04-26T18:32:02.114386+0000","last_fullsized":"2024-04-26T18:32:02.114386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'900","last_scrub_stamp":"2024-04-26T18:32:02.114315+0000","last_deep_scrub":"41'900","last_deep_scrub_stamp":"2024-04-26T18:32:02.114315+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.114315+0000","objects_scrubbed":52,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:38.542317+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":901,"num_write_kb":79506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586989,"num_omap_keys":940,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"41'2890","reported_seq":4636,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.470775+0000","last_change":"2024-04-26T18:32:12.470811+0000","last_active":"2024-04-26T18:32:12.470775+0000","last_peered":"2024-04-26T18:32:12.470775+0000","last_clean":"2024-04-26T18:32:12.470775+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T18:32:12.470775+0000","last_undegraded":"2024-04-26T18:32:12.470775+0000","last_fullsized":"2024-04-26T18:32:12.470775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2890","last_scrub_stamp":"2024-04-26T18:32:12.470679+0000","last_deep_scrub":"41'2890","last_deep_scrub_stamp":"2024-04-26T18:32:12.470679+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.470679+0000","objects_scrubbed":1245,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:04.903215+0000","scrub_duration":425,"objects_trimmed":0,"snaptrim_duration":0.077792920000000002,"stat_sum":{"num_bytes":29575215,"num_objects":1245,"num_object_clones":583,"num_object_copies":4980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":583,"num_read":185,"num_read_kb":122841,"num_write":2351,"num_write_kb":42495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"41'660","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.925374+0000","last_change":"2024-04-26T18:32:00.925440+0000","last_active":"2024-04-26T18:32:00.925374+0000","last_peered":"2024-04-26T18:32:00.925374+0000","last_clean":"2024-04-26T18:32:00.925374+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T18:32:00.925374+0000","last_undegraded":"2024-04-26T18:32:00.925374+0000","last_fullsized":"2024-04-26T18:32:00.925374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'660","last_scrub_stamp":"2024-04-26T18:32:00.925278+0000","last_deep_scrub":"41'660","last_deep_scrub_stamp":"2024-04-26T18:32:00.925278+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.925278+0000","objects_scrubbed":43,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:52.166326+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.18061166100000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"41'523","reported_seq":605,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.690197+0000","last_change":"2024-04-26T18:32:04.690243+0000","last_active":"2024-04-26T18:32:04.690197+0000","last_peered":"2024-04-26T18:32:04.690197+0000","last_clean":"2024-04-26T18:32:04.690197+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T18:32:04.690197+0000","last_undegraded":"2024-04-26T18:32:04.690197+0000","last_fullsized":"2024-04-26T18:32:04.690197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'523","last_scrub_stamp":"2024-04-26T18:32:04.690126+0000","last_deep_scrub":"41'523","last_deep_scrub_stamp":"2024-04-26T18:32:04.690126+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.690126+0000","objects_scrubbed":55,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:33.372095+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":511,"num_write_kb":66851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706333,"num_omap_keys":1229,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"41'2805","reported_seq":4545,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.292011+0000","last_change":"2024-04-26T18:32:06.292073+0000","last_active":"2024-04-26T18:32:06.292011+0000","last_peered":"2024-04-26T18:32:06.292011+0000","last_clean":"2024-04-26T18:32:06.292011+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T18:32:06.292011+0000","last_undegraded":"2024-04-26T18:32:06.292011+0000","last_fullsized":"2024-04-26T18:32:06.292011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2805","last_scrub_stamp":"2024-04-26T18:32:06.291917+0000","last_deep_scrub":"41'2805","last_deep_scrub_stamp":"2024-04-26T18:32:06.291917+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.291917+0000","objects_scrubbed":1237,"log_size":2805,"log_dups_size":0,"ondisk_log_size":2805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:15.030890+0000","scrub_duration":450,"objects_trimmed":0,"snaptrim_duration":0.18788326999999999,"stat_sum":{"num_bytes":37828835,"num_objects":1237,"num_object_clones":573,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":573,"num_read":167,"num_read_kb":252976,"num_write":2275,"num_write_kb":48379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"41'651","reported_seq":2744,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:54.781537+0000","last_change":"2024-04-26T18:31:54.781565+0000","last_active":"2024-04-26T18:31:54.781537+0000","last_peered":"2024-04-26T18:31:54.781537+0000","last_clean":"2024-04-26T18:31:54.781537+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T18:31:54.781537+0000","last_undegraded":"2024-04-26T18:31:54.781537+0000","last_fullsized":"2024-04-26T18:31:54.781537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'651","last_scrub_stamp":"2024-04-26T18:31:54.781462+0000","last_deep_scrub":"41'651","last_deep_scrub_stamp":"2024-04-26T18:31:54.781462+0000","last_clean_scrub_stamp":"2024-04-26T18:31:54.781462+0000","objects_scrubbed":51,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:56.927622+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.19854031599999999,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"41'879","reported_seq":961,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.007511+0000","last_change":"2024-04-26T18:32:00.007552+0000","last_active":"2024-04-26T18:32:00.007511+0000","last_peered":"2024-04-26T18:32:00.007511+0000","last_clean":"2024-04-26T18:32:00.007511+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T18:32:00.007511+0000","last_undegraded":"2024-04-26T18:32:00.007511+0000","last_fullsized":"2024-04-26T18:32:00.007511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'879","last_scrub_stamp":"2024-04-26T18:32:00.007451+0000","last_deep_scrub":"41'879","last_deep_scrub_stamp":"2024-04-26T18:32:00.007451+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.007451+0000","objects_scrubbed":66,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:14.053383+0000","scrub_duration":168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":915,"num_write_kb":75562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":939865,"num_omap_keys":1573,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"41'2861","reported_seq":4612,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.374178+0000","last_change":"2024-04-26T18:32:03.374203+0000","last_active":"2024-04-26T18:32:03.374178+0000","last_peered":"2024-04-26T18:32:03.374178+0000","last_clean":"2024-04-26T18:32:03.374178+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T18:32:03.374178+0000","last_undegraded":"2024-04-26T18:32:03.374178+0000","last_fullsized":"2024-04-26T18:32:03.374178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2861","last_scrub_stamp":"2024-04-26T18:32:03.374101+0000","last_deep_scrub":"41'2861","last_deep_scrub_stamp":"2024-04-26T18:32:03.374101+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.374101+0000","objects_scrubbed":1183,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:20.611585+0000","scrub_duration":476,"objects_trimmed":0,"snaptrim_duration":0.181349811,"stat_sum":{"num_bytes":38568471,"num_objects":1183,"num_object_clones":549,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":549,"num_read":153,"num_read_kb":161622,"num_write":2358,"num_write_kb":47514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"41'645","reported_seq":2736,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.630346+0000","last_change":"2024-04-26T18:32:04.630371+0000","last_active":"2024-04-26T18:32:04.630346+0000","last_peered":"2024-04-26T18:32:04.630346+0000","last_clean":"2024-04-26T18:32:04.630346+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T18:32:04.630346+0000","last_undegraded":"2024-04-26T18:32:04.630346+0000","last_fullsized":"2024-04-26T18:32:04.630346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'645","last_scrub_stamp":"2024-04-26T18:32:04.630289+0000","last_deep_scrub":"41'645","last_deep_scrub_stamp":"2024-04-26T18:32:04.630289+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.630289+0000","objects_scrubbed":50,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:19.277881+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.217975578,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"41'1538","reported_seq":1620,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.120232+0000","last_change":"2024-04-26T18:32:03.120264+0000","last_active":"2024-04-26T18:32:03.120232+0000","last_peered":"2024-04-26T18:32:03.120232+0000","last_clean":"2024-04-26T18:32:03.120232+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T18:32:03.120232+0000","last_undegraded":"2024-04-26T18:32:03.120232+0000","last_fullsized":"2024-04-26T18:32:03.120232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1538","last_scrub_stamp":"2024-04-26T18:32:03.120167+0000","last_deep_scrub":"41'1538","last_deep_scrub_stamp":"2024-04-26T18:32:03.120167+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.120167+0000","objects_scrubbed":55,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:27.152021+0000","scrub_duration":85,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":3200,"num_write_kb":72387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":716310,"num_omap_keys":1028,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"41'2904","reported_seq":4606,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.035578+0000","last_change":"2024-04-26T18:03:00.447628+0000","last_active":"2024-04-26T18:31:56.035578+0000","last_peered":"2024-04-26T18:31:56.035578+0000","last_clean":"2024-04-26T18:31:56.035578+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T18:31:56.035578+0000","last_undegraded":"2024-04-26T18:31:56.035578+0000","last_fullsized":"2024-04-26T18:31:56.035578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2904,"log_dups_size":0,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23002119400000001,"stat_sum":{"num_bytes":32774060,"num_objects":1224,"num_object_clones":563,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1224,"num_whiteouts":563,"num_read":174,"num_read_kb":173649,"num_write":2397,"num_write_kb":37665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"41'667","reported_seq":2760,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.084511+0000","last_change":"2024-04-26T18:32:05.084538+0000","last_active":"2024-04-26T18:32:05.084511+0000","last_peered":"2024-04-26T18:32:05.084511+0000","last_clean":"2024-04-26T18:32:05.084511+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T18:32:05.084511+0000","last_undegraded":"2024-04-26T18:32:05.084511+0000","last_fullsized":"2024-04-26T18:32:05.084511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'667","last_scrub_stamp":"2024-04-26T18:32:05.084447+0000","last_deep_scrub":"41'667","last_deep_scrub_stamp":"2024-04-26T18:32:05.084447+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.084447+0000","objects_scrubbed":51,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:46.447182+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0.077215679999999995,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"41'852","reported_seq":935,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.760035+0000","last_change":"2024-04-26T18:32:01.760074+0000","last_active":"2024-04-26T18:32:01.760035+0000","last_peered":"2024-04-26T18:32:01.760035+0000","last_clean":"2024-04-26T18:32:01.760035+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T18:32:01.760035+0000","last_undegraded":"2024-04-26T18:32:01.760035+0000","last_fullsized":"2024-04-26T18:32:01.760035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'852","last_scrub_stamp":"2024-04-26T18:32:01.759971+0000","last_deep_scrub":"41'852","last_deep_scrub_stamp":"2024-04-26T18:32:01.759971+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.759971+0000","objects_scrubbed":64,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:06.107316+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":856,"num_write_kb":87605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":737100,"num_omap_keys":1125,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"41'2980","reported_seq":4703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.413169+0000","last_change":"2024-04-26T18:32:10.413203+0000","last_active":"2024-04-26T18:32:10.413169+0000","last_peered":"2024-04-26T18:32:10.413169+0000","last_clean":"2024-04-26T18:32:10.413169+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T18:32:10.413169+0000","last_undegraded":"2024-04-26T18:32:10.413169+0000","last_fullsized":"2024-04-26T18:32:10.413169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2980","last_scrub_stamp":"2024-04-26T18:32:10.413087+0000","last_deep_scrub":"41'2980","last_deep_scrub_stamp":"2024-04-26T18:32:10.413087+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.413087+0000","objects_scrubbed":1282,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:44.034661+0000","scrub_duration":580,"objects_trimmed":0,"snaptrim_duration":0.20617318100000001,"stat_sum":{"num_bytes":38568987,"num_objects":1282,"num_object_clones":600,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":600,"num_read":173,"num_read_kb":195813,"num_write":2429,"num_write_kb":47342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'659","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.828245+0000","last_change":"2024-04-26T18:32:09.828290+0000","last_active":"2024-04-26T18:32:09.828245+0000","last_peered":"2024-04-26T18:32:09.828245+0000","last_clean":"2024-04-26T18:32:09.828245+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T18:32:09.828245+0000","last_undegraded":"2024-04-26T18:32:09.828245+0000","last_fullsized":"2024-04-26T18:32:09.828245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'659","last_scrub_stamp":"2024-04-26T18:32:09.828182+0000","last_deep_scrub":"41'659","last_deep_scrub_stamp":"2024-04-26T18:32:09.828182+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.828182+0000","objects_scrubbed":38,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:05.508126+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0.161265819,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"41'813","reported_seq":896,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.078583+0000","last_change":"2024-04-26T18:32:00.078624+0000","last_active":"2024-04-26T18:32:00.078583+0000","last_peered":"2024-04-26T18:32:00.078583+0000","last_clean":"2024-04-26T18:32:00.078583+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T18:32:00.078583+0000","last_undegraded":"2024-04-26T18:32:00.078583+0000","last_fullsized":"2024-04-26T18:32:00.078583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'813","last_scrub_stamp":"2024-04-26T18:32:00.078524+0000","last_deep_scrub":"41'813","last_deep_scrub_stamp":"2024-04-26T18:32:00.078524+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.078524+0000","objects_scrubbed":67,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:44.486095+0000","scrub_duration":113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":797,"num_write_kb":111877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":690144,"num_omap_keys":1125,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"41'2902","reported_seq":4673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.568312+0000","last_change":"2024-04-26T18:32:11.568347+0000","last_active":"2024-04-26T18:32:11.568312+0000","last_peered":"2024-04-26T18:32:11.568312+0000","last_clean":"2024-04-26T18:32:11.568312+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T18:32:11.568312+0000","last_undegraded":"2024-04-26T18:32:11.568312+0000","last_fullsized":"2024-04-26T18:32:11.568312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2902","last_scrub_stamp":"2024-04-26T18:32:11.568229+0000","last_deep_scrub":"41'2902","last_deep_scrub_stamp":"2024-04-26T18:32:11.568229+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.568229+0000","objects_scrubbed":1258,"log_size":2902,"log_dups_size":0,"ondisk_log_size":2902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:54.151842+0000","scrub_duration":547,"objects_trimmed":0,"snaptrim_duration":0.077512545000000002,"stat_sum":{"num_bytes":51130541,"num_objects":1258,"num_object_clones":577,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":577,"num_read":199,"num_read_kb":291004,"num_write":2373,"num_write_kb":60236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'665","reported_seq":2759,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.005783+0000","last_change":"2024-04-26T18:31:58.005832+0000","last_active":"2024-04-26T18:31:58.005783+0000","last_peered":"2024-04-26T18:31:58.005783+0000","last_clean":"2024-04-26T18:31:58.005783+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T18:31:58.005783+0000","last_undegraded":"2024-04-26T18:31:58.005783+0000","last_fullsized":"2024-04-26T18:31:58.005783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'665","last_scrub_stamp":"2024-04-26T18:31:58.005719+0000","last_deep_scrub":"41'665","last_deep_scrub_stamp":"2024-04-26T18:31:58.005719+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.005719+0000","objects_scrubbed":46,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:03.101467+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0.18566148499999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"41'584","reported_seq":666,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.942835+0000","last_change":"2024-04-26T18:32:00.942918+0000","last_active":"2024-04-26T18:32:00.942835+0000","last_peered":"2024-04-26T18:32:00.942835+0000","last_clean":"2024-04-26T18:32:00.942835+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T18:32:00.942835+0000","last_undegraded":"2024-04-26T18:32:00.942835+0000","last_fullsized":"2024-04-26T18:32:00.942835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'584","last_scrub_stamp":"2024-04-26T18:32:00.942765+0000","last_deep_scrub":"41'584","last_deep_scrub_stamp":"2024-04-26T18:32:00.942765+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.942765+0000","objects_scrubbed":46,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:32.515593+0000","scrub_duration":74,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":583,"num_write_kb":83272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":607529,"num_omap_keys":867,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"41'2814","reported_seq":4514,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.431293+0000","last_change":"2024-04-26T18:32:09.431345+0000","last_active":"2024-04-26T18:32:09.431293+0000","last_peered":"2024-04-26T18:32:09.431293+0000","last_clean":"2024-04-26T18:32:09.431293+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T18:32:09.431293+0000","last_undegraded":"2024-04-26T18:32:09.431293+0000","last_fullsized":"2024-04-26T18:32:09.431293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2814","last_scrub_stamp":"2024-04-26T18:32:09.431175+0000","last_deep_scrub":"41'2814","last_deep_scrub_stamp":"2024-04-26T18:32:09.431175+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.431175+0000","objects_scrubbed":1207,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:20.143758+0000","scrub_duration":465,"objects_trimmed":0,"snaptrim_duration":0.077645753999999997,"stat_sum":{"num_bytes":21677192,"num_objects":1207,"num_object_clones":566,"num_object_copies":4828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":566,"num_read":120,"num_read_kb":106865,"num_write":2295,"num_write_kb":28218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"41'683","reported_seq":2774,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.059308+0000","last_change":"2024-04-26T18:32:04.059308+0000","last_active":"2024-04-26T18:32:04.059308+0000","last_peered":"2024-04-26T18:32:04.059308+0000","last_clean":"2024-04-26T18:32:04.059308+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T18:32:04.059308+0000","last_undegraded":"2024-04-26T18:32:04.059308+0000","last_fullsized":"2024-04-26T18:32:04.059308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'683","last_scrub_stamp":"2024-04-26T18:32:04.059209+0000","last_deep_scrub":"41'683","last_deep_scrub_stamp":"2024-04-26T18:32:04.059209+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.059209+0000","objects_scrubbed":55,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:28.215239+0000","scrub_duration":66,"objects_trimmed":0,"snaptrim_duration":0.076659478000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'1679","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.718441+0000","last_change":"2024-04-26T18:31:56.718491+0000","last_active":"2024-04-26T18:31:56.718441+0000","last_peered":"2024-04-26T18:31:56.718441+0000","last_clean":"2024-04-26T18:31:56.718441+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T18:31:56.718441+0000","last_undegraded":"2024-04-26T18:31:56.718441+0000","last_fullsized":"2024-04-26T18:31:56.718441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1679","last_scrub_stamp":"2024-04-26T18:31:56.718376+0000","last_deep_scrub":"41'1679","last_deep_scrub_stamp":"2024-04-26T18:31:56.718376+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.718376+0000","objects_scrubbed":61,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:01.847577+0000","scrub_duration":94,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":992,"num_read_kb":4725,"num_write":1685,"num_write_kb":100551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733371,"num_omap_keys":1146,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"41'2764","reported_seq":4542,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.529368+0000","last_change":"2024-04-26T18:32:10.529429+0000","last_active":"2024-04-26T18:32:10.529368+0000","last_peered":"2024-04-26T18:32:10.529368+0000","last_clean":"2024-04-26T18:32:10.529368+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T18:32:10.529368+0000","last_undegraded":"2024-04-26T18:32:10.529368+0000","last_fullsized":"2024-04-26T18:32:10.529368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2764","last_scrub_stamp":"2024-04-26T18:32:10.529272+0000","last_deep_scrub":"41'2764","last_deep_scrub_stamp":"2024-04-26T18:32:10.529272+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.529272+0000","objects_scrubbed":1196,"log_size":2764,"log_dups_size":0,"ondisk_log_size":2764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.822475+0000","scrub_duration":519,"objects_trimmed":0,"snaptrim_duration":0.077766350999999997,"stat_sum":{"num_bytes":40144243,"num_objects":1196,"num_object_clones":556,"num_object_copies":4784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":556,"num_read":189,"num_read_kb":267710,"num_write":2256,"num_write_kb":47769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"41'633","reported_seq":2726,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.728992+0000","last_change":"2024-04-26T18:31:59.729028+0000","last_active":"2024-04-26T18:31:59.728992+0000","last_peered":"2024-04-26T18:31:59.728992+0000","last_clean":"2024-04-26T18:31:59.728992+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T18:31:59.728992+0000","last_undegraded":"2024-04-26T18:31:59.728992+0000","last_fullsized":"2024-04-26T18:31:59.728992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'633","last_scrub_stamp":"2024-04-26T18:31:59.728932+0000","last_deep_scrub":"41'633","last_deep_scrub_stamp":"2024-04-26T18:31:59.728932+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.728932+0000","objects_scrubbed":42,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:33.068760+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.20174721700000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'711","reported_seq":794,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.725201+0000","last_change":"2024-04-26T18:32:03.725201+0000","last_active":"2024-04-26T18:32:03.725201+0000","last_peered":"2024-04-26T18:32:03.725201+0000","last_clean":"2024-04-26T18:32:03.725201+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T18:32:03.725201+0000","last_undegraded":"2024-04-26T18:32:03.725201+0000","last_fullsized":"2024-04-26T18:32:03.725201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'711","last_scrub_stamp":"2024-04-26T18:32:03.725104+0000","last_deep_scrub":"41'711","last_deep_scrub_stamp":"2024-04-26T18:32:03.725104+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.725104+0000","objects_scrubbed":44,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:02.282920+0000","scrub_duration":86,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":715,"num_write_kb":79339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":638987,"num_omap_keys":977,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"41'2915","reported_seq":4654,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.230135+0000","last_change":"2024-04-26T18:32:07.230229+0000","last_active":"2024-04-26T18:32:07.230135+0000","last_peered":"2024-04-26T18:32:07.230135+0000","last_clean":"2024-04-26T18:32:07.230135+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T18:32:07.230135+0000","last_undegraded":"2024-04-26T18:32:07.230135+0000","last_fullsized":"2024-04-26T18:32:07.230135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2915","last_scrub_stamp":"2024-04-26T18:32:07.230056+0000","last_deep_scrub":"41'2915","last_deep_scrub_stamp":"2024-04-26T18:32:07.230056+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.230056+0000","objects_scrubbed":1212,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:49.885460+0000","scrub_duration":438,"objects_trimmed":0,"snaptrim_duration":0.20190264199999999,"stat_sum":{"num_bytes":26615609,"num_objects":1212,"num_object_clones":560,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":560,"num_read":154,"num_read_kb":128765,"num_write":2402,"num_write_kb":29722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"41'680","reported_seq":2772,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.737983+0000","last_change":"2024-04-26T18:32:08.738025+0000","last_active":"2024-04-26T18:32:08.737983+0000","last_peered":"2024-04-26T18:32:08.737983+0000","last_clean":"2024-04-26T18:32:08.737983+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T18:32:08.737983+0000","last_undegraded":"2024-04-26T18:32:08.737983+0000","last_fullsized":"2024-04-26T18:32:08.737983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'680","last_scrub_stamp":"2024-04-26T18:32:08.737892+0000","last_deep_scrub":"41'680","last_deep_scrub_stamp":"2024-04-26T18:32:08.737892+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.737892+0000","objects_scrubbed":51,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:06.001662+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0.22655562100000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'1656","reported_seq":1739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.946957+0000","last_change":"2024-04-26T18:32:02.947017+0000","last_active":"2024-04-26T18:32:02.946957+0000","last_peered":"2024-04-26T18:32:02.946957+0000","last_clean":"2024-04-26T18:32:02.946957+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T18:32:02.946957+0000","last_undegraded":"2024-04-26T18:32:02.946957+0000","last_fullsized":"2024-04-26T18:32:02.946957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1656","last_scrub_stamp":"2024-04-26T18:32:02.946864+0000","last_deep_scrub":"41'1656","last_deep_scrub_stamp":"2024-04-26T18:32:02.946864+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.946864+0000","objects_scrubbed":61,"log_size":1656,"log_dups_size":0,"ondisk_log_size":1656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:55.092910+0000","scrub_duration":80,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":0,"num_write":1680,"num_write_kb":72101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":996664,"num_omap_keys":1524,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"41'119","reported_seq":240,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.651093+0000","last_change":"2024-04-26T18:31:59.651093+0000","last_active":"2024-04-26T18:31:59.651093+0000","last_peered":"2024-04-26T18:31:59.651093+0000","last_clean":"2024-04-26T18:31:59.651093+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T18:31:59.651093+0000","last_undegraded":"2024-04-26T18:31:59.651093+0000","last_fullsized":"2024-04-26T18:31:59.651093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2024-04-26T18:31:59.650979+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2024-04-26T18:31:59.650979+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.650979+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:02.282951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"41'3034","reported_seq":4739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.352413+0000","last_change":"2024-04-26T18:32:10.352491+0000","last_active":"2024-04-26T18:32:10.352413+0000","last_peered":"2024-04-26T18:32:10.352413+0000","last_clean":"2024-04-26T18:32:10.352413+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T18:32:10.352413+0000","last_undegraded":"2024-04-26T18:32:10.352413+0000","last_fullsized":"2024-04-26T18:32:10.352413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3034","last_scrub_stamp":"2024-04-26T18:32:10.352285+0000","last_deep_scrub":"41'3034","last_deep_scrub_stamp":"2024-04-26T18:32:10.352285+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.352285+0000","objects_scrubbed":1270,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.086719+0000","scrub_duration":587,"objects_trimmed":0,"snaptrim_duration":0.101669149,"stat_sum":{"num_bytes":43937728,"num_objects":1270,"num_object_clones":639,"num_object_copies":5080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1270,"num_whiteouts":551,"num_read":195,"num_read_kb":160663,"num_write":2447,"num_write_kb":52378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"41'609","reported_seq":2689,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:53.072882+0000","last_change":"2024-04-26T18:03:00.046750+0000","last_active":"2024-04-26T18:31:53.072882+0000","last_peered":"2024-04-26T18:31:53.072882+0000","last_clean":"2024-04-26T18:31:53.072882+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T18:31:53.072882+0000","last_undegraded":"2024-04-26T18:31:53.072882+0000","last_fullsized":"2024-04-26T18:31:53.072882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10552916,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"41'573","reported_seq":654,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.642649+0000","last_change":"2024-04-26T18:31:57.642674+0000","last_active":"2024-04-26T18:31:57.642649+0000","last_peered":"2024-04-26T18:31:57.642649+0000","last_clean":"2024-04-26T18:31:57.642649+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T18:31:57.642649+0000","last_undegraded":"2024-04-26T18:31:57.642649+0000","last_fullsized":"2024-04-26T18:31:57.642649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'573","last_scrub_stamp":"2024-04-26T18:31:57.642571+0000","last_deep_scrub":"41'573","last_deep_scrub_stamp":"2024-04-26T18:31:57.642571+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.642571+0000","objects_scrubbed":31,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:57.521227+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":567,"num_write_kb":79001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":484428,"num_omap_keys":686,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"41'2911","reported_seq":4684,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.308824+0000","last_change":"2024-04-26T18:32:09.308855+0000","last_active":"2024-04-26T18:32:09.308824+0000","last_peered":"2024-04-26T18:32:09.308824+0000","last_clean":"2024-04-26T18:32:09.308824+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T18:32:09.308824+0000","last_undegraded":"2024-04-26T18:32:09.308824+0000","last_fullsized":"2024-04-26T18:32:09.308824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2911","last_scrub_stamp":"2024-04-26T18:32:09.308740+0000","last_deep_scrub":"41'2911","last_deep_scrub_stamp":"2024-04-26T18:32:09.308740+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.308740+0000","objects_scrubbed":1233,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:22.674322+0000","scrub_duration":538,"objects_trimmed":0,"snaptrim_duration":0.102636063,"stat_sum":{"num_bytes":37322430,"num_objects":1233,"num_object_clones":576,"num_object_copies":4932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1233,"num_whiteouts":576,"num_read":202,"num_read_kb":211285,"num_write":2388,"num_write_kb":48792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"41'658","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.783898+0000","last_change":"2024-04-26T18:32:10.783949+0000","last_active":"2024-04-26T18:32:10.783898+0000","last_peered":"2024-04-26T18:32:10.783898+0000","last_clean":"2024-04-26T18:32:10.783898+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T18:32:10.783898+0000","last_undegraded":"2024-04-26T18:32:10.783898+0000","last_fullsized":"2024-04-26T18:32:10.783898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'658","last_scrub_stamp":"2024-04-26T18:32:10.783838+0000","last_deep_scrub":"41'658","last_deep_scrub_stamp":"2024-04-26T18:32:10.783838+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.783838+0000","objects_scrubbed":45,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:26.666904+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0.16359686500000001,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"41'1363","reported_seq":1445,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.057394+0000","last_change":"2024-04-26T18:31:59.057432+0000","last_active":"2024-04-26T18:31:59.057394+0000","last_peered":"2024-04-26T18:31:59.057394+0000","last_clean":"2024-04-26T18:31:59.057394+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T18:31:59.057394+0000","last_undegraded":"2024-04-26T18:31:59.057394+0000","last_fullsized":"2024-04-26T18:31:59.057394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1363","last_scrub_stamp":"2024-04-26T18:31:59.057330+0000","last_deep_scrub":"41'1363","last_deep_scrub_stamp":"2024-04-26T18:31:59.057330+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.057330+0000","objects_scrubbed":66,"log_size":1363,"log_dups_size":0,"ondisk_log_size":1363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:24.994408+0000","scrub_duration":129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29364754,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":1371,"num_write_kb":104375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680344,"num_omap_keys":1110,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"41'2892","reported_seq":4661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.387811+0000","last_change":"2024-04-26T18:32:11.387849+0000","last_active":"2024-04-26T18:32:11.387811+0000","last_peered":"2024-04-26T18:32:11.387811+0000","last_clean":"2024-04-26T18:32:11.387811+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T18:32:11.387811+0000","last_undegraded":"2024-04-26T18:32:11.387811+0000","last_fullsized":"2024-04-26T18:32:11.387811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2892","last_scrub_stamp":"2024-04-26T18:32:11.387737+0000","last_deep_scrub":"41'2892","last_deep_scrub_stamp":"2024-04-26T18:32:11.387737+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.387737+0000","objects_scrubbed":1246,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:17.607606+0000","scrub_duration":548,"objects_trimmed":0,"snaptrim_duration":0.20706662200000001,"stat_sum":{"num_bytes":43474396,"num_objects":1246,"num_object_clones":573,"num_object_copies":4984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":573,"num_read":195,"num_read_kb":270204,"num_write":2374,"num_write_kb":47127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"41'650","reported_seq":2742,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.488019+0000","last_change":"2024-04-26T18:32:10.488093+0000","last_active":"2024-04-26T18:32:10.488019+0000","last_peered":"2024-04-26T18:32:10.488019+0000","last_clean":"2024-04-26T18:32:10.488019+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T18:32:10.488019+0000","last_undegraded":"2024-04-26T18:32:10.488019+0000","last_fullsized":"2024-04-26T18:32:10.488019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'650","last_scrub_stamp":"2024-04-26T18:32:10.487923+0000","last_deep_scrub":"41'650","last_deep_scrub_stamp":"2024-04-26T18:32:10.487923+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.487923+0000","objects_scrubbed":48,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:39.479283+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0.104614815,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"41'754","reported_seq":836,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.688281+0000","last_change":"2024-04-26T18:31:58.688311+0000","last_active":"2024-04-26T18:31:58.688281+0000","last_peered":"2024-04-26T18:31:58.688281+0000","last_clean":"2024-04-26T18:31:58.688281+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T18:31:58.688281+0000","last_undegraded":"2024-04-26T18:31:58.688281+0000","last_fullsized":"2024-04-26T18:31:58.688281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'754","last_scrub_stamp":"2024-04-26T18:31:58.688218+0000","last_deep_scrub":"41'754","last_deep_scrub_stamp":"2024-04-26T18:31:58.688218+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.688218+0000","objects_scrubbed":56,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:36.096935+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":758,"num_write_kb":95614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":774758,"num_omap_keys":1278,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"41'2925","reported_seq":4675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.950634+0000","last_change":"2024-04-26T18:03:00.379880+0000","last_active":"2024-04-26T18:31:49.950634+0000","last_peered":"2024-04-26T18:31:49.950634+0000","last_clean":"2024-04-26T18:31:49.950634+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T18:31:49.950634+0000","last_undegraded":"2024-04-26T18:31:49.950634+0000","last_fullsized":"2024-04-26T18:31:49.950634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16179385399999999,"stat_sum":{"num_bytes":31406117,"num_objects":1218,"num_object_clones":563,"num_object_copies":4872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":563,"num_read":224,"num_read_kb":160685,"num_write":2420,"num_write_kb":43855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"41'643","reported_seq":2739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.520153+0000","last_change":"2024-04-26T18:32:09.520190+0000","last_active":"2024-04-26T18:32:09.520153+0000","last_peered":"2024-04-26T18:32:09.520153+0000","last_clean":"2024-04-26T18:32:09.520153+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T18:32:09.520153+0000","last_undegraded":"2024-04-26T18:32:09.520153+0000","last_fullsized":"2024-04-26T18:32:09.520153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'643","last_scrub_stamp":"2024-04-26T18:32:09.520085+0000","last_deep_scrub":"41'643","last_deep_scrub_stamp":"2024-04-26T18:32:09.520085+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.520085+0000","objects_scrubbed":39,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:57.139329+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.103300084,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'779","reported_seq":861,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.079795+0000","last_change":"2024-04-26T18:31:57.079836+0000","last_active":"2024-04-26T18:31:57.079795+0000","last_peered":"2024-04-26T18:31:57.079795+0000","last_clean":"2024-04-26T18:31:57.079795+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T18:31:57.079795+0000","last_undegraded":"2024-04-26T18:31:57.079795+0000","last_fullsized":"2024-04-26T18:31:57.079795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'779","last_scrub_stamp":"2024-04-26T18:31:57.079725+0000","last_deep_scrub":"41'779","last_deep_scrub_stamp":"2024-04-26T18:31:57.079725+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.079725+0000","objects_scrubbed":63,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:51.311090+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165846,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":771,"num_write_kb":75142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":654528,"num_omap_keys":1052,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"41'2803","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.367624+0000","last_change":"2024-04-26T18:32:09.367657+0000","last_active":"2024-04-26T18:32:09.367624+0000","last_peered":"2024-04-26T18:32:09.367624+0000","last_clean":"2024-04-26T18:32:09.367624+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T18:32:09.367624+0000","last_undegraded":"2024-04-26T18:32:09.367624+0000","last_fullsized":"2024-04-26T18:32:09.367624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2803","last_scrub_stamp":"2024-04-26T18:32:09.367536+0000","last_deep_scrub":"41'2803","last_deep_scrub_stamp":"2024-04-26T18:32:09.367536+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.367536+0000","objects_scrubbed":1210,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:23.366496+0000","scrub_duration":507,"objects_trimmed":0,"snaptrim_duration":0.18140468300000001,"stat_sum":{"num_bytes":44194819,"num_objects":1210,"num_object_clones":561,"num_object_copies":4840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":561,"num_read":248,"num_read_kb":269492,"num_write":2276,"num_write_kb":51233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"41'698","reported_seq":2787,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.551879+0000","last_change":"2024-04-26T18:32:07.551953+0000","last_active":"2024-04-26T18:32:07.551879+0000","last_peered":"2024-04-26T18:32:07.551879+0000","last_clean":"2024-04-26T18:32:07.551879+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T18:32:07.551879+0000","last_undegraded":"2024-04-26T18:32:07.551879+0000","last_fullsized":"2024-04-26T18:32:07.551879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'698","last_scrub_stamp":"2024-04-26T18:32:07.551802+0000","last_deep_scrub":"41'698","last_deep_scrub_stamp":"2024-04-26T18:32:07.551802+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.551802+0000","objects_scrubbed":49,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:22.556878+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.101409261,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":14,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"41'903","reported_seq":984,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:55.745719+0000","last_change":"2024-04-26T18:31:55.745767+0000","last_active":"2024-04-26T18:31:55.745719+0000","last_peered":"2024-04-26T18:31:55.745719+0000","last_clean":"2024-04-26T18:31:55.745719+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T18:31:55.745719+0000","last_undegraded":"2024-04-26T18:31:55.745719+0000","last_fullsized":"2024-04-26T18:31:55.745719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'903","last_scrub_stamp":"2024-04-26T18:31:55.745640+0000","last_deep_scrub":"41'903","last_deep_scrub_stamp":"2024-04-26T18:31:55.745640+0000","last_clean_scrub_stamp":"2024-04-26T18:31:55.745640+0000","objects_scrubbed":60,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:28.794909+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":83,"num_read_kb":0,"num_write":946,"num_write_kb":79922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1081476,"num_omap_keys":1574,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"41'2759","reported_seq":4503,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.263934+0000","last_change":"2024-04-26T18:32:08.263969+0000","last_active":"2024-04-26T18:32:08.263934+0000","last_peered":"2024-04-26T18:32:08.263934+0000","last_clean":"2024-04-26T18:32:08.263934+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T18:32:08.263934+0000","last_undegraded":"2024-04-26T18:32:08.263934+0000","last_fullsized":"2024-04-26T18:32:08.263934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2759","last_scrub_stamp":"2024-04-26T18:32:08.263850+0000","last_deep_scrub":"41'2759","last_deep_scrub_stamp":"2024-04-26T18:32:08.263850+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.263850+0000","objects_scrubbed":1186,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:08.193743+0000","scrub_duration":506,"objects_trimmed":0,"snaptrim_duration":0.19926888800000001,"stat_sum":{"num_bytes":38301955,"num_objects":1186,"num_object_clones":557,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":557,"num_read":157,"num_read_kb":146023,"num_write":2246,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'638","reported_seq":2730,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.851465+0000","last_change":"2024-04-26T18:32:04.851550+0000","last_active":"2024-04-26T18:32:04.851465+0000","last_peered":"2024-04-26T18:32:04.851465+0000","last_clean":"2024-04-26T18:32:04.851465+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T18:32:04.851465+0000","last_undegraded":"2024-04-26T18:32:04.851465+0000","last_fullsized":"2024-04-26T18:32:04.851465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'638","last_scrub_stamp":"2024-04-26T18:32:04.851393+0000","last_deep_scrub":"41'638","last_deep_scrub_stamp":"2024-04-26T18:32:04.851393+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.851393+0000","objects_scrubbed":41,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:03.575646+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0.099299311000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"41'644","reported_seq":725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.950023+0000","last_change":"2024-04-26T18:31:58.950051+0000","last_active":"2024-04-26T18:31:58.950023+0000","last_peered":"2024-04-26T18:31:58.950023+0000","last_clean":"2024-04-26T18:31:58.950023+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T18:31:58.950023+0000","last_undegraded":"2024-04-26T18:31:58.950023+0000","last_fullsized":"2024-04-26T18:31:58.950023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'644","last_scrub_stamp":"2024-04-26T18:31:58.949961+0000","last_deep_scrub":"41'644","last_deep_scrub_stamp":"2024-04-26T18:31:58.949961+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.949961+0000","objects_scrubbed":54,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:01.897359+0000","scrub_duration":118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":625,"num_write_kb":74929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":589174,"num_omap_keys":906,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"41'3058","reported_seq":4787,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.180291+0000","last_change":"2024-04-26T18:32:12.180337+0000","last_active":"2024-04-26T18:32:12.180291+0000","last_peered":"2024-04-26T18:32:12.180291+0000","last_clean":"2024-04-26T18:32:12.180291+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T18:32:12.180291+0000","last_undegraded":"2024-04-26T18:32:12.180291+0000","last_fullsized":"2024-04-26T18:32:12.180291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3058","last_scrub_stamp":"2024-04-26T18:32:12.180190+0000","last_deep_scrub":"41'3058","last_deep_scrub_stamp":"2024-04-26T18:32:12.180190+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.180190+0000","objects_scrubbed":1342,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:13.914682+0000","scrub_duration":494,"objects_trimmed":0,"snaptrim_duration":0.21925704200000001,"stat_sum":{"num_bytes":62040101,"num_objects":1342,"num_object_clones":661,"num_object_copies":5368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1342,"num_whiteouts":573,"num_read":241,"num_read_kb":351124,"num_write":2466,"num_write_kb":72826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"41'681","reported_seq":2757,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.666324+0000","last_change":"2024-04-26T18:32:02.666418+0000","last_active":"2024-04-26T18:32:02.666324+0000","last_peered":"2024-04-26T18:32:02.666324+0000","last_clean":"2024-04-26T18:32:02.666324+0000","last_became_active":"2024-04-26T17:58:46.842960+0000","last_became_peered":"2024-04-26T17:58:46.842960+0000","last_unstale":"2024-04-26T18:32:02.666324+0000","last_undegraded":"2024-04-26T18:32:02.666324+0000","last_fullsized":"2024-04-26T18:32:02.666324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'681","last_scrub_stamp":"2024-04-26T18:32:02.666251+0000","last_deep_scrub":"41'681","last_deep_scrub_stamp":"2024-04-26T18:32:02.666251+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.666251+0000","objects_scrubbed":47,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:08.313470+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0.029754315999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"41'580","reported_seq":661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.963263+0000","last_change":"2024-04-26T18:32:01.963313+0000","last_active":"2024-04-26T18:32:01.963263+0000","last_peered":"2024-04-26T18:32:01.963263+0000","last_clean":"2024-04-26T18:32:01.963263+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T18:32:01.963263+0000","last_undegraded":"2024-04-26T18:32:01.963263+0000","last_fullsized":"2024-04-26T18:32:01.963263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'580","last_scrub_stamp":"2024-04-26T18:32:01.963197+0000","last_deep_scrub":"41'580","last_deep_scrub_stamp":"2024-04-26T18:32:01.963197+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.963197+0000","objects_scrubbed":58,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:05.206947+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":593,"num_write_kb":58770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":742892,"num_omap_keys":1212,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"41'2848","reported_seq":4552,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:50.023778+0000","last_change":"2024-04-26T18:03:00.451927+0000","last_active":"2024-04-26T18:31:50.023778+0000","last_peered":"2024-04-26T18:31:50.023778+0000","last_clean":"2024-04-26T18:31:50.023778+0000","last_became_active":"2024-04-26T17:58:46.841624+0000","last_became_peered":"2024-04-26T17:58:46.841624+0000","last_unstale":"2024-04-26T18:31:50.023778+0000","last_undegraded":"2024-04-26T18:31:50.023778+0000","last_fullsized":"2024-04-26T18:31:50.023778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218331676,"stat_sum":{"num_bytes":37909871,"num_objects":1250,"num_object_clones":586,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":586,"num_read":195,"num_read_kb":261621,"num_write":2312,"num_write_kb":56158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"41'642","reported_seq":2733,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.734314+0000","last_change":"2024-04-26T18:31:57.734339+0000","last_active":"2024-04-26T18:31:57.734314+0000","last_peered":"2024-04-26T18:31:57.734314+0000","last_clean":"2024-04-26T18:31:57.734314+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T18:31:57.734314+0000","last_undegraded":"2024-04-26T18:31:57.734314+0000","last_fullsized":"2024-04-26T18:31:57.734314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'642","last_scrub_stamp":"2024-04-26T18:31:57.734249+0000","last_deep_scrub":"41'642","last_deep_scrub_stamp":"2024-04-26T18:31:57.734249+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.734249+0000","objects_scrubbed":50,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:47.264757+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0.185065913,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"41'495","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:55.826400+0000","last_change":"2024-04-26T18:31:55.826447+0000","last_active":"2024-04-26T18:31:55.826400+0000","last_peered":"2024-04-26T18:31:55.826400+0000","last_clean":"2024-04-26T18:31:55.826400+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T18:31:55.826400+0000","last_undegraded":"2024-04-26T18:31:55.826400+0000","last_fullsized":"2024-04-26T18:31:55.826400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'495","last_scrub_stamp":"2024-04-26T18:31:55.826334+0000","last_deep_scrub":"41'495","last_deep_scrub_stamp":"2024-04-26T18:31:55.826334+0000","last_clean_scrub_stamp":"2024-04-26T18:31:55.826334+0000","objects_scrubbed":69,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:28.396193+0000","scrub_duration":84,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":485,"num_write_kb":79130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":608469,"num_omap_keys":1004,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"41'2856","reported_seq":4526,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.935689+0000","last_change":"2024-04-26T18:03:00.386810+0000","last_active":"2024-04-26T18:31:56.935689+0000","last_peered":"2024-04-26T18:31:56.935689+0000","last_clean":"2024-04-26T18:31:56.935689+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T18:31:56.935689+0000","last_undegraded":"2024-04-26T18:31:56.935689+0000","last_fullsized":"2024-04-26T18:31:56.935689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16361857299999999,"stat_sum":{"num_bytes":26393816,"num_objects":1264,"num_object_clones":588,"num_object_copies":5056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1264,"num_whiteouts":588,"num_read":170,"num_read_kb":98987,"num_write":2329,"num_write_kb":28734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"41'677","reported_seq":2763,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.465156+0000","last_change":"2024-04-26T18:32:11.465213+0000","last_active":"2024-04-26T18:32:11.465156+0000","last_peered":"2024-04-26T18:32:11.465156+0000","last_clean":"2024-04-26T18:32:11.465156+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T18:32:11.465156+0000","last_undegraded":"2024-04-26T18:32:11.465156+0000","last_fullsized":"2024-04-26T18:32:11.465156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'677","last_scrub_stamp":"2024-04-26T18:32:11.465055+0000","last_deep_scrub":"41'677","last_deep_scrub_stamp":"2024-04-26T18:32:11.465055+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.465055+0000","objects_scrubbed":59,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:21.674455+0000","scrub_duration":58,"objects_trimmed":0,"snaptrim_duration":0.10539311699999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"41'898","reported_seq":980,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.871764+0000","last_change":"2024-04-26T18:32:01.871793+0000","last_active":"2024-04-26T18:32:01.871764+0000","last_peered":"2024-04-26T18:32:01.871764+0000","last_clean":"2024-04-26T18:32:01.871764+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T18:32:01.871764+0000","last_undegraded":"2024-04-26T18:32:01.871764+0000","last_fullsized":"2024-04-26T18:32:01.871764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'898","last_scrub_stamp":"2024-04-26T18:32:01.871705+0000","last_deep_scrub":"41'898","last_deep_scrub_stamp":"2024-04-26T18:32:01.871705+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.871705+0000","objects_scrubbed":81,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:33.288361+0000","scrub_duration":88,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777888,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":70,"num_read_kb":0,"num_write":938,"num_write_kb":112536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1018873,"num_omap_keys":1685,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"41'2763","reported_seq":4531,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.433456+0000","last_change":"2024-04-26T18:32:08.433508+0000","last_active":"2024-04-26T18:32:08.433456+0000","last_peered":"2024-04-26T18:32:08.433456+0000","last_clean":"2024-04-26T18:32:08.433456+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T18:32:08.433456+0000","last_undegraded":"2024-04-26T18:32:08.433456+0000","last_fullsized":"2024-04-26T18:32:08.433456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2763","last_scrub_stamp":"2024-04-26T18:32:08.433375+0000","last_deep_scrub":"41'2763","last_deep_scrub_stamp":"2024-04-26T18:32:08.433375+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.433375+0000","objects_scrubbed":1149,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:22.775332+0000","scrub_duration":480,"objects_trimmed":0,"snaptrim_duration":0.076321086999999996,"stat_sum":{"num_bytes":36028739,"num_objects":1149,"num_object_clones":527,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":527,"num_read":153,"num_read_kb":73270,"num_write":2275,"num_write_kb":49180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'663","reported_seq":2754,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.994652+0000","last_change":"2024-04-26T18:31:59.994703+0000","last_active":"2024-04-26T18:31:59.994652+0000","last_peered":"2024-04-26T18:31:59.994652+0000","last_clean":"2024-04-26T18:31:59.994652+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T18:31:59.994652+0000","last_undegraded":"2024-04-26T18:31:59.994652+0000","last_fullsized":"2024-04-26T18:31:59.994652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'663","last_scrub_stamp":"2024-04-26T18:31:59.994591+0000","last_deep_scrub":"41'663","last_deep_scrub_stamp":"2024-04-26T18:31:59.994591+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.994591+0000","objects_scrubbed":41,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:30.332443+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0.187850924,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"41'1336","reported_seq":1417,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.087091+0000","last_change":"2024-04-26T18:32:01.087133+0000","last_active":"2024-04-26T18:32:01.087091+0000","last_peered":"2024-04-26T18:32:01.087091+0000","last_clean":"2024-04-26T18:32:01.087091+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T18:32:01.087091+0000","last_undegraded":"2024-04-26T18:32:01.087091+0000","last_fullsized":"2024-04-26T18:32:01.087091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1336","last_scrub_stamp":"2024-04-26T18:32:01.087020+0000","last_deep_scrub":"41'1336","last_deep_scrub_stamp":"2024-04-26T18:32:01.087020+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.087020+0000","objects_scrubbed":63,"log_size":1336,"log_dups_size":0,"ondisk_log_size":1336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:47.172921+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1332,"num_write_kb":75702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":906484,"num_omap_keys":1298,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"41'2855","reported_seq":4577,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.387392+0000","last_change":"2024-04-26T18:32:04.387452+0000","last_active":"2024-04-26T18:32:04.387392+0000","last_peered":"2024-04-26T18:32:04.387392+0000","last_clean":"2024-04-26T18:32:04.387392+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T18:32:04.387392+0000","last_undegraded":"2024-04-26T18:32:04.387392+0000","last_fullsized":"2024-04-26T18:32:04.387392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2855","last_scrub_stamp":"2024-04-26T18:32:04.387273+0000","last_deep_scrub":"41'2855","last_deep_scrub_stamp":"2024-04-26T18:32:04.387273+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.387273+0000","objects_scrubbed":1237,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:36.407756+0000","scrub_duration":519,"objects_trimmed":0,"snaptrim_duration":0.18615647199999999,"stat_sum":{"num_bytes":26768950,"num_objects":1237,"num_object_clones":575,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":575,"num_read":152,"num_read_kb":65566,"num_write":2334,"num_write_kb":43840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"41'667","reported_seq":2757,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.828269+0000","last_change":"2024-04-26T18:32:04.828308+0000","last_active":"2024-04-26T18:32:04.828269+0000","last_peered":"2024-04-26T18:32:04.828269+0000","last_clean":"2024-04-26T18:32:04.828269+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T18:32:04.828269+0000","last_undegraded":"2024-04-26T18:32:04.828269+0000","last_fullsized":"2024-04-26T18:32:04.828269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'667","last_scrub_stamp":"2024-04-26T18:32:04.828211+0000","last_deep_scrub":"41'667","last_deep_scrub_stamp":"2024-04-26T18:32:04.828211+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.828211+0000","objects_scrubbed":59,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:31.759050+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.19386972299999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"41'2251","reported_seq":2331,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.977289+0000","last_change":"2024-04-26T18:32:03.977400+0000","last_active":"2024-04-26T18:32:03.977289+0000","last_peered":"2024-04-26T18:32:03.977289+0000","last_clean":"2024-04-26T18:32:03.977289+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T18:32:03.977289+0000","last_undegraded":"2024-04-26T18:32:03.977289+0000","last_fullsized":"2024-04-26T18:32:03.977289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2251","last_scrub_stamp":"2024-04-26T18:32:03.977216+0000","last_deep_scrub":"41'2251","last_deep_scrub_stamp":"2024-04-26T18:32:03.977216+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.977216+0000","objects_scrubbed":48,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:37.835933+0000","scrub_duration":150,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":2240,"num_write_kb":108871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":513760,"num_omap_keys":876,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"41'2818","reported_seq":4523,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:49.943319+0000","last_change":"2024-04-26T18:03:00.448747+0000","last_active":"2024-04-26T18:31:49.943319+0000","last_peered":"2024-04-26T18:31:49.943319+0000","last_clean":"2024-04-26T18:31:49.943319+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T18:31:49.943319+0000","last_undegraded":"2024-04-26T18:31:49.943319+0000","last_fullsized":"2024-04-26T18:31:49.943319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":0,"log_size":2818,"log_dups_size":0,"ondisk_log_size":2818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.23086587,"stat_sum":{"num_bytes":33941132,"num_objects":1186,"num_object_clones":549,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":549,"num_read":167,"num_read_kb":131833,"num_write":2312,"num_write_kb":45432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"41'628","reported_seq":2725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.884017+0000","last_change":"2024-04-26T18:32:04.884070+0000","last_active":"2024-04-26T18:32:04.884017+0000","last_peered":"2024-04-26T18:32:04.884017+0000","last_clean":"2024-04-26T18:32:04.884017+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T18:32:04.884017+0000","last_undegraded":"2024-04-26T18:32:04.884017+0000","last_fullsized":"2024-04-26T18:32:04.884017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'628","last_scrub_stamp":"2024-04-26T18:32:04.883924+0000","last_deep_scrub":"41'628","last_deep_scrub_stamp":"2024-04-26T18:32:04.883924+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.883924+0000","objects_scrubbed":33,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:30.906006+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.16159970800000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"41'978","reported_seq":1207,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.891627+0000","last_change":"2024-04-26T18:32:00.891670+0000","last_active":"2024-04-26T18:32:00.891627+0000","last_peered":"2024-04-26T18:32:00.891627+0000","last_clean":"2024-04-26T18:32:00.891627+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T18:32:00.891627+0000","last_undegraded":"2024-04-26T18:32:00.891627+0000","last_fullsized":"2024-04-26T18:32:00.891627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'978","last_scrub_stamp":"2024-04-26T18:32:00.891546+0000","last_deep_scrub":"41'978","last_deep_scrub_stamp":"2024-04-26T18:32:00.891546+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.891546+0000","objects_scrubbed":60,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:18.710000+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17376085,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":220,"num_read_kb":683,"num_write":1019,"num_write_kb":76520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":776390,"num_omap_keys":1026,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"41'2989","reported_seq":4741,"reported_epoch":41,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-26T18:32:13.074015+0000","last_change":"2024-04-26T18:32:12.671889+0000","last_active":"2024-04-26T18:32:13.074015+0000","last_peered":"2024-04-26T18:32:13.074015+0000","last_clean":"2024-04-26T18:32:13.074015+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T18:32:13.074015+0000","last_undegraded":"2024-04-26T18:32:13.074015+0000","last_fullsized":"2024-04-26T18:32:13.074015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:07.714199+0000","last_clean_scrub_stamp":"2024-04-26T17:58:07.714199+0000","objects_scrubbed":1152,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22647874100000001,"stat_sum":{"num_bytes":37857272,"num_objects":1229,"num_object_clones":574,"num_object_copies":4916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":574,"num_read":190,"num_read_kb":232293,"num_write":2457,"num_write_kb":51113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"41'2741","reported_seq":4522,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.282696+0000","last_change":"2024-04-26T18:32:09.282696+0000","last_active":"2024-04-26T18:32:09.282696+0000","last_peered":"2024-04-26T18:32:09.282696+0000","last_clean":"2024-04-26T18:32:09.282696+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T18:32:09.282696+0000","last_undegraded":"2024-04-26T18:32:09.282696+0000","last_fullsized":"2024-04-26T18:32:09.282696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2741","last_scrub_stamp":"2024-04-26T18:32:09.282553+0000","last_deep_scrub":"41'2741","last_deep_scrub_stamp":"2024-04-26T18:32:09.282553+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.282553+0000","objects_scrubbed":1130,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:45.216775+0000","scrub_duration":479,"objects_trimmed":0,"snaptrim_duration":0.20154621,"stat_sum":{"num_bytes":35946841,"num_objects":1130,"num_object_clones":524,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1130,"num_whiteouts":524,"num_read":160,"num_read_kb":163026,"num_write":2271,"num_write_kb":38909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"41'666","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.047694+0000","last_change":"2024-04-26T18:32:07.047746+0000","last_active":"2024-04-26T18:32:07.047694+0000","last_peered":"2024-04-26T18:32:07.047694+0000","last_clean":"2024-04-26T18:32:07.047694+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T18:32:07.047694+0000","last_undegraded":"2024-04-26T18:32:07.047694+0000","last_fullsized":"2024-04-26T18:32:07.047694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'666","last_scrub_stamp":"2024-04-26T18:32:07.047595+0000","last_deep_scrub":"41'666","last_deep_scrub_stamp":"2024-04-26T18:32:07.047595+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.047595+0000","objects_scrubbed":54,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:23.963873+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.076360936000000004,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"41'1560","reported_seq":1641,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.994922+0000","last_change":"2024-04-26T18:31:59.994975+0000","last_active":"2024-04-26T18:31:59.994922+0000","last_peered":"2024-04-26T18:31:59.994922+0000","last_clean":"2024-04-26T18:31:59.994922+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T18:31:59.994922+0000","last_undegraded":"2024-04-26T18:31:59.994922+0000","last_fullsized":"2024-04-26T18:31:59.994922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1560","last_scrub_stamp":"2024-04-26T18:31:59.994829+0000","last_deep_scrub":"41'1560","last_deep_scrub_stamp":"2024-04-26T18:31:59.994829+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.994829+0000","objects_scrubbed":67,"log_size":1560,"log_dups_size":0,"ondisk_log_size":1560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:18.430158+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":1554,"num_write_kb":113147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":987257,"num_omap_keys":1474,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"41'2755","reported_seq":4495,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.226626+0000","last_change":"2024-04-26T18:32:11.226681+0000","last_active":"2024-04-26T18:32:11.226626+0000","last_peered":"2024-04-26T18:32:11.226626+0000","last_clean":"2024-04-26T18:32:11.226626+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T18:32:11.226626+0000","last_undegraded":"2024-04-26T18:32:11.226626+0000","last_fullsized":"2024-04-26T18:32:11.226626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2755","last_scrub_stamp":"2024-04-26T18:32:11.226494+0000","last_deep_scrub":"41'2755","last_deep_scrub_stamp":"2024-04-26T18:32:11.226494+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.226494+0000","objects_scrubbed":1175,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:00.894902+0000","scrub_duration":509,"objects_trimmed":0,"snaptrim_duration":0.101684618,"stat_sum":{"num_bytes":29230084,"num_objects":1175,"num_object_clones":548,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":548,"num_read":142,"num_read_kb":156265,"num_write":2265,"num_write_kb":32436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"41'722","reported_seq":2802,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:13.039168+0000","last_change":"2024-04-26T18:32:13.039205+0000","last_active":"2024-04-26T18:32:13.039168+0000","last_peered":"2024-04-26T18:32:13.039168+0000","last_clean":"2024-04-26T18:32:13.039168+0000","last_became_active":"2024-04-26T17:58:47.348873+0000","last_became_peered":"2024-04-26T17:58:47.348873+0000","last_unstale":"2024-04-26T18:32:13.039168+0000","last_undegraded":"2024-04-26T18:32:13.039168+0000","last_fullsized":"2024-04-26T18:32:13.039168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'722","last_scrub_stamp":"2024-04-26T18:32:13.039103+0000","last_deep_scrub":"41'722","last_deep_scrub_stamp":"2024-04-26T18:32:13.039103+0000","last_clean_scrub_stamp":"2024-04-26T18:32:13.039103+0000","objects_scrubbed":36,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:01.016525+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.075584111999999995,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"41'821","reported_seq":902,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.689748+0000","last_change":"2024-04-26T18:32:02.689784+0000","last_active":"2024-04-26T18:32:02.689748+0000","last_peered":"2024-04-26T18:32:02.689748+0000","last_clean":"2024-04-26T18:32:02.689748+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T18:32:02.689748+0000","last_undegraded":"2024-04-26T18:32:02.689748+0000","last_fullsized":"2024-04-26T18:32:02.689748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'821","last_scrub_stamp":"2024-04-26T18:32:02.689681+0000","last_deep_scrub":"41'821","last_deep_scrub_stamp":"2024-04-26T18:32:02.689681+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.689681+0000","objects_scrubbed":63,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:29.259168+0000","scrub_duration":74,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":840,"num_write_kb":71498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":995809,"num_omap_keys":1581,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"41'1003","reported_seq":1083,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.932857+0000","last_change":"2024-04-26T18:31:57.932885+0000","last_active":"2024-04-26T18:31:57.932857+0000","last_peered":"2024-04-26T18:31:57.932857+0000","last_clean":"2024-04-26T18:31:57.932857+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T18:31:57.932857+0000","last_undegraded":"2024-04-26T18:31:57.932857+0000","last_fullsized":"2024-04-26T18:31:57.932857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1003","last_scrub_stamp":"2024-04-26T18:31:57.932789+0000","last_deep_scrub":"41'1003","last_deep_scrub_stamp":"2024-04-26T18:31:57.932789+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.932789+0000","objects_scrubbed":55,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:34.641711+0000","scrub_duration":82,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":1019,"num_write_kb":79683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":815135,"num_omap_keys":1269,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"41'652","reported_seq":2742,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.768422+0000","last_change":"2024-04-26T18:32:00.768451+0000","last_active":"2024-04-26T18:32:00.768422+0000","last_peered":"2024-04-26T18:32:00.768422+0000","last_clean":"2024-04-26T18:32:00.768422+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T18:32:00.768422+0000","last_undegraded":"2024-04-26T18:32:00.768422+0000","last_fullsized":"2024-04-26T18:32:00.768422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'652","last_scrub_stamp":"2024-04-26T18:32:00.768356+0000","last_deep_scrub":"41'652","last_deep_scrub_stamp":"2024-04-26T18:32:00.768356+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.768356+0000","objects_scrubbed":56,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:23.008227+0000","scrub_duration":60,"objects_trimmed":0,"snaptrim_duration":0.20583575700000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"41'2937","reported_seq":4670,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.120873+0000","last_change":"2024-04-26T18:32:02.120902+0000","last_active":"2024-04-26T18:32:02.120873+0000","last_peered":"2024-04-26T18:32:02.120873+0000","last_clean":"2024-04-26T18:32:02.120873+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T18:32:02.120873+0000","last_undegraded":"2024-04-26T18:32:02.120873+0000","last_fullsized":"2024-04-26T18:32:02.120873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2937","last_scrub_stamp":"2024-04-26T18:32:02.120795+0000","last_deep_scrub":"41'2937","last_deep_scrub_stamp":"2024-04-26T18:32:02.120795+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.120795+0000","objects_scrubbed":1274,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:53.977570+0000","scrub_duration":530,"objects_trimmed":0,"snaptrim_duration":0.025934391000000001,"stat_sum":{"num_bytes":29962641,"num_objects":1274,"num_object_clones":596,"num_object_copies":5096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":596,"num_read":182,"num_read_kb":211414,"num_write":2395,"num_write_kb":42590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"41'592","reported_seq":672,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.679517+0000","last_change":"2024-04-26T18:32:01.679556+0000","last_active":"2024-04-26T18:32:01.679517+0000","last_peered":"2024-04-26T18:32:01.679517+0000","last_clean":"2024-04-26T18:32:01.679517+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T18:32:01.679517+0000","last_undegraded":"2024-04-26T18:32:01.679517+0000","last_fullsized":"2024-04-26T18:32:01.679517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'592","last_scrub_stamp":"2024-04-26T18:32:01.679413+0000","last_deep_scrub":"41'592","last_deep_scrub_stamp":"2024-04-26T18:32:01.679413+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.679413+0000","objects_scrubbed":50,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:29.321331+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":620,"num_write_kb":96015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":821836,"num_omap_keys":1412,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"41'678","reported_seq":2768,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.954109+0000","last_change":"2024-04-26T18:32:01.954135+0000","last_active":"2024-04-26T18:32:01.954109+0000","last_peered":"2024-04-26T18:32:01.954109+0000","last_clean":"2024-04-26T18:32:01.954109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T18:32:01.954109+0000","last_undegraded":"2024-04-26T18:32:01.954109+0000","last_fullsized":"2024-04-26T18:32:01.954109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'678","last_scrub_stamp":"2024-04-26T18:32:01.954045+0000","last_deep_scrub":"41'678","last_deep_scrub_stamp":"2024-04-26T18:32:01.954045+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.954045+0000","objects_scrubbed":51,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:09.121830+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0.18696554200000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"41'2812","reported_seq":4554,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.234272+0000","last_change":"2024-04-26T18:32:11.234332+0000","last_active":"2024-04-26T18:32:11.234272+0000","last_peered":"2024-04-26T18:32:11.234272+0000","last_clean":"2024-04-26T18:32:11.234272+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T18:32:11.234272+0000","last_undegraded":"2024-04-26T18:32:11.234272+0000","last_fullsized":"2024-04-26T18:32:11.234272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2812","last_scrub_stamp":"2024-04-26T18:32:11.234145+0000","last_deep_scrub":"41'2812","last_deep_scrub_stamp":"2024-04-26T18:32:11.234145+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.234145+0000","objects_scrubbed":1208,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:50.846229+0000","scrub_duration":528,"objects_trimmed":0,"snaptrim_duration":0.215933711,"stat_sum":{"num_bytes":39516255,"num_objects":1208,"num_object_clones":558,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":558,"num_read":159,"num_read_kb":155491,"num_write":2289,"num_write_kb":56059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"41'670","reported_seq":2763,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.836575+0000","last_change":"2024-04-26T18:32:05.836655+0000","last_active":"2024-04-26T18:32:05.836575+0000","last_peered":"2024-04-26T18:32:05.836575+0000","last_clean":"2024-04-26T18:32:05.836575+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T18:32:05.836575+0000","last_undegraded":"2024-04-26T18:32:05.836575+0000","last_fullsized":"2024-04-26T18:32:05.836575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:05.836474+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:05.836474+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.836474+0000","objects_scrubbed":42,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:02.889293+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.098603622000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"41'715","reported_seq":2807,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.618296+0000","last_change":"2024-04-26T18:32:00.618322+0000","last_active":"2024-04-26T18:32:00.618296+0000","last_peered":"2024-04-26T18:32:00.618296+0000","last_clean":"2024-04-26T18:32:00.618296+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T18:32:00.618296+0000","last_undegraded":"2024-04-26T18:32:00.618296+0000","last_fullsized":"2024-04-26T18:32:00.618296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'715","last_scrub_stamp":"2024-04-26T18:32:00.618231+0000","last_deep_scrub":"41'715","last_deep_scrub_stamp":"2024-04-26T18:32:00.618231+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.618231+0000","objects_scrubbed":53,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:47:15.792224+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.032925850999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"41'648","reported_seq":2730,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.663529+0000","last_change":"2024-04-26T18:32:03.663529+0000","last_active":"2024-04-26T18:32:03.663529+0000","last_peered":"2024-04-26T18:32:03.663529+0000","last_clean":"2024-04-26T18:32:03.663529+0000","last_became_active":"2024-04-26T17:58:46.843441+0000","last_became_peered":"2024-04-26T17:58:46.843441+0000","last_unstale":"2024-04-26T18:32:03.663529+0000","last_undegraded":"2024-04-26T18:32:03.663529+0000","last_fullsized":"2024-04-26T18:32:03.663529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'648","last_scrub_stamp":"2024-04-26T18:32:03.663405+0000","last_deep_scrub":"41'648","last_deep_scrub_stamp":"2024-04-26T18:32:03.663405+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.663405+0000","objects_scrubbed":38,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:53.247364+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.030186671000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"41'716","reported_seq":2805,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.779184+0000","last_change":"2024-04-26T18:32:03.779209+0000","last_active":"2024-04-26T18:32:03.779184+0000","last_peered":"2024-04-26T18:32:03.779184+0000","last_clean":"2024-04-26T18:32:03.779184+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T18:32:03.779184+0000","last_undegraded":"2024-04-26T18:32:03.779184+0000","last_fullsized":"2024-04-26T18:32:03.779184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'716","last_scrub_stamp":"2024-04-26T18:32:03.779118+0000","last_deep_scrub":"41'716","last_deep_scrub_stamp":"2024-04-26T18:32:03.779118+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.779118+0000","objects_scrubbed":51,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:23.169737+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0.201538621,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"41'641","reported_seq":2733,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.685414+0000","last_change":"2024-04-26T18:32:06.685447+0000","last_active":"2024-04-26T18:32:06.685414+0000","last_peered":"2024-04-26T18:32:06.685414+0000","last_clean":"2024-04-26T18:32:06.685414+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T18:32:06.685414+0000","last_undegraded":"2024-04-26T18:32:06.685414+0000","last_fullsized":"2024-04-26T18:32:06.685414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'641","last_scrub_stamp":"2024-04-26T18:32:06.685357+0000","last_deep_scrub":"41'641","last_deep_scrub_stamp":"2024-04-26T18:32:06.685357+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.685357+0000","objects_scrubbed":43,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:09.730912+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0.217865696,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"41'675","reported_seq":2762,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.077740+0000","last_change":"2024-04-26T18:32:06.077772+0000","last_active":"2024-04-26T18:32:06.077740+0000","last_peered":"2024-04-26T18:32:06.077740+0000","last_clean":"2024-04-26T18:32:06.077740+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T18:32:06.077740+0000","last_undegraded":"2024-04-26T18:32:06.077740+0000","last_fullsized":"2024-04-26T18:32:06.077740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'675","last_scrub_stamp":"2024-04-26T18:32:06.077676+0000","last_deep_scrub":"41'675","last_deep_scrub_stamp":"2024-04-26T18:32:06.077676+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.077676+0000","objects_scrubbed":55,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:18.207376+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0.077286562000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":18,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"41'694","reported_seq":2788,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.818357+0000","last_change":"2024-04-26T18:32:06.818433+0000","last_active":"2024-04-26T18:32:06.818357+0000","last_peered":"2024-04-26T18:32:06.818357+0000","last_clean":"2024-04-26T18:32:06.818357+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T18:32:06.818357+0000","last_undegraded":"2024-04-26T18:32:06.818357+0000","last_fullsized":"2024-04-26T18:32:06.818357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'694","last_scrub_stamp":"2024-04-26T18:32:06.818259+0000","last_deep_scrub":"41'694","last_deep_scrub_stamp":"2024-04-26T18:32:06.818259+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.818259+0000","objects_scrubbed":39,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:47.694008+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.101304621,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"41'633","reported_seq":2728,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.651489+0000","last_change":"2024-04-26T18:32:05.651530+0000","last_active":"2024-04-26T18:32:05.651489+0000","last_peered":"2024-04-26T18:32:05.651489+0000","last_clean":"2024-04-26T18:32:05.651489+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T18:32:05.651489+0000","last_undegraded":"2024-04-26T18:32:05.651489+0000","last_fullsized":"2024-04-26T18:32:05.651489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'633","last_scrub_stamp":"2024-04-26T18:32:05.651424+0000","last_deep_scrub":"41'633","last_deep_scrub_stamp":"2024-04-26T18:32:05.651424+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.651424+0000","objects_scrubbed":43,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.220794+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0.21869934299999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"41'670","reported_seq":2761,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.804052+0000","last_change":"2024-04-26T18:32:12.804094+0000","last_active":"2024-04-26T18:32:12.804052+0000","last_peered":"2024-04-26T18:32:12.804052+0000","last_clean":"2024-04-26T18:32:12.804052+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T18:32:12.804052+0000","last_undegraded":"2024-04-26T18:32:12.804052+0000","last_fullsized":"2024-04-26T18:32:12.804052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:12.803966+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:12.803966+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.803966+0000","objects_scrubbed":52,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:50.375581+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0.16324759799999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"41'666","reported_seq":2751,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.687001+0000","last_change":"2024-04-26T18:32:03.687030+0000","last_active":"2024-04-26T18:32:03.687001+0000","last_peered":"2024-04-26T18:32:03.687001+0000","last_clean":"2024-04-26T18:32:03.687001+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T18:32:03.687001+0000","last_undegraded":"2024-04-26T18:32:03.687001+0000","last_fullsized":"2024-04-26T18:32:03.687001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'666","last_scrub_stamp":"2024-04-26T18:32:03.686943+0000","last_deep_scrub":"41'666","last_deep_scrub_stamp":"2024-04-26T18:32:03.686943+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.686943+0000","objects_scrubbed":57,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:11.919852+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0.22595842999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":20,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"41'677","reported_seq":2772,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.874276+0000","last_change":"2024-04-26T18:31:57.874344+0000","last_active":"2024-04-26T18:31:57.874276+0000","last_peered":"2024-04-26T18:31:57.874276+0000","last_clean":"2024-04-26T18:31:57.874276+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T18:31:57.874276+0000","last_undegraded":"2024-04-26T18:31:57.874276+0000","last_fullsized":"2024-04-26T18:31:57.874276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'677","last_scrub_stamp":"2024-04-26T18:31:57.874206+0000","last_deep_scrub":"41'677","last_deep_scrub_stamp":"2024-04-26T18:31:57.874206+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.874206+0000","objects_scrubbed":39,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:25.707342+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0.16093863,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"41'680","reported_seq":2769,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.751285+0000","last_change":"2024-04-26T18:31:58.751344+0000","last_active":"2024-04-26T18:31:58.751285+0000","last_peered":"2024-04-26T18:31:58.751285+0000","last_clean":"2024-04-26T18:31:58.751285+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T18:31:58.751285+0000","last_undegraded":"2024-04-26T18:31:58.751285+0000","last_fullsized":"2024-04-26T18:31:58.751285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'680","last_scrub_stamp":"2024-04-26T18:31:58.751210+0000","last_deep_scrub":"41'680","last_deep_scrub_stamp":"2024-04-26T18:31:58.751210+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.751210+0000","objects_scrubbed":49,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:04.903523+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0.199229399,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"41'697","reported_seq":2784,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.884607+0000","last_change":"2024-04-26T18:32:02.884649+0000","last_active":"2024-04-26T18:32:02.884607+0000","last_peered":"2024-04-26T18:32:02.884607+0000","last_clean":"2024-04-26T18:32:02.884607+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T18:32:02.884607+0000","last_undegraded":"2024-04-26T18:32:02.884607+0000","last_fullsized":"2024-04-26T18:32:02.884607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'697","last_scrub_stamp":"2024-04-26T18:32:02.884542+0000","last_deep_scrub":"41'697","last_deep_scrub_stamp":"2024-04-26T18:32:02.884542+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.884542+0000","objects_scrubbed":62,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:26.965063+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0.097146090000000004,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":18,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"41'714","reported_seq":2802,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.528522+0000","last_change":"2024-04-26T18:32:08.528572+0000","last_active":"2024-04-26T18:32:08.528522+0000","last_peered":"2024-04-26T18:32:08.528522+0000","last_clean":"2024-04-26T18:32:08.528522+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T18:32:08.528522+0000","last_undegraded":"2024-04-26T18:32:08.528522+0000","last_fullsized":"2024-04-26T18:32:08.528522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'714","last_scrub_stamp":"2024-04-26T18:32:08.528457+0000","last_deep_scrub":"41'714","last_deep_scrub_stamp":"2024-04-26T18:32:08.528457+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.528457+0000","objects_scrubbed":62,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:52.072876+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.104951684,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"41'644","reported_seq":2734,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.649104+0000","last_change":"2024-04-26T18:31:59.649155+0000","last_active":"2024-04-26T18:31:59.649104+0000","last_peered":"2024-04-26T18:31:59.649104+0000","last_clean":"2024-04-26T18:31:59.649104+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T18:31:59.649104+0000","last_undegraded":"2024-04-26T18:31:59.649104+0000","last_fullsized":"2024-04-26T18:31:59.649104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'644","last_scrub_stamp":"2024-04-26T18:31:59.649030+0000","last_deep_scrub":"41'644","last_deep_scrub_stamp":"2024-04-26T18:31:59.649030+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.649030+0000","objects_scrubbed":49,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:55.872202+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0.032670101999999999,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"41'695","reported_seq":2786,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.852691+0000","last_change":"2024-04-26T18:32:05.852734+0000","last_active":"2024-04-26T18:32:05.852691+0000","last_peered":"2024-04-26T18:32:05.852691+0000","last_clean":"2024-04-26T18:32:05.852691+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T18:32:05.852691+0000","last_undegraded":"2024-04-26T18:32:05.852691+0000","last_fullsized":"2024-04-26T18:32:05.852691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'695","last_scrub_stamp":"2024-04-26T18:32:05.852593+0000","last_deep_scrub":"41'695","last_deep_scrub_stamp":"2024-04-26T18:32:05.852593+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.852593+0000","objects_scrubbed":50,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:42.782743+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.15919065099999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"41'670","reported_seq":2761,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.830636+0000","last_change":"2024-04-26T18:32:07.830710+0000","last_active":"2024-04-26T18:32:07.830636+0000","last_peered":"2024-04-26T18:32:07.830636+0000","last_clean":"2024-04-26T18:32:07.830636+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T18:32:07.830636+0000","last_undegraded":"2024-04-26T18:32:07.830636+0000","last_fullsized":"2024-04-26T18:32:07.830636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:07.830544+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:07.830544+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.830544+0000","objects_scrubbed":49,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:44.789153+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0.16311753700000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"41'690","reported_seq":2778,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:55.942349+0000","last_change":"2024-04-26T18:31:55.942423+0000","last_active":"2024-04-26T18:31:55.942349+0000","last_peered":"2024-04-26T18:31:55.942349+0000","last_clean":"2024-04-26T18:31:55.942349+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T18:31:55.942349+0000","last_undegraded":"2024-04-26T18:31:55.942349+0000","last_fullsized":"2024-04-26T18:31:55.942349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'690","last_scrub_stamp":"2024-04-26T18:31:55.942279+0000","last_deep_scrub":"41'690","last_deep_scrub_stamp":"2024-04-26T18:31:55.942279+0000","last_clean_scrub_stamp":"2024-04-26T18:31:55.942279+0000","objects_scrubbed":48,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:46.249420+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.077647145000000001,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"41'642","reported_seq":2737,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.727740+0000","last_change":"2024-04-26T18:32:02.727776+0000","last_active":"2024-04-26T18:32:02.727740+0000","last_peered":"2024-04-26T18:32:02.727740+0000","last_clean":"2024-04-26T18:32:02.727740+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T18:32:02.727740+0000","last_undegraded":"2024-04-26T18:32:02.727740+0000","last_fullsized":"2024-04-26T18:32:02.727740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'642","last_scrub_stamp":"2024-04-26T18:32:02.727675+0000","last_deep_scrub":"41'642","last_deep_scrub_stamp":"2024-04-26T18:32:02.727675+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.727675+0000","objects_scrubbed":38,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.088316+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.18619005699999999,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"41'641","reported_seq":2732,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.538071+0000","last_change":"2024-04-26T18:31:56.538071+0000","last_active":"2024-04-26T18:31:56.538071+0000","last_peered":"2024-04-26T18:31:56.538071+0000","last_clean":"2024-04-26T18:31:56.538071+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T18:31:56.538071+0000","last_undegraded":"2024-04-26T18:31:56.538071+0000","last_fullsized":"2024-04-26T18:31:56.538071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'641","last_scrub_stamp":"2024-04-26T18:31:56.537949+0000","last_deep_scrub":"41'641","last_deep_scrub_stamp":"2024-04-26T18:31:56.537949+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.537949+0000","objects_scrubbed":48,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:54.973187+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.22687219,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"41'664","reported_seq":2751,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.026360+0000","last_change":"2024-04-26T18:31:59.026396+0000","last_active":"2024-04-26T18:31:59.026360+0000","last_peered":"2024-04-26T18:31:59.026360+0000","last_clean":"2024-04-26T18:31:59.026360+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T18:31:59.026360+0000","last_undegraded":"2024-04-26T18:31:59.026360+0000","last_fullsized":"2024-04-26T18:31:59.026360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'664","last_scrub_stamp":"2024-04-26T18:31:59.026296+0000","last_deep_scrub":"41'664","last_deep_scrub_stamp":"2024-04-26T18:31:59.026296+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.026296+0000","objects_scrubbed":57,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:33.520201+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.18821249400000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"41'671","reported_seq":2764,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.773108+0000","last_change":"2024-04-26T18:32:11.773145+0000","last_active":"2024-04-26T18:32:11.773108+0000","last_peered":"2024-04-26T18:32:11.773108+0000","last_clean":"2024-04-26T18:32:11.773108+0000","last_became_active":"2024-04-26T17:58:46.846437+0000","last_became_peered":"2024-04-26T17:58:46.846437+0000","last_unstale":"2024-04-26T18:32:11.773108+0000","last_undegraded":"2024-04-26T18:32:11.773108+0000","last_fullsized":"2024-04-26T18:32:11.773108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'671","last_scrub_stamp":"2024-04-26T18:32:11.773028+0000","last_deep_scrub":"41'671","last_deep_scrub_stamp":"2024-04-26T18:32:11.773028+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.773028+0000","objects_scrubbed":59,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:05.407241+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0.100440928,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":16,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"41'652","reported_seq":2743,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.801763+0000","last_change":"2024-04-26T18:32:07.801835+0000","last_active":"2024-04-26T18:32:07.801763+0000","last_peered":"2024-04-26T18:32:07.801763+0000","last_clean":"2024-04-26T18:32:07.801763+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T18:32:07.801763+0000","last_undegraded":"2024-04-26T18:32:07.801763+0000","last_fullsized":"2024-04-26T18:32:07.801763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'652","last_scrub_stamp":"2024-04-26T18:32:07.801656+0000","last_deep_scrub":"41'652","last_deep_scrub_stamp":"2024-04-26T18:32:07.801656+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.801656+0000","objects_scrubbed":46,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:05.828107+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.100379555,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"41'648","reported_seq":2722,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.161410+0000","last_change":"2024-04-26T18:03:00.046913+0000","last_active":"2024-04-26T18:31:58.161410+0000","last_peered":"2024-04-26T18:31:58.161410+0000","last_clean":"2024-04-26T18:31:58.161410+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T18:31:58.161410+0000","last_undegraded":"2024-04-26T18:31:58.161410+0000","last_fullsized":"2024-04-26T18:31:58.161410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:03.690205+0000","last_clean_scrub_stamp":"2024-04-26T17:58:03.690205+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104580398,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":20,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"41'635","reported_seq":2724,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.624255+0000","last_change":"2024-04-26T18:31:58.624339+0000","last_active":"2024-04-26T18:31:58.624255+0000","last_peered":"2024-04-26T18:31:58.624255+0000","last_clean":"2024-04-26T18:31:58.624255+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T18:31:58.624255+0000","last_undegraded":"2024-04-26T18:31:58.624255+0000","last_fullsized":"2024-04-26T18:31:58.624255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'635","last_scrub_stamp":"2024-04-26T18:31:58.624171+0000","last_deep_scrub":"41'635","last_deep_scrub_stamp":"2024-04-26T18:31:58.624171+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.624171+0000","objects_scrubbed":47,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:09.715688+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.230423819,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"41'646","reported_seq":2739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.729951+0000","last_change":"2024-04-26T18:31:58.730003+0000","last_active":"2024-04-26T18:31:58.729951+0000","last_peered":"2024-04-26T18:31:58.729951+0000","last_clean":"2024-04-26T18:31:58.729951+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T18:31:58.729951+0000","last_undegraded":"2024-04-26T18:31:58.729951+0000","last_fullsized":"2024-04-26T18:31:58.729951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'646","last_scrub_stamp":"2024-04-26T18:31:58.729859+0000","last_deep_scrub":"41'646","last_deep_scrub_stamp":"2024-04-26T18:31:58.729859+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.729859+0000","objects_scrubbed":35,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:37.315038+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.101654339,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"41'626","reported_seq":2716,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.851339+0000","last_change":"2024-04-26T18:32:08.851425+0000","last_active":"2024-04-26T18:32:08.851339+0000","last_peered":"2024-04-26T18:32:08.851339+0000","last_clean":"2024-04-26T18:32:08.851339+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T18:32:08.851339+0000","last_undegraded":"2024-04-26T18:32:08.851339+0000","last_fullsized":"2024-04-26T18:32:08.851339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'626","last_scrub_stamp":"2024-04-26T18:32:08.851229+0000","last_deep_scrub":"41'626","last_deep_scrub_stamp":"2024-04-26T18:32:08.851229+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.851229+0000","objects_scrubbed":49,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:10.365460+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0.16310901,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"41'678","reported_seq":2774,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.556759+0000","last_change":"2024-04-26T18:32:06.556789+0000","last_active":"2024-04-26T18:32:06.556759+0000","last_peered":"2024-04-26T18:32:06.556759+0000","last_clean":"2024-04-26T18:32:06.556759+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T18:32:06.556759+0000","last_undegraded":"2024-04-26T18:32:06.556759+0000","last_fullsized":"2024-04-26T18:32:06.556759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'678","last_scrub_stamp":"2024-04-26T18:32:06.556698+0000","last_deep_scrub":"41'678","last_deep_scrub_stamp":"2024-04-26T18:32:06.556698+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.556698+0000","objects_scrubbed":34,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:09.223628+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.10388457199999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"41'694","reported_seq":2784,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.830110+0000","last_change":"2024-04-26T18:32:11.830110+0000","last_active":"2024-04-26T18:32:11.830110+0000","last_peered":"2024-04-26T18:32:11.830110+0000","last_clean":"2024-04-26T18:32:11.830110+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T18:32:11.830110+0000","last_undegraded":"2024-04-26T18:32:11.830110+0000","last_fullsized":"2024-04-26T18:32:11.830110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'694","last_scrub_stamp":"2024-04-26T18:32:11.830020+0000","last_deep_scrub":"41'694","last_deep_scrub_stamp":"2024-04-26T18:32:11.830020+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.830020+0000","objects_scrubbed":55,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:16.222483+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0.16390716399999999,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":17,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"41'646","reported_seq":2741,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.780439+0000","last_change":"2024-04-26T18:32:01.780490+0000","last_active":"2024-04-26T18:32:01.780439+0000","last_peered":"2024-04-26T18:32:01.780439+0000","last_clean":"2024-04-26T18:32:01.780439+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T18:32:01.780439+0000","last_undegraded":"2024-04-26T18:32:01.780439+0000","last_fullsized":"2024-04-26T18:32:01.780439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'646","last_scrub_stamp":"2024-04-26T18:32:01.780365+0000","last_deep_scrub":"41'646","last_deep_scrub_stamp":"2024-04-26T18:32:01.780365+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.780365+0000","objects_scrubbed":42,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:24.302566+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.19882805000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"41'640","reported_seq":2732,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.975704+0000","last_change":"2024-04-26T18:31:56.975765+0000","last_active":"2024-04-26T18:31:56.975704+0000","last_peered":"2024-04-26T18:31:56.975704+0000","last_clean":"2024-04-26T18:31:56.975704+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T18:31:56.975704+0000","last_undegraded":"2024-04-26T18:31:56.975704+0000","last_fullsized":"2024-04-26T18:31:56.975704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'640","last_scrub_stamp":"2024-04-26T18:31:56.975624+0000","last_deep_scrub":"41'640","last_deep_scrub_stamp":"2024-04-26T18:31:56.975624+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.975624+0000","objects_scrubbed":47,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.330947+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0.077373158999999997,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"41'626","reported_seq":2724,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.423461+0000","last_change":"2024-04-26T18:32:12.423532+0000","last_active":"2024-04-26T18:32:12.423461+0000","last_peered":"2024-04-26T18:32:12.423461+0000","last_clean":"2024-04-26T18:32:12.423461+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T18:32:12.423461+0000","last_undegraded":"2024-04-26T18:32:12.423461+0000","last_fullsized":"2024-04-26T18:32:12.423461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'626","last_scrub_stamp":"2024-04-26T18:32:12.423361+0000","last_deep_scrub":"41'626","last_deep_scrub_stamp":"2024-04-26T18:32:12.423361+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.423361+0000","objects_scrubbed":41,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:32.986258+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0.104812107,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1183673720,"num_objects":39268,"num_object_clones":18317,"num_object_copies":157072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39268,"num_whiteouts":18141,"num_read":5713,"num_read_kb":6011008,"num_write":75176,"num_write_kb":1483989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2573631488,"data_stored":2574974976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91894,"ondisk_log_size":91894,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3085,"num_object_clones":812,"num_object_copies":6170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3085,"num_whiteouts":812,"num_read":0,"num_read_kb":0,"num_write":3093,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42508,"ondisk_log_size":42508,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797006684,"num_objects":1886,"num_object_clones":0,"num_object_copies":3772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1886,"num_whiteouts":0,"num_read":2824,"num_read_kb":5408,"num_write":35013,"num_write_kb":2756186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24527923,"num_omap_keys":38818,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1594081280,"data_stored":1594013368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33082,"ondisk_log_size":33082,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575264,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":818236,"kb_used_data":570612,"kb_used_omap":1,"kb_used_meta":247614,"kb_avail":93553604,"statfs":{"total":96636764160,"available":95798890496,"internally_reserved":0,"allocated":584306688,"data_stored":584393669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":253557195},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575264,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864928,"kb_used_data":545112,"kb_used_omap":1,"kb_used_meta":319806,"kb_avail":93506912,"statfs":{"total":96636764160,"available":95751077888,"internally_reserved":0,"allocated":558194688,"data_stored":558281943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":327481799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575264,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752988,"kb_used_data":455444,"kb_used_omap":1,"kb_used_meta":297534,"kb_avail":93618852,"statfs":{"total":96636764160,"available":95865704448,"internally_reserved":0,"allocated":466374656,"data_stored":466129553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":304675269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575264,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":746976,"kb_used_data":481304,"kb_used_omap":1,"kb_used_meta":265662,"kb_avail":93624864,"statfs":{"total":96636764160,"available":95871860736,"internally_reserved":0,"allocated":492855296,"data_stored":492773676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272038341},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575264,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":912936,"kb_used_data":574944,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":93458904,"statfs":{"total":96636764160,"available":95701917696,"internally_reserved":0,"allocated":588742656,"data_stored":588833154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":346094024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575264,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":534204,"kb_used_data":322676,"kb_used_omap":1,"kb_used_meta":211518,"kb_avail":93837636,"statfs":{"total":96636764160,"available":96089739264,"internally_reserved":0,"allocated":330420224,"data_stored":330182370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216594885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575264,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":986984,"kb_used_data":635168,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93384856,"statfs":{"total":96636764160,"available":95626092544,"internally_reserved":0,"allocated":650412032,"data_stored":650334542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575265,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705460,"kb_used_data":489708,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93666380,"statfs":{"total":96636764160,"available":95914373120,"internally_reserved":0,"allocated":501460992,"data_stored":501203965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":205021184,"data_stored":205005563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234885740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163586048,"data_stored":163578528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163594240,"data_stored":163582538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":206127104,"data_stored":206119855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":222908416,"data_stored":222897653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297287680,"data_stored":297280195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":295362560,"data_stored":295362560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415035392,"data_stored":415203328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229273600,"data_stored":229273600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":424673280,"data_stored":425009152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":328777728,"data_stored":328945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":259764224,"data_stored":259764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":334802944,"data_stored":335138816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":285941760,"data_stored":286277632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:32:18.846 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.846 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.846 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.847 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.847 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.847 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.847 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T17:58:07.714199+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.848 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T17:58:03.690205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=31, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:32:18.848 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T18:32:38.850 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:32:38.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.959+0000 7f7e83ec4640 1 Processor -- start 2024-04-26T18:32:38.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.959+0000 7f7e83ec4640 1 -- start start 2024-04-26T18:32:38.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e83ec4640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e7c155da0 0x7f7e7c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:38.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e83ec4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c156180 0x7f7e7c0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:38.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e83ec4640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7c15f2a0 con 0x7f7e7c0cd840 2024-04-26T18:32:38.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e83ec4640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f7e7c15cbc0 con 0x7f7e7c155da0 2024-04-26T18:32:38.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e83ec4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c0cc730 con 0x7f7e7c156180 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e8145f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c156180 0x7f7e7c0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e81c60640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f7e7c155da0 0x7f7e7c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e82461640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f7e7c0cd840 0x7f7e7c0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:33566/0 (socket says 172.21.15.139:33566) 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.960+0000 7f7e82461640 1 -- 172.21.15.139:0/3808544740 learned_addr learned my addr 172.21.15.139:0/3808544740 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e80c5e640 1 -- 172.21.15.139:0/3808544740 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451549558 0 0) 0x7f7e7c15f2a0 con 0x7f7e7c0cd840 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e80c5e640 1 -- 172.21.15.139:0/3808544740 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e68003520 con 0x7f7e7c0cd840 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e8145f640 1 -- 172.21.15.139:0/3808544740 >> v2:172.21.15.143:3300/0 conn(0x7f7e7c155da0 msgr2=0x7f7e7c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:38.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e8145f640 1 --2- 172.21.15.139:0/3808544740 >> v2:172.21.15.143:3300/0 conn(0x7f7e7c155da0 0x7f7e7c15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:38.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e8145f640 1 -- 172.21.15.139:0/3808544740 >> v1:172.21.15.143:6789/0 conn(0x7f7e7c0cd840 legacy=0x7f7e7c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:38.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e8145f640 1 -- 172.21.15.139:0/3808544740 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c15f580 con 0x7f7e7c156180 2024-04-26T18:32:38.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e81c60640 1 --2- 172.21.15.139:0/3808544740 >> v2:172.21.15.143:3300/0 conn(0x7f7e7c155da0 0x7f7e7c15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.961+0000 7f7e8145f640 1 --2- 172.21.15.139:0/3808544740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c156180 0x7f7e7c0d12c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097a0 tx=0x7f7e6c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1604a1cc3c22c2da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e80c5e640 1 -- 172.21.15.139:0/3808544740 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c037070 con 0x7f7e7c156180 2024-04-26T18:32:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e80c5e640 1 -- 172.21.15.139:0/3808544740 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c02ae50 con 0x7f7e7c156180 2024-04-26T18:32:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e80c5e640 1 -- 172.21.15.139:0/3808544740 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c032640 con 0x7f7e7c156180 2024-04-26T18:32:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 -- 172.21.15.139:0/3808544740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c156180 msgr2=0x7f7e7c0d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:38.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/3808544740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c156180 0x7f7e7c0d12c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097a0 tx=0x7f7e6c02a100 comp rx=0 tx=0).stop 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 -- 172.21.15.139:0/3808544740 shutdown_connections 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/3808544740 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c156180 0x7f7e7c0d12c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/3808544740 >> v2:172.21.15.143:3300/0 conn(0x7f7e7c155da0 0x7f7e7c15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 -- 172.21.15.139:0/3808544740 >> 172.21.15.139:0/3808544740 conn(0x7f7e7c068090 msgr2=0x7f7e7c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 -- 172.21.15.139:0/3808544740 shutdown_connections 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.962+0000 7f7e83ec4640 1 -- 172.21.15.139:0/3808544740 wait complete. 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.963+0000 7f7e83ec4640 1 Processor -- start 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.963+0000 7f7e83ec4640 1 -- start start 2024-04-26T18:32:38.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e83ec4640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7c0cd840 0x7f7e7c15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e83ec4640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c155da0 0x7f7e7c158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e83ec4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e7c158b90 0x7f7e7c0d0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e83ec4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0c69b0 con 0x7f7e7c158b90 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e83ec4640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c15fb40 con 0x7f7e7c0cd840 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e83ec4640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c0c6b30 con 0x7f7e7c155da0 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e82461640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e7c158b90 0x7f7e7c0d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e8145f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c155da0 0x7f7e7c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:38.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e81c60640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7c0cd840 0x7f7e7c15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e8145f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c155da0 0x7f7e7c158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3301/0 says I am v2:172.21.15.139:51506/0 (socket says 172.21.15.139:51506) 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e8145f640 1 -- 172.21.15.139:0/2345366933 learned_addr learned my addr 172.21.15.139:0/2345366933 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.964+0000 7f7e82461640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e7c158b90 0x7f7e7c0d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40000/0 (socket says 172.21.15.139:40000) 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e8145f640 1 -- 172.21.15.139:0/2345366933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7c0cd840 msgr2=0x7f7e7c15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e8145f640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7c0cd840 0x7f7e7c15b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e8145f640 1 -- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e7c158b90 msgr2=0x7f7e7c0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e8145f640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e7c158b90 0x7f7e7c0d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e8145f640 1 -- 172.21.15.139:0/2345366933 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c157be0 con 0x7f7e7c155da0 2024-04-26T18:32:38.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e8145f640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c155da0 0x7f7e7c158650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c02a140 tx=0x7f7e6c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:38.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e727fc640 1 -- 172.21.15.139:0/2345366933 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c041070 con 0x7f7e7c155da0 2024-04-26T18:32:38.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e727fc640 1 -- 172.21.15.139:0/2345366933 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c03c460 con 0x7f7e7c155da0 2024-04-26T18:32:38.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e727fc640 1 -- 172.21.15.139:0/2345366933 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c037040 con 0x7f7e7c155da0 2024-04-26T18:32:38.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c159020 con 0x7f7e7c155da0 2024-04-26T18:32:38.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.965+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c157e50 con 0x7f7e7c155da0 2024-04-26T18:32:38.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.966+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7c076d20 con 0x7f7e7c155da0 2024-04-26T18:32:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.967+0000 7f7e727fc640 1 -- 172.21.15.139:0/2345366933 <== mon.2 v2:172.21.15.143:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e6c044070 con 0x7f7e7c155da0 2024-04-26T18:32:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.967+0000 7f7e727fc640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e6006c8f0 0x7f7e6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.967+0000 7f7e727fc640 1 -- 172.21.15.139:0/2345366933 <== mon.2 v2:172.21.15.143:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f7e6c0ac690 con 0x7f7e7c155da0 2024-04-26T18:32:38.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.967+0000 7f7e81c60640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e6006c8f0 0x7f7e6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.967+0000 7f7e81c60640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e6006c8f0 0x7f7e6006edb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009bd0 tx=0x7f7e7800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:38.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:38.971+0000 7f7e727fc640 1 -- 172.21.15.139:0/2345366933 <== mon.2 v2:172.21.15.143:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e6c07a000 con 0x7f7e7c155da0 2024-04-26T18:32:39.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.149+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 --> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e7c14cac0 con 0x7f7e6006c8f0 2024-04-26T18:32:39.165 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.165+0000 7f7e727fc640 1 -- 172.21.15.139:0/2345366933 <== mgr.4110 v2:172.21.15.139:6832/2404745913 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339345 (secure 0 0 0) 0x7f7e7c14cac0 con 0x7f7e6006c8f0 2024-04-26T18:32:39.169 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:32:39.170 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-26T18:32:39.172 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e6006c8f0 msgr2=0x7f7e6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.172 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e6006c8f0 0x7f7e6006edb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009bd0 tx=0x7f7e7800b040 comp rx=0 tx=0).stop 2024-04-26T18:32:39.172 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c155da0 msgr2=0x7f7e7c158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c155da0 0x7f7e7c158650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c02a140 tx=0x7f7e6c0046c0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 shutdown_connections 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f7e6006c8f0 0x7f7e6006edb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e7c158b90 0x7f7e7c0d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f7e7c155da0 0x7f7e7c158650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 --2- 172.21.15.139:0/2345366933 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7e7c0cd840 0x7f7e7c15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 >> 172.21.15.139:0/2345366933 conn(0x7f7e7c068090 msgr2=0x7f7e7c0c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 shutdown_connections 2024-04-26T18:32:39.173 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.169+0000 7f7e83ec4640 1 -- 172.21.15.139:0/2345366933 wait complete. 2024-04-26T18:32:39.180 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":1076,"stamp":"2024-04-26T18:32:37.600453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1981270772,"num_objects":44241,"num_object_clones":19129,"num_object_copies":167018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44241,"num_whiteouts":18953,"num_read":8653,"num_read_kb":6016516,"num_write":113441,"num_write_kb":4242591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24527923,"num_omap_keys":38818,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167719,"ondisk_log_size":167719,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":6322712,"kb_used_data":4074968,"kb_used_omap":12,"kb_used_meta":2247667,"kb_avail":748652008,"statfs":{"total":773094113280,"available":766619656192,"internally_reserved":0,"allocated":4172767232,"data_stored":4172132872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":2301611572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003219"},"pg_stats":[{"pgid":"2.1f","version":"41'584","reported_seq":667,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.796753+0000","last_change":"2024-04-26T18:31:56.796819+0000","last_active":"2024-04-26T18:31:56.796753+0000","last_peered":"2024-04-26T18:31:56.796753+0000","last_clean":"2024-04-26T18:31:56.796753+0000","last_became_active":"2024-04-26T17:58:03.718782+0000","last_became_peered":"2024-04-26T17:58:03.718782+0000","last_unstale":"2024-04-26T18:31:56.796753+0000","last_undegraded":"2024-04-26T18:31:56.796753+0000","last_fullsized":"2024-04-26T18:31:56.796753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'584","last_scrub_stamp":"2024-04-26T18:31:56.796674+0000","last_deep_scrub":"41'584","last_deep_scrub_stamp":"2024-04-26T18:31:56.796674+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.796674+0000","objects_scrubbed":60,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:28.842664+0000","scrub_duration":101,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37233347,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":593,"num_write_kb":74518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":625450,"num_omap_keys":1097,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"41'654","reported_seq":2750,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.579100+0000","last_change":"2024-04-26T18:31:57.579100+0000","last_active":"2024-04-26T18:31:57.579100+0000","last_peered":"2024-04-26T18:31:57.579100+0000","last_clean":"2024-04-26T18:31:57.579100+0000","last_became_active":"2024-04-26T17:58:04.721265+0000","last_became_peered":"2024-04-26T17:58:04.721265+0000","last_unstale":"2024-04-26T18:31:57.579100+0000","last_undegraded":"2024-04-26T18:31:57.579100+0000","last_fullsized":"2024-04-26T18:31:57.579100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'654","last_scrub_stamp":"2024-04-26T18:31:57.578980+0000","last_deep_scrub":"41'654","last_deep_scrub_stamp":"2024-04-26T18:31:57.578980+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.578980+0000","objects_scrubbed":48,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:13.947523+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0.230683108,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"41'2821","reported_seq":4612,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.281942+0000","last_change":"2024-04-26T18:32:10.282021+0000","last_active":"2024-04-26T18:32:10.281942+0000","last_peered":"2024-04-26T18:32:10.281942+0000","last_clean":"2024-04-26T18:32:10.281942+0000","last_became_active":"2024-04-26T17:58:08.737159+0000","last_became_peered":"2024-04-26T17:58:08.737159+0000","last_unstale":"2024-04-26T18:32:10.281942+0000","last_undegraded":"2024-04-26T18:32:10.281942+0000","last_fullsized":"2024-04-26T18:32:10.281942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2821","last_scrub_stamp":"2024-04-26T18:32:10.281550+0000","last_deep_scrub":"41'2821","last_deep_scrub_stamp":"2024-04-26T18:32:10.281550+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.281550+0000","objects_scrubbed":1217,"log_size":2821,"log_dups_size":0,"ondisk_log_size":2821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:32.863399+0000","scrub_duration":546,"objects_trimmed":0,"snaptrim_duration":0.226534869,"stat_sum":{"num_bytes":47000043,"num_objects":1217,"num_object_clones":566,"num_object_copies":4868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1217,"num_whiteouts":566,"num_read":213,"num_read_kb":295654,"num_write":2298,"num_write_kb":59293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'1181","reported_seq":1265,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.673264+0000","last_change":"2024-04-26T18:32:00.673264+0000","last_active":"2024-04-26T18:32:00.673264+0000","last_peered":"2024-04-26T18:32:00.673264+0000","last_clean":"2024-04-26T18:32:00.673264+0000","last_became_active":"2024-04-26T17:58:03.715995+0000","last_became_peered":"2024-04-26T17:58:03.715995+0000","last_unstale":"2024-04-26T18:32:00.673264+0000","last_undegraded":"2024-04-26T18:32:00.673264+0000","last_fullsized":"2024-04-26T18:32:00.673264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1181","last_scrub_stamp":"2024-04-26T18:32:00.673155+0000","last_deep_scrub":"41'1181","last_deep_scrub_stamp":"2024-04-26T18:32:00.673155+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.673155+0000","objects_scrubbed":66,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:14.043348+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":57,"num_read_kb":0,"num_write":1207,"num_write_kb":83571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741342,"num_omap_keys":1239,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"41'635","reported_seq":2728,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.801335+0000","last_change":"2024-04-26T18:32:05.801380+0000","last_active":"2024-04-26T18:32:05.801335+0000","last_peered":"2024-04-26T18:32:05.801335+0000","last_clean":"2024-04-26T18:32:05.801335+0000","last_became_active":"2024-04-26T17:58:04.724916+0000","last_became_peered":"2024-04-26T17:58:04.724916+0000","last_unstale":"2024-04-26T18:32:05.801335+0000","last_undegraded":"2024-04-26T18:32:05.801335+0000","last_fullsized":"2024-04-26T18:32:05.801335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'635","last_scrub_stamp":"2024-04-26T18:32:05.801240+0000","last_deep_scrub":"41'635","last_deep_scrub_stamp":"2024-04-26T18:32:05.801240+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.801240+0000","objects_scrubbed":44,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:52.982610+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.19357582500000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":12,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"41'2977","reported_seq":4673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.320358+0000","last_change":"2024-04-26T18:32:07.320429+0000","last_active":"2024-04-26T18:32:07.320358+0000","last_peered":"2024-04-26T18:32:07.320358+0000","last_clean":"2024-04-26T18:32:07.320358+0000","last_became_active":"2024-04-26T17:58:08.746773+0000","last_became_peered":"2024-04-26T17:58:08.746773+0000","last_unstale":"2024-04-26T18:32:07.320358+0000","last_undegraded":"2024-04-26T18:32:07.320358+0000","last_fullsized":"2024-04-26T18:32:07.320358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2977","last_scrub_stamp":"2024-04-26T18:32:07.320264+0000","last_deep_scrub":"41'2977","last_deep_scrub_stamp":"2024-04-26T18:32:07.320264+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.320264+0000","objects_scrubbed":1261,"log_size":2977,"log_dups_size":0,"ondisk_log_size":2977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:18.016502+0000","scrub_duration":448,"objects_trimmed":0,"snaptrim_duration":0.17635221100000001,"stat_sum":{"num_bytes":22365631,"num_objects":1261,"num_object_clones":594,"num_object_copies":5044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1261,"num_whiteouts":594,"num_read":144,"num_read_kb":92763,"num_write":2429,"num_write_kb":39864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"41'1089","reported_seq":1169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.713575+0000","last_change":"2024-04-26T18:32:05.713654+0000","last_active":"2024-04-26T18:32:05.713575+0000","last_peered":"2024-04-26T18:32:05.713575+0000","last_clean":"2024-04-26T18:32:05.713575+0000","last_became_active":"2024-04-26T17:58:03.722713+0000","last_became_peered":"2024-04-26T17:58:03.722713+0000","last_unstale":"2024-04-26T18:32:05.713575+0000","last_undegraded":"2024-04-26T18:32:05.713575+0000","last_fullsized":"2024-04-26T18:32:05.713575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1089","last_scrub_stamp":"2024-04-26T18:32:05.713461+0000","last_deep_scrub":"41'1089","last_deep_scrub_stamp":"2024-04-26T18:32:05.713461+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.713461+0000","objects_scrubbed":70,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:27.191884+0000","scrub_duration":129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":1097,"num_write_kb":133138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":946158,"num_omap_keys":1433,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'670","reported_seq":2762,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.817854+0000","last_change":"2024-04-26T18:32:06.817921+0000","last_active":"2024-04-26T18:32:06.817854+0000","last_peered":"2024-04-26T18:32:06.817854+0000","last_clean":"2024-04-26T18:32:06.817854+0000","last_became_active":"2024-04-26T17:58:04.722607+0000","last_became_peered":"2024-04-26T17:58:04.722607+0000","last_unstale":"2024-04-26T18:32:06.817854+0000","last_undegraded":"2024-04-26T18:32:06.817854+0000","last_fullsized":"2024-04-26T18:32:06.817854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:06.817747+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:06.817747+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.817747+0000","objects_scrubbed":44,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:13.360869+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0.16172857600000001,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":10,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"41'2946","reported_seq":4712,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.452156+0000","last_change":"2024-04-26T18:32:10.452241+0000","last_active":"2024-04-26T18:32:10.452156+0000","last_peered":"2024-04-26T18:32:10.452156+0000","last_clean":"2024-04-26T18:32:10.452156+0000","last_became_active":"2024-04-26T17:58:46.846516+0000","last_became_peered":"2024-04-26T17:58:46.846516+0000","last_unstale":"2024-04-26T18:32:10.452156+0000","last_undegraded":"2024-04-26T18:32:10.452156+0000","last_fullsized":"2024-04-26T18:32:10.452156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2946","last_scrub_stamp":"2024-04-26T18:32:10.452029+0000","last_deep_scrub":"41'2946","last_deep_scrub_stamp":"2024-04-26T18:32:10.452029+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.452029+0000","objects_scrubbed":1294,"log_size":2946,"log_dups_size":0,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:00.355165+0000","scrub_duration":588,"objects_trimmed":0,"snaptrim_duration":0.18830187000000001,"stat_sum":{"num_bytes":52036256,"num_objects":1294,"num_object_clones":599,"num_object_copies":5176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":599,"num_read":211,"num_read_kb":315253,"num_write":2398,"num_write_kb":54529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"41'589","reported_seq":669,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.712715+0000","last_change":"2024-04-26T18:32:00.712754+0000","last_active":"2024-04-26T18:32:00.712715+0000","last_peered":"2024-04-26T18:32:00.712715+0000","last_clean":"2024-04-26T18:32:00.712715+0000","last_became_active":"2024-04-26T17:58:03.718867+0000","last_became_peered":"2024-04-26T17:58:03.718867+0000","last_unstale":"2024-04-26T18:32:00.712715+0000","last_undegraded":"2024-04-26T18:32:00.712715+0000","last_fullsized":"2024-04-26T18:32:00.712715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'589","last_scrub_stamp":"2024-04-26T18:32:00.712651+0000","last_deep_scrub":"41'589","last_deep_scrub_stamp":"2024-04-26T18:32:00.712651+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.712651+0000","objects_scrubbed":64,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:54:32.175673+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":56,"num_read_kb":0,"num_write":594,"num_write_kb":70938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":905659,"num_omap_keys":1552,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"41'656","reported_seq":2743,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.919006+0000","last_change":"2024-04-26T18:31:58.919083+0000","last_active":"2024-04-26T18:31:58.919006+0000","last_peered":"2024-04-26T18:31:58.919006+0000","last_clean":"2024-04-26T18:31:58.919006+0000","last_became_active":"2024-04-26T17:58:04.723454+0000","last_became_peered":"2024-04-26T17:58:04.723454+0000","last_unstale":"2024-04-26T18:31:58.919006+0000","last_undegraded":"2024-04-26T18:31:58.919006+0000","last_fullsized":"2024-04-26T18:31:58.919006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'656","last_scrub_stamp":"2024-04-26T18:31:58.918900+0000","last_deep_scrub":"41'656","last_deep_scrub_stamp":"2024-04-26T18:31:58.918900+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.918900+0000","objects_scrubbed":47,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:11.806962+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0.161485249,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"41'2787","reported_seq":4566,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.273204+0000","last_change":"2024-04-26T18:32:05.273244+0000","last_active":"2024-04-26T18:32:05.273204+0000","last_peered":"2024-04-26T18:32:05.273204+0000","last_clean":"2024-04-26T18:32:05.273204+0000","last_became_active":"2024-04-26T17:58:08.742549+0000","last_became_peered":"2024-04-26T17:58:08.742549+0000","last_unstale":"2024-04-26T18:32:05.273204+0000","last_undegraded":"2024-04-26T18:32:05.273204+0000","last_fullsized":"2024-04-26T18:32:05.273204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2787","last_scrub_stamp":"2024-04-26T18:32:05.273123+0000","last_deep_scrub":"41'2787","last_deep_scrub_stamp":"2024-04-26T18:32:05.273123+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.273123+0000","objects_scrubbed":1192,"log_size":2787,"log_dups_size":0,"ondisk_log_size":2787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:08.317634+0000","scrub_duration":447,"objects_trimmed":0,"snaptrim_duration":0.18642139199999999,"stat_sum":{"num_bytes":46440810,"num_objects":1192,"num_object_clones":545,"num_object_copies":4768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1192,"num_whiteouts":545,"num_read":181,"num_read_kb":201245,"num_write":2302,"num_write_kb":49304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"41'700","reported_seq":2785,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.923048+0000","last_change":"2024-04-26T18:32:03.923118+0000","last_active":"2024-04-26T18:32:03.923048+0000","last_peered":"2024-04-26T18:32:03.923048+0000","last_clean":"2024-04-26T18:32:03.923048+0000","last_became_active":"2024-04-26T17:58:04.715324+0000","last_became_peered":"2024-04-26T17:58:04.715324+0000","last_unstale":"2024-04-26T18:32:03.923048+0000","last_undegraded":"2024-04-26T18:32:03.923048+0000","last_fullsized":"2024-04-26T18:32:03.923048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'700","last_scrub_stamp":"2024-04-26T18:32:03.922947+0000","last_deep_scrub":"41'700","last_deep_scrub_stamp":"2024-04-26T18:32:03.922947+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.922947+0000","objects_scrubbed":66,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:34.045147+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0.101605577,"stat_sum":{"num_bytes":0,"num_objects":66,"num_object_clones":20,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"41'2586","reported_seq":2668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.759132+0000","last_change":"2024-04-26T18:32:02.759176+0000","last_active":"2024-04-26T18:32:02.759132+0000","last_peered":"2024-04-26T18:32:02.759132+0000","last_clean":"2024-04-26T18:32:02.759132+0000","last_became_active":"2024-04-26T17:58:03.719458+0000","last_became_peered":"2024-04-26T17:58:03.719458+0000","last_unstale":"2024-04-26T18:32:02.759132+0000","last_undegraded":"2024-04-26T18:32:02.759132+0000","last_fullsized":"2024-04-26T18:32:02.759132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2586","last_scrub_stamp":"2024-04-26T18:32:02.759035+0000","last_deep_scrub":"41'2586","last_deep_scrub_stamp":"2024-04-26T18:32:02.759035+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.759035+0000","objects_scrubbed":50,"log_size":2586,"log_dups_size":0,"ondisk_log_size":2586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:33.776082+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":2609,"num_write_kb":88139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731120,"num_omap_keys":1205,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"41'2917","reported_seq":4650,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.398451+0000","last_change":"2024-04-26T18:32:08.398511+0000","last_active":"2024-04-26T18:32:08.398451+0000","last_peered":"2024-04-26T18:32:08.398451+0000","last_clean":"2024-04-26T18:32:08.398451+0000","last_became_active":"2024-04-26T17:58:08.745605+0000","last_became_peered":"2024-04-26T17:58:08.745605+0000","last_unstale":"2024-04-26T18:32:08.398451+0000","last_undegraded":"2024-04-26T18:32:08.398451+0000","last_fullsized":"2024-04-26T18:32:08.398451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2917","last_scrub_stamp":"2024-04-26T18:32:08.398358+0000","last_deep_scrub":"41'2917","last_deep_scrub_stamp":"2024-04-26T18:32:08.398358+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.398358+0000","objects_scrubbed":1273,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:18.785042+0000","scrub_duration":506,"objects_trimmed":0,"snaptrim_duration":0.19133515200000001,"stat_sum":{"num_bytes":43266035,"num_objects":1273,"num_object_clones":588,"num_object_copies":5092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1273,"num_whiteouts":588,"num_read":173,"num_read_kb":222814,"num_write":2389,"num_write_kb":54953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"41'663","reported_seq":2759,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.631651+0000","last_change":"2024-04-26T18:31:59.631693+0000","last_active":"2024-04-26T18:31:59.631651+0000","last_peered":"2024-04-26T18:31:59.631651+0000","last_clean":"2024-04-26T18:31:59.631651+0000","last_became_active":"2024-04-26T17:58:04.717631+0000","last_became_peered":"2024-04-26T17:58:04.717631+0000","last_unstale":"2024-04-26T18:31:59.631651+0000","last_undegraded":"2024-04-26T18:31:59.631651+0000","last_fullsized":"2024-04-26T18:31:59.631651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'663","last_scrub_stamp":"2024-04-26T18:31:59.631553+0000","last_deep_scrub":"41'663","last_deep_scrub_stamp":"2024-04-26T18:31:59.631553+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.631553+0000","objects_scrubbed":50,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:22.786623+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0.22887548799999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":9,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'1388","reported_seq":1470,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.044298+0000","last_change":"2024-04-26T18:31:58.044331+0000","last_active":"2024-04-26T18:31:58.044298+0000","last_peered":"2024-04-26T18:31:58.044298+0000","last_clean":"2024-04-26T18:31:58.044298+0000","last_became_active":"2024-04-26T17:58:03.712852+0000","last_became_peered":"2024-04-26T17:58:03.712852+0000","last_unstale":"2024-04-26T18:31:58.044298+0000","last_undegraded":"2024-04-26T18:31:58.044298+0000","last_fullsized":"2024-04-26T18:31:58.044298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1388","last_scrub_stamp":"2024-04-26T18:31:58.044235+0000","last_deep_scrub":"41'1388","last_deep_scrub_stamp":"2024-04-26T18:31:58.044235+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.044235+0000","objects_scrubbed":61,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:36.044743+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":1392,"num_write_kb":95976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":773289,"num_omap_keys":1315,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"41'2855","reported_seq":4608,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.382931+0000","last_change":"2024-04-26T18:32:11.382976+0000","last_active":"2024-04-26T18:32:11.382931+0000","last_peered":"2024-04-26T18:32:11.382931+0000","last_clean":"2024-04-26T18:32:11.382931+0000","last_became_active":"2024-04-26T17:58:46.846635+0000","last_became_peered":"2024-04-26T17:58:46.846635+0000","last_unstale":"2024-04-26T18:32:11.382931+0000","last_undegraded":"2024-04-26T18:32:11.382931+0000","last_fullsized":"2024-04-26T18:32:11.382931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2855","last_scrub_stamp":"2024-04-26T18:32:11.382757+0000","last_deep_scrub":"41'2855","last_deep_scrub_stamp":"2024-04-26T18:32:11.382757+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.382757+0000","objects_scrubbed":1180,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.694014+0000","scrub_duration":499,"objects_trimmed":0,"snaptrim_duration":0.18928092499999999,"stat_sum":{"num_bytes":21448645,"num_objects":1180,"num_object_clones":543,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":543,"num_read":145,"num_read_kb":62792,"num_write":2368,"num_write_kb":33318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"41'711","reported_seq":2801,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.715520+0000","last_change":"2024-04-26T18:32:07.715551+0000","last_active":"2024-04-26T18:32:07.715520+0000","last_peered":"2024-04-26T18:32:07.715520+0000","last_clean":"2024-04-26T18:32:07.715520+0000","last_became_active":"2024-04-26T17:58:04.717100+0000","last_became_peered":"2024-04-26T17:58:04.717100+0000","last_unstale":"2024-04-26T18:32:07.715520+0000","last_undegraded":"2024-04-26T18:32:07.715520+0000","last_fullsized":"2024-04-26T18:32:07.715520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'711","last_scrub_stamp":"2024-04-26T18:32:07.715450+0000","last_deep_scrub":"41'711","last_deep_scrub_stamp":"2024-04-26T18:32:07.715450+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.715450+0000","objects_scrubbed":56,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:18.023367+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0.22842327800000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":15,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"41'900","reported_seq":982,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.114386+0000","last_change":"2024-04-26T18:32:02.114433+0000","last_active":"2024-04-26T18:32:02.114386+0000","last_peered":"2024-04-26T18:32:02.114386+0000","last_clean":"2024-04-26T18:32:02.114386+0000","last_became_active":"2024-04-26T17:58:03.718632+0000","last_became_peered":"2024-04-26T17:58:03.718632+0000","last_unstale":"2024-04-26T18:32:02.114386+0000","last_undegraded":"2024-04-26T18:32:02.114386+0000","last_fullsized":"2024-04-26T18:32:02.114386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'900","last_scrub_stamp":"2024-04-26T18:32:02.114315+0000","last_deep_scrub":"41'900","last_deep_scrub_stamp":"2024-04-26T18:32:02.114315+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.114315+0000","objects_scrubbed":52,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:38.542317+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":901,"num_write_kb":79506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586989,"num_omap_keys":940,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"41'2890","reported_seq":4636,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.470775+0000","last_change":"2024-04-26T18:32:12.470811+0000","last_active":"2024-04-26T18:32:12.470775+0000","last_peered":"2024-04-26T18:32:12.470775+0000","last_clean":"2024-04-26T18:32:12.470775+0000","last_became_active":"2024-04-26T17:58:08.743407+0000","last_became_peered":"2024-04-26T17:58:08.743407+0000","last_unstale":"2024-04-26T18:32:12.470775+0000","last_undegraded":"2024-04-26T18:32:12.470775+0000","last_fullsized":"2024-04-26T18:32:12.470775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2890","last_scrub_stamp":"2024-04-26T18:32:12.470679+0000","last_deep_scrub":"41'2890","last_deep_scrub_stamp":"2024-04-26T18:32:12.470679+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.470679+0000","objects_scrubbed":1245,"log_size":2890,"log_dups_size":0,"ondisk_log_size":2890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:04.903215+0000","scrub_duration":425,"objects_trimmed":0,"snaptrim_duration":0.077792920000000002,"stat_sum":{"num_bytes":29575215,"num_objects":1245,"num_object_clones":583,"num_object_copies":4980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1245,"num_whiteouts":583,"num_read":185,"num_read_kb":122841,"num_write":2351,"num_write_kb":42495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"41'660","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.925374+0000","last_change":"2024-04-26T18:32:00.925440+0000","last_active":"2024-04-26T18:32:00.925374+0000","last_peered":"2024-04-26T18:32:00.925374+0000","last_clean":"2024-04-26T18:32:00.925374+0000","last_became_active":"2024-04-26T17:58:04.712120+0000","last_became_peered":"2024-04-26T17:58:04.712120+0000","last_unstale":"2024-04-26T18:32:00.925374+0000","last_undegraded":"2024-04-26T18:32:00.925374+0000","last_fullsized":"2024-04-26T18:32:00.925374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'660","last_scrub_stamp":"2024-04-26T18:32:00.925278+0000","last_deep_scrub":"41'660","last_deep_scrub_stamp":"2024-04-26T18:32:00.925278+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.925278+0000","objects_scrubbed":43,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:13:52.166326+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.18061166100000001,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"41'523","reported_seq":605,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.690197+0000","last_change":"2024-04-26T18:32:04.690243+0000","last_active":"2024-04-26T18:32:04.690197+0000","last_peered":"2024-04-26T18:32:04.690197+0000","last_clean":"2024-04-26T18:32:04.690197+0000","last_became_active":"2024-04-26T17:58:03.719973+0000","last_became_peered":"2024-04-26T17:58:03.719973+0000","last_unstale":"2024-04-26T18:32:04.690197+0000","last_undegraded":"2024-04-26T18:32:04.690197+0000","last_fullsized":"2024-04-26T18:32:04.690197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'523","last_scrub_stamp":"2024-04-26T18:32:04.690126+0000","last_deep_scrub":"41'523","last_deep_scrub_stamp":"2024-04-26T18:32:04.690126+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.690126+0000","objects_scrubbed":55,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:33.372095+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":511,"num_write_kb":66851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706333,"num_omap_keys":1229,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"41'2805","reported_seq":4545,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.292011+0000","last_change":"2024-04-26T18:32:06.292073+0000","last_active":"2024-04-26T18:32:06.292011+0000","last_peered":"2024-04-26T18:32:06.292011+0000","last_clean":"2024-04-26T18:32:06.292011+0000","last_became_active":"2024-04-26T17:58:08.746233+0000","last_became_peered":"2024-04-26T17:58:08.746233+0000","last_unstale":"2024-04-26T18:32:06.292011+0000","last_undegraded":"2024-04-26T18:32:06.292011+0000","last_fullsized":"2024-04-26T18:32:06.292011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2805","last_scrub_stamp":"2024-04-26T18:32:06.291917+0000","last_deep_scrub":"41'2805","last_deep_scrub_stamp":"2024-04-26T18:32:06.291917+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.291917+0000","objects_scrubbed":1237,"log_size":2805,"log_dups_size":0,"ondisk_log_size":2805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:15.030890+0000","scrub_duration":450,"objects_trimmed":0,"snaptrim_duration":0.18788326999999999,"stat_sum":{"num_bytes":37828835,"num_objects":1237,"num_object_clones":573,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":573,"num_read":167,"num_read_kb":252976,"num_write":2275,"num_write_kb":48379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"41'651","reported_seq":2744,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:54.781537+0000","last_change":"2024-04-26T18:31:54.781565+0000","last_active":"2024-04-26T18:31:54.781537+0000","last_peered":"2024-04-26T18:31:54.781537+0000","last_clean":"2024-04-26T18:31:54.781537+0000","last_became_active":"2024-04-26T17:58:04.715064+0000","last_became_peered":"2024-04-26T17:58:04.715064+0000","last_unstale":"2024-04-26T18:31:54.781537+0000","last_undegraded":"2024-04-26T18:31:54.781537+0000","last_fullsized":"2024-04-26T18:31:54.781537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'651","last_scrub_stamp":"2024-04-26T18:31:54.781462+0000","last_deep_scrub":"41'651","last_deep_scrub_stamp":"2024-04-26T18:31:54.781462+0000","last_clean_scrub_stamp":"2024-04-26T18:31:54.781462+0000","objects_scrubbed":51,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:56.927622+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.19854031599999999,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"41'879","reported_seq":961,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.007511+0000","last_change":"2024-04-26T18:32:00.007552+0000","last_active":"2024-04-26T18:32:00.007511+0000","last_peered":"2024-04-26T18:32:00.007511+0000","last_clean":"2024-04-26T18:32:00.007511+0000","last_became_active":"2024-04-26T17:58:03.722845+0000","last_became_peered":"2024-04-26T17:58:03.722845+0000","last_unstale":"2024-04-26T18:32:00.007511+0000","last_undegraded":"2024-04-26T18:32:00.007511+0000","last_fullsized":"2024-04-26T18:32:00.007511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'879","last_scrub_stamp":"2024-04-26T18:32:00.007451+0000","last_deep_scrub":"41'879","last_deep_scrub_stamp":"2024-04-26T18:32:00.007451+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.007451+0000","objects_scrubbed":66,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:14.053383+0000","scrub_duration":168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":61,"num_read_kb":0,"num_write":915,"num_write_kb":75562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":939865,"num_omap_keys":1573,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"41'2861","reported_seq":4612,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.374178+0000","last_change":"2024-04-26T18:32:03.374203+0000","last_active":"2024-04-26T18:32:03.374178+0000","last_peered":"2024-04-26T18:32:03.374178+0000","last_clean":"2024-04-26T18:32:03.374178+0000","last_became_active":"2024-04-26T17:58:08.742170+0000","last_became_peered":"2024-04-26T17:58:08.742170+0000","last_unstale":"2024-04-26T18:32:03.374178+0000","last_undegraded":"2024-04-26T18:32:03.374178+0000","last_fullsized":"2024-04-26T18:32:03.374178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2861","last_scrub_stamp":"2024-04-26T18:32:03.374101+0000","last_deep_scrub":"41'2861","last_deep_scrub_stamp":"2024-04-26T18:32:03.374101+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.374101+0000","objects_scrubbed":1183,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:20.611585+0000","scrub_duration":476,"objects_trimmed":0,"snaptrim_duration":0.181349811,"stat_sum":{"num_bytes":38568471,"num_objects":1183,"num_object_clones":549,"num_object_copies":4732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1183,"num_whiteouts":549,"num_read":153,"num_read_kb":161622,"num_write":2358,"num_write_kb":47514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"41'645","reported_seq":2736,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.630346+0000","last_change":"2024-04-26T18:32:04.630371+0000","last_active":"2024-04-26T18:32:04.630346+0000","last_peered":"2024-04-26T18:32:04.630346+0000","last_clean":"2024-04-26T18:32:04.630346+0000","last_became_active":"2024-04-26T17:58:04.713612+0000","last_became_peered":"2024-04-26T17:58:04.713612+0000","last_unstale":"2024-04-26T18:32:04.630346+0000","last_undegraded":"2024-04-26T18:32:04.630346+0000","last_fullsized":"2024-04-26T18:32:04.630346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'645","last_scrub_stamp":"2024-04-26T18:32:04.630289+0000","last_deep_scrub":"41'645","last_deep_scrub_stamp":"2024-04-26T18:32:04.630289+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.630289+0000","objects_scrubbed":50,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:19.277881+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.217975578,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"41'1538","reported_seq":1620,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.120232+0000","last_change":"2024-04-26T18:32:03.120264+0000","last_active":"2024-04-26T18:32:03.120232+0000","last_peered":"2024-04-26T18:32:03.120232+0000","last_clean":"2024-04-26T18:32:03.120232+0000","last_became_active":"2024-04-26T17:58:03.723056+0000","last_became_peered":"2024-04-26T17:58:03.723056+0000","last_unstale":"2024-04-26T18:32:03.120232+0000","last_undegraded":"2024-04-26T18:32:03.120232+0000","last_fullsized":"2024-04-26T18:32:03.120232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1538","last_scrub_stamp":"2024-04-26T18:32:03.120167+0000","last_deep_scrub":"41'1538","last_deep_scrub_stamp":"2024-04-26T18:32:03.120167+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.120167+0000","objects_scrubbed":55,"log_size":1538,"log_dups_size":0,"ondisk_log_size":1538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:27.152021+0000","scrub_duration":85,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":3200,"num_write_kb":72387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":716310,"num_omap_keys":1028,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"41'2904","reported_seq":4663,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:15.017388+0000","last_change":"2024-04-26T18:32:15.017428+0000","last_active":"2024-04-26T18:32:15.017388+0000","last_peered":"2024-04-26T18:32:15.017388+0000","last_clean":"2024-04-26T18:32:15.017388+0000","last_became_active":"2024-04-26T17:58:08.745841+0000","last_became_peered":"2024-04-26T17:58:08.745841+0000","last_unstale":"2024-04-26T18:32:15.017388+0000","last_undegraded":"2024-04-26T18:32:15.017388+0000","last_fullsized":"2024-04-26T18:32:15.017388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2904","last_scrub_stamp":"2024-04-26T18:32:15.017307+0000","last_deep_scrub":"41'2904","last_deep_scrub_stamp":"2024-04-26T18:32:15.017307+0000","last_clean_scrub_stamp":"2024-04-26T18:32:15.017307+0000","objects_scrubbed":1224,"log_size":2904,"log_dups_size":0,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:58.447514+0000","scrub_duration":401,"objects_trimmed":0,"snaptrim_duration":0.23002119400000001,"stat_sum":{"num_bytes":32774060,"num_objects":1224,"num_object_clones":563,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1224,"num_whiteouts":563,"num_read":174,"num_read_kb":173649,"num_write":2397,"num_write_kb":37665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"41'667","reported_seq":2760,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.084511+0000","last_change":"2024-04-26T18:32:05.084538+0000","last_active":"2024-04-26T18:32:05.084511+0000","last_peered":"2024-04-26T18:32:05.084511+0000","last_clean":"2024-04-26T18:32:05.084511+0000","last_became_active":"2024-04-26T17:58:04.712376+0000","last_became_peered":"2024-04-26T17:58:04.712376+0000","last_unstale":"2024-04-26T18:32:05.084511+0000","last_undegraded":"2024-04-26T18:32:05.084511+0000","last_fullsized":"2024-04-26T18:32:05.084511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'667","last_scrub_stamp":"2024-04-26T18:32:05.084447+0000","last_deep_scrub":"41'667","last_deep_scrub_stamp":"2024-04-26T18:32:05.084447+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.084447+0000","objects_scrubbed":51,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:46.447182+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0.077215679999999995,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"41'852","reported_seq":935,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.760035+0000","last_change":"2024-04-26T18:32:01.760074+0000","last_active":"2024-04-26T18:32:01.760035+0000","last_peered":"2024-04-26T18:32:01.760035+0000","last_clean":"2024-04-26T18:32:01.760035+0000","last_became_active":"2024-04-26T17:58:03.718973+0000","last_became_peered":"2024-04-26T17:58:03.718973+0000","last_unstale":"2024-04-26T18:32:01.760035+0000","last_undegraded":"2024-04-26T18:32:01.760035+0000","last_fullsized":"2024-04-26T18:32:01.760035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'852","last_scrub_stamp":"2024-04-26T18:32:01.759971+0000","last_deep_scrub":"41'852","last_deep_scrub_stamp":"2024-04-26T18:32:01.759971+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.759971+0000","objects_scrubbed":64,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:06.107316+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":856,"num_write_kb":87605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":737100,"num_omap_keys":1125,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"41'2980","reported_seq":4703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.413169+0000","last_change":"2024-04-26T18:32:10.413203+0000","last_active":"2024-04-26T18:32:10.413169+0000","last_peered":"2024-04-26T18:32:10.413169+0000","last_clean":"2024-04-26T18:32:10.413169+0000","last_became_active":"2024-04-26T17:58:08.739935+0000","last_became_peered":"2024-04-26T17:58:08.739935+0000","last_unstale":"2024-04-26T18:32:10.413169+0000","last_undegraded":"2024-04-26T18:32:10.413169+0000","last_fullsized":"2024-04-26T18:32:10.413169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2980","last_scrub_stamp":"2024-04-26T18:32:10.413087+0000","last_deep_scrub":"41'2980","last_deep_scrub_stamp":"2024-04-26T18:32:10.413087+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.413087+0000","objects_scrubbed":1282,"log_size":2980,"log_dups_size":0,"ondisk_log_size":2980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:44.034661+0000","scrub_duration":580,"objects_trimmed":0,"snaptrim_duration":0.20617318100000001,"stat_sum":{"num_bytes":38568987,"num_objects":1282,"num_object_clones":600,"num_object_copies":5128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1282,"num_whiteouts":600,"num_read":173,"num_read_kb":195813,"num_write":2429,"num_write_kb":47342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"41'659","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.828245+0000","last_change":"2024-04-26T18:32:09.828290+0000","last_active":"2024-04-26T18:32:09.828245+0000","last_peered":"2024-04-26T18:32:09.828245+0000","last_clean":"2024-04-26T18:32:09.828245+0000","last_became_active":"2024-04-26T17:58:04.725930+0000","last_became_peered":"2024-04-26T17:58:04.725930+0000","last_unstale":"2024-04-26T18:32:09.828245+0000","last_undegraded":"2024-04-26T18:32:09.828245+0000","last_fullsized":"2024-04-26T18:32:09.828245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'659","last_scrub_stamp":"2024-04-26T18:32:09.828182+0000","last_deep_scrub":"41'659","last_deep_scrub_stamp":"2024-04-26T18:32:09.828182+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.828182+0000","objects_scrubbed":38,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:05.508126+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0.161265819,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"41'813","reported_seq":896,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.078583+0000","last_change":"2024-04-26T18:32:00.078624+0000","last_active":"2024-04-26T18:32:00.078583+0000","last_peered":"2024-04-26T18:32:00.078583+0000","last_clean":"2024-04-26T18:32:00.078583+0000","last_became_active":"2024-04-26T17:58:03.715948+0000","last_became_peered":"2024-04-26T17:58:03.715948+0000","last_unstale":"2024-04-26T18:32:00.078583+0000","last_undegraded":"2024-04-26T18:32:00.078583+0000","last_fullsized":"2024-04-26T18:32:00.078583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'813","last_scrub_stamp":"2024-04-26T18:32:00.078524+0000","last_deep_scrub":"41'813","last_deep_scrub_stamp":"2024-04-26T18:32:00.078524+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.078524+0000","objects_scrubbed":67,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:44.486095+0000","scrub_duration":113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":797,"num_write_kb":111877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":690144,"num_omap_keys":1125,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"41'2902","reported_seq":4673,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.568312+0000","last_change":"2024-04-26T18:32:11.568347+0000","last_active":"2024-04-26T18:32:11.568312+0000","last_peered":"2024-04-26T18:32:11.568312+0000","last_clean":"2024-04-26T18:32:11.568312+0000","last_became_active":"2024-04-26T17:58:08.740793+0000","last_became_peered":"2024-04-26T17:58:08.740793+0000","last_unstale":"2024-04-26T18:32:11.568312+0000","last_undegraded":"2024-04-26T18:32:11.568312+0000","last_fullsized":"2024-04-26T18:32:11.568312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2902","last_scrub_stamp":"2024-04-26T18:32:11.568229+0000","last_deep_scrub":"41'2902","last_deep_scrub_stamp":"2024-04-26T18:32:11.568229+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.568229+0000","objects_scrubbed":1258,"log_size":2902,"log_dups_size":0,"ondisk_log_size":2902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:51:54.151842+0000","scrub_duration":547,"objects_trimmed":0,"snaptrim_duration":0.077512545000000002,"stat_sum":{"num_bytes":51130541,"num_objects":1258,"num_object_clones":577,"num_object_copies":5032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1258,"num_whiteouts":577,"num_read":199,"num_read_kb":291004,"num_write":2373,"num_write_kb":60236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"41'665","reported_seq":2759,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.005783+0000","last_change":"2024-04-26T18:31:58.005832+0000","last_active":"2024-04-26T18:31:58.005783+0000","last_peered":"2024-04-26T18:31:58.005783+0000","last_clean":"2024-04-26T18:31:58.005783+0000","last_became_active":"2024-04-26T17:58:04.707754+0000","last_became_peered":"2024-04-26T17:58:04.707754+0000","last_unstale":"2024-04-26T18:31:58.005783+0000","last_undegraded":"2024-04-26T18:31:58.005783+0000","last_fullsized":"2024-04-26T18:31:58.005783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'665","last_scrub_stamp":"2024-04-26T18:31:58.005719+0000","last_deep_scrub":"41'665","last_deep_scrub_stamp":"2024-04-26T18:31:58.005719+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.005719+0000","objects_scrubbed":46,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:16:03.101467+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0.18566148499999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"41'584","reported_seq":666,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.942835+0000","last_change":"2024-04-26T18:32:00.942918+0000","last_active":"2024-04-26T18:32:00.942835+0000","last_peered":"2024-04-26T18:32:00.942835+0000","last_clean":"2024-04-26T18:32:00.942835+0000","last_became_active":"2024-04-26T17:58:03.711132+0000","last_became_peered":"2024-04-26T17:58:03.711132+0000","last_unstale":"2024-04-26T18:32:00.942835+0000","last_undegraded":"2024-04-26T18:32:00.942835+0000","last_fullsized":"2024-04-26T18:32:00.942835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'584","last_scrub_stamp":"2024-04-26T18:32:00.942765+0000","last_deep_scrub":"41'584","last_deep_scrub_stamp":"2024-04-26T18:32:00.942765+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.942765+0000","objects_scrubbed":46,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:32.515593+0000","scrub_duration":74,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":49,"num_read_kb":0,"num_write":583,"num_write_kb":83272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":607529,"num_omap_keys":867,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"41'2814","reported_seq":4514,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.431293+0000","last_change":"2024-04-26T18:32:09.431345+0000","last_active":"2024-04-26T18:32:09.431293+0000","last_peered":"2024-04-26T18:32:09.431293+0000","last_clean":"2024-04-26T18:32:09.431293+0000","last_became_active":"2024-04-26T17:58:08.739345+0000","last_became_peered":"2024-04-26T17:58:08.739345+0000","last_unstale":"2024-04-26T18:32:09.431293+0000","last_undegraded":"2024-04-26T18:32:09.431293+0000","last_fullsized":"2024-04-26T18:32:09.431293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2814","last_scrub_stamp":"2024-04-26T18:32:09.431175+0000","last_deep_scrub":"41'2814","last_deep_scrub_stamp":"2024-04-26T18:32:09.431175+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.431175+0000","objects_scrubbed":1207,"log_size":2814,"log_dups_size":0,"ondisk_log_size":2814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:20.143758+0000","scrub_duration":465,"objects_trimmed":0,"snaptrim_duration":0.077645753999999997,"stat_sum":{"num_bytes":21677192,"num_objects":1207,"num_object_clones":566,"num_object_copies":4828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1207,"num_whiteouts":566,"num_read":120,"num_read_kb":106865,"num_write":2295,"num_write_kb":28218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"41'683","reported_seq":2774,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.059308+0000","last_change":"2024-04-26T18:32:04.059308+0000","last_active":"2024-04-26T18:32:04.059308+0000","last_peered":"2024-04-26T18:32:04.059308+0000","last_clean":"2024-04-26T18:32:04.059308+0000","last_became_active":"2024-04-26T17:58:04.712156+0000","last_became_peered":"2024-04-26T17:58:04.712156+0000","last_unstale":"2024-04-26T18:32:04.059308+0000","last_undegraded":"2024-04-26T18:32:04.059308+0000","last_fullsized":"2024-04-26T18:32:04.059308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'683","last_scrub_stamp":"2024-04-26T18:32:04.059209+0000","last_deep_scrub":"41'683","last_deep_scrub_stamp":"2024-04-26T18:32:04.059209+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.059209+0000","objects_scrubbed":55,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:28.215239+0000","scrub_duration":66,"objects_trimmed":0,"snaptrim_duration":0.076659478000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'1679","reported_seq":2698,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.718441+0000","last_change":"2024-04-26T18:31:56.718491+0000","last_active":"2024-04-26T18:31:56.718441+0000","last_peered":"2024-04-26T18:31:56.718441+0000","last_clean":"2024-04-26T18:31:56.718441+0000","last_became_active":"2024-04-26T17:58:03.714110+0000","last_became_peered":"2024-04-26T17:58:03.714110+0000","last_unstale":"2024-04-26T18:31:56.718441+0000","last_undegraded":"2024-04-26T18:31:56.718441+0000","last_fullsized":"2024-04-26T18:31:56.718441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1679","last_scrub_stamp":"2024-04-26T18:31:56.718376+0000","last_deep_scrub":"41'1679","last_deep_scrub_stamp":"2024-04-26T18:31:56.718376+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.718376+0000","objects_scrubbed":61,"log_size":1679,"log_dups_size":0,"ondisk_log_size":1679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:01.847577+0000","scrub_duration":94,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":992,"num_read_kb":4725,"num_write":1685,"num_write_kb":100551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":733371,"num_omap_keys":1146,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"41'2764","reported_seq":4542,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.529368+0000","last_change":"2024-04-26T18:32:10.529429+0000","last_active":"2024-04-26T18:32:10.529368+0000","last_peered":"2024-04-26T18:32:10.529368+0000","last_clean":"2024-04-26T18:32:10.529368+0000","last_became_active":"2024-04-26T17:58:08.740971+0000","last_became_peered":"2024-04-26T17:58:08.740971+0000","last_unstale":"2024-04-26T18:32:10.529368+0000","last_undegraded":"2024-04-26T18:32:10.529368+0000","last_fullsized":"2024-04-26T18:32:10.529368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2764","last_scrub_stamp":"2024-04-26T18:32:10.529272+0000","last_deep_scrub":"41'2764","last_deep_scrub_stamp":"2024-04-26T18:32:10.529272+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.529272+0000","objects_scrubbed":1196,"log_size":2764,"log_dups_size":0,"ondisk_log_size":2764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:58.822475+0000","scrub_duration":519,"objects_trimmed":0,"snaptrim_duration":0.077766350999999997,"stat_sum":{"num_bytes":40144243,"num_objects":1196,"num_object_clones":556,"num_object_copies":4784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1196,"num_whiteouts":556,"num_read":189,"num_read_kb":267710,"num_write":2256,"num_write_kb":47769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"41'633","reported_seq":2726,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.728992+0000","last_change":"2024-04-26T18:31:59.729028+0000","last_active":"2024-04-26T18:31:59.728992+0000","last_peered":"2024-04-26T18:31:59.728992+0000","last_clean":"2024-04-26T18:31:59.728992+0000","last_became_active":"2024-04-26T17:58:04.710769+0000","last_became_peered":"2024-04-26T17:58:04.710769+0000","last_unstale":"2024-04-26T18:31:59.728992+0000","last_undegraded":"2024-04-26T18:31:59.728992+0000","last_fullsized":"2024-04-26T18:31:59.728992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'633","last_scrub_stamp":"2024-04-26T18:31:59.728932+0000","last_deep_scrub":"41'633","last_deep_scrub_stamp":"2024-04-26T18:31:59.728932+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.728932+0000","objects_scrubbed":42,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:33.068760+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.20174721700000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'711","reported_seq":794,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.725201+0000","last_change":"2024-04-26T18:32:03.725201+0000","last_active":"2024-04-26T18:32:03.725201+0000","last_peered":"2024-04-26T18:32:03.725201+0000","last_clean":"2024-04-26T18:32:03.725201+0000","last_became_active":"2024-04-26T17:58:03.719559+0000","last_became_peered":"2024-04-26T17:58:03.719559+0000","last_unstale":"2024-04-26T18:32:03.725201+0000","last_undegraded":"2024-04-26T18:32:03.725201+0000","last_fullsized":"2024-04-26T18:32:03.725201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'711","last_scrub_stamp":"2024-04-26T18:32:03.725104+0000","last_deep_scrub":"41'711","last_deep_scrub_stamp":"2024-04-26T18:32:03.725104+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.725104+0000","objects_scrubbed":44,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:54:02.282920+0000","scrub_duration":86,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":715,"num_write_kb":79339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":638987,"num_omap_keys":977,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"41'2915","reported_seq":4654,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.230135+0000","last_change":"2024-04-26T18:32:07.230229+0000","last_active":"2024-04-26T18:32:07.230135+0000","last_peered":"2024-04-26T18:32:07.230135+0000","last_clean":"2024-04-26T18:32:07.230135+0000","last_became_active":"2024-04-26T17:58:08.733969+0000","last_became_peered":"2024-04-26T17:58:08.733969+0000","last_unstale":"2024-04-26T18:32:07.230135+0000","last_undegraded":"2024-04-26T18:32:07.230135+0000","last_fullsized":"2024-04-26T18:32:07.230135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2915","last_scrub_stamp":"2024-04-26T18:32:07.230056+0000","last_deep_scrub":"41'2915","last_deep_scrub_stamp":"2024-04-26T18:32:07.230056+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.230056+0000","objects_scrubbed":1212,"log_size":2915,"log_dups_size":0,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:49.885460+0000","scrub_duration":438,"objects_trimmed":0,"snaptrim_duration":0.20190264199999999,"stat_sum":{"num_bytes":26615609,"num_objects":1212,"num_object_clones":560,"num_object_copies":4848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1212,"num_whiteouts":560,"num_read":154,"num_read_kb":128765,"num_write":2402,"num_write_kb":29722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"41'680","reported_seq":2772,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.737983+0000","last_change":"2024-04-26T18:32:08.738025+0000","last_active":"2024-04-26T18:32:08.737983+0000","last_peered":"2024-04-26T18:32:08.737983+0000","last_clean":"2024-04-26T18:32:08.737983+0000","last_became_active":"2024-04-26T17:58:04.726898+0000","last_became_peered":"2024-04-26T17:58:04.726898+0000","last_unstale":"2024-04-26T18:32:08.737983+0000","last_undegraded":"2024-04-26T18:32:08.737983+0000","last_fullsized":"2024-04-26T18:32:08.737983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'680","last_scrub_stamp":"2024-04-26T18:32:08.737892+0000","last_deep_scrub":"41'680","last_deep_scrub_stamp":"2024-04-26T18:32:08.737892+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.737892+0000","objects_scrubbed":51,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:06.001662+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0.22655562100000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'1656","reported_seq":1739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.946957+0000","last_change":"2024-04-26T18:32:02.947017+0000","last_active":"2024-04-26T18:32:02.946957+0000","last_peered":"2024-04-26T18:32:02.946957+0000","last_clean":"2024-04-26T18:32:02.946957+0000","last_became_active":"2024-04-26T17:58:03.714495+0000","last_became_peered":"2024-04-26T17:58:03.714495+0000","last_unstale":"2024-04-26T18:32:02.946957+0000","last_undegraded":"2024-04-26T18:32:02.946957+0000","last_fullsized":"2024-04-26T18:32:02.946957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1656","last_scrub_stamp":"2024-04-26T18:32:02.946864+0000","last_deep_scrub":"41'1656","last_deep_scrub_stamp":"2024-04-26T18:32:02.946864+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.946864+0000","objects_scrubbed":61,"log_size":1656,"log_dups_size":0,"ondisk_log_size":1656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:55.092910+0000","scrub_duration":80,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":64,"num_read_kb":0,"num_write":1680,"num_write_kb":72101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":996664,"num_omap_keys":1524,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"41'119","reported_seq":240,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.651093+0000","last_change":"2024-04-26T18:31:59.651093+0000","last_active":"2024-04-26T18:31:59.651093+0000","last_peered":"2024-04-26T18:31:59.651093+0000","last_clean":"2024-04-26T18:31:59.651093+0000","last_became_active":"2024-04-26T17:57:54.435829+0000","last_became_peered":"2024-04-26T17:57:54.435829+0000","last_unstale":"2024-04-26T18:31:59.651093+0000","last_undegraded":"2024-04-26T18:31:59.651093+0000","last_fullsized":"2024-04-26T18:31:59.651093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2024-04-26T18:31:59.650979+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2024-04-26T18:31:59.650979+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.650979+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:02.282951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"41'3034","reported_seq":4739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.352413+0000","last_change":"2024-04-26T18:32:10.352491+0000","last_active":"2024-04-26T18:32:10.352413+0000","last_peered":"2024-04-26T18:32:10.352413+0000","last_clean":"2024-04-26T18:32:10.352413+0000","last_became_active":"2024-04-26T17:58:08.736694+0000","last_became_peered":"2024-04-26T17:58:08.736694+0000","last_unstale":"2024-04-26T18:32:10.352413+0000","last_undegraded":"2024-04-26T18:32:10.352413+0000","last_fullsized":"2024-04-26T18:32:10.352413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3034","last_scrub_stamp":"2024-04-26T18:32:10.352285+0000","last_deep_scrub":"41'3034","last_deep_scrub_stamp":"2024-04-26T18:32:10.352285+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.352285+0000","objects_scrubbed":1270,"log_size":3034,"log_dups_size":0,"ondisk_log_size":3034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:40.086719+0000","scrub_duration":587,"objects_trimmed":0,"snaptrim_duration":0.101669149,"stat_sum":{"num_bytes":43937728,"num_objects":1270,"num_object_clones":639,"num_object_copies":5080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1270,"num_whiteouts":551,"num_read":195,"num_read_kb":160663,"num_write":2447,"num_write_kb":52378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"41'662","reported_seq":2752,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:14.493652+0000","last_change":"2024-04-26T18:32:14.493700+0000","last_active":"2024-04-26T18:32:14.493652+0000","last_peered":"2024-04-26T18:32:14.493652+0000","last_clean":"2024-04-26T18:32:14.493652+0000","last_became_active":"2024-04-26T17:58:04.724521+0000","last_became_peered":"2024-04-26T17:58:04.724521+0000","last_unstale":"2024-04-26T18:32:14.493652+0000","last_undegraded":"2024-04-26T18:32:14.493652+0000","last_fullsized":"2024-04-26T18:32:14.493652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'662","last_scrub_stamp":"2024-04-26T18:32:14.493554+0000","last_deep_scrub":"41'662","last_deep_scrub_stamp":"2024-04-26T18:32:14.493554+0000","last_clean_scrub_stamp":"2024-04-26T18:32:14.493554+0000","objects_scrubbed":53,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:55:51.116601+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.10552916,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":15,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"41'573","reported_seq":654,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.642649+0000","last_change":"2024-04-26T18:31:57.642674+0000","last_active":"2024-04-26T18:31:57.642649+0000","last_peered":"2024-04-26T18:31:57.642649+0000","last_clean":"2024-04-26T18:31:57.642649+0000","last_became_active":"2024-04-26T17:58:03.714122+0000","last_became_peered":"2024-04-26T17:58:03.714122+0000","last_unstale":"2024-04-26T18:31:57.642649+0000","last_undegraded":"2024-04-26T18:31:57.642649+0000","last_fullsized":"2024-04-26T18:31:57.642649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'573","last_scrub_stamp":"2024-04-26T18:31:57.642571+0000","last_deep_scrub":"41'573","last_deep_scrub_stamp":"2024-04-26T18:31:57.642571+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.642571+0000","objects_scrubbed":31,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:57.521227+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":567,"num_write_kb":79001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":484428,"num_omap_keys":686,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"41'2911","reported_seq":4684,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.308824+0000","last_change":"2024-04-26T18:32:09.308855+0000","last_active":"2024-04-26T18:32:09.308824+0000","last_peered":"2024-04-26T18:32:09.308824+0000","last_clean":"2024-04-26T18:32:09.308824+0000","last_became_active":"2024-04-26T17:58:08.734593+0000","last_became_peered":"2024-04-26T17:58:08.734593+0000","last_unstale":"2024-04-26T18:32:09.308824+0000","last_undegraded":"2024-04-26T18:32:09.308824+0000","last_fullsized":"2024-04-26T18:32:09.308824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2911","last_scrub_stamp":"2024-04-26T18:32:09.308740+0000","last_deep_scrub":"41'2911","last_deep_scrub_stamp":"2024-04-26T18:32:09.308740+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.308740+0000","objects_scrubbed":1233,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:22.674322+0000","scrub_duration":538,"objects_trimmed":0,"snaptrim_duration":0.102636063,"stat_sum":{"num_bytes":37322430,"num_objects":1233,"num_object_clones":576,"num_object_copies":4932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1233,"num_whiteouts":576,"num_read":202,"num_read_kb":211285,"num_write":2388,"num_write_kb":48792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"41'658","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.783898+0000","last_change":"2024-04-26T18:32:10.783949+0000","last_active":"2024-04-26T18:32:10.783898+0000","last_peered":"2024-04-26T18:32:10.783898+0000","last_clean":"2024-04-26T18:32:10.783898+0000","last_became_active":"2024-04-26T17:58:04.726512+0000","last_became_peered":"2024-04-26T17:58:04.726512+0000","last_unstale":"2024-04-26T18:32:10.783898+0000","last_undegraded":"2024-04-26T18:32:10.783898+0000","last_fullsized":"2024-04-26T18:32:10.783898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'658","last_scrub_stamp":"2024-04-26T18:32:10.783838+0000","last_deep_scrub":"41'658","last_deep_scrub_stamp":"2024-04-26T18:32:10.783838+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.783838+0000","objects_scrubbed":45,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:26.666904+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0.16359686500000001,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":7,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"41'1363","reported_seq":1445,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.057394+0000","last_change":"2024-04-26T18:31:59.057432+0000","last_active":"2024-04-26T18:31:59.057394+0000","last_peered":"2024-04-26T18:31:59.057394+0000","last_clean":"2024-04-26T18:31:59.057394+0000","last_became_active":"2024-04-26T17:58:03.715251+0000","last_became_peered":"2024-04-26T17:58:03.715251+0000","last_unstale":"2024-04-26T18:31:59.057394+0000","last_undegraded":"2024-04-26T18:31:59.057394+0000","last_fullsized":"2024-04-26T18:31:59.057394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1363","last_scrub_stamp":"2024-04-26T18:31:59.057330+0000","last_deep_scrub":"41'1363","last_deep_scrub_stamp":"2024-04-26T18:31:59.057330+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.057330+0000","objects_scrubbed":66,"log_size":1363,"log_dups_size":0,"ondisk_log_size":1363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:24.994408+0000","scrub_duration":129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29364754,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":1371,"num_write_kb":104375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680344,"num_omap_keys":1110,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"41'2892","reported_seq":4661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.387811+0000","last_change":"2024-04-26T18:32:11.387849+0000","last_active":"2024-04-26T18:32:11.387811+0000","last_peered":"2024-04-26T18:32:11.387811+0000","last_clean":"2024-04-26T18:32:11.387811+0000","last_became_active":"2024-04-26T17:58:08.747738+0000","last_became_peered":"2024-04-26T17:58:08.747738+0000","last_unstale":"2024-04-26T18:32:11.387811+0000","last_undegraded":"2024-04-26T18:32:11.387811+0000","last_fullsized":"2024-04-26T18:32:11.387811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2892","last_scrub_stamp":"2024-04-26T18:32:11.387737+0000","last_deep_scrub":"41'2892","last_deep_scrub_stamp":"2024-04-26T18:32:11.387737+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.387737+0000","objects_scrubbed":1246,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:17.607606+0000","scrub_duration":548,"objects_trimmed":0,"snaptrim_duration":0.20706662200000001,"stat_sum":{"num_bytes":43474396,"num_objects":1246,"num_object_clones":573,"num_object_copies":4984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1246,"num_whiteouts":573,"num_read":195,"num_read_kb":270204,"num_write":2374,"num_write_kb":47127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"41'650","reported_seq":2742,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:10.488019+0000","last_change":"2024-04-26T18:32:10.488093+0000","last_active":"2024-04-26T18:32:10.488019+0000","last_peered":"2024-04-26T18:32:10.488019+0000","last_clean":"2024-04-26T18:32:10.488019+0000","last_became_active":"2024-04-26T17:58:04.716644+0000","last_became_peered":"2024-04-26T17:58:04.716644+0000","last_unstale":"2024-04-26T18:32:10.488019+0000","last_undegraded":"2024-04-26T18:32:10.488019+0000","last_fullsized":"2024-04-26T18:32:10.488019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'650","last_scrub_stamp":"2024-04-26T18:32:10.487923+0000","last_deep_scrub":"41'650","last_deep_scrub_stamp":"2024-04-26T18:32:10.487923+0000","last_clean_scrub_stamp":"2024-04-26T18:32:10.487923+0000","objects_scrubbed":48,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:39.479283+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0.104614815,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"41'754","reported_seq":836,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.688281+0000","last_change":"2024-04-26T18:31:58.688311+0000","last_active":"2024-04-26T18:31:58.688281+0000","last_peered":"2024-04-26T18:31:58.688281+0000","last_clean":"2024-04-26T18:31:58.688281+0000","last_became_active":"2024-04-26T17:58:03.714805+0000","last_became_peered":"2024-04-26T17:58:03.714805+0000","last_unstale":"2024-04-26T18:31:58.688281+0000","last_undegraded":"2024-04-26T18:31:58.688281+0000","last_fullsized":"2024-04-26T18:31:58.688281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'754","last_scrub_stamp":"2024-04-26T18:31:58.688218+0000","last_deep_scrub":"41'754","last_deep_scrub_stamp":"2024-04-26T18:31:58.688218+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.688218+0000","objects_scrubbed":56,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:36.096935+0000","scrub_duration":68,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":65,"num_read_kb":0,"num_write":758,"num_write_kb":95614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":774758,"num_omap_keys":1278,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"41'2925","reported_seq":4732,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:15.226242+0000","last_change":"2024-04-26T18:32:15.226280+0000","last_active":"2024-04-26T18:32:15.226242+0000","last_peered":"2024-04-26T18:32:15.226242+0000","last_clean":"2024-04-26T18:32:15.226242+0000","last_became_active":"2024-04-26T17:58:08.736881+0000","last_became_peered":"2024-04-26T17:58:08.736881+0000","last_unstale":"2024-04-26T18:32:15.226242+0000","last_undegraded":"2024-04-26T18:32:15.226242+0000","last_fullsized":"2024-04-26T18:32:15.226242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2925","last_scrub_stamp":"2024-04-26T18:32:15.226161+0000","last_deep_scrub":"41'2925","last_deep_scrub_stamp":"2024-04-26T18:32:15.226161+0000","last_clean_scrub_stamp":"2024-04-26T18:32:15.226161+0000","objects_scrubbed":1218,"log_size":2925,"log_dups_size":0,"ondisk_log_size":2925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:37.074277+0000","scrub_duration":437,"objects_trimmed":0,"snaptrim_duration":0.16179385399999999,"stat_sum":{"num_bytes":31406117,"num_objects":1218,"num_object_clones":563,"num_object_copies":4872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":563,"num_read":224,"num_read_kb":160685,"num_write":2420,"num_write_kb":43855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"41'643","reported_seq":2739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.520153+0000","last_change":"2024-04-26T18:32:09.520190+0000","last_active":"2024-04-26T18:32:09.520153+0000","last_peered":"2024-04-26T18:32:09.520153+0000","last_clean":"2024-04-26T18:32:09.520153+0000","last_became_active":"2024-04-26T17:58:04.716574+0000","last_became_peered":"2024-04-26T17:58:04.716574+0000","last_unstale":"2024-04-26T18:32:09.520153+0000","last_undegraded":"2024-04-26T18:32:09.520153+0000","last_fullsized":"2024-04-26T18:32:09.520153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'643","last_scrub_stamp":"2024-04-26T18:32:09.520085+0000","last_deep_scrub":"41'643","last_deep_scrub_stamp":"2024-04-26T18:32:09.520085+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.520085+0000","objects_scrubbed":39,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:57.139329+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.103300084,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":8,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'779","reported_seq":861,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.079795+0000","last_change":"2024-04-26T18:31:57.079836+0000","last_active":"2024-04-26T18:31:57.079795+0000","last_peered":"2024-04-26T18:31:57.079795+0000","last_clean":"2024-04-26T18:31:57.079795+0000","last_became_active":"2024-04-26T17:58:03.715937+0000","last_became_peered":"2024-04-26T17:58:03.715937+0000","last_unstale":"2024-04-26T18:31:57.079795+0000","last_undegraded":"2024-04-26T18:31:57.079795+0000","last_fullsized":"2024-04-26T18:31:57.079795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'779","last_scrub_stamp":"2024-04-26T18:31:57.079725+0000","last_deep_scrub":"41'779","last_deep_scrub_stamp":"2024-04-26T18:31:57.079725+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.079725+0000","objects_scrubbed":63,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:51.311090+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165846,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":771,"num_write_kb":75142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":654528,"num_omap_keys":1052,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"41'2803","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.367624+0000","last_change":"2024-04-26T18:32:09.367657+0000","last_active":"2024-04-26T18:32:09.367624+0000","last_peered":"2024-04-26T18:32:09.367624+0000","last_clean":"2024-04-26T18:32:09.367624+0000","last_became_active":"2024-04-26T17:58:08.746817+0000","last_became_peered":"2024-04-26T17:58:08.746817+0000","last_unstale":"2024-04-26T18:32:09.367624+0000","last_undegraded":"2024-04-26T18:32:09.367624+0000","last_fullsized":"2024-04-26T18:32:09.367624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2803","last_scrub_stamp":"2024-04-26T18:32:09.367536+0000","last_deep_scrub":"41'2803","last_deep_scrub_stamp":"2024-04-26T18:32:09.367536+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.367536+0000","objects_scrubbed":1210,"log_size":2803,"log_dups_size":0,"ondisk_log_size":2803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:23.366496+0000","scrub_duration":507,"objects_trimmed":0,"snaptrim_duration":0.18140468300000001,"stat_sum":{"num_bytes":44194819,"num_objects":1210,"num_object_clones":561,"num_object_copies":4840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1210,"num_whiteouts":561,"num_read":248,"num_read_kb":269492,"num_write":2276,"num_write_kb":51233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"41'698","reported_seq":2787,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.551879+0000","last_change":"2024-04-26T18:32:07.551953+0000","last_active":"2024-04-26T18:32:07.551879+0000","last_peered":"2024-04-26T18:32:07.551879+0000","last_clean":"2024-04-26T18:32:07.551879+0000","last_became_active":"2024-04-26T17:58:04.713496+0000","last_became_peered":"2024-04-26T17:58:04.713496+0000","last_unstale":"2024-04-26T18:32:07.551879+0000","last_undegraded":"2024-04-26T18:32:07.551879+0000","last_fullsized":"2024-04-26T18:32:07.551879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'698","last_scrub_stamp":"2024-04-26T18:32:07.551802+0000","last_deep_scrub":"41'698","last_deep_scrub_stamp":"2024-04-26T18:32:07.551802+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.551802+0000","objects_scrubbed":49,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:22.556878+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.101409261,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":14,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"41'903","reported_seq":984,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:55.745719+0000","last_change":"2024-04-26T18:31:55.745767+0000","last_active":"2024-04-26T18:31:55.745719+0000","last_peered":"2024-04-26T18:31:55.745719+0000","last_clean":"2024-04-26T18:31:55.745719+0000","last_became_active":"2024-04-26T17:58:03.711285+0000","last_became_peered":"2024-04-26T17:58:03.711285+0000","last_unstale":"2024-04-26T18:31:55.745719+0000","last_undegraded":"2024-04-26T18:31:55.745719+0000","last_fullsized":"2024-04-26T18:31:55.745719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'903","last_scrub_stamp":"2024-04-26T18:31:55.745640+0000","last_deep_scrub":"41'903","last_deep_scrub_stamp":"2024-04-26T18:31:55.745640+0000","last_clean_scrub_stamp":"2024-04-26T18:31:55.745640+0000","objects_scrubbed":60,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:28.794909+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":83,"num_read_kb":0,"num_write":946,"num_write_kb":79922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1081476,"num_omap_keys":1574,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"41'2759","reported_seq":4503,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.263934+0000","last_change":"2024-04-26T18:32:08.263969+0000","last_active":"2024-04-26T18:32:08.263934+0000","last_peered":"2024-04-26T18:32:08.263934+0000","last_clean":"2024-04-26T18:32:08.263934+0000","last_became_active":"2024-04-26T17:58:08.738796+0000","last_became_peered":"2024-04-26T17:58:08.738796+0000","last_unstale":"2024-04-26T18:32:08.263934+0000","last_undegraded":"2024-04-26T18:32:08.263934+0000","last_fullsized":"2024-04-26T18:32:08.263934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2759","last_scrub_stamp":"2024-04-26T18:32:08.263850+0000","last_deep_scrub":"41'2759","last_deep_scrub_stamp":"2024-04-26T18:32:08.263850+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.263850+0000","objects_scrubbed":1186,"log_size":2759,"log_dups_size":0,"ondisk_log_size":2759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:08.193743+0000","scrub_duration":506,"objects_trimmed":0,"snaptrim_duration":0.19926888800000001,"stat_sum":{"num_bytes":38301955,"num_objects":1186,"num_object_clones":557,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":557,"num_read":157,"num_read_kb":146023,"num_write":2246,"num_write_kb":42726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'638","reported_seq":2730,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.851465+0000","last_change":"2024-04-26T18:32:04.851550+0000","last_active":"2024-04-26T18:32:04.851465+0000","last_peered":"2024-04-26T18:32:04.851465+0000","last_clean":"2024-04-26T18:32:04.851465+0000","last_became_active":"2024-04-26T17:58:04.716691+0000","last_became_peered":"2024-04-26T17:58:04.716691+0000","last_unstale":"2024-04-26T18:32:04.851465+0000","last_undegraded":"2024-04-26T18:32:04.851465+0000","last_fullsized":"2024-04-26T18:32:04.851465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'638","last_scrub_stamp":"2024-04-26T18:32:04.851393+0000","last_deep_scrub":"41'638","last_deep_scrub_stamp":"2024-04-26T18:32:04.851393+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.851393+0000","objects_scrubbed":41,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:03.575646+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0.099299311000000001,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"41'644","reported_seq":725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.950023+0000","last_change":"2024-04-26T18:31:58.950051+0000","last_active":"2024-04-26T18:31:58.950023+0000","last_peered":"2024-04-26T18:31:58.950023+0000","last_clean":"2024-04-26T18:31:58.950023+0000","last_became_active":"2024-04-26T17:58:03.722651+0000","last_became_peered":"2024-04-26T17:58:03.722651+0000","last_unstale":"2024-04-26T18:31:58.950023+0000","last_undegraded":"2024-04-26T18:31:58.950023+0000","last_fullsized":"2024-04-26T18:31:58.950023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'644","last_scrub_stamp":"2024-04-26T18:31:58.949961+0000","last_deep_scrub":"41'644","last_deep_scrub_stamp":"2024-04-26T18:31:58.949961+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.949961+0000","objects_scrubbed":54,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:01.897359+0000","scrub_duration":118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":625,"num_write_kb":74929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":589174,"num_omap_keys":906,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"41'3058","reported_seq":4787,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.180291+0000","last_change":"2024-04-26T18:32:12.180337+0000","last_active":"2024-04-26T18:32:12.180291+0000","last_peered":"2024-04-26T18:32:12.180291+0000","last_clean":"2024-04-26T18:32:12.180291+0000","last_became_active":"2024-04-26T17:58:08.742425+0000","last_became_peered":"2024-04-26T17:58:08.742425+0000","last_unstale":"2024-04-26T18:32:12.180291+0000","last_undegraded":"2024-04-26T18:32:12.180291+0000","last_fullsized":"2024-04-26T18:32:12.180291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3058","last_scrub_stamp":"2024-04-26T18:32:12.180190+0000","last_deep_scrub":"41'3058","last_deep_scrub_stamp":"2024-04-26T18:32:12.180190+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.180190+0000","objects_scrubbed":1342,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:13.914682+0000","scrub_duration":494,"objects_trimmed":0,"snaptrim_duration":0.21925704200000001,"stat_sum":{"num_bytes":62040101,"num_objects":1342,"num_object_clones":661,"num_object_copies":5368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1342,"num_whiteouts":573,"num_read":241,"num_read_kb":351124,"num_write":2466,"num_write_kb":72826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"41'681","reported_seq":2757,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.666324+0000","last_change":"2024-04-26T18:32:02.666418+0000","last_active":"2024-04-26T18:32:02.666324+0000","last_peered":"2024-04-26T18:32:02.666324+0000","last_clean":"2024-04-26T18:32:02.666324+0000","last_became_active":"2024-04-26T17:58:46.842960+0000","last_became_peered":"2024-04-26T17:58:46.842960+0000","last_unstale":"2024-04-26T18:32:02.666324+0000","last_undegraded":"2024-04-26T18:32:02.666324+0000","last_fullsized":"2024-04-26T18:32:02.666324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'681","last_scrub_stamp":"2024-04-26T18:32:02.666251+0000","last_deep_scrub":"41'681","last_deep_scrub_stamp":"2024-04-26T18:32:02.666251+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.666251+0000","objects_scrubbed":47,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:08.313470+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0.029754315999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"41'580","reported_seq":661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.963263+0000","last_change":"2024-04-26T18:32:01.963313+0000","last_active":"2024-04-26T18:32:01.963263+0000","last_peered":"2024-04-26T18:32:01.963263+0000","last_clean":"2024-04-26T18:32:01.963263+0000","last_became_active":"2024-04-26T17:58:03.713116+0000","last_became_peered":"2024-04-26T17:58:03.713116+0000","last_unstale":"2024-04-26T18:32:01.963263+0000","last_undegraded":"2024-04-26T18:32:01.963263+0000","last_fullsized":"2024-04-26T18:32:01.963263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'580","last_scrub_stamp":"2024-04-26T18:32:01.963197+0000","last_deep_scrub":"41'580","last_deep_scrub_stamp":"2024-04-26T18:32:01.963197+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.963197+0000","objects_scrubbed":58,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:05.206947+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":52,"num_read_kb":0,"num_write":593,"num_write_kb":58770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":742892,"num_omap_keys":1212,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"41'2848","reported_seq":4611,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:16.030952+0000","last_change":"2024-04-26T18:32:16.030995+0000","last_active":"2024-04-26T18:32:16.030952+0000","last_peered":"2024-04-26T18:32:16.030952+0000","last_clean":"2024-04-26T18:32:16.030952+0000","last_became_active":"2024-04-26T17:58:46.841624+0000","last_became_peered":"2024-04-26T17:58:46.841624+0000","last_unstale":"2024-04-26T18:32:16.030952+0000","last_undegraded":"2024-04-26T18:32:16.030952+0000","last_fullsized":"2024-04-26T18:32:16.030952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2848","last_scrub_stamp":"2024-04-26T18:32:16.030853+0000","last_deep_scrub":"41'2848","last_deep_scrub_stamp":"2024-04-26T18:32:16.030853+0000","last_clean_scrub_stamp":"2024-04-26T18:32:16.030853+0000","objects_scrubbed":1250,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:01.201642+0000","scrub_duration":395,"objects_trimmed":0,"snaptrim_duration":0.218331676,"stat_sum":{"num_bytes":37909871,"num_objects":1250,"num_object_clones":586,"num_object_copies":5000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1250,"num_whiteouts":586,"num_read":195,"num_read_kb":261621,"num_write":2312,"num_write_kb":56158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"41'642","reported_seq":2733,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.734314+0000","last_change":"2024-04-26T18:31:57.734339+0000","last_active":"2024-04-26T18:31:57.734314+0000","last_peered":"2024-04-26T18:31:57.734314+0000","last_clean":"2024-04-26T18:31:57.734314+0000","last_became_active":"2024-04-26T17:58:04.705691+0000","last_became_peered":"2024-04-26T17:58:04.705691+0000","last_unstale":"2024-04-26T18:31:57.734314+0000","last_undegraded":"2024-04-26T18:31:57.734314+0000","last_fullsized":"2024-04-26T18:31:57.734314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'642","last_scrub_stamp":"2024-04-26T18:31:57.734249+0000","last_deep_scrub":"41'642","last_deep_scrub_stamp":"2024-04-26T18:31:57.734249+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.734249+0000","objects_scrubbed":50,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:47.264757+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0.185065913,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"41'495","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:55.826400+0000","last_change":"2024-04-26T18:31:55.826447+0000","last_active":"2024-04-26T18:31:55.826400+0000","last_peered":"2024-04-26T18:31:55.826400+0000","last_clean":"2024-04-26T18:31:55.826400+0000","last_became_active":"2024-04-26T17:58:03.715377+0000","last_became_peered":"2024-04-26T17:58:03.715377+0000","last_unstale":"2024-04-26T18:31:55.826400+0000","last_undegraded":"2024-04-26T18:31:55.826400+0000","last_fullsized":"2024-04-26T18:31:55.826400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'495","last_scrub_stamp":"2024-04-26T18:31:55.826334+0000","last_deep_scrub":"41'495","last_deep_scrub_stamp":"2024-04-26T18:31:55.826334+0000","last_clean_scrub_stamp":"2024-04-26T18:31:55.826334+0000","objects_scrubbed":69,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:28.396193+0000","scrub_duration":84,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971554,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":485,"num_write_kb":79130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":608469,"num_omap_keys":1004,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"41'2856","reported_seq":4585,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:14.184356+0000","last_change":"2024-04-26T18:32:14.184393+0000","last_active":"2024-04-26T18:32:14.184356+0000","last_peered":"2024-04-26T18:32:14.184356+0000","last_clean":"2024-04-26T18:32:14.184356+0000","last_became_active":"2024-04-26T17:58:08.739171+0000","last_became_peered":"2024-04-26T17:58:08.739171+0000","last_unstale":"2024-04-26T18:32:14.184356+0000","last_undegraded":"2024-04-26T18:32:14.184356+0000","last_fullsized":"2024-04-26T18:32:14.184356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2856","last_scrub_stamp":"2024-04-26T18:32:14.184270+0000","last_deep_scrub":"41'2856","last_deep_scrub_stamp":"2024-04-26T18:32:14.184270+0000","last_clean_scrub_stamp":"2024-04-26T18:32:14.184270+0000","objects_scrubbed":1264,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:33.790372+0000","scrub_duration":431,"objects_trimmed":0,"snaptrim_duration":0.16361857299999999,"stat_sum":{"num_bytes":26393816,"num_objects":1264,"num_object_clones":588,"num_object_copies":5056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1264,"num_whiteouts":588,"num_read":170,"num_read_kb":98987,"num_write":2329,"num_write_kb":28734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"41'677","reported_seq":2763,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.465156+0000","last_change":"2024-04-26T18:32:11.465213+0000","last_active":"2024-04-26T18:32:11.465156+0000","last_peered":"2024-04-26T18:32:11.465156+0000","last_clean":"2024-04-26T18:32:11.465156+0000","last_became_active":"2024-04-26T17:58:04.719117+0000","last_became_peered":"2024-04-26T17:58:04.719117+0000","last_unstale":"2024-04-26T18:32:11.465156+0000","last_undegraded":"2024-04-26T18:32:11.465156+0000","last_fullsized":"2024-04-26T18:32:11.465156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'677","last_scrub_stamp":"2024-04-26T18:32:11.465055+0000","last_deep_scrub":"41'677","last_deep_scrub_stamp":"2024-04-26T18:32:11.465055+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.465055+0000","objects_scrubbed":59,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:21.674455+0000","scrub_duration":58,"objects_trimmed":0,"snaptrim_duration":0.10539311699999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"41'898","reported_seq":980,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.871764+0000","last_change":"2024-04-26T18:32:01.871793+0000","last_active":"2024-04-26T18:32:01.871764+0000","last_peered":"2024-04-26T18:32:01.871764+0000","last_clean":"2024-04-26T18:32:01.871764+0000","last_became_active":"2024-04-26T17:58:03.723767+0000","last_became_peered":"2024-04-26T17:58:03.723767+0000","last_unstale":"2024-04-26T18:32:01.871764+0000","last_undegraded":"2024-04-26T18:32:01.871764+0000","last_fullsized":"2024-04-26T18:32:01.871764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'898","last_scrub_stamp":"2024-04-26T18:32:01.871705+0000","last_deep_scrub":"41'898","last_deep_scrub_stamp":"2024-04-26T18:32:01.871705+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.871705+0000","objects_scrubbed":81,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:33.288361+0000","scrub_duration":88,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777888,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":70,"num_read_kb":0,"num_write":938,"num_write_kb":112536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":73,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1018873,"num_omap_keys":1685,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"41'2763","reported_seq":4531,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.433456+0000","last_change":"2024-04-26T18:32:08.433508+0000","last_active":"2024-04-26T18:32:08.433456+0000","last_peered":"2024-04-26T18:32:08.433456+0000","last_clean":"2024-04-26T18:32:08.433456+0000","last_became_active":"2024-04-26T17:58:08.735562+0000","last_became_peered":"2024-04-26T17:58:08.735562+0000","last_unstale":"2024-04-26T18:32:08.433456+0000","last_undegraded":"2024-04-26T18:32:08.433456+0000","last_fullsized":"2024-04-26T18:32:08.433456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2763","last_scrub_stamp":"2024-04-26T18:32:08.433375+0000","last_deep_scrub":"41'2763","last_deep_scrub_stamp":"2024-04-26T18:32:08.433375+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.433375+0000","objects_scrubbed":1149,"log_size":2763,"log_dups_size":0,"ondisk_log_size":2763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:22.775332+0000","scrub_duration":480,"objects_trimmed":0,"snaptrim_duration":0.076321086999999996,"stat_sum":{"num_bytes":36028739,"num_objects":1149,"num_object_clones":527,"num_object_copies":4596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1149,"num_whiteouts":527,"num_read":153,"num_read_kb":73270,"num_write":2275,"num_write_kb":49180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'663","reported_seq":2754,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.994652+0000","last_change":"2024-04-26T18:31:59.994703+0000","last_active":"2024-04-26T18:31:59.994652+0000","last_peered":"2024-04-26T18:31:59.994652+0000","last_clean":"2024-04-26T18:31:59.994652+0000","last_became_active":"2024-04-26T17:58:04.711485+0000","last_became_peered":"2024-04-26T17:58:04.711485+0000","last_unstale":"2024-04-26T18:31:59.994652+0000","last_undegraded":"2024-04-26T18:31:59.994652+0000","last_fullsized":"2024-04-26T18:31:59.994652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'663","last_scrub_stamp":"2024-04-26T18:31:59.994591+0000","last_deep_scrub":"41'663","last_deep_scrub_stamp":"2024-04-26T18:31:59.994591+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.994591+0000","objects_scrubbed":41,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:30.332443+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0.187850924,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"41'1336","reported_seq":1417,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.087091+0000","last_change":"2024-04-26T18:32:01.087133+0000","last_active":"2024-04-26T18:32:01.087091+0000","last_peered":"2024-04-26T18:32:01.087091+0000","last_clean":"2024-04-26T18:32:01.087091+0000","last_became_active":"2024-04-26T17:58:03.718187+0000","last_became_peered":"2024-04-26T17:58:03.718187+0000","last_unstale":"2024-04-26T18:32:01.087091+0000","last_undegraded":"2024-04-26T18:32:01.087091+0000","last_fullsized":"2024-04-26T18:32:01.087091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1336","last_scrub_stamp":"2024-04-26T18:32:01.087020+0000","last_deep_scrub":"41'1336","last_deep_scrub_stamp":"2024-04-26T18:32:01.087020+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.087020+0000","objects_scrubbed":63,"log_size":1336,"log_dups_size":0,"ondisk_log_size":1336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:47.172921+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":43,"num_read_kb":0,"num_write":1332,"num_write_kb":75702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":906484,"num_omap_keys":1298,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"41'2855","reported_seq":4577,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.387392+0000","last_change":"2024-04-26T18:32:04.387452+0000","last_active":"2024-04-26T18:32:04.387392+0000","last_peered":"2024-04-26T18:32:04.387392+0000","last_clean":"2024-04-26T18:32:04.387392+0000","last_became_active":"2024-04-26T17:58:08.742218+0000","last_became_peered":"2024-04-26T17:58:08.742218+0000","last_unstale":"2024-04-26T18:32:04.387392+0000","last_undegraded":"2024-04-26T18:32:04.387392+0000","last_fullsized":"2024-04-26T18:32:04.387392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2855","last_scrub_stamp":"2024-04-26T18:32:04.387273+0000","last_deep_scrub":"41'2855","last_deep_scrub_stamp":"2024-04-26T18:32:04.387273+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.387273+0000","objects_scrubbed":1237,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:36.407756+0000","scrub_duration":519,"objects_trimmed":0,"snaptrim_duration":0.18615647199999999,"stat_sum":{"num_bytes":26768950,"num_objects":1237,"num_object_clones":575,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1237,"num_whiteouts":575,"num_read":152,"num_read_kb":65566,"num_write":2334,"num_write_kb":43840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"41'667","reported_seq":2757,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.828269+0000","last_change":"2024-04-26T18:32:04.828308+0000","last_active":"2024-04-26T18:32:04.828269+0000","last_peered":"2024-04-26T18:32:04.828269+0000","last_clean":"2024-04-26T18:32:04.828269+0000","last_became_active":"2024-04-26T17:58:04.722888+0000","last_became_peered":"2024-04-26T17:58:04.722888+0000","last_unstale":"2024-04-26T18:32:04.828269+0000","last_undegraded":"2024-04-26T18:32:04.828269+0000","last_fullsized":"2024-04-26T18:32:04.828269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'667","last_scrub_stamp":"2024-04-26T18:32:04.828211+0000","last_deep_scrub":"41'667","last_deep_scrub_stamp":"2024-04-26T18:32:04.828211+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.828211+0000","objects_scrubbed":59,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:31.759050+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.19386972299999999,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":14,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"41'2251","reported_seq":2331,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.977289+0000","last_change":"2024-04-26T18:32:03.977400+0000","last_active":"2024-04-26T18:32:03.977289+0000","last_peered":"2024-04-26T18:32:03.977289+0000","last_clean":"2024-04-26T18:32:03.977289+0000","last_became_active":"2024-04-26T17:58:03.723063+0000","last_became_peered":"2024-04-26T17:58:03.723063+0000","last_unstale":"2024-04-26T18:32:03.977289+0000","last_undegraded":"2024-04-26T18:32:03.977289+0000","last_fullsized":"2024-04-26T18:32:03.977289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2251","last_scrub_stamp":"2024-04-26T18:32:03.977216+0000","last_deep_scrub":"41'2251","last_deep_scrub_stamp":"2024-04-26T18:32:03.977216+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.977216+0000","objects_scrubbed":48,"log_size":2251,"log_dups_size":0,"ondisk_log_size":2251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:37.835933+0000","scrub_duration":150,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":48,"num_read_kb":0,"num_write":2240,"num_write_kb":108871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":513760,"num_omap_keys":876,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"41'2818","reported_seq":4579,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:14.049107+0000","last_change":"2024-04-26T18:32:14.049142+0000","last_active":"2024-04-26T18:32:14.049107+0000","last_peered":"2024-04-26T18:32:14.049107+0000","last_clean":"2024-04-26T18:32:14.049107+0000","last_became_active":"2024-04-26T17:58:08.744683+0000","last_became_peered":"2024-04-26T17:58:08.744683+0000","last_unstale":"2024-04-26T18:32:14.049107+0000","last_undegraded":"2024-04-26T18:32:14.049107+0000","last_fullsized":"2024-04-26T18:32:14.049107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2818","last_scrub_stamp":"2024-04-26T18:32:14.049021+0000","last_deep_scrub":"41'2818","last_deep_scrub_stamp":"2024-04-26T18:32:14.049021+0000","last_clean_scrub_stamp":"2024-04-26T18:32:14.049021+0000","objects_scrubbed":1186,"log_size":2818,"log_dups_size":0,"ondisk_log_size":2818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:44.096470+0000","scrub_duration":419,"objects_trimmed":0,"snaptrim_duration":0.23086587,"stat_sum":{"num_bytes":33941132,"num_objects":1186,"num_object_clones":549,"num_object_copies":4744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1186,"num_whiteouts":549,"num_read":167,"num_read_kb":131833,"num_write":2312,"num_write_kb":45432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"41'628","reported_seq":2725,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:04.884017+0000","last_change":"2024-04-26T18:32:04.884070+0000","last_active":"2024-04-26T18:32:04.884017+0000","last_peered":"2024-04-26T18:32:04.884017+0000","last_clean":"2024-04-26T18:32:04.884017+0000","last_became_active":"2024-04-26T17:58:04.717148+0000","last_became_peered":"2024-04-26T17:58:04.717148+0000","last_unstale":"2024-04-26T18:32:04.884017+0000","last_undegraded":"2024-04-26T18:32:04.884017+0000","last_fullsized":"2024-04-26T18:32:04.884017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'628","last_scrub_stamp":"2024-04-26T18:32:04.883924+0000","last_deep_scrub":"41'628","last_deep_scrub_stamp":"2024-04-26T18:32:04.883924+0000","last_clean_scrub_stamp":"2024-04-26T18:32:04.883924+0000","objects_scrubbed":33,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:30.906006+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.16159970800000001,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"41'978","reported_seq":1207,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.891627+0000","last_change":"2024-04-26T18:32:00.891670+0000","last_active":"2024-04-26T18:32:00.891627+0000","last_peered":"2024-04-26T18:32:00.891627+0000","last_clean":"2024-04-26T18:32:00.891627+0000","last_became_active":"2024-04-26T17:58:03.722569+0000","last_became_peered":"2024-04-26T17:58:03.722569+0000","last_unstale":"2024-04-26T18:32:00.891627+0000","last_undegraded":"2024-04-26T18:32:00.891627+0000","last_fullsized":"2024-04-26T18:32:00.891627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'978","last_scrub_stamp":"2024-04-26T18:32:00.891546+0000","last_deep_scrub":"41'978","last_deep_scrub_stamp":"2024-04-26T18:32:00.891546+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.891546+0000","objects_scrubbed":60,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:18.710000+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17376085,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":220,"num_read_kb":683,"num_write":1019,"num_write_kb":76520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":776390,"num_omap_keys":1026,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"41'2989","reported_seq":4749,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:13.106723+0000","last_change":"2024-04-26T18:32:13.106780+0000","last_active":"2024-04-26T18:32:13.106723+0000","last_peered":"2024-04-26T18:32:13.106723+0000","last_clean":"2024-04-26T18:32:13.106723+0000","last_became_active":"2024-04-26T17:58:08.742738+0000","last_became_peered":"2024-04-26T17:58:08.742738+0000","last_unstale":"2024-04-26T18:32:13.106723+0000","last_undegraded":"2024-04-26T18:32:13.106723+0000","last_fullsized":"2024-04-26T18:32:13.106723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2989","last_scrub_stamp":"2024-04-26T18:32:13.106634+0000","last_deep_scrub":"41'2989","last_deep_scrub_stamp":"2024-04-26T18:32:13.106634+0000","last_clean_scrub_stamp":"2024-04-26T18:32:13.106634+0000","objects_scrubbed":1229,"log_size":2989,"log_dups_size":0,"ondisk_log_size":2989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:43.429385+0000","scrub_duration":433,"objects_trimmed":0,"snaptrim_duration":0.22647874100000001,"stat_sum":{"num_bytes":37857272,"num_objects":1229,"num_object_clones":574,"num_object_copies":4916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1229,"num_whiteouts":574,"num_read":190,"num_read_kb":232293,"num_write":2457,"num_write_kb":51113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"41'2741","reported_seq":4522,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:09.282696+0000","last_change":"2024-04-26T18:32:09.282696+0000","last_active":"2024-04-26T18:32:09.282696+0000","last_peered":"2024-04-26T18:32:09.282696+0000","last_clean":"2024-04-26T18:32:09.282696+0000","last_became_active":"2024-04-26T17:58:08.739683+0000","last_became_peered":"2024-04-26T17:58:08.739683+0000","last_unstale":"2024-04-26T18:32:09.282696+0000","last_undegraded":"2024-04-26T18:32:09.282696+0000","last_fullsized":"2024-04-26T18:32:09.282696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2741","last_scrub_stamp":"2024-04-26T18:32:09.282553+0000","last_deep_scrub":"41'2741","last_deep_scrub_stamp":"2024-04-26T18:32:09.282553+0000","last_clean_scrub_stamp":"2024-04-26T18:32:09.282553+0000","objects_scrubbed":1130,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:45:45.216775+0000","scrub_duration":479,"objects_trimmed":0,"snaptrim_duration":0.20154621,"stat_sum":{"num_bytes":35946841,"num_objects":1130,"num_object_clones":524,"num_object_copies":4520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1130,"num_whiteouts":524,"num_read":160,"num_read_kb":163026,"num_write":2271,"num_write_kb":38909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"41'666","reported_seq":2755,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.047694+0000","last_change":"2024-04-26T18:32:07.047746+0000","last_active":"2024-04-26T18:32:07.047694+0000","last_peered":"2024-04-26T18:32:07.047694+0000","last_clean":"2024-04-26T18:32:07.047694+0000","last_became_active":"2024-04-26T17:58:04.718772+0000","last_became_peered":"2024-04-26T17:58:04.718772+0000","last_unstale":"2024-04-26T18:32:07.047694+0000","last_undegraded":"2024-04-26T18:32:07.047694+0000","last_fullsized":"2024-04-26T18:32:07.047694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'666","last_scrub_stamp":"2024-04-26T18:32:07.047595+0000","last_deep_scrub":"41'666","last_deep_scrub_stamp":"2024-04-26T18:32:07.047595+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.047595+0000","objects_scrubbed":54,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:34:23.963873+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.076360936000000004,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"41'1560","reported_seq":1641,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.994922+0000","last_change":"2024-04-26T18:31:59.994975+0000","last_active":"2024-04-26T18:31:59.994922+0000","last_peered":"2024-04-26T18:31:59.994922+0000","last_clean":"2024-04-26T18:31:59.994922+0000","last_became_active":"2024-04-26T17:58:03.710899+0000","last_became_peered":"2024-04-26T17:58:03.710899+0000","last_unstale":"2024-04-26T18:31:59.994922+0000","last_undegraded":"2024-04-26T18:31:59.994922+0000","last_fullsized":"2024-04-26T18:31:59.994922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1560","last_scrub_stamp":"2024-04-26T18:31:59.994829+0000","last_deep_scrub":"41'1560","last_deep_scrub_stamp":"2024-04-26T18:31:59.994829+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.994829+0000","objects_scrubbed":67,"log_size":1560,"log_dups_size":0,"ondisk_log_size":1560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:50:18.430158+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":1554,"num_write_kb":113147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":987257,"num_omap_keys":1474,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"41'2755","reported_seq":4495,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.226626+0000","last_change":"2024-04-26T18:32:11.226681+0000","last_active":"2024-04-26T18:32:11.226626+0000","last_peered":"2024-04-26T18:32:11.226626+0000","last_clean":"2024-04-26T18:32:11.226626+0000","last_became_active":"2024-04-26T17:58:08.737759+0000","last_became_peered":"2024-04-26T17:58:08.737759+0000","last_unstale":"2024-04-26T18:32:11.226626+0000","last_undegraded":"2024-04-26T18:32:11.226626+0000","last_fullsized":"2024-04-26T18:32:11.226626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2755","last_scrub_stamp":"2024-04-26T18:32:11.226494+0000","last_deep_scrub":"41'2755","last_deep_scrub_stamp":"2024-04-26T18:32:11.226494+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.226494+0000","objects_scrubbed":1175,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:00.894902+0000","scrub_duration":509,"objects_trimmed":0,"snaptrim_duration":0.101684618,"stat_sum":{"num_bytes":29230084,"num_objects":1175,"num_object_clones":548,"num_object_copies":4700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1175,"num_whiteouts":548,"num_read":142,"num_read_kb":156265,"num_write":2265,"num_write_kb":32436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"41'722","reported_seq":2802,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:13.039168+0000","last_change":"2024-04-26T18:32:13.039205+0000","last_active":"2024-04-26T18:32:13.039168+0000","last_peered":"2024-04-26T18:32:13.039168+0000","last_clean":"2024-04-26T18:32:13.039168+0000","last_became_active":"2024-04-26T17:58:47.348873+0000","last_became_peered":"2024-04-26T17:58:47.348873+0000","last_unstale":"2024-04-26T18:32:13.039168+0000","last_undegraded":"2024-04-26T18:32:13.039168+0000","last_fullsized":"2024-04-26T18:32:13.039168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'722","last_scrub_stamp":"2024-04-26T18:32:13.039103+0000","last_deep_scrub":"41'722","last_deep_scrub_stamp":"2024-04-26T18:32:13.039103+0000","last_clean_scrub_stamp":"2024-04-26T18:32:13.039103+0000","objects_scrubbed":36,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:01.016525+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.075584111999999995,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"41'821","reported_seq":902,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.689748+0000","last_change":"2024-04-26T18:32:02.689784+0000","last_active":"2024-04-26T18:32:02.689748+0000","last_peered":"2024-04-26T18:32:02.689748+0000","last_clean":"2024-04-26T18:32:02.689748+0000","last_became_active":"2024-04-26T17:58:03.722672+0000","last_became_peered":"2024-04-26T17:58:03.722672+0000","last_unstale":"2024-04-26T18:32:02.689748+0000","last_undegraded":"2024-04-26T18:32:02.689748+0000","last_fullsized":"2024-04-26T18:32:02.689748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'821","last_scrub_stamp":"2024-04-26T18:32:02.689681+0000","last_deep_scrub":"41'821","last_deep_scrub_stamp":"2024-04-26T18:32:02.689681+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.689681+0000","objects_scrubbed":63,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:29.259168+0000","scrub_duration":74,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":67,"num_read_kb":0,"num_write":840,"num_write_kb":71498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":995809,"num_omap_keys":1581,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"41'1003","reported_seq":1083,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.932857+0000","last_change":"2024-04-26T18:31:57.932885+0000","last_active":"2024-04-26T18:31:57.932857+0000","last_peered":"2024-04-26T18:31:57.932857+0000","last_clean":"2024-04-26T18:31:57.932857+0000","last_became_active":"2024-04-26T17:58:03.722587+0000","last_became_peered":"2024-04-26T17:58:03.722587+0000","last_unstale":"2024-04-26T18:31:57.932857+0000","last_undegraded":"2024-04-26T18:31:57.932857+0000","last_fullsized":"2024-04-26T18:31:57.932857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1003","last_scrub_stamp":"2024-04-26T18:31:57.932789+0000","last_deep_scrub":"41'1003","last_deep_scrub_stamp":"2024-04-26T18:31:57.932789+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.932789+0000","objects_scrubbed":55,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:34.641711+0000","scrub_duration":82,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":1019,"num_write_kb":79683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":815135,"num_omap_keys":1269,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"41'652","reported_seq":2742,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.768422+0000","last_change":"2024-04-26T18:32:00.768451+0000","last_active":"2024-04-26T18:32:00.768422+0000","last_peered":"2024-04-26T18:32:00.768422+0000","last_clean":"2024-04-26T18:32:00.768422+0000","last_became_active":"2024-04-26T17:58:04.712759+0000","last_became_peered":"2024-04-26T17:58:04.712759+0000","last_unstale":"2024-04-26T18:32:00.768422+0000","last_undegraded":"2024-04-26T18:32:00.768422+0000","last_fullsized":"2024-04-26T18:32:00.768422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'652","last_scrub_stamp":"2024-04-26T18:32:00.768356+0000","last_deep_scrub":"41'652","last_deep_scrub_stamp":"2024-04-26T18:32:00.768356+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.768356+0000","objects_scrubbed":56,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:23.008227+0000","scrub_duration":60,"objects_trimmed":0,"snaptrim_duration":0.20583575700000001,"stat_sum":{"num_bytes":0,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"41'2937","reported_seq":4670,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.120873+0000","last_change":"2024-04-26T18:32:02.120902+0000","last_active":"2024-04-26T18:32:02.120873+0000","last_peered":"2024-04-26T18:32:02.120873+0000","last_clean":"2024-04-26T18:32:02.120873+0000","last_became_active":"2024-04-26T17:58:08.739194+0000","last_became_peered":"2024-04-26T17:58:08.739194+0000","last_unstale":"2024-04-26T18:32:02.120873+0000","last_undegraded":"2024-04-26T18:32:02.120873+0000","last_fullsized":"2024-04-26T18:32:02.120873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2937","last_scrub_stamp":"2024-04-26T18:32:02.120795+0000","last_deep_scrub":"41'2937","last_deep_scrub_stamp":"2024-04-26T18:32:02.120795+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.120795+0000","objects_scrubbed":1274,"log_size":2937,"log_dups_size":0,"ondisk_log_size":2937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:53.977570+0000","scrub_duration":530,"objects_trimmed":0,"snaptrim_duration":0.025934391000000001,"stat_sum":{"num_bytes":29962641,"num_objects":1274,"num_object_clones":596,"num_object_copies":5096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1274,"num_whiteouts":596,"num_read":182,"num_read_kb":211414,"num_write":2395,"num_write_kb":42590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"41'592","reported_seq":672,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.679517+0000","last_change":"2024-04-26T18:32:01.679556+0000","last_active":"2024-04-26T18:32:01.679517+0000","last_peered":"2024-04-26T18:32:01.679517+0000","last_clean":"2024-04-26T18:32:01.679517+0000","last_became_active":"2024-04-26T17:58:03.720406+0000","last_became_peered":"2024-04-26T17:58:03.720406+0000","last_unstale":"2024-04-26T18:32:01.679517+0000","last_undegraded":"2024-04-26T18:32:01.679517+0000","last_fullsized":"2024-04-26T18:32:01.679517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'592","last_scrub_stamp":"2024-04-26T18:32:01.679413+0000","last_deep_scrub":"41'592","last_deep_scrub_stamp":"2024-04-26T18:32:01.679413+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.679413+0000","objects_scrubbed":50,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:29.321331+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":54,"num_read_kb":0,"num_write":620,"num_write_kb":96015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":821836,"num_omap_keys":1412,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"41'678","reported_seq":2768,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.954109+0000","last_change":"2024-04-26T18:32:01.954135+0000","last_active":"2024-04-26T18:32:01.954109+0000","last_peered":"2024-04-26T18:32:01.954109+0000","last_clean":"2024-04-26T18:32:01.954109+0000","last_became_active":"2024-04-26T17:58:04.712533+0000","last_became_peered":"2024-04-26T17:58:04.712533+0000","last_unstale":"2024-04-26T18:32:01.954109+0000","last_undegraded":"2024-04-26T18:32:01.954109+0000","last_fullsized":"2024-04-26T18:32:01.954109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'678","last_scrub_stamp":"2024-04-26T18:32:01.954045+0000","last_deep_scrub":"41'678","last_deep_scrub_stamp":"2024-04-26T18:32:01.954045+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.954045+0000","objects_scrubbed":51,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:09.121830+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0.18696554200000001,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"41'2812","reported_seq":4554,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.234272+0000","last_change":"2024-04-26T18:32:11.234332+0000","last_active":"2024-04-26T18:32:11.234272+0000","last_peered":"2024-04-26T18:32:11.234272+0000","last_clean":"2024-04-26T18:32:11.234272+0000","last_became_active":"2024-04-26T17:58:08.737697+0000","last_became_peered":"2024-04-26T17:58:08.737697+0000","last_unstale":"2024-04-26T18:32:11.234272+0000","last_undegraded":"2024-04-26T18:32:11.234272+0000","last_fullsized":"2024-04-26T18:32:11.234272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2812","last_scrub_stamp":"2024-04-26T18:32:11.234145+0000","last_deep_scrub":"41'2812","last_deep_scrub_stamp":"2024-04-26T18:32:11.234145+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.234145+0000","objects_scrubbed":1208,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:50.846229+0000","scrub_duration":528,"objects_trimmed":0,"snaptrim_duration":0.215933711,"stat_sum":{"num_bytes":39516255,"num_objects":1208,"num_object_clones":558,"num_object_copies":4832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1208,"num_whiteouts":558,"num_read":159,"num_read_kb":155491,"num_write":2289,"num_write_kb":56059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"41'670","reported_seq":2763,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.836575+0000","last_change":"2024-04-26T18:32:05.836655+0000","last_active":"2024-04-26T18:32:05.836575+0000","last_peered":"2024-04-26T18:32:05.836575+0000","last_clean":"2024-04-26T18:32:05.836575+0000","last_became_active":"2024-04-26T17:58:04.716755+0000","last_became_peered":"2024-04-26T17:58:04.716755+0000","last_unstale":"2024-04-26T18:32:05.836575+0000","last_undegraded":"2024-04-26T18:32:05.836575+0000","last_fullsized":"2024-04-26T18:32:05.836575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:05.836474+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:05.836474+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.836474+0000","objects_scrubbed":42,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:02.889293+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.098603622000000002,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"41'715","reported_seq":2807,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:00.618296+0000","last_change":"2024-04-26T18:32:00.618322+0000","last_active":"2024-04-26T18:32:00.618296+0000","last_peered":"2024-04-26T18:32:00.618296+0000","last_clean":"2024-04-26T18:32:00.618296+0000","last_became_active":"2024-04-26T17:58:04.717640+0000","last_became_peered":"2024-04-26T17:58:04.717640+0000","last_unstale":"2024-04-26T18:32:00.618296+0000","last_undegraded":"2024-04-26T18:32:00.618296+0000","last_fullsized":"2024-04-26T18:32:00.618296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'715","last_scrub_stamp":"2024-04-26T18:32:00.618231+0000","last_deep_scrub":"41'715","last_deep_scrub_stamp":"2024-04-26T18:32:00.618231+0000","last_clean_scrub_stamp":"2024-04-26T18:32:00.618231+0000","objects_scrubbed":53,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:47:15.792224+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.032925850999999999,"stat_sum":{"num_bytes":0,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"41'648","reported_seq":2730,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.663529+0000","last_change":"2024-04-26T18:32:03.663529+0000","last_active":"2024-04-26T18:32:03.663529+0000","last_peered":"2024-04-26T18:32:03.663529+0000","last_clean":"2024-04-26T18:32:03.663529+0000","last_became_active":"2024-04-26T17:58:46.843441+0000","last_became_peered":"2024-04-26T17:58:46.843441+0000","last_unstale":"2024-04-26T18:32:03.663529+0000","last_undegraded":"2024-04-26T18:32:03.663529+0000","last_fullsized":"2024-04-26T18:32:03.663529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'648","last_scrub_stamp":"2024-04-26T18:32:03.663405+0000","last_deep_scrub":"41'648","last_deep_scrub_stamp":"2024-04-26T18:32:03.663405+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.663405+0000","objects_scrubbed":38,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:53.247364+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.030186671000000002,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":9,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"41'716","reported_seq":2805,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.779184+0000","last_change":"2024-04-26T18:32:03.779209+0000","last_active":"2024-04-26T18:32:03.779184+0000","last_peered":"2024-04-26T18:32:03.779184+0000","last_clean":"2024-04-26T18:32:03.779184+0000","last_became_active":"2024-04-26T17:58:04.718611+0000","last_became_peered":"2024-04-26T17:58:04.718611+0000","last_unstale":"2024-04-26T18:32:03.779184+0000","last_undegraded":"2024-04-26T18:32:03.779184+0000","last_fullsized":"2024-04-26T18:32:03.779184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'716","last_scrub_stamp":"2024-04-26T18:32:03.779118+0000","last_deep_scrub":"41'716","last_deep_scrub_stamp":"2024-04-26T18:32:03.779118+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.779118+0000","objects_scrubbed":51,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:23.169737+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0.201538621,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"41'641","reported_seq":2733,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.685414+0000","last_change":"2024-04-26T18:32:06.685447+0000","last_active":"2024-04-26T18:32:06.685414+0000","last_peered":"2024-04-26T18:32:06.685414+0000","last_clean":"2024-04-26T18:32:06.685414+0000","last_became_active":"2024-04-26T17:58:04.717097+0000","last_became_peered":"2024-04-26T17:58:04.717097+0000","last_unstale":"2024-04-26T18:32:06.685414+0000","last_undegraded":"2024-04-26T18:32:06.685414+0000","last_fullsized":"2024-04-26T18:32:06.685414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'641","last_scrub_stamp":"2024-04-26T18:32:06.685357+0000","last_deep_scrub":"41'641","last_deep_scrub_stamp":"2024-04-26T18:32:06.685357+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.685357+0000","objects_scrubbed":43,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:09.730912+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0.217865696,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"41'675","reported_seq":2762,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.077740+0000","last_change":"2024-04-26T18:32:06.077772+0000","last_active":"2024-04-26T18:32:06.077740+0000","last_peered":"2024-04-26T18:32:06.077740+0000","last_clean":"2024-04-26T18:32:06.077740+0000","last_became_active":"2024-04-26T17:58:04.718678+0000","last_became_peered":"2024-04-26T17:58:04.718678+0000","last_unstale":"2024-04-26T18:32:06.077740+0000","last_undegraded":"2024-04-26T18:32:06.077740+0000","last_fullsized":"2024-04-26T18:32:06.077740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'675","last_scrub_stamp":"2024-04-26T18:32:06.077676+0000","last_deep_scrub":"41'675","last_deep_scrub_stamp":"2024-04-26T18:32:06.077676+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.077676+0000","objects_scrubbed":55,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:18.207376+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0.077286562000000003,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":18,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"41'694","reported_seq":2788,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.818357+0000","last_change":"2024-04-26T18:32:06.818433+0000","last_active":"2024-04-26T18:32:06.818357+0000","last_peered":"2024-04-26T18:32:06.818357+0000","last_clean":"2024-04-26T18:32:06.818357+0000","last_became_active":"2024-04-26T17:58:04.718935+0000","last_became_peered":"2024-04-26T17:58:04.718935+0000","last_unstale":"2024-04-26T18:32:06.818357+0000","last_undegraded":"2024-04-26T18:32:06.818357+0000","last_fullsized":"2024-04-26T18:32:06.818357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'694","last_scrub_stamp":"2024-04-26T18:32:06.818259+0000","last_deep_scrub":"41'694","last_deep_scrub_stamp":"2024-04-26T18:32:06.818259+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.818259+0000","objects_scrubbed":39,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:47.694008+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.101304621,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"41'633","reported_seq":2728,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.651489+0000","last_change":"2024-04-26T18:32:05.651530+0000","last_active":"2024-04-26T18:32:05.651489+0000","last_peered":"2024-04-26T18:32:05.651489+0000","last_clean":"2024-04-26T18:32:05.651489+0000","last_became_active":"2024-04-26T17:58:04.716925+0000","last_became_peered":"2024-04-26T17:58:04.716925+0000","last_unstale":"2024-04-26T18:32:05.651489+0000","last_undegraded":"2024-04-26T18:32:05.651489+0000","last_fullsized":"2024-04-26T18:32:05.651489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'633","last_scrub_stamp":"2024-04-26T18:32:05.651424+0000","last_deep_scrub":"41'633","last_deep_scrub_stamp":"2024-04-26T18:32:05.651424+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.651424+0000","objects_scrubbed":43,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:41.220794+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0.21869934299999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":9,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"41'670","reported_seq":2761,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.804052+0000","last_change":"2024-04-26T18:32:12.804094+0000","last_active":"2024-04-26T18:32:12.804052+0000","last_peered":"2024-04-26T18:32:12.804052+0000","last_clean":"2024-04-26T18:32:12.804052+0000","last_became_active":"2024-04-26T17:58:04.726531+0000","last_became_peered":"2024-04-26T17:58:04.726531+0000","last_unstale":"2024-04-26T18:32:12.804052+0000","last_undegraded":"2024-04-26T18:32:12.804052+0000","last_fullsized":"2024-04-26T18:32:12.804052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:12.803966+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:12.803966+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.803966+0000","objects_scrubbed":52,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:50.375581+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0.16324759799999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"41'666","reported_seq":2751,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:03.687001+0000","last_change":"2024-04-26T18:32:03.687030+0000","last_active":"2024-04-26T18:32:03.687001+0000","last_peered":"2024-04-26T18:32:03.687001+0000","last_clean":"2024-04-26T18:32:03.687001+0000","last_became_active":"2024-04-26T17:58:04.713386+0000","last_became_peered":"2024-04-26T17:58:04.713386+0000","last_unstale":"2024-04-26T18:32:03.687001+0000","last_undegraded":"2024-04-26T18:32:03.687001+0000","last_fullsized":"2024-04-26T18:32:03.687001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'666","last_scrub_stamp":"2024-04-26T18:32:03.686943+0000","last_deep_scrub":"41'666","last_deep_scrub_stamp":"2024-04-26T18:32:03.686943+0000","last_clean_scrub_stamp":"2024-04-26T18:32:03.686943+0000","objects_scrubbed":57,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:31:11.919852+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0.22595842999999999,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":20,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"41'677","reported_seq":2772,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:57.874276+0000","last_change":"2024-04-26T18:31:57.874344+0000","last_active":"2024-04-26T18:31:57.874276+0000","last_peered":"2024-04-26T18:31:57.874276+0000","last_clean":"2024-04-26T18:31:57.874276+0000","last_became_active":"2024-04-26T17:58:04.722827+0000","last_became_peered":"2024-04-26T17:58:04.722827+0000","last_unstale":"2024-04-26T18:31:57.874276+0000","last_undegraded":"2024-04-26T18:31:57.874276+0000","last_fullsized":"2024-04-26T18:31:57.874276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'677","last_scrub_stamp":"2024-04-26T18:31:57.874206+0000","last_deep_scrub":"41'677","last_deep_scrub_stamp":"2024-04-26T18:31:57.874206+0000","last_clean_scrub_stamp":"2024-04-26T18:31:57.874206+0000","objects_scrubbed":39,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:25.707342+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0.16093863,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"41'680","reported_seq":2769,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.751285+0000","last_change":"2024-04-26T18:31:58.751344+0000","last_active":"2024-04-26T18:31:58.751285+0000","last_peered":"2024-04-26T18:31:58.751285+0000","last_clean":"2024-04-26T18:31:58.751285+0000","last_became_active":"2024-04-26T17:58:04.708096+0000","last_became_peered":"2024-04-26T17:58:04.708096+0000","last_unstale":"2024-04-26T18:31:58.751285+0000","last_undegraded":"2024-04-26T18:31:58.751285+0000","last_fullsized":"2024-04-26T18:31:58.751285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'680","last_scrub_stamp":"2024-04-26T18:31:58.751210+0000","last_deep_scrub":"41'680","last_deep_scrub_stamp":"2024-04-26T18:31:58.751210+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.751210+0000","objects_scrubbed":49,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:04.903523+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0.199229399,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"41'697","reported_seq":2784,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.884607+0000","last_change":"2024-04-26T18:32:02.884649+0000","last_active":"2024-04-26T18:32:02.884607+0000","last_peered":"2024-04-26T18:32:02.884607+0000","last_clean":"2024-04-26T18:32:02.884607+0000","last_became_active":"2024-04-26T17:58:04.713803+0000","last_became_peered":"2024-04-26T17:58:04.713803+0000","last_unstale":"2024-04-26T18:32:02.884607+0000","last_undegraded":"2024-04-26T18:32:02.884607+0000","last_fullsized":"2024-04-26T18:32:02.884607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'697","last_scrub_stamp":"2024-04-26T18:32:02.884542+0000","last_deep_scrub":"41'697","last_deep_scrub_stamp":"2024-04-26T18:32:02.884542+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.884542+0000","objects_scrubbed":62,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:26.965063+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0.097146090000000004,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":18,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":18,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"41'714","reported_seq":2802,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.528522+0000","last_change":"2024-04-26T18:32:08.528572+0000","last_active":"2024-04-26T18:32:08.528522+0000","last_peered":"2024-04-26T18:32:08.528522+0000","last_clean":"2024-04-26T18:32:08.528522+0000","last_became_active":"2024-04-26T17:58:04.714626+0000","last_became_peered":"2024-04-26T17:58:04.714626+0000","last_unstale":"2024-04-26T18:32:08.528522+0000","last_undegraded":"2024-04-26T18:32:08.528522+0000","last_fullsized":"2024-04-26T18:32:08.528522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'714","last_scrub_stamp":"2024-04-26T18:32:08.528457+0000","last_deep_scrub":"41'714","last_deep_scrub_stamp":"2024-04-26T18:32:08.528457+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.528457+0000","objects_scrubbed":62,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:52.072876+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.104951684,"stat_sum":{"num_bytes":0,"num_objects":62,"num_object_clones":17,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"41'644","reported_seq":2734,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.649104+0000","last_change":"2024-04-26T18:31:59.649155+0000","last_active":"2024-04-26T18:31:59.649104+0000","last_peered":"2024-04-26T18:31:59.649104+0000","last_clean":"2024-04-26T18:31:59.649104+0000","last_became_active":"2024-04-26T17:58:04.714277+0000","last_became_peered":"2024-04-26T17:58:04.714277+0000","last_unstale":"2024-04-26T18:31:59.649104+0000","last_undegraded":"2024-04-26T18:31:59.649104+0000","last_fullsized":"2024-04-26T18:31:59.649104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'644","last_scrub_stamp":"2024-04-26T18:31:59.649030+0000","last_deep_scrub":"41'644","last_deep_scrub_stamp":"2024-04-26T18:31:59.649030+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.649030+0000","objects_scrubbed":49,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:55.872202+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0.032670101999999999,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"41'695","reported_seq":2786,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:05.852691+0000","last_change":"2024-04-26T18:32:05.852734+0000","last_active":"2024-04-26T18:32:05.852691+0000","last_peered":"2024-04-26T18:32:05.852691+0000","last_clean":"2024-04-26T18:32:05.852691+0000","last_became_active":"2024-04-26T17:58:04.722038+0000","last_became_peered":"2024-04-26T17:58:04.722038+0000","last_unstale":"2024-04-26T18:32:05.852691+0000","last_undegraded":"2024-04-26T18:32:05.852691+0000","last_fullsized":"2024-04-26T18:32:05.852691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'695","last_scrub_stamp":"2024-04-26T18:32:05.852593+0000","last_deep_scrub":"41'695","last_deep_scrub_stamp":"2024-04-26T18:32:05.852593+0000","last_clean_scrub_stamp":"2024-04-26T18:32:05.852593+0000","objects_scrubbed":50,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:42.782743+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.15919065099999999,"stat_sum":{"num_bytes":0,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"41'670","reported_seq":2761,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.830636+0000","last_change":"2024-04-26T18:32:07.830710+0000","last_active":"2024-04-26T18:32:07.830636+0000","last_peered":"2024-04-26T18:32:07.830636+0000","last_clean":"2024-04-26T18:32:07.830636+0000","last_became_active":"2024-04-26T17:58:04.725368+0000","last_became_peered":"2024-04-26T17:58:04.725368+0000","last_unstale":"2024-04-26T18:32:07.830636+0000","last_undegraded":"2024-04-26T18:32:07.830636+0000","last_fullsized":"2024-04-26T18:32:07.830636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'670","last_scrub_stamp":"2024-04-26T18:32:07.830544+0000","last_deep_scrub":"41'670","last_deep_scrub_stamp":"2024-04-26T18:32:07.830544+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.830544+0000","objects_scrubbed":49,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:44.789153+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0.16311753700000001,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"41'690","reported_seq":2778,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:55.942349+0000","last_change":"2024-04-26T18:31:55.942423+0000","last_active":"2024-04-26T18:31:55.942349+0000","last_peered":"2024-04-26T18:31:55.942349+0000","last_clean":"2024-04-26T18:31:55.942349+0000","last_became_active":"2024-04-26T17:58:04.716546+0000","last_became_peered":"2024-04-26T17:58:04.716546+0000","last_unstale":"2024-04-26T18:31:55.942349+0000","last_undegraded":"2024-04-26T18:31:55.942349+0000","last_fullsized":"2024-04-26T18:31:55.942349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'690","last_scrub_stamp":"2024-04-26T18:31:55.942279+0000","last_deep_scrub":"41'690","last_deep_scrub_stamp":"2024-04-26T18:31:55.942279+0000","last_clean_scrub_stamp":"2024-04-26T18:31:55.942279+0000","objects_scrubbed":48,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:46.249420+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.077647145000000001,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"41'642","reported_seq":2737,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:02.727740+0000","last_change":"2024-04-26T18:32:02.727776+0000","last_active":"2024-04-26T18:32:02.727740+0000","last_peered":"2024-04-26T18:32:02.727740+0000","last_clean":"2024-04-26T18:32:02.727740+0000","last_became_active":"2024-04-26T17:58:04.714917+0000","last_became_peered":"2024-04-26T17:58:04.714917+0000","last_unstale":"2024-04-26T18:32:02.727740+0000","last_undegraded":"2024-04-26T18:32:02.727740+0000","last_fullsized":"2024-04-26T18:32:02.727740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'642","last_scrub_stamp":"2024-04-26T18:32:02.727675+0000","last_deep_scrub":"41'642","last_deep_scrub_stamp":"2024-04-26T18:32:02.727675+0000","last_clean_scrub_stamp":"2024-04-26T18:32:02.727675+0000","objects_scrubbed":38,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:04.088316+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.18619005699999999,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":8,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"41'641","reported_seq":2732,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.538071+0000","last_change":"2024-04-26T18:31:56.538071+0000","last_active":"2024-04-26T18:31:56.538071+0000","last_peered":"2024-04-26T18:31:56.538071+0000","last_clean":"2024-04-26T18:31:56.538071+0000","last_became_active":"2024-04-26T17:58:04.722308+0000","last_became_peered":"2024-04-26T17:58:04.722308+0000","last_unstale":"2024-04-26T18:31:56.538071+0000","last_undegraded":"2024-04-26T18:31:56.538071+0000","last_fullsized":"2024-04-26T18:31:56.538071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'641","last_scrub_stamp":"2024-04-26T18:31:56.537949+0000","last_deep_scrub":"41'641","last_deep_scrub_stamp":"2024-04-26T18:31:56.537949+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.537949+0000","objects_scrubbed":48,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:54.973187+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.22687219,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"41'664","reported_seq":2751,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:59.026360+0000","last_change":"2024-04-26T18:31:59.026396+0000","last_active":"2024-04-26T18:31:59.026360+0000","last_peered":"2024-04-26T18:31:59.026360+0000","last_clean":"2024-04-26T18:31:59.026360+0000","last_became_active":"2024-04-26T17:58:04.711606+0000","last_became_peered":"2024-04-26T17:58:04.711606+0000","last_unstale":"2024-04-26T18:31:59.026360+0000","last_undegraded":"2024-04-26T18:31:59.026360+0000","last_fullsized":"2024-04-26T18:31:59.026360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'664","last_scrub_stamp":"2024-04-26T18:31:59.026296+0000","last_deep_scrub":"41'664","last_deep_scrub_stamp":"2024-04-26T18:31:59.026296+0000","last_clean_scrub_stamp":"2024-04-26T18:31:59.026296+0000","objects_scrubbed":57,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:33.520201+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.18821249400000001,"stat_sum":{"num_bytes":0,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"41'671","reported_seq":2764,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.773108+0000","last_change":"2024-04-26T18:32:11.773145+0000","last_active":"2024-04-26T18:32:11.773108+0000","last_peered":"2024-04-26T18:32:11.773108+0000","last_clean":"2024-04-26T18:32:11.773108+0000","last_became_active":"2024-04-26T17:58:46.846437+0000","last_became_peered":"2024-04-26T17:58:46.846437+0000","last_unstale":"2024-04-26T18:32:11.773108+0000","last_undegraded":"2024-04-26T18:32:11.773108+0000","last_fullsized":"2024-04-26T18:32:11.773108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'671","last_scrub_stamp":"2024-04-26T18:32:11.773028+0000","last_deep_scrub":"41'671","last_deep_scrub_stamp":"2024-04-26T18:32:11.773028+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.773028+0000","objects_scrubbed":59,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:05.407241+0000","scrub_duration":56,"objects_trimmed":0,"snaptrim_duration":0.100440928,"stat_sum":{"num_bytes":0,"num_objects":59,"num_object_clones":16,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":16,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"41'652","reported_seq":2743,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:07.801763+0000","last_change":"2024-04-26T18:32:07.801835+0000","last_active":"2024-04-26T18:32:07.801763+0000","last_peered":"2024-04-26T18:32:07.801763+0000","last_clean":"2024-04-26T18:32:07.801763+0000","last_became_active":"2024-04-26T17:58:04.726794+0000","last_became_peered":"2024-04-26T17:58:04.726794+0000","last_unstale":"2024-04-26T18:32:07.801763+0000","last_undegraded":"2024-04-26T18:32:07.801763+0000","last_fullsized":"2024-04-26T18:32:07.801763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'652","last_scrub_stamp":"2024-04-26T18:32:07.801656+0000","last_deep_scrub":"41'652","last_deep_scrub_stamp":"2024-04-26T18:32:07.801656+0000","last_clean_scrub_stamp":"2024-04-26T18:32:07.801656+0000","objects_scrubbed":46,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:05.828107+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.100379555,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"41'711","reported_seq":2795,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:13.456559+0000","last_change":"2024-04-26T18:32:13.456607+0000","last_active":"2024-04-26T18:32:13.456559+0000","last_peered":"2024-04-26T18:32:13.456559+0000","last_clean":"2024-04-26T18:32:13.456559+0000","last_became_active":"2024-04-26T17:58:04.723431+0000","last_became_peered":"2024-04-26T17:58:04.723431+0000","last_unstale":"2024-04-26T18:32:13.456559+0000","last_undegraded":"2024-04-26T18:32:13.456559+0000","last_fullsized":"2024-04-26T18:32:13.456559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'711","last_scrub_stamp":"2024-04-26T18:32:13.456498+0000","last_deep_scrub":"41'711","last_deep_scrub_stamp":"2024-04-26T18:32:13.456498+0000","last_clean_scrub_stamp":"2024-04-26T18:32:13.456498+0000","objects_scrubbed":63,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:09.638517+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.104580398,"stat_sum":{"num_bytes":0,"num_objects":63,"num_object_clones":20,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":20,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"41'635","reported_seq":2724,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.624255+0000","last_change":"2024-04-26T18:31:58.624339+0000","last_active":"2024-04-26T18:31:58.624255+0000","last_peered":"2024-04-26T18:31:58.624255+0000","last_clean":"2024-04-26T18:31:58.624255+0000","last_became_active":"2024-04-26T17:58:04.723801+0000","last_became_peered":"2024-04-26T17:58:04.723801+0000","last_unstale":"2024-04-26T18:31:58.624255+0000","last_undegraded":"2024-04-26T18:31:58.624255+0000","last_fullsized":"2024-04-26T18:31:58.624255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'635","last_scrub_stamp":"2024-04-26T18:31:58.624171+0000","last_deep_scrub":"41'635","last_deep_scrub_stamp":"2024-04-26T18:31:58.624171+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.624171+0000","objects_scrubbed":47,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:09.715688+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.230423819,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"41'646","reported_seq":2739,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:58.729951+0000","last_change":"2024-04-26T18:31:58.730003+0000","last_active":"2024-04-26T18:31:58.729951+0000","last_peered":"2024-04-26T18:31:58.729951+0000","last_clean":"2024-04-26T18:31:58.729951+0000","last_became_active":"2024-04-26T17:58:04.713304+0000","last_became_peered":"2024-04-26T17:58:04.713304+0000","last_unstale":"2024-04-26T18:31:58.729951+0000","last_undegraded":"2024-04-26T18:31:58.729951+0000","last_fullsized":"2024-04-26T18:31:58.729951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'646","last_scrub_stamp":"2024-04-26T18:31:58.729859+0000","last_deep_scrub":"41'646","last_deep_scrub_stamp":"2024-04-26T18:31:58.729859+0000","last_clean_scrub_stamp":"2024-04-26T18:31:58.729859+0000","objects_scrubbed":35,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:37.315038+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.101654339,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"41'626","reported_seq":2716,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:08.851339+0000","last_change":"2024-04-26T18:32:08.851425+0000","last_active":"2024-04-26T18:32:08.851339+0000","last_peered":"2024-04-26T18:32:08.851339+0000","last_clean":"2024-04-26T18:32:08.851339+0000","last_became_active":"2024-04-26T17:58:04.725401+0000","last_became_peered":"2024-04-26T17:58:04.725401+0000","last_unstale":"2024-04-26T18:32:08.851339+0000","last_undegraded":"2024-04-26T18:32:08.851339+0000","last_fullsized":"2024-04-26T18:32:08.851339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'626","last_scrub_stamp":"2024-04-26T18:32:08.851229+0000","last_deep_scrub":"41'626","last_deep_scrub_stamp":"2024-04-26T18:32:08.851229+0000","last_clean_scrub_stamp":"2024-04-26T18:32:08.851229+0000","objects_scrubbed":49,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:10.365460+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0.16310901,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"41'678","reported_seq":2774,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:06.556759+0000","last_change":"2024-04-26T18:32:06.556789+0000","last_active":"2024-04-26T18:32:06.556759+0000","last_peered":"2024-04-26T18:32:06.556759+0000","last_clean":"2024-04-26T18:32:06.556759+0000","last_became_active":"2024-04-26T17:58:04.711769+0000","last_became_peered":"2024-04-26T17:58:04.711769+0000","last_unstale":"2024-04-26T18:32:06.556759+0000","last_undegraded":"2024-04-26T18:32:06.556759+0000","last_fullsized":"2024-04-26T18:32:06.556759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'678","last_scrub_stamp":"2024-04-26T18:32:06.556698+0000","last_deep_scrub":"41'678","last_deep_scrub_stamp":"2024-04-26T18:32:06.556698+0000","last_clean_scrub_stamp":"2024-04-26T18:32:06.556698+0000","objects_scrubbed":34,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:09.223628+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.10388457199999999,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":6,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"41'694","reported_seq":2784,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:11.830110+0000","last_change":"2024-04-26T18:32:11.830110+0000","last_active":"2024-04-26T18:32:11.830110+0000","last_peered":"2024-04-26T18:32:11.830110+0000","last_clean":"2024-04-26T18:32:11.830110+0000","last_became_active":"2024-04-26T17:58:04.726615+0000","last_became_peered":"2024-04-26T17:58:04.726615+0000","last_unstale":"2024-04-26T18:32:11.830110+0000","last_undegraded":"2024-04-26T18:32:11.830110+0000","last_fullsized":"2024-04-26T18:32:11.830110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'694","last_scrub_stamp":"2024-04-26T18:32:11.830020+0000","last_deep_scrub":"41'694","last_deep_scrub_stamp":"2024-04-26T18:32:11.830020+0000","last_clean_scrub_stamp":"2024-04-26T18:32:11.830020+0000","objects_scrubbed":55,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:16.222483+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0.16390716399999999,"stat_sum":{"num_bytes":0,"num_objects":55,"num_object_clones":17,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"41'646","reported_seq":2741,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:01.780439+0000","last_change":"2024-04-26T18:32:01.780490+0000","last_active":"2024-04-26T18:32:01.780439+0000","last_peered":"2024-04-26T18:32:01.780439+0000","last_clean":"2024-04-26T18:32:01.780439+0000","last_became_active":"2024-04-26T17:58:04.714049+0000","last_became_peered":"2024-04-26T17:58:04.714049+0000","last_unstale":"2024-04-26T18:32:01.780439+0000","last_undegraded":"2024-04-26T18:32:01.780439+0000","last_fullsized":"2024-04-26T18:32:01.780439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'646","last_scrub_stamp":"2024-04-26T18:32:01.780365+0000","last_deep_scrub":"41'646","last_deep_scrub_stamp":"2024-04-26T18:32:01.780365+0000","last_clean_scrub_stamp":"2024-04-26T18:32:01.780365+0000","objects_scrubbed":42,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:24.302566+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.19882805000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":10,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"41'640","reported_seq":2732,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:31:56.975704+0000","last_change":"2024-04-26T18:31:56.975765+0000","last_active":"2024-04-26T18:31:56.975704+0000","last_peered":"2024-04-26T18:31:56.975704+0000","last_clean":"2024-04-26T18:31:56.975704+0000","last_became_active":"2024-04-26T17:58:04.714807+0000","last_became_peered":"2024-04-26T17:58:04.714807+0000","last_unstale":"2024-04-26T18:31:56.975704+0000","last_undegraded":"2024-04-26T18:31:56.975704+0000","last_fullsized":"2024-04-26T18:31:56.975704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'640","last_scrub_stamp":"2024-04-26T18:31:56.975624+0000","last_deep_scrub":"41'640","last_deep_scrub_stamp":"2024-04-26T18:31:56.975624+0000","last_clean_scrub_stamp":"2024-04-26T18:31:56.975624+0000","objects_scrubbed":47,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.330947+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0.077373158999999997,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"41'626","reported_seq":2724,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T18:32:12.423461+0000","last_change":"2024-04-26T18:32:12.423532+0000","last_active":"2024-04-26T18:32:12.423461+0000","last_peered":"2024-04-26T18:32:12.423461+0000","last_clean":"2024-04-26T18:32:12.423461+0000","last_became_active":"2024-04-26T17:58:04.719154+0000","last_became_peered":"2024-04-26T17:58:04.719154+0000","last_unstale":"2024-04-26T18:32:12.423461+0000","last_undegraded":"2024-04-26T18:32:12.423461+0000","last_fullsized":"2024-04-26T18:32:12.423461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'626","last_scrub_stamp":"2024-04-26T18:32:12.423361+0000","last_deep_scrub":"41'626","last_deep_scrub_stamp":"2024-04-26T18:32:12.423361+0000","last_clean_scrub_stamp":"2024-04-26T18:32:12.423361+0000","objects_scrubbed":41,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:32.986258+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0.104812107,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1183673720,"num_objects":39268,"num_object_clones":18317,"num_object_copies":157072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39268,"num_whiteouts":18141,"num_read":5713,"num_read_kb":6011008,"num_write":75176,"num_write_kb":1483989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2573631488,"data_stored":2574974976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91894,"ondisk_log_size":91894,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3085,"num_object_clones":812,"num_object_copies":6170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3085,"num_whiteouts":812,"num_read":0,"num_read_kb":0,"num_write":3093,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42624,"ondisk_log_size":42624,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797006684,"num_objects":1886,"num_object_clones":0,"num_object_copies":3772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1886,"num_whiteouts":0,"num_read":2824,"num_read_kb":5408,"num_write":35013,"num_write_kb":2756186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1625,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24527923,"num_omap_keys":38818,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1594081280,"data_stored":1594013368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33082,"ondisk_log_size":33082,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575268,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":818236,"kb_used_data":570612,"kb_used_omap":1,"kb_used_meta":247614,"kb_avail":93553604,"statfs":{"total":96636764160,"available":95798890496,"internally_reserved":0,"allocated":584306688,"data_stored":584393669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":253557195},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575268,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":864928,"kb_used_data":545112,"kb_used_omap":1,"kb_used_meta":319806,"kb_avail":93506912,"statfs":{"total":96636764160,"available":95751077888,"internally_reserved":0,"allocated":558194688,"data_stored":558281943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":327481799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575268,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752988,"kb_used_data":455444,"kb_used_omap":1,"kb_used_meta":297534,"kb_avail":93618852,"statfs":{"total":96636764160,"available":95865704448,"internally_reserved":0,"allocated":466374656,"data_stored":466129553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":304675269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575268,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":746976,"kb_used_data":481304,"kb_used_omap":1,"kb_used_meta":265662,"kb_avail":93624864,"statfs":{"total":96636764160,"available":95871860736,"internally_reserved":0,"allocated":492855296,"data_stored":492773676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272038341},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575268,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":912936,"kb_used_data":574944,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":93458904,"statfs":{"total":96636764160,"available":95701917696,"internally_reserved":0,"allocated":588742656,"data_stored":588833154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":346094024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575268,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":534204,"kb_used_data":322676,"kb_used_omap":1,"kb_used_meta":211518,"kb_avail":93837636,"statfs":{"total":96636764160,"available":96089739264,"internally_reserved":0,"allocated":330420224,"data_stored":330182370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216594885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575268,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":986984,"kb_used_data":635168,"kb_used_omap":1,"kb_used_meta":351806,"kb_avail":93384856,"statfs":{"total":96636764160,"available":95626092544,"internally_reserved":0,"allocated":650412032,"data_stored":650334542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":360249798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575269,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":705460,"kb_used_data":489708,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93666380,"statfs":{"total":96636764160,"available":95914373120,"internally_reserved":0,"allocated":501460992,"data_stored":501203965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":205021184,"data_stored":205005563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234885740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163586048,"data_stored":163578528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":163594240,"data_stored":163582538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":206127104,"data_stored":206119855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":222908416,"data_stored":222897653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297287680,"data_stored":297280195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":295362560,"data_stored":295362560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415035392,"data_stored":415203328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":229273600,"data_stored":229273600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":424673280,"data_stored":425009152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":328777728,"data_stored":328945664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":259764224,"data_stored":259764224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":334802944,"data_stored":335138816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":285941760,"data_stored":286277632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:32:39.188 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T18:32:39.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.318+0000 7f70f0d19640 1 Processor -- start 2024-04-26T18:32:39.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.318+0000 7f70f0d19640 1 -- start start 2024-04-26T18:32:39.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70f0d19640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f70ec070230 0x7f70ec0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70f0d19640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec0c9c80 0x7f70ec0c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70f0d19640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70ec158960 con 0x7f70ec0c8b10 2024-04-26T18:32:39.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70f0d19640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f70ec159830 con 0x7f70ec070230 2024-04-26T18:32:39.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70f0d19640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f70ec158c20 con 0x7f70ec0c9c80 2024-04-26T18:32:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70e9d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f70ec070230 0x7f70ec0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70ea59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f70ec0c8b10 0x7f70ec06fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:42174/0 (socket says 172.21.15.139:42174) 2024-04-26T18:32:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70e9d9b640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f70ec070230 0x7f70ec0ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40010/0 (socket says 172.21.15.139:40010) 2024-04-26T18:32:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70ea59c640 1 -- 172.21.15.139:0/3914262281 learned_addr learned my addr 172.21.15.139:0/3914262281 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70ead9d640 1 --2- 172.21.15.139:0/3914262281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec0c9c80 0x7f70ec0c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70e9d9b640 1 -- 172.21.15.139:0/3914262281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec0c9c80 msgr2=0x7f70ec0c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:39.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70e9d9b640 1 --2- 172.21.15.139:0/3914262281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec0c9c80 0x7f70ec0c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70e9d9b640 1 -- 172.21.15.139:0/3914262281 >> v1:172.21.15.139:6789/0 conn(0x7f70ec0c8b10 legacy=0x7f70ec06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70e9d9b640 1 -- 172.21.15.139:0/3914262281 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec158f00 con 0x7f70ec070230 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70e959a640 1 -- 172.21.15.139:0/3914262281 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442226113 0 0) 0x7f70ec158960 con 0x7f70ec0c8b10 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.319+0000 7f70ead9d640 1 --2- 172.21.15.139:0/3914262281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec0c9c80 0x7f70ec0c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.320+0000 7f70e9d9b640 1 --2- 172.21.15.139:0/3914262281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec070230 0x7f70ec0ca460 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ba40 tx=0x7f70e002c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905621804c0cd03e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.320+0000 7f70e959a640 1 -- 172.21.15.139:0/3914262281 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e00327d0 con 0x7f70ec070230 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.320+0000 7f70e959a640 1 -- 172.21.15.139:0/3914262281 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e0038070 con 0x7f70ec070230 2024-04-26T18:32:39.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.320+0000 7f70e959a640 1 -- 172.21.15.139:0/3914262281 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0032b90 con 0x7f70ec070230 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 -- 172.21.15.139:0/3914262281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec070230 msgr2=0x7f70ec0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 --2- 172.21.15.139:0/3914262281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec070230 0x7f70ec0ca460 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ba40 tx=0x7f70e002c8d0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 -- 172.21.15.139:0/3914262281 shutdown_connections 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 --2- 172.21.15.139:0/3914262281 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec0c9c80 0x7f70ec0c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 --2- 172.21.15.139:0/3914262281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec070230 0x7f70ec0ca460 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 -- 172.21.15.139:0/3914262281 >> 172.21.15.139:0/3914262281 conn(0x7f70ec06dd40 msgr2=0x7f70ec06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 -- 172.21.15.139:0/3914262281 shutdown_connections 2024-04-26T18:32:39.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.321+0000 7f70f0d19640 1 -- 172.21.15.139:0/3914262281 wait complete. 2024-04-26T18:32:39.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.322+0000 7f70f0d19640 1 Processor -- start 2024-04-26T18:32:39.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.322+0000 7f70f0d19640 1 -- start start 2024-04-26T18:32:39.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70f0d19640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec070230 0x7f70ec1f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70f0d19640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec0c8b10 0x7f70ec1e2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70f0d19640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70ec0c9c80 0x7f70ec142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70f0d19640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec0c2020 con 0x7f70ec0c8b10 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70f0d19640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec1594c0 con 0x7f70ec0c9c80 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70f0d19640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f70ec0cdd30 con 0x7f70ec070230 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec0c8b10 0x7f70ec1e2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec0c8b10 0x7f70ec1e2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40022/0 (socket says 172.21.15.139:40022) 2024-04-26T18:32:39.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 -- 172.21.15.139:0/4130914198 learned_addr learned my addr 172.21.15.139:0/4130914198 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70ea59c640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec070230 0x7f70ec1f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70ead9d640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70ec0c9c80 0x7f70ec142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 -- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec070230 msgr2=0x7f70ec1f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec070230 0x7f70ec1f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 -- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70ec0c9c80 msgr2=0x7f70ec142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70ec0c9c80 0x7f70ec142950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 -- 172.21.15.139:0/4130914198 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec1f50a0 con 0x7f70ec0c8b10 2024-04-26T18:32:39.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.323+0000 7f70e9d9b640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec0c8b10 0x7f70ec1e2740 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f70e000bb60 tx=0x7f70e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.324+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0033ca0 con 0x7f70ec0c8b10 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.324+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e0046410 con 0x7f70ec0c8b10 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.324+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec1e2120 con 0x7f70ec0c8b10 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.324+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0033e60 con 0x7f70ec0c8b10 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.324+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec1f5340 con 0x7f70ec0c8b10 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.325+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec076d20 con 0x7f70ec0c8b10 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.325+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f70e0044020 con 0x7f70ec0c8b10 2024-04-26T18:32:39.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.326+0000 7f70daffd640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f70cc06c8f0 0x7f70cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.326+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f70e00acf40 con 0x7f70ec0c8b10 2024-04-26T18:32:39.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.326+0000 7f70ea59c640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f70cc06c8f0 0x7f70cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.326+0000 7f70ea59c640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f70cc06c8f0 0x7f70cc06edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000f60 tx=0x7f70dc007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.330+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f70e007af30 con 0x7f70ec0c8b10 2024-04-26T18:32:39.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.512+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f70ec0ca240 con 0x7f70ec0c8b10 2024-04-26T18:32:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.516+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f70e007a830 con 0x7f70ec0c8b10 2024-04-26T18:32:39.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.517+0000 7f70daffd640 1 -- 172.21.15.139:0/4130914198 <== mon.0 v2:172.21.15.139:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f70e0032eb0 con 0x7f70ec0c8b10 2024-04-26T18:32:39.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f70cc06c8f0 msgr2=0x7f70cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f70cc06c8f0 0x7f70cc06edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f70dc000f60 tx=0x7f70dc007c00 comp rx=0 tx=0).stop 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec0c8b10 msgr2=0x7f70ec1e2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec0c8b10 0x7f70ec1e2740 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f70e000bb60 tx=0x7f70e0004730 comp rx=0 tx=0).stop 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 shutdown_connections 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f70cc06c8f0 0x7f70cc06edb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f70ec0c9c80 0x7f70ec142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70ec0c8b10 0x7f70ec1e2740 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 --2- 172.21.15.139:0/4130914198 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f70ec070230 0x7f70ec1f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 >> 172.21.15.139:0/4130914198 conn(0x7f70ec06dd40 msgr2=0x7f70ec06e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 shutdown_connections 2024-04-26T18:32:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.519+0000 7f70f0d19640 1 -- 172.21.15.139:0/4130914198 wait complete. 2024-04-26T18:32:39.531 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T18:32:39.531 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:32:39.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.629+0000 7fccc3186640 1 Processor -- start 2024-04-26T18:32:39.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.629+0000 7fccc3186640 1 -- start start 2024-04-26T18:32:39.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc3186640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7fccbc156180 0x7fccbc15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc3186640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc0cd840 0x7fccbc0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc3186640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccbc15f2a0 con 0x7fccbc155da0 2024-04-26T18:32:39.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc3186640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7fccbc15cbc0 con 0x7fccbc156180 2024-04-26T18:32:39.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc3186640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fccbc0cc730 con 0x7fccbc0cd840 2024-04-26T18:32:39.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc0f22640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fccbc155da0 0x7fccbc0d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34938/0 (socket says 172.21.15.139:34938) 2024-04-26T18:32:39.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc0f22640 1 -- 172.21.15.139:0/880132783 learned_addr learned my addr 172.21.15.139:0/880132783 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:39.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbbfff640 1 --2- 172.21.15.139:0/880132783 >> v2:172.21.15.143:3300/0 conn(0x7fccbc156180 0x7fccbc15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccc1723640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc0cd840 0x7fccbc0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961211663 0 0) 0x7fccbc15f2a0 con 0x7fccbc155da0 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccac003520 con 0x7fccbc155da0 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3192531794 0 0) 0x7fccac003520 con 0x7fccbc155da0 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc0cd840 msgr2=0x7fccbc0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc0cd840 0x7fccbc0c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 >> v2:172.21.15.143:3300/0 conn(0x7fccbc156180 msgr2=0x7fccbc15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 --2- 172.21.15.139:0/880132783 >> v2:172.21.15.143:3300/0 conn(0x7fccbc156180 0x7fccbc15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc15f580 con 0x7fccbc155da0 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7fccb0001670 con 0x7fccbc155da0 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 >> v1:172.21.15.139:6789/0 conn(0x7fccbc155da0 legacy=0x7fccbc0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.630+0000 7fccbb7fe640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccac0039b0 0x7fccac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbb7fe640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccac004800 0x7fccac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbb7fe640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0051c0 0x7fccac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc15cbc0 con 0x7fccac0039b0 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc0cc730 con 0x7fccac0051c0 2024-04-26T18:32:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fccac00bf50 con 0x7fccac004800 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc1723640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc0cd840 0x7fccbc0c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbbfff640 1 --2- 172.21.15.139:0/880132783 >> v2:172.21.15.143:3300/0 conn(0x7fccbc156180 0x7fccbc15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc0f22640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccac0039b0 0x7fccac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbbfff640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccac004800 0x7fccac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc1723640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0051c0 0x7fccac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc0f22640 1 -- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccac004800 msgr2=0x7fccac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc0f22640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccac004800 0x7fccac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc0f22640 1 -- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0051c0 msgr2=0x7fccac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc0f22640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0051c0 0x7fccac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccc0f22640 1 -- 172.21.15.139:0/880132783 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac003520 con 0x7fccac0039b0 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.631+0000 7fccbbfff640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccac004800 0x7fccac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc0f22640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccac0039b0 0x7fccac003dd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c2c0 tx=0x7fccac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb9bc67971ac4cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0007d50 con 0x7fccac0039b0 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fccb002e070 con 0x7fccac0039b0 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccbb7fe640 1 -- 172.21.15.139:0/880132783 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0005d50 con 0x7fccac0039b0 2024-04-26T18:32:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc3186640 1 -- 172.21.15.139:0/880132783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccac0039b0 msgr2=0x7fccac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc3186640 1 --2- 172.21.15.139:0/880132783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccac0039b0 0x7fccac003dd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c2c0 tx=0x7fccac005830 comp rx=0 tx=0).stop 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc1723640 1 -- 172.21.15.139:0/880132783 reap_dead start 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc3186640 1 -- 172.21.15.139:0/880132783 shutdown_connections 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc3186640 1 -- 172.21.15.139:0/880132783 >> 172.21.15.139:0/880132783 conn(0x7fccbc068090 msgr2=0x7fccbc0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc3186640 1 -- 172.21.15.139:0/880132783 shutdown_connections 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.632+0000 7fccc3186640 1 -- 172.21.15.139:0/880132783 wait complete. 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 Processor -- start 2024-04-26T18:32:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 -- start start 2024-04-26T18:32:39.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0039b0 0x7fccbc156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc157430 0x7fccbc157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccbc158240 0x7fccbc1efa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc0d19d0 con 0x7fccbc158240 2024-04-26T18:32:39.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc15fb40 con 0x7fccac0039b0 2024-04-26T18:32:39.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.634+0000 7fccc3186640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fccbc0d1b50 con 0x7fccbc157430 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccbc158240 0x7fccbc1efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccbc158240 0x7fccbc1efa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41918/0 (socket says 172.21.15.139:41918) 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 -- 172.21.15.139:0/3354188257 learned_addr learned my addr 172.21.15.139:0/3354188257 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccbbfff640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc157430 0x7fccbc157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc0f22640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0039b0 0x7fccbc156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 -- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc157430 msgr2=0x7fccbc157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc157430 0x7fccbc157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 -- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0039b0 msgr2=0x7fccbc156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0039b0 0x7fccbc156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 -- 172.21.15.139:0/3354188257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc1ef500 con 0x7fccbc158240 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc0f22640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0039b0 0x7fccbc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc1723640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccbc158240 0x7fccbc1efa00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0b7460 tx=0x7fccb4011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccb97fa640 1 -- 172.21.15.139:0/3354188257 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4003990 con 0x7fccbc158240 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccb97fa640 1 -- 172.21.15.139:0/3354188257 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fccb401b070 con 0x7fccbc158240 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc158aa0 con 0x7fccbc158240 2024-04-26T18:32:39.644 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccb97fa640 1 -- 172.21.15.139:0/3354188257 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4003b70 con 0x7fccbc158240 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.635+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccbc1f1df0 con 0x7fccbc158240 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.636+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccbc1ef6d0 con 0x7fccbc158240 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.637+0000 7fccb97fa640 1 -- 172.21.15.139:0/3354188257 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fccb4005d10 con 0x7fccbc158240 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.637+0000 7fccb97fa640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcca006c920 0x7fcca006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.637+0000 7fccb97fa640 1 -- 172.21.15.139:0/3354188257 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fccb408d550 con 0x7fccbc158240 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.637+0000 7fccc0f22640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcca006c920 0x7fcca006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.638+0000 7fccc0f22640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcca006c920 0x7fcca006ede0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fccb0033000 tx=0x7fccb0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.645 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.641+0000 7fccb97fa640 1 -- 172.21.15.139:0/3354188257 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fccb4025020 con 0x7fccbc158240 2024-04-26T18:32:39.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.855+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccbc076d20 con 0x7fccbc158240 2024-04-26T18:32:39.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.855+0000 7fccb97fa640 1 -- 172.21.15.139:0/3354188257 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7fccb405b590 con 0x7fccbc158240 2024-04-26T18:32:39.856 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:32:39.856 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:32:39.857 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:32:39.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.857+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcca006c920 msgr2=0x7fcca006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.857+0000 7fccc3186640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcca006c920 0x7fcca006ede0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fccb0033000 tx=0x7fccb0009030 comp rx=0 tx=0).stop 2024-04-26T18:32:39.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.857+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccbc158240 msgr2=0x7fccbc1efa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.857+0000 7fccc3186640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccbc158240 0x7fccbc1efa00 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0b7460 tx=0x7fccb4011890 comp rx=0 tx=0).stop 2024-04-26T18:32:39.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 shutdown_connections 2024-04-26T18:32:39.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcca006c920 0x7fcca006ede0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccbc158240 0x7fccbc1efa00 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fccbc157430 0x7fccbc157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 --2- 172.21.15.139:0/3354188257 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccac0039b0 0x7fccbc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 >> 172.21.15.139:0/3354188257 conn(0x7fccbc068090 msgr2=0x7fccbc15b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:39.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 shutdown_connections 2024-04-26T18:32:39.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.858+0000 7fccc3186640 1 -- 172.21.15.139:0/3354188257 wait complete. 2024-04-26T18:32:39.869 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:32:39.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.967+0000 7f923ceb8640 1 Processor -- start 2024-04-26T18:32:39.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.967+0000 7f923ceb8640 1 -- start start 2024-04-26T18:32:39.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.967+0000 7f923ceb8640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92380cb950 0x7f92381652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f923ceb8640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9238159d70 con 0x7f92380caab0 2024-04-26T18:32:39.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f923ceb8640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9238154030 con 0x7f9238153c50 2024-04-26T18:32:39.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f923ceb8640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f92380c43a0 con 0x7f92380cb950 2024-04-26T18:32:39.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f9236d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92380cb950 0x7f92381652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f9235d9b640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f92380caab0 0x7f923806fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34948/0 (socket says 172.21.15.139:34948) 2024-04-26T18:32:39.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f9236d9d640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f92380cb950 0x7f92381652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41932/0 (socket says 172.21.15.139:41932) 2024-04-26T18:32:39.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f9235d9b640 1 -- 172.21.15.139:0/3962974461 learned_addr learned my addr 172.21.15.139:0/3962974461 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:39.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f9236d9d640 1 -- 172.21.15.139:0/3962974461 >> v1:172.21.15.143:6789/0 conn(0x7f9238153c50 legacy=0x7f92380cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f9236d9d640 1 -- 172.21.15.139:0/3962974461 >> v1:172.21.15.139:6789/0 conn(0x7f92380caab0 legacy=0x7f923806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f9236d9d640 1 -- 172.21.15.139:0/3962974461 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923815a030 con 0x7f92380cb950 2024-04-26T18:32:39.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.968+0000 7f923559a640 1 -- 172.21.15.139:0/3962974461 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443855637 0 0) 0x7f9238159d70 con 0x7f92380caab0 2024-04-26T18:32:39.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.969+0000 7f9236d9d640 1 --2- 172.21.15.139:0/3962974461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92380cb950 0x7f92381652e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9230009d90 tx=0x7f923002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690c6f1bba74e472 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.969+0000 7f923559a640 1 -- 172.21.15.139:0/3962974461 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230037070 con 0x7f92380cb950 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.969+0000 7f923559a640 1 -- 172.21.15.139:0/3962974461 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9230007740 con 0x7f92380cb950 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.969+0000 7f923559a640 1 -- 172.21.15.139:0/3962974461 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230007b30 con 0x7f92380cb950 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.970+0000 7f923ceb8640 1 -- 172.21.15.139:0/3962974461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92380cb950 msgr2=0x7f92381652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.970+0000 7f923ceb8640 1 --2- 172.21.15.139:0/3962974461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92380cb950 0x7f92381652e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9230009d90 tx=0x7f923002a780 comp rx=0 tx=0).stop 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.970+0000 7f923ceb8640 1 -- 172.21.15.139:0/3962974461 shutdown_connections 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.970+0000 7f923ceb8640 1 --2- 172.21.15.139:0/3962974461 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92380cb950 0x7f92381652e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.970+0000 7f923ceb8640 1 -- 172.21.15.139:0/3962974461 >> 172.21.15.139:0/3962974461 conn(0x7f9238071bf0 msgr2=0x7f9238071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.970+0000 7f923ceb8640 1 -- 172.21.15.139:0/3962974461 shutdown_connections 2024-04-26T18:32:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.970+0000 7f923ceb8640 1 -- 172.21.15.139:0/3962974461 wait complete. 2024-04-26T18:32:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.971+0000 7f923ceb8640 1 Processor -- start 2024-04-26T18:32:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.971+0000 7f923ceb8640 1 -- start start 2024-04-26T18:32:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f923ceb8640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92380caab0 0x7f92381f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f923ceb8640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92380cb950 0x7f92381e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f923ceb8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9238153c50 0x7f923814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f923ceb8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f92380cf4c0 con 0x7f9238153c50 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f923ceb8640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f923815a8d0 con 0x7f92380caab0 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f923ceb8640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f923815a5f0 con 0x7f92380cb950 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9238153c50 0x7f923814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9238153c50 0x7f923814ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41944/0 (socket says 172.21.15.139:41944) 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 -- 172.21.15.139:0/4131004004 learned_addr learned my addr 172.21.15.139:0/4131004004 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9235d9b640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92380cb950 0x7f92381e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f923659c640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92380caab0 0x7f92381f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 -- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92380cb950 msgr2=0x7f92381e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92380cb950 0x7f92381e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 -- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92380caab0 msgr2=0x7f92381f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92380caab0 0x7f92381f04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.972+0000 7f9236d9d640 1 -- 172.21.15.139:0/4131004004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92381e5680 con 0x7f9238153c50 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.973+0000 7f9236d9d640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9238153c50 0x7f923814ec40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9230035040 tx=0x7f9230004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.973+0000 7f9226ffd640 1 -- 172.21.15.139:0/4131004004 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230042020 con 0x7f9238153c50 2024-04-26T18:32:39.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.973+0000 7f9226ffd640 1 -- 172.21.15.139:0/4131004004 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9230007e40 con 0x7f9238153c50 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.973+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92380b4610 con 0x7f9238153c50 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.973+0000 7f9226ffd640 1 -- 172.21.15.139:0/4131004004 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230037040 con 0x7f9238153c50 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.973+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92381efcc0 con 0x7f9238153c50 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.974+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9238069ae0 con 0x7f9238153c50 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.974+0000 7f9226ffd640 1 -- 172.21.15.139:0/4131004004 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9230045020 con 0x7f9238153c50 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.974+0000 7f9226ffd640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f921806c8f0 0x7f921806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.975+0000 7f9226ffd640 1 -- 172.21.15.139:0/4131004004 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7f92300ad250 con 0x7f9238153c50 2024-04-26T18:32:39.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.975+0000 7f923659c640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f921806c8f0 0x7f921806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:39.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.975+0000 7f923659c640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f921806c8f0 0x7f921806edb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9228000f60 tx=0x7f9228009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:39.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:39.979+0000 7f9226ffd640 1 -- 172.21.15.139:0/4131004004 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f923004c030 con 0x7f9238153c50 2024-04-26T18:32:40.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.199+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9238076d20 con 0x7f9238153c50 2024-04-26T18:32:40.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.200+0000 7f9226ffd640 1 -- 172.21.15.139:0/4131004004 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6823 (secure 0 0 0) 0x7f923007ac20 con 0x7f9238153c50 2024-04-26T18:32:40.200 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:32:40.200 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6836/3914708776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6833","nonce":3914708776},{"type":"v1","addr":"172.21.15.143:6836","nonce":3914708776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/75605651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":75605651},{"type":"v1","addr":"172.21.15.139:6836","nonce":75605651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/687656878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":687656878},{"type":"v1","addr":"172.21.15.139:6837","nonce":687656878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/293719818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":293719818},{"type":"v1","addr":"172.21.15.139:6839","nonce":293719818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/819206996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6835","nonce":819206996},{"type":"v1","addr":"172.21.15.143:6837","nonce":819206996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:04.046385+0000","modified":"2024-04-26T17:58:27.123495+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4309":{"gid":4309,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.143:6834/19919207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":19919207},{"type":"v1","addr":"172.21.15.143:6834","nonce":19919207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4309,"qdb_cluster":[4309]},"id":1}]} 2024-04-26T18:32:40.201 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2024-04-26T18:32:40.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f921806c8f0 msgr2=0x7f921806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f921806c8f0 0x7f921806edb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9228000f60 tx=0x7f9228009040 comp rx=0 tx=0).stop 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9238153c50 msgr2=0x7f923814ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9238153c50 0x7f923814ec40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9230035040 tx=0x7f9230004a40 comp rx=0 tx=0).stop 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 shutdown_connections 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f921806c8f0 0x7f921806edb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9238153c50 0x7f923814ec40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f92380cb950 0x7f92381e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 --2- 172.21.15.139:0/4131004004 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f92380caab0 0x7f92381f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 >> 172.21.15.139:0/4131004004 conn(0x7f9238071bf0 msgr2=0x7f92380c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 shutdown_connections 2024-04-26T18:32:40.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.202+0000 7f923ceb8640 1 -- 172.21.15.139:0/4131004004 wait complete. 2024-04-26T18:32:40.213 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T18:32:40.311 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.311+0000 7fc624b7f640 1 Processor -- start 2024-04-26T18:32:40.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.311+0000 7fc624b7f640 1 -- start start 2024-04-26T18:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.312+0000 7fc624b7f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62015bb80 0x7fc620068090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.312+0000 7fc624b7f640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62015c010 con 0x7fc6200b0c00 2024-04-26T18:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.312+0000 7fc624b7f640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62015c2a0 con 0x7fc6200afda0 2024-04-26T18:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.312+0000 7fc624b7f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc6200b0fe0 con 0x7fc62015bb80 2024-04-26T18:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.312+0000 7fc61e59c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fc6200b0c00 0x7fc62015fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34960/0 (socket says 172.21.15.139:34960) 2024-04-26T18:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.312+0000 7fc61e59c640 1 -- 172.21.15.139:0/1243542183 learned_addr learned my addr 172.21.15.139:0/1243542183 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.312+0000 7fc61ed9d640 1 --2- 172.21.15.139:0/1243542183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62015bb80 0x7fc620068090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.313+0000 7fc61d59a640 1 -- 172.21.15.139:0/1243542183 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674107395 0 0) 0x7fc62015c010 con 0x7fc6200b0c00 2024-04-26T18:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.313+0000 7fc61d59a640 1 -- 172.21.15.139:0/1243542183 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc608003520 con 0x7fc6200b0c00 2024-04-26T18:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.313+0000 7fc61ed9d640 1 -- 172.21.15.139:0/1243542183 >> v1:172.21.15.143:6789/0 conn(0x7fc6200afda0 legacy=0x7fc620072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.313+0000 7fc61ed9d640 1 -- 172.21.15.139:0/1243542183 >> v1:172.21.15.139:6789/0 conn(0x7fc6200b0c00 legacy=0x7fc62015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.313+0000 7fc61ed9d640 1 -- 172.21.15.139:0/1243542183 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62015c580 con 0x7fc62015bb80 2024-04-26T18:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.313+0000 7fc61ed9d640 1 --2- 172.21.15.139:0/1243542183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62015bb80 0x7fc620068090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc618009dc0 tx=0x7fc61802a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ab33cdfcff74a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc61d59a640 1 -- 172.21.15.139:0/1243542183 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618007740 con 0x7fc62015bb80 2024-04-26T18:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc61d59a640 1 -- 172.21.15.139:0/1243542183 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc6180078e0 con 0x7fc62015bb80 2024-04-26T18:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc61d59a640 1 -- 172.21.15.139:0/1243542183 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618007c90 con 0x7fc62015bb80 2024-04-26T18:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc624b7f640 1 -- 172.21.15.139:0/1243542183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62015bb80 msgr2=0x7fc620068090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1243542183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62015bb80 0x7fc620068090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc618009dc0 tx=0x7fc61802a760 comp rx=0 tx=0).stop 2024-04-26T18:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc624b7f640 1 -- 172.21.15.139:0/1243542183 shutdown_connections 2024-04-26T18:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1243542183 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc62015bb80 0x7fc620068090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc624b7f640 1 -- 172.21.15.139:0/1243542183 >> 172.21.15.139:0/1243542183 conn(0x7fc6200ce110 msgr2=0x7fc6200ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc624b7f640 1 -- 172.21.15.139:0/1243542183 shutdown_connections 2024-04-26T18:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.314+0000 7fc624b7f640 1 -- 172.21.15.139:0/1243542183 wait complete. 2024-04-26T18:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 Processor -- start 2024-04-26T18:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 -- start start 2024-04-26T18:32:40.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6200afda0 0x7fc62015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6200b0c00 0x7fc6200cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62015bb80 0x7fc620151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc62015f640 con 0x7fc6200b0c00 2024-04-26T18:32:40.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fc62015cb40 con 0x7fc62015bb80 2024-04-26T18:32:40.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc624b7f640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fc62015f2d0 con 0x7fc6200afda0 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc61dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6200b0c00 0x7fc6200cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc61dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6200b0c00 0x7fc6200cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41952/0 (socket says 172.21.15.139:41952) 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc61dd9b640 1 -- 172.21.15.139:0/1201716216 learned_addr learned my addr 172.21.15.139:0/1201716216 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc61e59c640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6200afda0 0x7fc62015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.316+0000 7fc61ed9d640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62015bb80 0x7fc620151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc61dd9b640 1 -- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6200afda0 msgr2=0x7fc62015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc61dd9b640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6200afda0 0x7fc62015ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc61dd9b640 1 -- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62015bb80 msgr2=0x7fc620151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc61dd9b640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62015bb80 0x7fc620151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc61dd9b640 1 -- 172.21.15.139:0/1201716216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6200b3630 con 0x7fc6200b0c00 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc61dd9b640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6200b0c00 0x7fc6200cd1d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c470 tx=0x7fc610001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc60effd640 1 -- 172.21.15.139:0/1201716216 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6100052d0 con 0x7fc6200b0c00 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc60effd640 1 -- 172.21.15.139:0/1201716216 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc610005470 con 0x7fc6200b0c00 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc60effd640 1 -- 172.21.15.139:0/1201716216 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610007280 con 0x7fc6200b0c00 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62015d480 con 0x7fc6200b0c00 2024-04-26T18:32:40.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.317+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62015cda0 con 0x7fc6200b0c00 2024-04-26T18:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.318+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc620073b10 con 0x7fc6200b0c00 2024-04-26T18:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.318+0000 7fc60effd640 1 -- 172.21.15.139:0/1201716216 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc610007420 con 0x7fc6200b0c00 2024-04-26T18:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.319+0000 7fc60effd640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc60006c8f0 0x7fc60006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.319+0000 7fc60effd640 1 -- 172.21.15.139:0/1201716216 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fc61008b460 con 0x7fc6200b0c00 2024-04-26T18:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.319+0000 7fc61e59c640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc60006c8f0 0x7fc60006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.319+0000 7fc61e59c640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc60006c8f0 0x7fc60006edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6140011e0 tx=0x7fc614007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.323+0000 7fc60effd640 1 -- 172.21.15.139:0/1201716216 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc620073b10 con 0x7fc6200b0c00 2024-04-26T18:32:40.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.498+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc620076d20 con 0x7fc6200b0c00 2024-04-26T18:32:40.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.499+0000 7fc60effd640 1 -- 172.21.15.139:0/1201716216 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+19069 (secure 0 0 0) 0x7fc6200b3630 con 0x7fc6200b0c00 2024-04-26T18:32:40.500 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-26T18:32:40.500 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":41,"fsid":"ef741c66-6f9a-4560-84cd-b0800c4824c8","created":"2024-04-26T17:57:40.968728+0000","modified":"2024-04-26T18:03:05.800428+0000","last_up_change":"2024-04-26T17:57:52.097026+0000","last_in_change":"2024-04-26T17:57:43.168764+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:57:53.040764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:01.890167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:03.007303+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:06.720686+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6951230-a06c-4cb8-9d72-2d09d8613dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6801","nonce":1771669412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6803","nonce":1771669412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6807","nonce":1771669412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1771669412},{"type":"v1","addr":"172.21.15.139:6805","nonce":1771669412}]},"public_addr":"172.21.15.139:6801/1771669412","cluster_addr":"172.21.15.139:6803/1771669412","heartbeat_back_addr":"172.21.15.139:6807/1771669412","heartbeat_front_addr":"172.21.15.139:6805/1771669412","state":["exists","up"]},{"osd":1,"uuid":"67d74841-bcd8-49bb-a1ea-d377f02f9809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6825","nonce":1977806301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6827","nonce":1977806301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6831","nonce":1977806301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":1977806301},{"type":"v1","addr":"172.21.15.139:6829","nonce":1977806301}]},"public_addr":"172.21.15.139:6825/1977806301","cluster_addr":"172.21.15.139:6827/1977806301","heartbeat_back_addr":"172.21.15.139:6831/1977806301","heartbeat_front_addr":"172.21.15.139:6829/1977806301","state":["exists","up"]},{"osd":2,"uuid":"217ac863-ae16-45ca-beb8-ea1c98608bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6809","nonce":522876570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6811","nonce":522876570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6815","nonce":522876570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":522876570},{"type":"v1","addr":"172.21.15.139:6813","nonce":522876570}]},"public_addr":"172.21.15.139:6809/522876570","cluster_addr":"172.21.15.139:6811/522876570","heartbeat_back_addr":"172.21.15.139:6815/522876570","heartbeat_front_addr":"172.21.15.139:6813/522876570","state":["exists","up"]},{"osd":3,"uuid":"c63be4e7-36b9-4a28-bd92-f19624621308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6817","nonce":797802605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6819","nonce":797802605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6823","nonce":797802605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":797802605},{"type":"v1","addr":"172.21.15.139:6821","nonce":797802605}]},"public_addr":"172.21.15.139:6817/797802605","cluster_addr":"172.21.15.139:6819/797802605","heartbeat_back_addr":"172.21.15.139:6823/797802605","heartbeat_front_addr":"172.21.15.139:6821/797802605","state":["exists","up"]},{"osd":4,"uuid":"9f00d029-aa1d-4c57-bc47-5754aa16cc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6801","nonce":1263839422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6803","nonce":1263839422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6807","nonce":1263839422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":1263839422},{"type":"v1","addr":"172.21.15.143:6805","nonce":1263839422}]},"public_addr":"172.21.15.143:6801/1263839422","cluster_addr":"172.21.15.143:6803/1263839422","heartbeat_back_addr":"172.21.15.143:6807/1263839422","heartbeat_front_addr":"172.21.15.143:6805/1263839422","state":["exists","up"]},{"osd":5,"uuid":"8c61e259-582c-460f-8e57-9e5d5cc4d3eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6809","nonce":3412241994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6811","nonce":3412241994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6815","nonce":3412241994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3412241994},{"type":"v1","addr":"172.21.15.143:6813","nonce":3412241994}]},"public_addr":"172.21.15.143:6809/3412241994","cluster_addr":"172.21.15.143:6811/3412241994","heartbeat_back_addr":"172.21.15.143:6815/3412241994","heartbeat_front_addr":"172.21.15.143:6813/3412241994","state":["exists","up"]},{"osd":6,"uuid":"70338401-87be-4309-8795-449c1c990609","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6817","nonce":3661563662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6819","nonce":3661563662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6823","nonce":3661563662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":3661563662},{"type":"v1","addr":"172.21.15.143:6821","nonce":3661563662}]},"public_addr":"172.21.15.143:6817/3661563662","cluster_addr":"172.21.15.143:6819/3661563662","heartbeat_back_addr":"172.21.15.143:6823/3661563662","heartbeat_front_addr":"172.21.15.143:6821/3661563662","state":["exists","up"]},{"osd":7,"uuid":"29a5a215-4bec-4320-a3ac-3a8a48619903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6825","nonce":735298849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6827","nonce":735298849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6831","nonce":735298849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":735298849},{"type":"v1","addr":"172.21.15.143:6829","nonce":735298849}]},"public_addr":"172.21.15.143:6825/735298849","cluster_addr":"172.21.15.143:6827/735298849","heartbeat_back_addr":"172.21.15.143:6831/735298849","heartbeat_front_addr":"172.21.15.143:6829/735298849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.308183+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.369797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.291064+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.373014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.290647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.295026+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.368770+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:48.370638+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":464,"length":42}]},{"pool":4,"snaps":[{"begin":464,"length":42}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:32:40.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc60006c8f0 msgr2=0x7fc60006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc60006c8f0 0x7fc60006edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6140011e0 tx=0x7fc614007d30 comp rx=0 tx=0).stop 2024-04-26T18:32:40.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6200b0c00 msgr2=0x7fc6200cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6200b0c00 0x7fc6200cd1d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c470 tx=0x7fc610001e70 comp rx=0 tx=0).stop 2024-04-26T18:32:40.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 shutdown_connections 2024-04-26T18:32:40.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fc60006c8f0 0x7fc60006edb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc62015bb80 0x7fc620151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6200b0c00 0x7fc6200cd1d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 --2- 172.21.15.139:0/1201716216 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fc6200afda0 0x7fc62015ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.501+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 >> 172.21.15.139:0/1201716216 conn(0x7fc6200ce110 msgr2=0x7fc6200c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.502+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 shutdown_connections 2024-04-26T18:32:40.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.502+0000 7fc624b7f640 1 -- 172.21.15.139:0/1201716216 wait complete. 2024-04-26T18:32:40.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T18:32:40.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.609+0000 7fcf58911640 1 Processor -- start 2024-04-26T18:32:40.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.610+0000 7fcf58911640 1 -- start start 2024-04-26T18:32:40.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.610+0000 7fcf58911640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 0x7fcf540cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.610+0000 7fcf58911640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf540ccc60 con 0x7fcf54155cf0 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.610+0000 7fcf58911640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5415f7a0 con 0x7fcf540cbac0 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.610+0000 7fcf58911640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5406c310 con 0x7fcf5415f010 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5259c640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7fcf54155cf0 0x7fcf5415c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34968/0 (socket says 172.21.15.139:34968) 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5259c640 1 -- 172.21.15.139:0/286655195 learned_addr learned my addr 172.21.15.139:0/286655195 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 0x7fcf540cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961889036 0 0) 0x7fcf540ccc60 con 0x7fcf54155cf0 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf3c003520 con 0x7fcf54155cf0 2024-04-26T18:32:40.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 <== mon.1 v1:172.21.15.143:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279458469 0 0) 0x7fcf5415f7a0 con 0x7fcf540cbac0 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 --> v1:172.21.15.143:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf540ccc60 con 0x7fcf540cbac0 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2341711902 0 0) 0x7fcf3c003520 con 0x7fcf54155cf0 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 msgr2=0x7fcf540cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 0x7fcf540cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 >> v1:172.21.15.143:6789/0 conn(0x7fcf540cbac0 legacy=0x7fcf54071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5415fa80 con 0x7fcf54155cf0 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7fcf44001670 con 0x7fcf54155cf0 2024-04-26T18:32:40.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 0x7fcf540cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 >> v1:172.21.15.139:6789/0 conn(0x7fcf54155cf0 legacy=0x7fcf5415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c003b70 0x7fcf3c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf3c004800 0x7fcf3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 0x7fcf3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c00ba70 con 0x7fcf3c004800 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c00bbf0 con 0x7fcf3c003b70 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3c00bdc0 con 0x7fcf5415f010 2024-04-26T18:32:40.617 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf3c004800 0x7fcf3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf5259c640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c003b70 0x7fcf3c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.611+0000 7fcf52d9d640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 0x7fcf3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf51d9b640 1 -- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 msgr2=0x7fcf3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf5415f010 0x7fcf3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf51d9b640 1 -- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c003b70 msgr2=0x7fcf3c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c003b70 0x7fcf3c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf51d9b640 1 -- 172.21.15.139:0/286655195 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c003520 con 0x7fcf3c004800 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf3c004800 0x7fcf3c004c80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009c60 tx=0x7fcf3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd3e8f32f776824 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.618 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48036070 con 0x7fcf3c004800 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcf48031400 con 0x7fcf3c004800 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.612+0000 7fcf5159a640 1 -- 172.21.15.139:0/286655195 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48009860 con 0x7fcf3c004800 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.613+0000 7fcf58911640 1 -- 172.21.15.139:0/286655195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf3c004800 msgr2=0x7fcf3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.613+0000 7fcf58911640 1 --2- 172.21.15.139:0/286655195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf3c004800 0x7fcf3c004c80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009c60 tx=0x7fcf3c005830 comp rx=0 tx=0).stop 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.613+0000 7fcf52d9d640 1 -- 172.21.15.139:0/286655195 reap_dead start 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.613+0000 7fcf58911640 1 -- 172.21.15.139:0/286655195 shutdown_connections 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.613+0000 7fcf58911640 1 -- 172.21.15.139:0/286655195 >> 172.21.15.139:0/286655195 conn(0x7fcf5406ffc0 msgr2=0x7fcf540703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.613+0000 7fcf58911640 1 -- 172.21.15.139:0/286655195 shutdown_connections 2024-04-26T18:32:40.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.613+0000 7fcf58911640 1 -- 172.21.15.139:0/286655195 wait complete. 2024-04-26T18:32:40.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.614+0000 7fcf58911640 1 Processor -- start 2024-04-26T18:32:40.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.614+0000 7fcf58911640 1 -- start start 2024-04-26T18:32:40.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf58911640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c004800 0x7fcf541550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf58911640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf540b14d0 0x7fcf541524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf58911640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf540b1910 0x7fcf5414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf58911640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcf540cb060 con 0x7fcf540b1910 2024-04-26T18:32:40.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf58911640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7fcf540cad80 con 0x7fcf3c004800 2024-04-26T18:32:40.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf58911640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7fcf541560d0 con 0x7fcf540b14d0 2024-04-26T18:32:40.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf540b1910 0x7fcf5414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf540b1910 0x7fcf5414bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41968/0 (socket says 172.21.15.139:41968) 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 -- 172.21.15.139:0/855515756 learned_addr learned my addr 172.21.15.139:0/855515756 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf5259c640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c004800 0x7fcf541550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf540b14d0 0x7fcf541524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 -- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf540b14d0 msgr2=0x7fcf541524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf540b14d0 0x7fcf541524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 -- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c004800 msgr2=0x7fcf541550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c004800 0x7fcf541550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf52d9d640 1 -- 172.21.15.139:0/855515756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5415a150 con 0x7fcf540b1910 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.615+0000 7fcf51d9b640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf540b14d0 0x7fcf541524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.616+0000 7fcf52d9d640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf540b1910 0x7fcf5414bca0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcf540b2110 tx=0x7fcf4c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.616+0000 7fcf42ffd640 1 -- 172.21.15.139:0/855515756 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c019070 con 0x7fcf540b1910 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.616+0000 7fcf42ffd640 1 -- 172.21.15.139:0/855515756 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcf4c006e20 con 0x7fcf540b1910 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.616+0000 7fcf42ffd640 1 -- 172.21.15.139:0/855515756 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c003bb0 con 0x7fcf540b1910 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.616+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf54154e40 con 0x7fcf540b1910 2024-04-26T18:32:40.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.616+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf541e7a00 con 0x7fcf540b1910 2024-04-26T18:32:40.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.617+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf54076d20 con 0x7fcf540b1910 2024-04-26T18:32:40.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.617+0000 7fcf42ffd640 1 -- 172.21.15.139:0/855515756 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf4c01c070 con 0x7fcf540b1910 2024-04-26T18:32:40.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.618+0000 7fcf42ffd640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcf3406c8f0 0x7fcf3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.618+0000 7fcf5259c640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcf3406c8f0 0x7fcf3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.618+0000 7fcf42ffd640 1 -- 172.21.15.139:0/855515756 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6791+0+0 (secure 0 0 0) 0x7fcf4c08b310 con 0x7fcf540b1910 2024-04-26T18:32:40.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.618+0000 7fcf5259c640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcf3406c8f0 0x7fcf3406edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcf44001050 tx=0x7fcf44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.622+0000 7fcf42ffd640 1 -- 172.21.15.139:0/855515756 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf4c059270 con 0x7fcf540b1910 2024-04-26T18:32:40.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.837+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcf5415c840 con 0x7fcf540b1910 2024-04-26T18:32:40.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.839+0000 7fcf42ffd640 1 -- 172.21.15.139:0/855515756 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fcf4c058b70 con 0x7fcf540b1910 2024-04-26T18:32:40.839 INFO:teuthology.orchestra.run.smithi139.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T18:32:40.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcf3406c8f0 msgr2=0x7fcf3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcf3406c8f0 0x7fcf3406edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcf44001050 tx=0x7fcf44009040 comp rx=0 tx=0).stop 2024-04-26T18:32:40.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf540b1910 msgr2=0x7fcf5414bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf540b1910 0x7fcf5414bca0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcf540b2110 tx=0x7fcf4c00ff70 comp rx=0 tx=0).stop 2024-04-26T18:32:40.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 shutdown_connections 2024-04-26T18:32:40.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7fcf3406c8f0 0x7fcf3406edb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf540b1910 0x7fcf5414bca0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7fcf540b14d0 0x7fcf541524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 --2- 172.21.15.139:0/855515756 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcf3c004800 0x7fcf541550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 >> 172.21.15.139:0/855515756 conn(0x7fcf5406ffc0 msgr2=0x7fcf540703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 shutdown_connections 2024-04-26T18:32:40.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.843+0000 7fcf58911640 1 -- 172.21.15.139:0/855515756 wait complete. 2024-04-26T18:32:40.854 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T18:32:40.906 INFO:tasks.ceph.mds.f.smithi143.stdout:starting mds.f at 2024-04-26T18:32:40.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.955+0000 7f6f335ac640 1 Processor -- start 2024-04-26T18:32:40.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.956+0000 7f6f335ac640 1 -- start start 2024-04-26T18:32:40.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.956+0000 7f6f335ac640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f6f2c0c8db0 0x7f6f2c0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.956+0000 7f6f335ac640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6f2c0c9490 0x7f6f2c152200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.956+0000 7f6f335ac640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2c158c00 con 0x7f6f2c0c7d90 2024-04-26T18:32:40.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.956+0000 7f6f335ac640 1 -- --> v2:172.21.15.139:3300/0 -- mon_getmap magic: 0 -- 0x7f6f2c0c3c10 con 0x7f6f2c0c9490 2024-04-26T18:32:40.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.956+0000 7f6f335ac640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f6f2c0c3240 con 0x7f6f2c0c8db0 2024-04-26T18:32:40.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.956+0000 7f6f30b47640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6f2c0c9490 0x7f6f2c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f31b49640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f6f2c0c7d90 0x7f6f2c0ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34978/0 (socket says 172.21.15.139:34978) 2024-04-26T18:32:40.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f30b47640 1 --2- >> v2:172.21.15.139:3300/0 conn(0x7f6f2c0c9490 0x7f6f2c152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41972/0 (socket says 172.21.15.139:41972) 2024-04-26T18:32:40.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f31b49640 1 -- 172.21.15.139:0/2037677577 learned_addr learned my addr 172.21.15.139:0/2037677577 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:40.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f31348640 1 --2- 172.21.15.139:0/2037677577 >> v2:172.21.15.143:3300/0 conn(0x7f6f2c0c8db0 0x7f6f2c0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f30b47640 1 -- 172.21.15.139:0/2037677577 >> v2:172.21.15.143:3300/0 conn(0x7f6f2c0c8db0 msgr2=0x7f6f2c0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:40.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f30b47640 1 --2- 172.21.15.139:0/2037677577 >> v2:172.21.15.143:3300/0 conn(0x7f6f2c0c8db0 0x7f6f2c0c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f30b47640 1 -- 172.21.15.139:0/2037677577 >> v1:172.21.15.139:6789/0 conn(0x7f6f2c0c7d90 legacy=0x7f6f2c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f30b47640 1 -- 172.21.15.139:0/2037677577 --> v2:172.21.15.139:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2c0c2930 con 0x7f6f2c0c9490 2024-04-26T18:32:40.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.957+0000 7f6f30b47640 1 --2- 172.21.15.139:0/2037677577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c152200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0cde00 tx=0x7f6f1c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a618c8ebb1fd4e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f23fff640 1 -- 172.21.15.139:0/2037677577 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c037070 con 0x7f6f2c0c9490 2024-04-26T18:32:40.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f23fff640 1 -- 172.21.15.139:0/2037677577 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f1c032440 con 0x7f6f2c0c9490 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f23fff640 1 -- 172.21.15.139:0/2037677577 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c032830 con 0x7f6f2c0c9490 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 -- 172.21.15.139:0/2037677577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 msgr2=0x7f6f2c152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 --2- 172.21.15.139:0/2037677577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c152200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0cde00 tx=0x7f6f1c02a230 comp rx=0 tx=0).stop 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 -- 172.21.15.139:0/2037677577 shutdown_connections 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 --2- 172.21.15.139:0/2037677577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c152200 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 --2- 172.21.15.139:0/2037677577 >> v2:172.21.15.143:3300/0 conn(0x7f6f2c0c8db0 0x7f6f2c0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 -- 172.21.15.139:0/2037677577 >> 172.21.15.139:0/2037677577 conn(0x7f6f2c06dd40 msgr2=0x7f6f2c06e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 -- 172.21.15.139:0/2037677577 shutdown_connections 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.958+0000 7f6f335ac640 1 -- 172.21.15.139:0/2037677577 wait complete. 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.959+0000 7f6f335ac640 1 Processor -- start 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.959+0000 7f6f335ac640 1 -- start start 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f335ac640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f2c0c7d90 0x7f6f2c155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f335ac640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f2c0c8db0 0x7f6f2c146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f335ac640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c1467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f335ac640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c0c2bf0 con 0x7f6f2c0c9490 2024-04-26T18:32:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f335ac640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2c152740 con 0x7f6f2c0c8db0 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f335ac640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2c0c2ed0 con 0x7f6f2c0c7d90 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f31b49640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c1467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f31b49640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c1467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41978/0 (socket says 172.21.15.139:41978) 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f31b49640 1 -- 172.21.15.139:0/1165281343 learned_addr learned my addr 172.21.15.139:0/1165281343 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f31348640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f2c0c7d90 0x7f6f2c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.960+0000 7f6f30b47640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f2c0c8db0 0x7f6f2c146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f31b49640 1 -- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f2c0c7d90 msgr2=0x7f6f2c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f31b49640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f2c0c7d90 0x7f6f2c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f31b49640 1 -- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f2c0c8db0 msgr2=0x7f6f2c146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:40.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f31b49640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f2c0c8db0 0x7f6f2c146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:40.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f31b49640 1 -- 172.21.15.139:0/1165281343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2c1491b0 con 0x7f6f2c0c9490 2024-04-26T18:32:40.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f31348640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f2c0c7d90 0x7f6f2c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f30b47640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f2c0c8db0 0x7f6f2c146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f31b49640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c1467d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c450 tx=0x7f6f2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f21ffb640 1 -- 172.21.15.139:0/1165281343 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28017070 con 0x7f6f2c0c9490 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f21ffb640 1 -- 172.21.15.139:0/1165281343 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f28005ce0 con 0x7f6f2c0c9490 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f21ffb640 1 -- 172.21.15.139:0/1165281343 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28007270 con 0x7f6f2c0c9490 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2c1545d0 con 0x7f6f2c0c9490 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.961+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2c154890 con 0x7f6f2c0c9490 2024-04-26T18:32:40.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.962+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2c076d20 con 0x7f6f2c0c9490 2024-04-26T18:32:40.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.963+0000 7f6f21ffb640 1 -- 172.21.15.139:0/1165281343 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f2801a070 con 0x7f6f2c0c9490 2024-04-26T18:32:40.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.963+0000 7f6f21ffb640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f1006c8f0 0x7f6f1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:40.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.963+0000 7f6f21ffb640 1 -- 172.21.15.139:0/1165281343 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6821+0+0 (secure 0 0 0) 0x7f6f2808b280 con 0x7f6f2c0c9490 2024-04-26T18:32:40.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.963+0000 7f6f31348640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f1006c8f0 0x7f6f1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:40.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.963+0000 7f6f31348640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f1006c8f0 0x7f6f1006edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f24003f00 tx=0x7f6f240098d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:40.969 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:40.967+0000 7f6f21ffb640 1 -- 172.21.15.139:0/1165281343 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f28058b70 con 0x7f6f2c0c9490 2024-04-26T18:32:41.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.180+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6f2c06e5c0 con 0x7f6f2c0c9490 2024-04-26T18:32:41.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.848+0000 7f6f21ffb640 1 -- 172.21.15.139:0/1165281343 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f6f2805ce70 con 0x7f6f2c0c9490 2024-04-26T18:32:41.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f1006c8f0 msgr2=0x7f6f1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:41.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f1006c8f0 0x7f6f1006edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f24003f00 tx=0x7f6f240098d0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 msgr2=0x7f6f2c1467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:41.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c1467d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c450 tx=0x7f6f2800c910 comp rx=0 tx=0).stop 2024-04-26T18:32:41.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 shutdown_connections 2024-04-26T18:32:41.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f6f1006c8f0 0x7f6f1006edb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f2c0c9490 0x7f6f2c1467d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6f2c0c8db0 0x7f6f2c146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 --2- 172.21.15.139:0/1165281343 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f6f2c0c7d90 0x7f6f2c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 >> 172.21.15.139:0/1165281343 conn(0x7f6f2c06dd40 msgr2=0x7f6f2c073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:41.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 shutdown_connections 2024-04-26T18:32:41.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.851+0000 7f6f335ac640 1 -- 172.21.15.139:0/1165281343 wait complete. 2024-04-26T18:32:41.866 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T18:32:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.967+0000 7f86d23bf640 1 Processor -- start 2024-04-26T18:32:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.968+0000 7f86d23bf640 1 -- start start 2024-04-26T18:32:41.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.968+0000 7f86d23bf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 0x7f86cc070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.968+0000 7f86d23bf640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc0c9c50 con 0x7f86cc070870 2024-04-26T18:32:41.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.968+0000 7f86d23bf640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc0ca1d0 con 0x7f86cc0cb000 2024-04-26T18:32:41.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.968+0000 7f86d23bf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc0c9ef0 con 0x7f86cc15cf60 2024-04-26T18:32:41.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.968+0000 7f86cbfff640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f86cc070870 0x7f86cc0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:34992/0 (socket says 172.21.15.139:34992) 2024-04-26T18:32:41.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.968+0000 7f86cbfff640 1 -- 172.21.15.139:0/10095592 learned_addr learned my addr 172.21.15.139:0/10095592 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:41.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430769322 0 0) 0x7f86cc0c9c50 con 0x7f86cc070870 2024-04-26T18:32:41.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86d095c640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 0x7f86cc070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86b4003520 con 0x7f86cc070870 2024-04-26T18:32:41.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 <== mon.0 v1:172.21.15.139:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3877854062 0 0) 0x7f86b4003520 con 0x7f86cc070870 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 msgr2=0x7f86cc070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 0x7f86cc070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 >> v1:172.21.15.143:6789/0 conn(0x7f86cc0cb000 legacy=0x7f86cc1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 --> v1:172.21.15.139:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc0cb550 con 0x7f86cc070870 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 <== mon.0 v1:172.21.15.139:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2793444606 0 0) 0x7f86c0001670 con 0x7f86cc070870 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 >> v1:172.21.15.139:6789/0 conn(0x7f86cc070870 legacy=0x7f86cc0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b40039e0 0x7f86b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86b4004800 0x7f86b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 0x7f86b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc0c9ef0 con 0x7f86b4004800 2024-04-26T18:32:41.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f86b400ba70 con 0x7f86b40039e0 2024-04-26T18:32:41.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f86b400bc70 con 0x7f86cc15cf60 2024-04-26T18:32:41.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86cb7fe640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86b4004800 0x7f86b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86cbfff640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b40039e0 0x7f86b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86d095c640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 0x7f86b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86cb7fe640 1 -- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 msgr2=0x7f86b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86cb7fe640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc15cf60 0x7f86b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86cb7fe640 1 -- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b40039e0 msgr2=0x7f86b4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86cb7fe640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b40039e0 0x7f86b4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.969+0000 7f86cb7fe640 1 -- 172.21.15.139:0/10095592 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b4003520 con 0x7f86b4004800 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.970+0000 7f86cb7fe640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86b4004800 0x7f86b4004c80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f86bc001720 tx=0x7f86b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e741170027996558 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.970+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc001370 con 0x7f86b4004800 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.970+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f86bc0052d0 con 0x7f86b4004800 2024-04-26T18:32:41.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.970+0000 7f86caffd640 1 -- 172.21.15.139:0/10095592 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc02abb0 con 0x7f86b4004800 2024-04-26T18:32:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.971+0000 7f86d23bf640 1 -- 172.21.15.139:0/10095592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86b4004800 msgr2=0x7f86b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.971+0000 7f86d23bf640 1 --2- 172.21.15.139:0/10095592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86b4004800 0x7f86b4004c80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f86bc001720 tx=0x7f86b4005830 comp rx=0 tx=0).stop 2024-04-26T18:32:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.971+0000 7f86d095c640 1 -- 172.21.15.139:0/10095592 reap_dead start 2024-04-26T18:32:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.971+0000 7f86d23bf640 1 -- 172.21.15.139:0/10095592 shutdown_connections 2024-04-26T18:32:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.971+0000 7f86d23bf640 1 -- 172.21.15.139:0/10095592 >> 172.21.15.139:0/10095592 conn(0x7f86cc076730 msgr2=0x7f86cc068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.971+0000 7f86d23bf640 1 -- 172.21.15.139:0/10095592 shutdown_connections 2024-04-26T18:32:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.971+0000 7f86d23bf640 1 -- 172.21.15.139:0/10095592 wait complete. 2024-04-26T18:32:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.972+0000 7f86d23bf640 1 Processor -- start 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.972+0000 7f86d23bf640 1 -- start start 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d23bf640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b4004800 0x7f86cc1e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d23bf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86cc1e5770 0x7f86cc14aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d23bf640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc1499a0 0x7f86cc149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d23bf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1540f0 con 0x7f86cc1e5770 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d23bf640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc153f70 con 0x7f86b4004800 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d23bf640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc071590 con 0x7f86cc1499a0 2024-04-26T18:32:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86cc1e5770 0x7f86cc14aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86cc1e5770 0x7f86cc14aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41986/0 (socket says 172.21.15.139:41986) 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 -- 172.21.15.139:0/1148257266 learned_addr learned my addr 172.21.15.139:0/1148257266 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d095c640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc1499a0 0x7f86cc149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cbfff640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b4004800 0x7f86cc1e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 -- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc1499a0 msgr2=0x7f86cc149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc1499a0 0x7f86cc149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 -- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b4004800 msgr2=0x7f86cc1e2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b4004800 0x7f86cc1e2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 -- 172.21.15.139:0/1148257266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc157800 con 0x7f86cc1e5770 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86cb7fe640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86cc1e5770 0x7f86cc14aa90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f86bc005040 tx=0x7f86bc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86c8ff9640 1 -- 172.21.15.139:0/1148257266 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc042070 con 0x7f86cc1e5770 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86c8ff9640 1 -- 172.21.15.139:0/1148257266 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f86bc005480 con 0x7f86cc1e5770 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86cc06dcc0 con 0x7f86cc1e5770 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.973+0000 7f86c8ff9640 1 -- 172.21.15.139:0/1148257266 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc037040 con 0x7f86cc1e5770 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.974+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86cc06c3b0 con 0x7f86cc1e5770 2024-04-26T18:32:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.974+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86cc069ae0 con 0x7f86cc1e5770 2024-04-26T18:32:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.975+0000 7f86c8ff9640 1 -- 172.21.15.139:0/1148257266 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86bc0067d0 con 0x7f86cc1e5770 2024-04-26T18:32:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.975+0000 7f86c8ff9640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f86b806c920 0x7f86b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.975+0000 7f86cbfff640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f86b806c920 0x7f86b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.975+0000 7f86c8ff9640 1 -- 172.21.15.139:0/1148257266 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6821+0+0 (secure 0 0 0) 0x7f86bc0ab870 con 0x7f86cc1e5770 2024-04-26T18:32:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.976+0000 7f86cbfff640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f86b806c920 0x7f86b806ede0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f86c0000fb0 tx=0x7f86c00078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:41.980+0000 7f86c8ff9640 1 -- 172.21.15.139:0/1148257266 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86bc02f2a0 con 0x7f86cc1e5770 2024-04-26T18:32:42.154 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.154+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f86cc076d20 con 0x7f86cc1e5770 2024-04-26T18:32:42.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.857+0000 7f86c8ff9640 1 -- 172.21.15.139:0/1148257266 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) ==== 181+0+0 (secure 0 0 0) 0x7f86bc0790e0 con 0x7f86cc1e5770 2024-04-26T18:32:42.858 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' removed 2024-04-26T18:32:42.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f86b806c920 msgr2=0x7f86b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:42.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f86b806c920 0x7f86b806ede0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f86c0000fb0 tx=0x7f86c00078f0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86cc1e5770 msgr2=0x7f86cc14aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:42.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86cc1e5770 0x7f86cc14aa90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f86bc005040 tx=0x7f86bc001120 comp rx=0 tx=0).stop 2024-04-26T18:32:42.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 shutdown_connections 2024-04-26T18:32:42.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f86b806c920 0x7f86b806ede0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f86cc1499a0 0x7f86cc149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86cc1e5770 0x7f86cc14aa90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 --2- 172.21.15.139:0/1148257266 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f86b4004800 0x7f86cc1e2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 >> 172.21.15.139:0/1148257266 conn(0x7f86cc076730 msgr2=0x7f86cc1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:42.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.860+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 shutdown_connections 2024-04-26T18:32:42.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.861+0000 7f86d23bf640 1 -- 172.21.15.139:0/1148257266 wait complete. 2024-04-26T18:32:42.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T18:32:42.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.984+0000 7f94649f0640 1 Processor -- start 2024-04-26T18:32:42.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.984+0000 7f94649f0640 1 -- start start 2024-04-26T18:32:42.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f94649f0640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f946014f7a0 0x7f94600720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:42.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f94649f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94600c86b0 0x7f94600c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:42.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f94649f0640 1 -- --> v1:172.21.15.143:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94600c8240 con 0x7f94600c7b20 2024-04-26T18:32:42.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f94649f0640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f9460073c60 con 0x7f946014f7a0 2024-04-26T18:32:42.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f94649f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f94600c4750 con 0x7f94600c86b0 2024-04-26T18:32:42.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f945dd9b640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94600c86b0 0x7f94600c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:42.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f945e59c640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f946014f7a0 0x7f94600720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:42.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f945ed9d640 1 --1- >> v1:172.21.15.143:6789/0 conn(0x7f94600c7b20 0x7f946015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.143:6789/0 says I am v1:172.21.15.139:38340/0 (socket says 172.21.15.139:38340) 2024-04-26T18:32:42.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.985+0000 7f945ed9d640 1 -- 172.21.15.139:0/4216011577 learned_addr learned my addr 172.21.15.139:0/4216011577 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:42.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.986+0000 7f945dd9b640 1 -- 172.21.15.139:0/4216011577 >> v2:172.21.15.143:3300/0 conn(0x7f946014f7a0 msgr2=0x7f94600720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:42.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.986+0000 7f945dd9b640 1 --2- 172.21.15.139:0/4216011577 >> v2:172.21.15.143:3300/0 conn(0x7f946014f7a0 0x7f94600720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.986+0000 7f945dd9b640 1 -- 172.21.15.139:0/4216011577 >> v1:172.21.15.143:6789/0 conn(0x7f94600c7b20 legacy=0x7f946015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:42.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.986+0000 7f945dd9b640 1 -- 172.21.15.139:0/4216011577 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9460159560 con 0x7f94600c86b0 2024-04-26T18:32:42.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.986+0000 7f945dd9b640 1 --2- 172.21.15.139:0/4216011577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94600c86b0 0x7f94600c61b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94540097a0 tx=0x7f945402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4c68769d8d92a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:42.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f945d59a640 1 -- 172.21.15.139:0/4216011577 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454037070 con 0x7f94600c86b0 2024-04-26T18:32:42.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f945d59a640 1 -- 172.21.15.139:0/4216011577 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f945402ae50 con 0x7f94600c86b0 2024-04-26T18:32:42.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f945d59a640 1 -- 172.21.15.139:0/4216011577 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454032680 con 0x7f94600c86b0 2024-04-26T18:32:42.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 -- 172.21.15.139:0/4216011577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94600c86b0 msgr2=0x7f94600c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:42.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 --2- 172.21.15.139:0/4216011577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94600c86b0 0x7f94600c61b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f94540097a0 tx=0x7f945402a100 comp rx=0 tx=0).stop 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 -- 172.21.15.139:0/4216011577 shutdown_connections 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 --2- 172.21.15.139:0/4216011577 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f94600c86b0 0x7f94600c61b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 --2- 172.21.15.139:0/4216011577 >> v2:172.21.15.143:3300/0 conn(0x7f946014f7a0 0x7f94600720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 -- 172.21.15.139:0/4216011577 >> 172.21.15.139:0/4216011577 conn(0x7f94600686c0 msgr2=0x7f946006fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 -- 172.21.15.139:0/4216011577 shutdown_connections 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.987+0000 7f94649f0640 1 -- 172.21.15.139:0/4216011577 wait complete. 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 Processor -- start 2024-04-26T18:32:42.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 -- start start 2024-04-26T18:32:42.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94600c7b20 0x7f946013ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:42.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94600c86b0 0x7f94601457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:42.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f946014f7a0 0x7f94601e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:42.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9460159840 con 0x7f94600c86b0 2024-04-26T18:32:42.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f9460073920 con 0x7f94600c7b20 2024-04-26T18:32:42.993 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f94649f0640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f94600707c0 con 0x7f946014f7a0 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f945dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94600c86b0 0x7f94601457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f945e59c640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94600c7b20 0x7f946013ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f945dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94600c86b0 0x7f94601457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41996/0 (socket says 172.21.15.139:41996) 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f945dd9b640 1 -- 172.21.15.139:0/3662354254 learned_addr learned my addr 172.21.15.139:0/3662354254 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.989+0000 7f945ed9d640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f946014f7a0 0x7f94601e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f945dd9b640 1 -- 172.21.15.139:0/3662354254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f946014f7a0 msgr2=0x7f94601e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f945dd9b640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f946014f7a0 0x7f94601e3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f945dd9b640 1 -- 172.21.15.139:0/3662354254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94600c7b20 msgr2=0x7f946013ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:42.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f945dd9b640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94600c7b20 0x7f946013ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:42.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f945dd9b640 1 -- 172.21.15.139:0/3662354254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94601f3220 con 0x7f94600c86b0 2024-04-26T18:32:42.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f945dd9b640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94600c86b0 0x7f94601457c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f945402a140 tx=0x7f94540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:42.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f944effd640 1 -- 172.21.15.139:0/3662354254 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454041070 con 0x7f94600c86b0 2024-04-26T18:32:42.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f944effd640 1 -- 172.21.15.139:0/3662354254 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f945403c660 con 0x7f94600c86b0 2024-04-26T18:32:42.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94601f3500 con 0x7f94600c86b0 2024-04-26T18:32:42.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f944effd640 1 -- 172.21.15.139:0/3662354254 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454037040 con 0x7f94600c86b0 2024-04-26T18:32:42.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.990+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94601f3ac0 con 0x7f94600c86b0 2024-04-26T18:32:42.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.991+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9460076d20 con 0x7f94600c86b0 2024-04-26T18:32:42.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.992+0000 7f944effd640 1 -- 172.21.15.139:0/3662354254 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9454044070 con 0x7f94600c86b0 2024-04-26T18:32:42.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.992+0000 7f944effd640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f944006c8f0 0x7f944006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:42.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.992+0000 7f944effd640 1 -- 172.21.15.139:0/3662354254 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6383+0+0 (secure 0 0 0) 0x7f94540ac640 con 0x7f94600c86b0 2024-04-26T18:32:42.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.992+0000 7f945e59c640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f944006c8f0 0x7f944006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:42.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.993+0000 7f945e59c640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f944006c8f0 0x7f944006edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94500113e0 tx=0x7f945000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:42.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:42.996+0000 7f944effd640 1 -- 172.21.15.139:0/3662354254 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f945407a210 con 0x7f94600c86b0 2024-04-26T18:32:43.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.185+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9460156360 con 0x7f94600c86b0 2024-04-26T18:32:43.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.863+0000 7f944effd640 1 -- 172.21.15.139:0/3662354254 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) ==== 169+0+0 (secure 0 0 0) 0x7f945407e510 con 0x7f94600c86b0 2024-04-26T18:32:43.864 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' removed 2024-04-26T18:32:43.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f944006c8f0 msgr2=0x7f944006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:43.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f944006c8f0 0x7f944006edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f94500113e0 tx=0x7f945000b040 comp rx=0 tx=0).stop 2024-04-26T18:32:43.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94600c86b0 msgr2=0x7f94601457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:43.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94600c86b0 0x7f94601457c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f945402a140 tx=0x7f94540046c0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 shutdown_connections 2024-04-26T18:32:43.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f944006c8f0 0x7f944006edb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f946014f7a0 0x7f94601e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94600c86b0 0x7f94601457c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 --2- 172.21.15.139:0/3662354254 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94600c7b20 0x7f946013ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 >> 172.21.15.139:0/3662354254 conn(0x7f94600686c0 msgr2=0x7f9460072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:43.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 shutdown_connections 2024-04-26T18:32:43.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.865+0000 7f94649f0640 1 -- 172.21.15.139:0/3662354254 wait complete. 2024-04-26T18:32:43.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T18:32:43.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.983+0000 7f16b2015640 1 Processor -- start 2024-04-26T18:32:43.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.983+0000 7f16b2015640 1 -- start start 2024-04-26T18:32:43.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.983+0000 7f16b2015640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cc210 0x7f16ac0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:43.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.983+0000 7f16b2015640 1 --2- >> v2:172.21.15.143:3300/0 conn(0x7f16ac0cd830 0x7f16ac0d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:43.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.983+0000 7f16b2015640 1 -- --> v1:172.21.15.139:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16ac15f2d0 con 0x7f16ac155f30 2024-04-26T18:32:43.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.983+0000 7f16b2015640 1 -- --> v2:172.21.15.143:3300/0 -- mon_getmap magic: 0 -- 0x7f16ac15fe70 con 0x7f16ac0cd830 2024-04-26T18:32:43.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.983+0000 7f16b2015640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16ac15f540 con 0x7f16ac0cc210 2024-04-26T18:32:43.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16ab7fe640 1 --1- >> v1:172.21.15.139:6789/0 conn(0x7f16ac155f30 0x7f16ac15c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.139:6789/0 says I am v1:172.21.15.139:35008/0 (socket says 172.21.15.139:35008) 2024-04-26T18:32:43.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16ab7fe640 1 -- 172.21.15.139:0/1296482940 learned_addr learned my addr 172.21.15.139:0/1296482940 (peer_addr_for_me v1:172.21.15.139:0/0) 2024-04-26T18:32:43.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16abfff640 1 --2- 172.21.15.139:0/1296482940 >> v2:172.21.15.143:3300/0 conn(0x7f16ac0cd830 0x7f16ac0d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:43.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16aaffd640 1 --2- 172.21.15.139:0/1296482940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cc210 0x7f16ac0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:43.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16aa7fc640 1 -- 172.21.15.139:0/1296482940 <== mon.0 v1:172.21.15.139:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446551237 0 0) 0x7f16ac15f2d0 con 0x7f16ac155f30 2024-04-26T18:32:43.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16aa7fc640 1 -- 172.21.15.139:0/1296482940 --> v1:172.21.15.139:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1698003520 con 0x7f16ac155f30 2024-04-26T18:32:43.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16aaffd640 1 -- 172.21.15.139:0/1296482940 >> v2:172.21.15.143:3300/0 conn(0x7f16ac0cd830 msgr2=0x7f16ac0d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:32:43.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16aaffd640 1 --2- 172.21.15.139:0/1296482940 >> v2:172.21.15.143:3300/0 conn(0x7f16ac0cd830 0x7f16ac0d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16aaffd640 1 -- 172.21.15.139:0/1296482940 >> v1:172.21.15.139:6789/0 conn(0x7f16ac155f30 legacy=0x7f16ac15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:43.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16aaffd640 1 -- 172.21.15.139:0/1296482940 --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac15f820 con 0x7f16ac0cc210 2024-04-26T18:32:43.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.984+0000 7f16abfff640 1 --2- 172.21.15.139:0/1296482940 >> v2:172.21.15.143:3300/0 conn(0x7f16ac0cd830 0x7f16ac0d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:32:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16aaffd640 1 --2- 172.21.15.139:0/1296482940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cc210 0x7f16ac0d12c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16940097a0 tx=0x7f169402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694b2cbfe7a2e3c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16aa7fc640 1 -- 172.21.15.139:0/1296482940 <== mon.2 v2:172.21.15.143:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694037070 con 0x7f16ac0cc210 2024-04-26T18:32:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16aa7fc640 1 -- 172.21.15.139:0/1296482940 <== mon.2 v2:172.21.15.143:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1694032440 con 0x7f16ac0cc210 2024-04-26T18:32:43.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16aa7fc640 1 -- 172.21.15.139:0/1296482940 <== mon.2 v2:172.21.15.143:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16940327f0 con 0x7f16ac0cc210 2024-04-26T18:32:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16b2015640 1 -- 172.21.15.139:0/1296482940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cc210 msgr2=0x7f16ac0d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16b2015640 1 --2- 172.21.15.139:0/1296482940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cc210 0x7f16ac0d12c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f16940097a0 tx=0x7f169402a180 comp rx=0 tx=0).stop 2024-04-26T18:32:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16b2015640 1 -- 172.21.15.139:0/1296482940 shutdown_connections 2024-04-26T18:32:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16b2015640 1 --2- 172.21.15.139:0/1296482940 >> v2:172.21.15.143:3300/0 conn(0x7f16ac0cd830 0x7f16ac0d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16b2015640 1 --2- 172.21.15.139:0/1296482940 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cc210 0x7f16ac0d12c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:43.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16b2015640 1 -- 172.21.15.139:0/1296482940 >> 172.21.15.139:0/1296482940 conn(0x7f16ac068090 msgr2=0x7f16ac0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.985+0000 7f16b2015640 1 -- 172.21.15.139:0/1296482940 shutdown_connections 2024-04-26T18:32:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.986+0000 7f16b2015640 1 -- 172.21.15.139:0/1296482940 wait complete. 2024-04-26T18:32:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 Processor -- start 2024-04-26T18:32:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 -- start start 2024-04-26T18:32:43.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0cc210 0x7f16ac1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 --2- >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cd830 0x7f16ac14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac155f30 0x7f16ac14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:43.998 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac0cc730 con 0x7f16ac0cc210 2024-04-26T18:32:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac156310 con 0x7f16ac155f30 2024-04-26T18:32:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.987+0000 7f16b2015640 1 -- --> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] -- mon_getmap magic: 0 -- 0x7f16ac0c6210 con 0x7f16ac0cd830 2024-04-26T18:32:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0cc210 0x7f16ac1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0cc210 0x7f16ac1f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42008/0 (socket says 172.21.15.139:42008) 2024-04-26T18:32:43.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 -- 172.21.15.139:0/653476243 learned_addr learned my addr 172.21.15.139:0/653476243 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-26T18:32:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16aaffd640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cd830 0x7f16ac14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16abfff640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac155f30 0x7f16ac14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 -- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cd830 msgr2=0x7f16ac14d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cd830 0x7f16ac14d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 -- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac155f30 msgr2=0x7f16ac14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:44.000 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac155f30 0x7f16ac14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 -- 172.21.15.139:0/653476243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac14c630 con 0x7f16ac0cc210 2024-04-26T18:32:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16aaffd640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cd830 0x7f16ac14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:32:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16abfff640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac155f30 0x7f16ac14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:32:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16ab7fe640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0cc210 0x7f16ac1f1af0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f169c00cad0 tx=0x7f169c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:44.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16a3fff640 1 -- 172.21.15.139:0/653476243 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c017070 con 0x7f16ac0cc210 2024-04-26T18:32:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16a3fff640 1 -- 172.21.15.139:0/653476243 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f169c00ac30 con 0x7f16ac0cc210 2024-04-26T18:32:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ac14c070 con 0x7f16ac0cc210 2024-04-26T18:32:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16a3fff640 1 -- 172.21.15.139:0/653476243 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c012400 con 0x7f16ac0cc210 2024-04-26T18:32:44.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.988+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ac14f080 con 0x7f16ac0cc210 2024-04-26T18:32:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.989+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ac076d20 con 0x7f16ac0cc210 2024-04-26T18:32:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.990+0000 7f16a3fff640 1 -- 172.21.15.139:0/653476243 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f169c01a070 con 0x7f16ac0cc210 2024-04-26T18:32:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.990+0000 7f16a3fff640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f168c06c8f0 0x7f168c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:32:44.003 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.990+0000 7f16a3fff640 1 -- 172.21.15.139:0/653476243 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5853+0+0 (secure 0 0 0) 0x7f169c08baa0 con 0x7f16ac0cc210 2024-04-26T18:32:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.990+0000 7f16aaffd640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f168c06c8f0 0x7f168c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:32:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.991+0000 7f16aaffd640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f168c06c8f0 0x7f168c06edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1694034000 tx=0x7f169402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:32:44.004 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:43.994+0000 7f16a3fff640 1 -- 172.21.15.139:0/653476243 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f169c059d90 con 0x7f16ac0cc210 2024-04-26T18:32:44.230 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.230+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f16ac069ef0 con 0x7f16ac0cc210 2024-04-26T18:32:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.864+0000 7f16a3fff640 1 -- 172.21.15.139:0/653476243 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v45) ==== 178+0+0 (secure 0 0 0) 0x7f169c059690 con 0x7f16ac0cc210 2024-04-26T18:32:44.865 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data_ec' removed 2024-04-26T18:32:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f168c06c8f0 msgr2=0x7f168c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:44.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f168c06c8f0 0x7f168c06edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1694034000 tx=0x7f169402e000 comp rx=0 tx=0).stop 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0cc210 msgr2=0x7f16ac1f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0cc210 0x7f16ac1f1af0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f169c00cad0 tx=0x7f169c00cf90 comp rx=0 tx=0).stop 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 shutdown_connections 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:6832/2404745913,v1:172.21.15.139:6833/2404745913] conn(0x7f168c06c8f0 0x7f168c06edb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16ac155f30 0x7f16ac14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.143:3301/0,v1:172.21.15.143:6790/0] conn(0x7f16ac0cd830 0x7f16ac14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 --2- 172.21.15.139:0/653476243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16ac0cc210 0x7f16ac1f1af0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:32:44.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 >> 172.21.15.139:0/653476243 conn(0x7f16ac068090 msgr2=0x7f16ac0c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:32:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 shutdown_connections 2024-04-26T18:32:44.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-26T18:32:44.867+0000 7f16b2015640 1 -- 172.21.15.139:0/653476243 wait complete. 2024-04-26T18:32:44.885 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T18:32:44.885 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T18:32:44.885 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:44.895 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T18:32:44.896 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T18:32:44.896 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:44.948 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T18:32:44.948 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-26T18:32:44.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.000 INFO:tasks.ceph.mds.e:Stopped 2024-04-26T18:32:45.000 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T18:32:45.000 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.011 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T18:32:45.011 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T18:32:45.012 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.064 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T18:32:45.064 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-26T18:32:45.064 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.116 INFO:tasks.ceph.mds.f:Stopped 2024-04-26T18:32:45.116 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T18:32:45.116 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T18:32:45.117 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.174 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T18:32:45.175 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T18:32:45.175 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.245 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T18:32:45.245 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T18:32:45.245 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.303 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T18:32:45.303 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T18:32:45.304 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.372 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T18:32:45.372 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T18:32:45.373 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.444 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T18:32:45.444 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T18:32:45.444 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.503 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T18:32:45.503 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T18:32:45.504 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.564 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T18:32:45.565 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T18:32:45.565 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.627 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T18:32:45.627 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T18:32:45.627 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T18:32:45.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.654 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T18:32:45.655 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T18:32:45.655 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.679 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T18:32:45.679 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T18:32:45.679 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T18:32:45.680 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.707 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T18:32:45.708 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T18:32:45.708 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.731 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T18:32:45.731 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T18:32:45.731 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:32:45.781 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T18:32:45.782 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T18:32:45.782 DEBUG:teuthology.orchestra.run.smithi139:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-26T18:32:45.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T18:32:45.822 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T18:32:46.631 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T18:32:46.631 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T18:32:46.759 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T18:32:46.759 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T18:32:46.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T18:32:46.824 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T18:32:46.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T18:32:46.898 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T18:32:48.135 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T18:32:48.136 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T18:32:48.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T18:32:48.236 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T18:32:48.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T18:32:48.303 DEBUG:teuthology.orchestra.run.smithi143:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T18:32:48.367 INFO:tasks.ceph:Archiving mon data... 2024-04-26T18:32:48.369 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/data/mon.a.tgz 2024-04-26T18:32:48.369 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-04-26T18:32:48.387 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.eFi3xIpyIc 2024-04-26T18:32:48.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eFi3xIpyIc 2024-04-26T18:32:48.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.eFi3xIpyIc 2024-04-26T18:32:48.599 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.eFi3xIpyIc is 296KB 2024-04-26T18:32:48.694 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.eFi3xIpyIc 2024-04-26T18:32:48.709 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/data/mon.b.tgz 2024-04-26T18:32:48.709 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-04-26T18:32:48.724 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.0N3sDVQN00 2024-04-26T18:32:48.725 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0N3sDVQN00 2024-04-26T18:32:48.852 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.0N3sDVQN00 2024-04-26T18:32:48.933 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.0N3sDVQN00 is 296KB 2024-04-26T18:32:49.027 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.0N3sDVQN00 2024-04-26T18:32:49.041 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/data/mon.c.tgz 2024-04-26T18:32:49.041 DEBUG:teuthology.orchestra.run.smithi143:> mktemp 2024-04-26T18:32:49.095 INFO:teuthology.orchestra.run.smithi143.stdout:/tmp/tmp.LoN37N2JnS 2024-04-26T18:32:49.095 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LoN37N2JnS 2024-04-26T18:32:49.210 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 0666 /tmp/tmp.LoN37N2JnS 2024-04-26T18:32:49.292 DEBUG:teuthology.orchestra.remote:smithi143:/tmp/tmp.LoN37N2JnS is 296KB 2024-04-26T18:32:49.387 DEBUG:teuthology.orchestra.run.smithi143:> rm -fr /tmp/tmp.LoN37N2JnS 2024-04-26T18:32:49.401 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T18:32:49.401 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T18:32:49.404 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T18:32:49.487 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T18:32:49.518 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T18:32:49.518 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T18:32:49.520 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/remote/smithi139/crash 2024-04-26T18:32:49.521 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T18:32:49.554 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/remote/smithi143/crash 2024-04-26T18:32:49.555 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T18:32:49.580 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T18:32:49.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:32:49.598 DEBUG:teuthology.orchestra.run.smithi143:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:32:49.669 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T18:32:49.695 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T18:32:49.718 INFO:tasks.ceph:Compressing logs... 2024-04-26T18:32:49.719 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T18:32:49.738 DEBUG:teuthology.orchestra.run.smithi143:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T18:32:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34469.log 2024-04-26T18:32:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T18:32:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34469.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-26T18:32:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T18:32:49.790 INFO:teuthology.orchestra.run.smithi143.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34469.log.gz 2024-04-26T18:32:49.790 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T18:32:49.791 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34596.log: /var/log/ceph/ceph-mgr.x.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-04-26T18:32:49.792 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T18:32:49.792 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.c.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T18:32:49.796 INFO:teuthology.orchestra.run.smithi143.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T18:32:49.819 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34345.log 2024-04-26T18:32:49.819 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34516.log 2024-04-26T18:32:49.819 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34345.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34345.log.gz 2024-04-26T18:32:49.819 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-04-26T18:32:49.819 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34516.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34516.log.gz 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34556.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34636.log 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34425.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34636.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34636.log.gz 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mds.d.log: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T18:32:49.820 INFO:teuthology.orchestra.run.smithi143.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-04-26T18:32:49.821 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-mon.b.log: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T18:32:49.824 INFO:teuthology.orchestra.run.smithi143.stderr:/var/log/ceph/ceph-client.admin.34385.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-04-26T18:32:49.913 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47466.log 2024-04-26T18:32:49.913 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43003.log 2024-04-26T18:32:49.913 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44302.log 2024-04-26T18:32:49.913 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42157.log 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43003.log.gz 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47466.log.gz 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.0.44302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53512.log 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44302.log.gz 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42157.log.gz 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54910.log 2024-04-26T18:32:49.914 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40617.log 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54910.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53512.log.gz 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52702.log 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54910.log.gz 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54119.log 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40617.log: /var/log/ceph/ceph-client.admin.52702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54439.log 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40617.log.gz 2024-04-26T18:32:49.915 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54119.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52702.log.gz 2024-04-26T18:32:49.916 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51573.log 2024-04-26T18:32:49.916 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44605.log 2024-04-26T18:32:49.916 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54439.log: /var/log/ceph/ceph-client.admin.51573.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54119.log.gz 2024-04-26T18:32:49.916 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2024-04-26T18:32:49.916 INFO:teuthology.orchestra.run.smithi139.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54439.log.gz 2024-04-26T18:32:49.916 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50081.log 2024-04-26T18:32:49.916 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51573.log.gz 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.45124.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44605.log.gz 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51437.log 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43983.log 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50081.log.gz 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49348.log 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43344.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43983.log.gz 2024-04-26T18:32:49.917 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55917.log 2024-04-26T18:32:49.918 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51437.log.gz 2024-04-26T18:32:49.918 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz 2024-04-26T18:32:49.918 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55665.log 2024-04-26T18:32:49.918 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55917.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49348.log.gz 2024-04-26T18:32:49.918 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51793.log 2024-04-26T18:32:49.918 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55665.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55917.log.gz 2024-04-26T18:32:49.918 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55665.log.gz 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51325.log 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42995.log 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51325.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51793.log.gz 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55455.log 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55749.log 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-04-26T18:32:49.919 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42995.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51325.log.gz 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41295.log 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42995.log.gz 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55749.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55455.log.gz 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54482.log 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55749.log.gz 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40745.log 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41295.log.gz 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr:gzip/var/log/ceph/ceph-client.admin.54482.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43585.log 2024-04-26T18:32:49.920 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40745.log.gz 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43585.log: gzip 91.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.54482.log.gz -- 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr: /var/log/ceph/ceph-client.admin.43543.log 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43585.log.gz 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47575.log 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54801.log 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz 2024-04-26T18:32:49.921 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47575.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43543.log.gz 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44807.log 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54801.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr: 91.1% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47575.log.gz 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54801.log.gz 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49475.log 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42325.log 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51146.log 2024-04-26T18:32:49.922 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44807.log.gz 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42325.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49475.log.gz 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53852.log 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42325.log.gz 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56085.log 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51146.log.gz 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56420.log 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51530.log 2024-04-26T18:32:49.923 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56085.log.gz 2024-04-26T18:32:49.924 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56420.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53852.log.gz 2024-04-26T18:32:49.924 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2024-04-26T18:32:49.924 INFO:teuthology.orchestra.run.smithi139.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56420.log.gz 2024-04-26T18:32:49.924 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2024-04-26T18:32:49.924 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51530.log.gz 2024-04-26T18:32:49.924 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53138.log 2024-04-26T18:32:49.924 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49765.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2024-04-26T18:32:49.925 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T18:32:49.925 INFO:teuthology.orchestra.run.smithi139.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2024-04-26T18:32:49.925 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2024-04-26T18:32:49.925 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40831.log 2024-04-26T18:32:49.925 INFO:teuthology.orchestra.run.smithi139.stderr: 90.8% 87.8% -- replaced with /var/log/ceph/ceph.log.gz -- replaced with /var/log/ceph/ceph-client.admin.53138.log.gz 2024-04-26T18:32:49.925 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.925 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52873.log 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40831.log.gz 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42031.log 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40308.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52873.log.gz 2024-04-26T18:32:49.926 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55175.log 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43006.log 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42031.log: /var/log/ceph/ceph-client.admin.55175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47296.log 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42031.log.gz 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43006.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55175.log.gz 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53095.log 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43006.log.gz 2024-04-26T18:32:49.927 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49282.log 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47296.log.gz 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43008.log 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53095.log.gz 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52968.log 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53596.log 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52968.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43008.log.gz 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49282.log.gz 2024-04-26T18:32:49.928 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52968.log.gz 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56379.log 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53596.log.gz 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48519.log 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50624.log 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.48519.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56379.log.gz 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53639.log 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42115.log 2024-04-26T18:32:49.929 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50624.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53233.log 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48519.log.gz 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50624.log.gz 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42115.log.gz 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53639.log.gz 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2024-04-26T18:32:49.930 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53233.log: /var/log/ceph/ceph-client.admin.48646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34878.log 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53233.log.gz 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz/var/log/ceph/ceph-client.admin.34878.log: 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40659.log 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42451.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34878.log.gz 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56599.log 2024-04-26T18:32:49.931 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40659.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53979.log 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56599.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40659.log.gz 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51878.log 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53979.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56599.log.gz 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51878.log.gz 2024-04-26T18:32:49.932 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.3.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53979.log.gz 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43007.log 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56043.log 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43007.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56043.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43007.log.gz 2024-04-26T18:32:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54727.log 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55707.log 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56043.log.gz 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54727.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gz 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41019.log 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51079.log 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55707.log: /var/log/ceph/ceph-client.admin.41019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50496.log 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr: 87.6% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55707.log.gz -- replaced with /var/log/ceph/ceph-client.admin.54727.log.gz 2024-04-26T18:32:49.934 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41019.log.gz 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52254.log 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48941.log 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51079.log.gz 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50496.log.gz 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52254.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42675.log 2024-04-26T18:32:49.935 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.48941.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52254.log.gz 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44929.log 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42675.log: /var/log/ceph/ceph-mds.c.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48941.log.gz 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48811.log 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42675.log.gz 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51189.log 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.48811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42199.log 2024-04-26T18:32:49.936 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43005.log 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44929.log.gz 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50362.log 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48811.log.gz 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56211.log 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42199.log.gz 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9%/var/log/ceph/ceph-client.admin.43005.log: -- replaced with /var/log/ceph/ceph-client.admin.51189.log.gz/var/log/ceph/ceph-client.admin.50362.log: 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49638.log 2024-04-26T18:32:49.937 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43005.log.gz 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49638.log: 91.1% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56211.log.gz -- replaced with /var/log/ceph/ceph-client.admin.50362.log.gz 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49638.log.gz 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr: --verbose/var/log/ceph/ceph-client.admin.49518.log: -- /var/log/ceph/ceph-client.admin.43669.log 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T18:32:49.938 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43669.log: gzip -5 90.9% --verbose -- /var/log/ceph/ceph-client.admin.47339.log 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-mgr.y.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51921.log 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43669.log.gz 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42674.log 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54844.log 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51921.log: /var/log/ceph/ceph-client.admin.42674.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47339.log.gz 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42674.log.gz 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51921.log.gz 2024-04-26T18:32:49.939 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51641.log 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54844.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-osd.0.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51641.log.gz 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54844.log.gz 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5/var/log/ceph/ceph-client.admin.50453.log: --verbose -- /var/log/ceph/ceph-client.admin.52490.log 2024-04-26T18:32:49.940 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49239.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52490.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52490.log.gz 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44479.log 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45309.log 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44479.log.gz 2024-04-26T18:32:49.941 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.45309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56127.log 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48603.log 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45309.log.gz 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43711.log 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56127.log.gz/var/log/ceph/ceph-client.admin.48603.log: 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48603.log.gz 2024-04-26T18:32:49.942 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42670.log 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50319.log 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43711.log.gz 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.45266.log: /var/log/ceph/ceph-client.admin.42670.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42670.log.gz 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55581.log 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56556.log 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55581.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50319.log.gz 2024-04-26T18:32:49.943 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56683.log 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55581.log.gz 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56556.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56556.log.gz 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40400.log 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55791.log 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56683.log: /var/log/ceph/ceph-client.admin.40400.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55791.log: 88.3% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56683.log.gz 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40400.log.gz 2024-04-26T18:32:49.944 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55791.log.gz 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56253.log 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50581.log 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.56253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40891.log 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50581.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56253.log.gz 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50581.log.gz 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51282.log 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2024-04-26T18:32:49.945 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51282.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40891.log.gz 2024-04-26T18:32:49.946 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51282.log.gz 2024-04-26T18:32:49.946 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54355.log 2024-04-26T18:32:49.946 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42073.log 2024-04-26T18:32:49.946 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54355.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2024-04-26T18:32:49.946 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52533.log 2024-04-26T18:32:49.946 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42073.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54355.log.gz 2024-04-26T18:32:49.946 INFO:teuthology.orchestra.run.smithi139.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42073.log.gz 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56767.log 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55218.log 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56767.log: 88.3% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52533.log.gz 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56767.log.gz 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56514.log 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54203.log 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56514.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56514.log.gz 2024-04-26T18:32:49.947 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55218.log.gz 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54953.log 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55539.log 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54953.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54203.log.gz 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54953.log.gz 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55539.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56169.log 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55539.log.gz 2024-04-26T18:32:49.948 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51036.log 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56169.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53403.log 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56169.log.gz 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51036.log.gz 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52830.log 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43345.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53403.log.gz 2024-04-26T18:32:49.949 INFO:teuthology.orchestra.run.smithi139.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50749.log 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48898.log 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50749.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52830.log.gz 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50749.log.gz 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44521.log 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.48898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56641.log 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44521.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48898.log.gz 2024-04-26T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44521.log.gz 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49936.log 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53936.log 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49936.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56641.log.gz 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0%/var/log/ceph/ceph-client.admin.53936.log: -- replaced with /var/log/ceph/ceph-client.admin.49936.log.gz 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53936.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55036.log 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.951 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48768.log 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55036.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55036.log.gz 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43753.log 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.48768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48476.log 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43753.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48768.log.gz 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43753.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52126.log 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.952 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.48476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55497.log 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52126.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48476.log.gz 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52126.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55497.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44437.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55497.log.gz 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35139.log 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42493.log 2024-04-26T18:32:49.953 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.35139.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35139.log.gz 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52746.log 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42493.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51394.log 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52746.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.52746.log.gz 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45058.log 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.51394.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51394.log.gz 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49681.log 2024-04-26T18:32:49.954 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.45058.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45058.log.gz 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50203.log 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49681.log: 94.4% 90.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49681.log.gz 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35243.log 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1%/var/log/ceph/ceph-client.admin.41723.log: -- replaced with /var/log/ceph/ceph-client.admin.50203.log.gz 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43339.log 2024-04-26T18:32:49.955 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.35243.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35243.log.gz 2024-04-26T18:32:49.956 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42668.log 2024-04-26T18:32:49.956 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43339.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2024-04-26T18:32:49.956 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43339.log.gz 2024-04-26T18:32:49.956 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41896.log 2024-04-26T18:32:49.956 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52363.log 2024-04-26T18:32:49.956 INFO:teuthology.orchestra.run.smithi139.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42668.log.gz 2024-04-26T18:32:49.956 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40515.log 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41896.log.gz 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50876.log 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr: 88.2%/var/log/ceph/ceph-client.admin.40515.log: -- replaced with /var/log/ceph/ceph-client.admin.52363.log.gz 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55623.log 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40515.log.gz 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55959.log 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50876.log: /var/log/ceph/ceph-client.admin.55623.log: 88.3% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50876.log.gz 2024-04-26T18:32:49.957 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55623.log.gz 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53360.log 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55959.log.gz 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49112.log 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53360.log: 88.2% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53360.log.gz 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-04-26T18:32:49.958 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49112.log: /var/log/ceph/ceph-client.admin.51684.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49112.log.gz 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42672.log 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47532.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56337.log 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42672.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28846.log 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42672.log.gz 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50246.log 2024-04-26T18:32:49.959 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph.tmp-client.admin.28846.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56337.log.gz 2024-04-26T18:32:49.960 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28846.log.gz 2024-04-26T18:32:49.960 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2024-04-26T18:32:49.960 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2024-04-26T18:32:49.960 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50246.log: /var/log/ceph/ceph-client.admin.45175.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50246.log.gz 2024-04-26T18:32:49.960 INFO:teuthology.orchestra.run.smithi139.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2024-04-26T18:32:49.960 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56295.log 2024-04-26T18:32:49.960 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49893.log 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.47423.log: /var/log/ceph/ceph-client.admin.56295.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56470.log 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.49893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42283.log 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56470.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49893.log.gz 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56470.log.gz 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44647.log 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49391.log 2024-04-26T18:32:49.961 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42283.log: /var/log/ceph/ceph-client.admin.44647.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42283.log.gz 2024-04-26T18:32:49.962 INFO:teuthology.orchestra.run.smithi139.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44647.log.gz 2024-04-26T18:32:49.962 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54246.log 2024-04-26T18:32:49.962 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42241.log 2024-04-26T18:32:49.962 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54246.log: /var/log/ceph/ceph-client.admin.49391.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49391.log.gz 2024-04-26T18:32:49.962 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54246.log.gz 2024-04-26T18:32:49.962 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43346.log 2024-04-26T18:32:49.962 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53809.log 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42241.log: /var/log/ceph/ceph-client.admin.43346.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42241.log.gz 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43346.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40701.log 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54076.log 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53809.log: /var/log/ceph/ceph-client.admin.40701.log: 88.2% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40701.log.gz 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53809.log.gz 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53469.log 2024-04-26T18:32:49.963 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49808.log 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54076.log.gz 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52169.log 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr: 88.4%/var/log/ceph/ceph-client.admin.49808.log: -- replaced with /var/log/ceph/ceph-client.admin.53469.log.gz 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49808.log.gz 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43011.log 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53276.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52169.log.gz 2024-04-26T18:32:49.964 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43347.log 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43347.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43011.log.gz 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43347.log.gz 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42671.log 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.49155.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-04-26T18:32:49.965 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52297.log 2024-04-26T18:32:49.966 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42671.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42671.log.gz 2024-04-26T18:32:49.966 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-04-26T18:32:49.966 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52297.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52297.log.gz 2024-04-26T18:32:49.966 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55833.log 2024-04-26T18:32:49.966 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.45014.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-04-26T18:32:49.966 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40977.log 2024-04-26T18:32:49.966 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55833.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55833.log.gz 2024-04-26T18:32:49.967 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43341.log 2024-04-26T18:32:49.967 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40977.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40977.log.gz 2024-04-26T18:32:49.967 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55079.log 2024-04-26T18:32:49.967 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.43341.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43341.log.gz 2024-04-26T18:32:49.967 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54312.log 2024-04-26T18:32:49.967 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55079.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T18:32:49.967 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40935.log 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.54312.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55079.log.gz 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50792.log 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54312.log.gz 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.40935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56725.log 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.50792.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40935.log.gz 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42673.log 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50792.log.gz 2024-04-26T18:32:49.968 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54684.log 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56725.log.gz 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44886.log 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42673.log.gz/var/log/ceph/ceph-client.admin.54684.log: 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40789.log 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54684.log.gz 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56001.log 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44886.log: /var/log/ceph/ceph-client.admin.40789.log: 88.2% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40789.log.gz 2024-04-26T18:32:49.969 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44886.log.gz 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.56001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55316.log 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56001.log.gz 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55316.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55316.log.gz 2024-04-26T18:32:49.970 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.42665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41061.log 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.52406.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gz 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.44563.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41061.log.gz 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55875.log 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.41954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2024-04-26T18:32:49.971 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.55875.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-04-26T18:32:49.972 INFO:teuthology.orchestra.run.smithi139.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55875.log.gz 2024-04-26T18:32:49.972 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.53011.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2024-04-26T18:32:50.112 INFO:teuthology.orchestra.run.smithi139.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T18:32:50.304 INFO:teuthology.orchestra.run.smithi143.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T18:32:50.352 INFO:teuthology.orchestra.run.smithi143.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T18:32:51.348 INFO:teuthology.orchestra.run.smithi139.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T18:32:58.142 INFO:teuthology.orchestra.run.smithi143.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-26T18:33:06.086 INFO:teuthology.orchestra.run.smithi139.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T18:33:09.081 INFO:teuthology.orchestra.run.smithi143.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T18:33:12.838 INFO:teuthology.orchestra.run.smithi139.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T18:33:14.585 INFO:teuthology.orchestra.run.smithi143.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T18:33:14.606 INFO:teuthology.orchestra.run.smithi143.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T18:33:18.184 INFO:teuthology.orchestra.run.smithi139.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T18:33:18.764 INFO:teuthology.orchestra.run.smithi143.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T18:33:18.766 INFO:teuthology.orchestra.run.smithi143.stderr: 2024-04-26T18:33:18.767 INFO:teuthology.orchestra.run.smithi143.stderr:real 0m28.994s 2024-04-26T18:33:18.767 INFO:teuthology.orchestra.run.smithi143.stderr:user 1m43.785s 2024-04-26T18:33:18.767 INFO:teuthology.orchestra.run.smithi143.stderr:sys 0m3.398s 2024-04-26T18:33:21.138 INFO:teuthology.orchestra.run.smithi139.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T18:33:21.140 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-26T18:33:21.140 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m31.388s 2024-04-26T18:33:21.140 INFO:teuthology.orchestra.run.smithi139.stderr:user 1m37.844s 2024-04-26T18:33:21.140 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m3.223s 2024-04-26T18:33:21.140 INFO:tasks.ceph:Archiving logs... 2024-04-26T18:33:21.141 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/remote/smithi139/log 2024-04-26T18:33:21.142 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T18:33:38.284 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/remote/smithi143/log 2024-04-26T18:33:38.285 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T18:34:22.124 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T18:34:22.134 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T18:34:22.135 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T18:34:22.138 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T18:34:22.211 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T18:34:22.222 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T18:34:22.223 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:34:22.225 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:34:22.239 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:34:22.239 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:34:22.244 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:34:22.244 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-04-26T18:34:22.245 INFO:teuthology.orchestra.run.smithi143.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +866us[ +864us] +/- 51ms 2024-04-26T18:34:22.245 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 137 -450us[ -451us] +/- 68ms 2024-04-26T18:34:22.245 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 -886us[ -888us] +/- 77ms 2024-04-26T18:34:22.245 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:34:22.245 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:34:22.245 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-26T18:34:22.245 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv01.front.sepia.ceph.com 3 7 377 75 +942us[ +954us] +/- 50ms 2024-04-26T18:34:22.246 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -460us[ -460us] +/- 49ms 2024-04-26T18:34:22.246 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -846us[ -846us] +/- 77ms 2024-04-26T18:34:22.246 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:34:22.246 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T18:34:22.256 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T18:34:22.257 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T18:34:22.276 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T18:34:22.355 DEBUG:teuthology.orchestra.run.smithi143:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T18:34:22.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:34:22.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:34:22.442 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:34:22.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:34:22.470 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T18:34:22.480 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T18:34:22.495 INFO:teuthology.task.internal:Duration was 2569.477645 seconds 2024-04-26T18:34:22.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T18:34:22.506 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T18:34:22.506 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T18:34:22.509 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T18:34:22.545 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:34:22.546 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:34:22.762 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T18:34:22.763 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-04-26T18:34:22.763 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T18:34:22.823 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-04-26T18:34:22.824 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T18:34:22.854 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T18:34:22.854 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T18:34:22.866 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T18:34:22.921 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T18:34:22.921 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T18:34:22.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T18:34:23.073 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T18:34:23.084 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T18:34:23.084 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T18:34:23.107 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T18:34:23.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T18:34:23.176 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:34:23.180 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:34:23.199 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-04-26T18:34:23.202 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-04-26T18:34:23.224 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:34:23.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:34:23.265 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:34:23.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:34:23.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T18:34:23.300 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T18:34:23.301 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/remote/smithi139 2024-04-26T18:34:23.301 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T18:34:23.365 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902/remote/smithi143 2024-04-26T18:34:23.365 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T18:34:23.412 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T18:34:23.412 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T18:34:23.416 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T18:34:23.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T18:34:23.470 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T18:34:23.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T18:34:23.490 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T18:34:23.490 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T18:34:23.493 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T18:34:23.504 INFO:teuthology.orchestra.run.smithi139.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 18:34 /home/ubuntu/cephtest 2024-04-26T18:34:23.510 INFO:teuthology.orchestra.run.smithi143.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 18:34 /home/ubuntu/cephtest 2024-04-26T18:34:23.510 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T18:34:23.521 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T18:34:23.554 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T18:34:23.577 DEBUG:teuthology.nuke:shortname: smithi139 2024-04-26T18:34:23.578 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T18:34:23.601 DEBUG:teuthology.nuke:shortname: smithi143 2024-04-26T18:34:23.601 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T18:34:23.604 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:57.999179', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEQIpNjdmw3OpD6urd9c73iOU/gvK8pVA7gfAwGaZV98H13QrqB25Dp9rK4lsH5j+mXwdMM7LVekWSQKFmxgdjg='} 2024-04-26T18:34:23.626 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674902', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:57.997779', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbY6cHb+lyowSuGrXDH5beUKiAA8gcpQt5g9hJxe6q8KsDPigm0OceYPTSxwM/X8ogHP4aGS4xf3nYiLcxB+nM='} 2024-04-26T18:34:23.663 INFO:teuthology.orchestra.console.smithi139:Power off 2024-04-26T18:34:23.664 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T18:34:23.691 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2024-04-26T18:34:23.691 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:23.707 INFO:teuthology.orchestra.console.smithi143:Power off 2024-04-26T18:34:23.708 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T18:34:23.718 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-26T18:34:23.733 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2024-04-26T18:34:23.733 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:23.758 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-04-26T18:34:27.720 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:27.759 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:27.831 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-26T18:34:27.869 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-04-26T18:34:31.834 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:31.870 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:31.945 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-26T18:34:31.981 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-04-26T18:34:35.947 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:35.982 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:34:36.059 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2024-04-26T18:34:36.092 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-04-26T18:34:36.161 INFO:teuthology.orchestra.console.smithi139:Power off completed 2024-04-26T18:34:36.193 INFO:teuthology.orchestra.console.smithi143:Power off completed 2024-04-26T18:34:36.300 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} duration: 2569.4776453971863 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi139 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9a565719221a4f9f8d4dc491f0b7d91f status: fail success: false 2024-04-26T18:34:36.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T18:34:36.384 INFO:teuthology.run:FAIL